Running Deepseek R1 Locally

Reply
Thread Tools
  #1  
Old 02-07-2025, 03:04 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,637
Thanks: 0
Thanked 545 Times in 337 Posts
Default Running Deepseek R1 Locally

Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78
  #2  
Old 02-07-2025, 10:50 AM
New Englander New Englander is offline
Soaring Eagle member
Join Date: May 2017
Location: Massachusetts, Pinellas, Now Sanibel
Posts: 2,145
Thanks: 725
Thanked 1,412 Times in 488 Posts
Default

What the heck is that guy talking about?
  #3  
Old 02-07-2025, 12:06 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,702
Thanks: 1,269
Thanked 4,376 Times in 1,925 Posts
Default

I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.

Last edited by Velvet; 02-07-2025 at 12:12 PM.
  #4  
Old 02-07-2025, 12:16 PM
Altavia Altavia is online now
Sage
Join Date: Jun 2019
Posts: 4,426
Thanks: 1,880
Thanked 3,395 Times in 1,617 Posts
Default

The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.

Last edited by Altavia; 02-07-2025 at 12:27 PM.
  #5  
Old 02-07-2025, 12:17 PM
CoachKandSportsguy CoachKandSportsguy is offline
Sage
Join Date: Jan 2019
Location: Marsh Bend
Posts: 3,457
Thanks: 639
Thanked 2,512 Times in 1,225 Posts
Default

Quote:
Originally Posted by Velvet View Post
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.
I wouldn' load anything from China, tik-toc, deep seek, anything from China. Although they typically use the data for blackmail purposes, after finding a target, it's not worth the risk at all.

Apple is even finding Malware in some Apple Store products, which is very disappointing. Stupid lawyers trying to break a great product for other competitors.
  #6  
Old 02-07-2025, 12:35 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,702
Thanks: 1,269
Thanked 4,376 Times in 1,925 Posts
Default

Quote:
Originally Posted by Altavia View Post
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.
If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.
  #7  
Old 02-07-2025, 12:52 PM
Bill14564 Bill14564 is online now
Sage
Join Date: Nov 2020
Location: Village of Hillsborough
Posts: 6,757
Thanks: 2,064
Thanked 7,192 Times in 2,804 Posts
Default

Quote:
Originally Posted by Altavia View Post
The very geeky video explains how to build, install and run a Deepseek AI locally, without connection to the Internet.

Very cool (and a little bit frightening...) stuff.
Quote:
Originally Posted by Velvet View Post
If you mean DeepSeek has published an open code - how it runs, to be modified and used for your own purposes, I agree. That is like using Pythagoras’ theorem in your own applied math equation. I admire that decision by Liang Wenfeng, the math whiz who established DeepSeek - so anyone can use his algorithm.
No, I believe he means Deepseek has published it's actual models (implementations of Deepseek) that you can download onto your own hardware and run with no connection to the internet. If you run it this way it is impossible for any information to be sent anywhere.

Most people will not run it this way. Most people will use a web interface to access an implementation of Deepseek somewhere on the internet. When used in this way there is the potential that some data could be sent to places you aren't aware of. The security researcher identified this potential but according to the articles I could find, did not see it actually sending any info.
__________________
Why do people insist on making claims without looking them up first, do they really think no one will check? Proof by emphatic assertion rarely works.
Confirmation bias is real; I can find any number of articles that say so.


Victor, NY
Randallstown, MD
Yakima, WA
Stevensville, MD
Village of Hillsborough
  #8  
Old 02-07-2025, 12:58 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,702
Thanks: 1,269
Thanked 4,376 Times in 1,925 Posts
Default

So, are you saying the models can be run off line like Excel, for example? Which is exactly what open code would allow. I can see using these models safely as long as you never intend to send them or their applications online anywhere at any time.

Last edited by Velvet; 02-07-2025 at 01:10 PM.
  #9  
Old 02-08-2025, 03:55 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,637
Thanks: 0
Thanked 545 Times in 337 Posts
Default

Quote:
Originally Posted by New Englander View Post
What the heck is that guy talking about?
Yeah...He talks fast and with no fluff ...Except for Ana De Armas.

Last edited by MorTech; 02-08-2025 at 04:06 AM.
  #10  
Old 02-08-2025, 03:57 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,637
Thanks: 0
Thanked 545 Times in 337 Posts
Default

Quote:
Originally Posted by Velvet View Post
I would advise against it. DeepSeek is Chinese artificial intelligence AI. It’s a sweet operation, I had it summarize Crime and Punishment chapter by chapter because I just could not follow the book etc.

But yesterday the Wall Street Journal wrote that in order to use DeepSeek you have to authorize DeepSeek to access your personal data. It collects everything including key strokes (banking password anybody?) and sends it to a Chinese service. It can store your data even after you have deleted the app. So I deleted DeepSeek, changed all my passwords afterwards that I used in the time DeepSeek had access to all my devices - that’s another thing you have to authorize in order to use it. Now I use ChatGPT. Which is American and is actually a more powerful AI. DeepSeek is not allowed on government issued devices.
Deepseek R1 is open source and you do not need an Internet connection to run it.
  #11  
Old 02-08-2025, 04:37 AM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,637
Thanks: 0
Thanked 545 Times in 337 Posts
Default

Deepseek R1 revealed to the world that the $300B total AI investment is perhaps 100X overvalued Maybe 80X.
  #12  
Old 02-08-2025, 08:40 AM
CosmicTrucker's Avatar
CosmicTrucker CosmicTrucker is offline
Senior Member
Join Date: Mar 2021
Location: Hawkins
Posts: 165
Thanks: 676
Thanked 109 Times in 66 Posts
Default

Quote:
Originally Posted by MorTech View Post
Run a local Deepseek R1 AI for cheap....

https://www.youtube.com/watch?v=e-EG3B5Uj78
I trust Dave and his talent. Despite my long-standing interest in topics like this, I find it beyond my comprehension. I suppose age is catching up with me.
  #13  
Old 02-08-2025, 09:29 AM
Decadeofdave Decadeofdave is offline
Senior Member
Join Date: Mar 2019
Location: Marblehead, Ohio / Virginia Trace
Posts: 468
Thanks: 268
Thanked 551 Times in 235 Posts
Default

No thanks, don't need it. I don't like playing with things I don't understand.
  #14  
Old 02-08-2025, 12:58 PM
MorTech MorTech is offline
Platinum member
Join Date: Jan 2017
Posts: 1,637
Thanks: 0
Thanked 545 Times in 337 Posts
Default

Video on Jetson Orin Nano Super Developer Kit...$250.

https://www.youtube.com/watch?v=fcGD7kHgxqE
  #15  
Old 02-08-2025, 02:35 PM
Velvet's Avatar
Velvet Velvet is offline
Sage
Join Date: Mar 2019
Posts: 5,702
Thanks: 1,269
Thanked 4,376 Times in 1,925 Posts
Default

Thank you, but DeepSeek offline models can’t do what I want to do at this time. I am interested in art. Perhaps when they are more developed.

For example, neither ChatGPT nor DeepSeek can sing “Alegria” by Cirque du Soleil translated to English for me. Neither can either one take one of my oil paintings and change the style while maintaining the composition.

They’re pretty good at reasoning though. I could ask why does my golf cart stalls, for example.

Last edited by Velvet; 02-09-2025 at 11:30 AM.
Reply

Tags
deepseek, running, locally, run, local


You are viewing a new design of the TOTV site. Click here to revert to the old version.

All times are GMT -5. The time now is 09:07 PM.