View Single Post
  #1  
Old 01-29-2025, 08:22
chants chants is offline
VIP
 
Join Date: Jul 2016
Posts: 826
Rept. Given: 47
Rept. Rcvd 50 Times in 31 Posts
Thanks Given: 737
Thanks Rcvd at 1,140 Times in 529 Posts
chants Reputation: 51
Running DeepSeek R1 locally

DeepSeek has its flagship V3 model equivalent to GPT4 and it's reasoning model R1 freely accessible:
Quote:
https://www.deepseek.com/
AI training for 5.6 million USD exceeding the quality of 100 mil to 1 bil USD. Inference of high quality is within reach of your own local environment where your data stays private. I've found their models better at reasoning than OpenAIs significantly. It's quite exciting and I'm surprised noone has brought the topic up yet, given the large amount of use cases for reverse engineering and the very low cost.

If you have a GPU recommend OLlama which works on Windows, Linux and Mac (can also rin Facebook/Meta's Llama models):
Quote:
https://ollama.com/
. Can choose from the models listed here:
Quote:
https://ollama.com/library/deepseek-r1
. 8b is pretty lightweight but if you have a recent Nvidia GPU with a lot of RAM why not go for 32b.

For a frontend chat interface, I recommend Chatbot AI:
Quote:
https://chatboxai.app
Even better the V3 and R1 model are open source and you can do your own model finishing if you have the resources.

R1:
Quote:
https://github.com/deepseek-ai/DeepSeek-R1
V3:
Quote:
https://github.com/deepseek-ai/DeepSeek-V3
Reply With Quote
The Following 4 Users Say Thank You to chants For This Useful Post:
blue_devil (01-29-2025), DARKER (01-29-2025), Doit (01-30-2025), wx69wx2023 (01-31-2025)