Exetools  

Go Back   Exetools > General > General Discussion

Notices

 
 
Thread Tools Display Modes
Prev Previous Post   Next Post Next
  #1  
Old 01-29-2025, 08:22
chants chants is offline
VIP
 
Join Date: Jul 2016
Posts: 812
Rept. Given: 46
Rept. Rcvd 50 Times in 31 Posts
Thanks Given: 723
Thanks Rcvd at 1,124 Times in 519 Posts
chants Reputation: 51
Running DeepSeek R1 locally

DeepSeek has its flagship V3 model equivalent to GPT4 and it's reasoning model R1 freely accessible:
Quote:
https://www.deepseek.com/
AI training for 5.6 million USD exceeding the quality of 100 mil to 1 bil USD. Inference of high quality is within reach of your own local environment where your data stays private. I've found their models better at reasoning than OpenAIs significantly. It's quite exciting and I'm surprised noone has brought the topic up yet, given the large amount of use cases for reverse engineering and the very low cost.

If you have a GPU recommend OLlama which works on Windows, Linux and Mac (can also rin Facebook/Meta's Llama models):
Quote:
https://ollama.com/
. Can choose from the models listed here:
Quote:
https://ollama.com/library/deepseek-r1
. 8b is pretty lightweight but if you have a recent Nvidia GPU with a lot of RAM why not go for 32b.

For a frontend chat interface, I recommend Chatbot AI:
Quote:
https://chatboxai.app
Even better the V3 and R1 model are open source and you can do your own model finishing if you have the resources.

R1:
Quote:
https://github.com/deepseek-ai/DeepSeek-R1
V3:
Quote:
https://github.com/deepseek-ai/DeepSeek-V3
Reply With Quote
The Following 4 Users Say Thank You to chants For This Useful Post:
blue_devil (01-29-2025), DARKER (01-29-2025), Doit (01-30-2025), wx69wx2023 (01-31-2025)
 

Tags
deepseek, ollama

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



All times are GMT +8. The time now is 05:06.


Always Your Best Friend: Aaron, JMI, ahmadmansoor, ZeNiX, chessgod101
( 1998 - 2025 )