![]() |
Strata: 12GB VRAM + 32~64GB RAM to run 125B Qwen3.8-Flash-Next
Strata is very hot recently.
3-tier: VRAM -> RAM -> SSD https://github.com/Niko1221/Strata |
Wow their practical benchmarks are in the 40 to 100 tokens per second range. Could absolutely do some useful work with a rig like that.
NVIDIA RTX 3060 12GB $280 64GB DDR5 (2x32GB) 6000MHz CL30/CL34 $180 AMD Ryzen 5 7600 or Intel i5-12400 $180 1TB NVMe M.2 SSD (Gen 4 preferred) $60 Budget B650 (AMD) or B760 (Intel) $120 650W–750W 80+ Bronze PSU & Budget Case $110 So around $930 to build a new rig and if buying the GPU used maybe even $820. That is not bad at all. I can see why it is hot. |
1 Attachment(s)
It's surprisingly usable on my RTX 4070 + 64GB RAM + 5800X3D, though it's definitely a bit slow.
I need a 256K context window for Claude Code CLI to chew through Strata's own source repo with IQ2_XS. 128K just doesn't cut it. |
| All times are GMT +8. The time now is 07:24. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
Always Your Best Friend: Aaron, JMI, ahmadmansoor, ZeNiX