Exetools

Exetools (https://forum.exetools.com/index.php)
-   General Discussion (https://forum.exetools.com/forumdisplay.php?f=2)
-   -   Strata: 12GB VRAM + 32~64GB RAM to run 125B Qwen3.8-Flash-Next (https://forum.exetools.com/showthread.php?t=21789)

WhoCares 10-06-2026 10:59

Strata: 12GB VRAM + 32~64GB RAM to run 125B Qwen3.8-Flash-Next
 
Strata is very hot recently.

3-tier: VRAM -> RAM -> SSD

https://github.com/Niko1221/Strata

chants 10-06-2026 13:30

Wow their practical benchmarks are in the 40 to 100 tokens per second range. Could absolutely do some useful work with a rig like that.

NVIDIA RTX 3060 12GB $280
64GB DDR5 (2x32GB) 6000MHz CL30/CL34 $180
AMD Ryzen 5 7600 or Intel i5-12400 $180
1TB NVMe M.2 SSD (Gen 4 preferred) $60
Budget B650 (AMD) or B760 (Intel) $120
650W–750W 80+ Bronze PSU & Budget Case $110

So around $930 to build a new rig and if buying the GPU used maybe even $820. That is not bad at all. I can see why it is hot.

WhoCares 10-06-2026 13:55

1 Attachment(s)
It's surprisingly usable on my RTX 4070 + 64GB RAM + 5800X3D, though it's definitely a bit slow.

I need a 256K context window for Claude Code CLI to chew through Strata's own source repo with IQ2_XS. 128K just doesn't cut it.


All times are GMT +8. The time now is 07:24.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
Always Your Best Friend: Aaron, JMI, ahmadmansoor, ZeNiX