Quote:
Originally Posted by WhoCares
There is a fork for Strata:
With the above fork, I can run Swift-Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS with 60 token/s, 256k context, 80GB commited memory in Win11.
The abliterated model:
https://huggingface.co/SC117/Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF/tree/main/IQ3_XXS
|
Any updates on how this is working out
in practice?
Is it good for reversing and coding? Or just as a general purpose LLM?