@cjzafir: Qwen 3.5 4B model and 8B are too good. I fine-tuned a 4B model today and got 98% accuracy on full precision and Q8 quan…

X AI KOLs Timeline News

Summary

A developer reports achieving high accuracy with fine-tuned Qwen 3.5 4B and 8B models using Unsloth, suggesting a shift towards specialized Expert Language Models (ELMs) for niche tasks.

Qwen 3.5 4B model and 8B are too good. I fine-tuned a 4B model today and got 98% accuracy on full precision and Q8 quant variant. And for Q4 variant too its just 1% loss in quality. My stack: > Codex 5.5 as Planner/Orchestrator > Deepseek v4 pro generate examples > Collab pro provides A100 GPU > Unsloth provides the tuning recipe Then Codex run for 8-9 hours to get each phase done. - Foundation clarity - Dataset creation - Quality gates - Fine tuning - Running Evals - Quantization - Testing/Reporting It's just funny sometimes how easy it is to tune 5B to 10B models now and beating second tier SoTA models in niche specific environments. I have models that beat Gemini 3 pro, Sonnet 4.6, GPT-4.5 mini with ease. It's now that we move towards ELMs (Expert Language Models) rather than running everything on LLMs. You don't use Porsche everywhere! Build Camry for companies and make $.
Original Article

Similar Articles

Qwen3.5 122B is the best?

Reddit r/LocalLLaMA

A user shares their experience comparing several large language models (Qwen, Gemma) on complex tool-calling tasks, finding Qwen3.5 122B the most reliable, while criticizing smaller MoE models for instability.