Dense vs. MoE gap is shrinking fast with the 3.6-27B release
Summary
A new 3.6-27B release shows MoE closing the performance gap with dense models, especially in coding tasks and large context windows, though dense still leads overall.
Similar Articles
Qwen 35B-A3B MoE vs 27B dense in local coding tests: ~4× faster, much smaller quality gap than I expected
A local experiment comparing Qwen 35B-A3B MoE and Qwen 27B dense on coding-maintenance tasks, finding the MoE model ~3.9× faster with a smaller quality gap than expected.
I measured it: swapping a dense 27B for a 30B-A3B MoE changes the local concurrency ceiling (same rig as prior test, one variable change)
The author tests and compares the concurrency performance of dense versus MoE AI models on a MacBook Pro, finding that MoE models scale significantly better due to lower memory bandwidth usage per token.
@no_stp_on_snek: Dense vs MOE - Can MOE keep up with dense quality? spawned from a problem a friend is having. he has an agentic run tha…
A comparison of dense and Mixture of Experts (MoE) models to assess if MoE can match dense model quality in agentic tasks, based on benchmark tests with various models showing performance metrics.
Forgive my ignorance but how is a 27B model better than 397B?
User questions how Qwen's 27B dense model can outperform its 397B MoE variant, sparking discussion on MoE efficiency versus dense model quality.
Qwen3.6-27B: Flagship-Level Coding in a 27B Dense Model
Qwen releases Qwen3.6-27B, a 27B dense model claiming flagship-level coding performance surpassing the larger Qwen3.5-397B-A17B MoE, with impressive SVG generation demos.