dense-models

Tag

Cards List
#dense-models

When will we have another breakthrough for faster local dense models?

Reddit r/LocalLLaMA ↗ · 2026-10-22

The author discusses the lack of architectural speedup breakthroughs for local dense models since MTP, noting most recent speedups come from MoE sparsity at the cost of stability, and asks whether faster dense models like Qwen4-27B are coming. The post compares dense vs MoE reliability and highlights community finetunes focusing mainly on reducing reasoning tokens.

0 favorites 0 likes
#dense-models

@no_stp_on_snek: Dense vs MOE - Can MOE keep up with dense quality? spawned from a problem a friend is having. he has an agentic run tha…

X AI KOLs Timeline ↗ · 2026-08-25 Cached

A comparison of dense and Mixture of Experts (MoE) models to assess if MoE can match dense model quality in agentic tasks, based on benchmark tests with various models showing performance metrics.

0 favorites 0 likes
#dense-models

Quants impact for agentic use and local LLMs?

Reddit r/AI_Agents ↗ · 2026-08-23

The author shares findings from testing quantization impacts on local LLMs for agentic use, revealing that many quants are statistically indistinguishable, MoEs are less affected than dense models, and significant degradation occurs below Q4 quantization.

0 favorites 0 likes
#dense-models

I measured it: swapping a dense 27B for a 30B-A3B MoE changes the local concurrency ceiling (same rig as prior test, one variable change)

Reddit r/AI_Agents ↗ · 2026-08-20

The author tests and compares the concurrency performance of dense versus MoE AI models on a MacBook Pro, finding that MoE models scale significantly better due to lower memory bandwidth usage per token.

0 favorites 0 likes
#dense-models

12GB VRAM gang, what's our plan?

Reddit r/LocalLLaMA ↗ · 2026-08-11

Discussion about running LLMs on 12GB VRAM, noting current focus on dense models like Muse Glimmer 30B and Qwen 3.8 27B, and questioning whether upgrading to 24GB VRAM is needed.

0 favorites 0 likes
#dense-models

@TheAhmadOsman: Dense models like Qwen 3.8 27B are a TERRIBLE experience on unified-memory systems like DGX Spark btw DGX Sparks are be…

X AI KOLs Following ↗ · 2026-08-08 Cached

Ahmad Osman argues that dense models like Qwen 27B perform poorly on unified-memory systems such as NVIDIA DGX Spark, suggesting MoE models are a better fit; he claims discrete GPUs like the RTX PRO 6000 deliver far better performance for agentic workloads.

0 favorites 0 likes
#dense-models

llama.cpp MTP speculative simplified for July 2026 big wins on dense models, underwhelming on MoE

Reddit r/LocalLLaMA ↗ · 2026-07-25

An analysis of native MTP speculative decoding in llama.cpp shows significant speedups (1.4x-2.2x) for dense models like Qwen3.6-27B, but underwhelming results on MoE architectures, where gains are minimal due to already low per-step overhead.

0 favorites 0 likes
#dense-models

Why are MoE models so belittled?

Reddit r/LocalLLaMA ↗ · 2026-07-11

Discusses the common perception that MoE models with low active parameters are inferior to dense models, arguing that router effectiveness and architecture nuances matter.

0 favorites 0 likes
#dense-models

Pruning and Distilling Mixture-of-Experts into Dense Language Models

Hugging Face Daily Papers ↗ · 2026-05-27 Cached

A systematic framework converts mixture-of-experts models into dense architectures through expert scoring, selection, grouping, and knowledge distillation, achieving superior performance and efficiency compared to traditional pruning methods.

0 favorites 0 likes
#dense-models

What is the point of MoE models, beyond being faster?

Reddit r/LocalLLaMA ↗ · 2026-05-19

A discussion about the advantages of Mixture of Experts (MoE) models over dense models beyond speed, considering RAM constraints and scaling limits.

0 favorites 0 likes
#dense-models

Are the rich RAM /poor GPU people wrong here?

Reddit r/LocalLLaMA ↗ · 2026-05-15

Discusses the trade-off between dense and Mixture-of-Experts (MoE) models for local AI, noting that high-RAM users have limited MoE options beyond Qwen 3.5 122B, and questioning if large GPU is the only viable path.

0 favorites 0 likes
← Back to home

Submit Feedback