logit-fusion

Tag

Cards List
#logit-fusion

DLLG: Dynamic Logit-Level Gating of LLM Experts

arXiv cs.CL · 2026-06-04 Cached

DLLG (Dynamic Logit-Level Gating) is a novel framework that dynamically fuses multiple specialized LLMs at the token-level logit space using a lightweight learned gating module, outperforming routing, heuristic ensembling, and parameter-merging baselines across reasoning and code benchmarks. The approach requires only sparse response-level supervision and preserves expert modularity without retraining.

0 favorites 0 likes
← Back to home

Submit Feedback