bridge-projections

Tag

Cards List
#bridge-projections

Scaling LLMs horizontally: hidden-state coupling without weight modification [R]

Reddit r/MachineLearning · 2026-05-18

Residual Coupling (RC) connects frozen language models in parallel using lightweight learned linear bridges, enabling horizontal scaling without weight modification. It reduces perplexity by up to 80.7% compared to MoE and improves accuracy on TruthfulQA by 9.1 percentage points.

0 favorites 0 likes
← Back to home

Submit Feedback