jensen-shannon-divergence

Tag

Cards List
#jensen-shannon-divergence

BOUNDARY_SYNC: Measuring Communication-Induced Representational Coupling in Multi-Agent LLM Systems

arXiv cs.LG · 4d ago Cached

This paper introduces Boundary_Sync, a protocol measuring representational coupling in multi-agent LLM systems. Experiments with GPT-4o show that communication causes significant homogenization in both text and image modalities, but group size moderates the direction, with larger groups leading to homogenization and smaller groups to diversification.

0 favorites 0 likes
#jensen-shannon-divergence

Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning

arXiv cs.AI · 2026-06-20 Cached

Introduces Independent Combinatorial Tokens (ICT) framework that uses Jensen-Shannon divergence between token logit distributions to identify critical branching points, preventing entropy collapse and explosion in RLVR for LLM reasoning. Achieves up to 14.9% pass@4 improvement on Qwen models.

0 favorites 0 likes
← Back to home

Submit Feedback