distributional-alignment

Tag

Cards List
#distributional-alignment

Distributional Alignment of LLMs and Its Generalization Properties

arXiv cs.CL ↗ · 2026-10-26

This arXiv paper studies how to distributionally align LLM output distributions with human reference distributions and evaluates how well this alignment generalizes to unseen questions, finding that same-domain generalization works but cross-topic generalization is unstable and can degrade model capabilities.

0 favorites 0 likes
#distributional-alignment

BehaviorBench: Benchmarking Foundation Models for Behavioral Science Tasks

arXiv cs.CL ↗ · 2026-06-24 Cached

This paper introduces BehaviorBench, a comprehensive benchmark for evaluating foundation models on behavioral science tasks including behavior prediction, strategic decision-making, subject-trait inference, and behavioral knowledge application. It also presents Be.FM-1.5, a fine-tuned model that achieves strong distributional alignment, highlighting the gap between general-purpose and behaviorally adapted models.

0 favorites 0 likes
#distributional-alignment

Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning

arXiv cs.CL ↗ · 2026-05-21 Cached

This paper proposes using distributional alignment between task vector-based and in-context learning inference as a criterion for designing task vectors, and introduces Linear Task Vector (LTV) that minimizes next-token probability discrepancy via closed-form linear mapping. LTV achieves 9.2% average accuracy improvement over baselines across eight benchmarks and five LLMs.

0 favorites 0 likes
← Back to home

Submit Feedback