compositional-constraints

Tag

Cards List
#compositional-constraints

Large Language Models Can Follow Instructions, But Not Many at Once: Phase Transitions in Compositional Constraint Satisfaction

arXiv cs.AI · 4d ago Cached

This paper introduces Constraint Saturation Evaluation (CSE), a procedural benchmark testing LLMs under 1-12 simultaneous constraints, finding that per-constraint pass rates decay gradually but joint success collapses beyond 5-6 constraints, with weak coupling between constraint types and little mitigation from inference-time strategies.

0 favorites 0 likes
← Back to home

Submit Feedback