benchmark-fragility

Tag

Cards List
#benchmark-fragility

Frozen Scenes, Shifting Winners: Configuration Fragility in Text-to-3D Evaluation

arXiv cs.AI ↗ · 2026-10-02 Cached

This paper audits configuration fragility in text-to-3D evaluation by holding 300 generated scenes fixed while varying render and caption settings, finding that configuration variance often exceeds between-generator variance and that VLM-based evaluators frequently shift their reported winner without any change in the underlying scenes.

0 favorites 0 likes
← Back to home

Submit Feedback