prover-refuter

Tag

Cards List
#prover-refuter

ROSE: An Intent-Centered Evaluation Metric for NL2SQL

Hugging Face Daily Papers · 2026-04-14 Cached

ROSE is a novel intent-centered evaluation metric for NL2SQL that uses a Prover-Refuter cascade to assess semantic correctness independently of ground-truth SQL, achieving 24% better agreement with human experts than existing metrics. The paper addresses limitations of Execution Accuracy and provides a re-evaluation of 19 NL2SQL methods with publicly released resources.

0 favorites 0 likes
← Back to home

Submit Feedback