R^3-SQL: Ranking Reward and Resampling for Text-to-SQL

Hugging Face Daily Papers 论文

摘要

# Paper page - R^3-SQL: Ranking Reward and Resampling for Text-to-SQL Source: [https://huggingface.co/papers/2604.25325](https://huggingface.co/papers/2604.25325) ## Abstract R$^3$\-SQL addresses inconsistencies in scoring functionally equivalent SQL queries and improves candidate recall through unified reward ranking and agentic resampling techniques\. Modern[Text\-to\-SQL](https://huggingface.co/papers?q=Text-to-SQL)systems generate multiple candidate[SQL queries](https://huggingface.co/papers

Modern Text-to-SQL systems generate multiple candidate SQL queries and rank them to judge a final prediction. However, existing methods face two limitations. First, they often score functionally equivalent SQL queries inconsistently despite identical execution results. Second, ranking cannot recover when the correct SQL is absent from the candidate pool. We propose R^3-SQL, a Text-to-SQL framework that addresses both issues through unified reward for ranking and resampling. R^3-SQL first groups candidates by execution result and ranks groups for consistency. To score each group, it combines a pairwise preference across groups with a pointwise utility from the best group rank and size, capturing relative preference, consistency, and candidate quality. To improve candidate recall, R^3-SQL introduces agentic resampling, which judges the generated candidate pool and selectively resamples when the correct SQL is likely absent. R^3-SQL achieves 75.03 execution accuracy on BIRD-dev, a new state of the art among methods using models with disclosed sizes, with consistent gains across five benchmarks.
查看原文
查看缓存全文

缓存时间: 2026/05/11 10:44

Paper page - R^3-SQL: Ranking Reward and Resampling for Text-to-SQL

Source: https://huggingface.co/papers/2604.25325

Abstract

R^3-SQL addresses inconsistencies in scoring functionally equivalent SQL queries and improves candidate recall through unified reward ranking and agentic resampling techniques.

ModernText-to-SQLsystems generate multiple candidateSQL queriesand rank them to judge a final prediction. However, existing methods face two limitations. First, they often score functionally equivalentSQL queriesinconsistently despite identical execution results. Second, ranking cannot recover when the correct SQL is absent from the candidate pool. We propose R^3-SQL, aText-to-SQLframework that addresses both issues through unified reward for ranking and resampling. R^3-SQL first groups candidates by execution result and ranks groups for consistency. To score each group, it combines apairwise preferenceacross groups with apointwise utilityfrom the best group rank and size, capturing relative preference, consistency, and candidate quality. To improve candidate recall, R^3-SQL introducesagentic resampling, which judges the generated candidate pool and selectively resamples when the correct SQL is likely absent. R^3-SQL achieves 75.03execution accuracyon BIRD-dev, a new state of the art among methods using models with disclosed sizes, with consistent gains across five benchmarks.

View arXiv pageView PDFAdd to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2604.25325 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2604.25325 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2604.25325 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

相似文章

排名质量相同,决策却不同:衡量并减少 LLM 评分器中的顺序依赖性

Hugging Face Daily Papers

本文指出,基于 LLM 的评分器即使产生相同的排名质量,当提示中候选内容的顺序发生变化时,仍可能做出不同的决策,并提出顺序一致性 SFT(OC-SFT)来惩罚不同排列顺序下分数的不一致。在重排序、响应排序和多文档问答任务上,OC-SFT 在保持排名质量的同时,提升了决策稳定性。