text2cypher

PIPE-Cypher is a pipeline that automatically generates balanced NL-to-Cypher benchmarks from live property graphs and seed queries, using techniques like schema profiling, reverse-query grounding, and local LLM judging to create discriminative, deployment-relevant benchmarks.

This paper introduces Reflection-Augmented Scaling (RAS), a method that uses execution feedback from failed Cypher queries to iteratively refine query generation via in-context learning, reducing execution error rates by 41-50% across multiple datasets and models.