TRACE:面向 LitTraceQA 的目标感知检索、证据归因定位与契约约束抽取
摘要
TRACE 引入目标感知检索、证据归因定位与契约约束抽取,以弥合科学文献 LitTraceQA 中的"grounding 契约鸿沟",在官方 71 题测试集上得分 0.760613,论文抽取 F1 表现强劲(0.9728),但表格抽取性能相对较弱。
arXiv:2609.38861v1 Announce Type: new
Abstract: Finding a relevant paper is not the same as producing a verifiable answer from it. LitTraceQA requires canonical paper identifiers, exact evidence at the page or object level, and typed answers that match the evaluator. We call the separation between source access and scorer-visible correctness the grounding contract gap. TRACE - Target-Aware Retrieval, Attributed Evidence, and Contract-Constrained Extraction - addresses this gap with target-grouped retrieval, independent typed evidence localization, multimodal table extraction, schema-driven table construction, and fail-closed validation. It indexes 27,487 papers through passage, object, alias, citation, and dense representations while retaining the question target behind each signal. For tables, TRACE predicts the observation unit before extracting values and assembles rows with evaluator-compatible key normalization. Our audited selected clean-track artifact scores 0.760613 on the official 71-question test set, including 0.9728 paper F1, 0.6847 evidence F1, 0.9800 multiple-choice accuracy, 0.5423 table-row F1, and 0.3508 macro cell accuracy. On 11 public-development table records, a clean baseline and coordinate-aware visual fill obtain row F1 of 0.291 and 0.411, respectively; this diagnostic comparison includes fallback outputs and is not an official-test claim. Remaining errors chiefly concern locator, observation-unit, row-key, and source-value identity.
查看缓存全文
缓存时间: 2026/10/01 09:45
# TRACE: Target-Aware Retrieval, Attributed Evidence, and Contract-Constrained Extraction for LitTraceQA
Source: [https://arxiv.org/html/2609.38861](https://arxiv.org/html/2609.38861)
Sachin GuptaDivya GodaraAffiliation:Independent ResearcherAffiliation:San Jose, USAEmail:[godaradivya@gmail\.com](mailto:)Accepted at the 1st Workshop on Grounding Language Models: Learning FaithfullyEfficientlyAffiliation:\(GroundLM 2026\), co\-located with EMNLP 2026\.
###### Abstract
Finding a relevant paper is not the same as producing a verifiable answer from it\. LitTraceQA requires canonical paper identifiers, exact evidence at the page or object level, and typed answers that match the evaluator\. We call the separation between source access and scorer\-visible correctness the*grounding contract gap*\.Trace—Target\-Aware Retrieval, Attributed Evidence, and Contract\-Constrained Extraction—addresses this gap with target\-grouped retrieval, independent typed evidence localization, multimodal table extraction, schema\-driven table construction, and fail\-closed validation\. It indexes 27,487 papers through passage, object, alias, citation, and dense representations while retaining the question target behind each signal\. For tables,Tracepredicts the observation unit before extracting values and assembles rows with evaluator\-compatible key normalization\. Our audited selected clean\-track artifact scores0\.760613on the official 71\-question test set, including0\.9728paper F1,0\.6847evidence F1,0\.9800multiple\-choice accuracy,0\.5423table\-row F1, and0\.3508macro cell accuracy\. On 11 public\-development table records, a clean baseline and coordinate\-aware visual fill obtain row F1 of 0\.291 and 0\.411, respectively; this diagnostic comparison includes fallback outputs and is not an official\-test claim\. Remaining errors chiefly concern locator, observation\-unit, row\-key, and source\-value identity\.
## 1Introduction
Scientific question answering is often described as retrieval followed by generation\. That abstraction is incomplete forLitTraceQA\([Liu et al\., 2026](https://arxiv.org/html/2609.38861#bib.bib2)\)\. GroundLM 2026 pairs scientific\-evidence grounding inLitTraceQAwith view\-level visual\-evidence identification in GoldenViewVQA\([Wang et al\., 2026a](https://arxiv.org/html/2609.38861#bib.bib3)\); the shared\-task findings paper describes the joint evaluation setting\([Wang et al\., 2026b](https://arxiv.org/html/2609.38861#bib.bib1)\)\. We participate only inLitTraceQA, under the official evaluator team namegabby\. Given a research question and a fixed metadata pool, the system must produce a connected trace
q⟶P^⟶E^P^⟶A^,q\\longrightarrow\\widehat\{P\}\\longrightarrow\\widehat\{E\}\_\{\\widehat\{P\}\}\\longrightarrow\\widehat\{A\},\(1\)whereP^\\widehat\{P\}is a set of canonical paper IDs,E^\\widehat\{E\}is a set of typed source locators inside those papers, andA^\\widehat\{A\}is one or more schema\-constrained answers\. The components are scored separately, and evidence must close over the selected paper set\. A semantically correct answer can therefore score poorly when a page is adjacent to the annotated page, a printed object ID is normalized incorrectly, or a source value is placed under a paraphrased row key\.
Our first pipeline had all three pathologies\. It collapsed retrieval results for several named methods into one global rank, emitted only evidence quoted by the chosen answer path, and treated every selected paper as exactly one table row\. These were not model\-capacity failures\. They were representation failures at the interfaces between retrieval, grounding, and structured generation\. We call the resulting separation between information available in the corpus and information emitted in evaluator\-visible form the*grounding contract gap*\.
We organize the system study around three questions:
RQ1:Which retrieval representation preserves the identity and cardinality of the requested paper targets? RQ2:Why can source\-correct evidence and values still fail structured evaluation, and which decomposition reduces that loss? RQ3:Which execution contracts prevent operational errors from silently becoming valid but score\-dead submissions?
Our contributions are:
- •a target\-aware paper selector that retains route, target group, group\-local rank, route score, and semantic role instead of flattening heterogeneous evidence;
- •an independent typed localizer over PDF text and detected tables, figures, equations, and citation contexts, with exact scorer\-key normalization and paper–evidence closure;
- •an observation\-unit\-first table pipeline that plans the row axis, extracts visual and textual values, and assembles typed rows deterministically; and
- •an artifact\-level audit protocol covering corpus/index alignment, semantic fallbacks, official validation, hashes, source revision, and recorded selected artifacts\.
Code, configurations, and release\-audit materials are available at[https://github\.com/sachinkg12/trace](https://github.com/sachinkg12/trace)\.
Figure 1:Tracecarries a typed request through an internal target\-group contract to scorer\-visible canonical papersPP, evidence locatorsE\(P\)E\(P\), and answerAA\. Input badges denote optional multiple\-choice choices, an optional table schema, and the required answer type\. A detached development\-and\-selection rail records public\-development gates, aggregate\-score checkpoint selection, source audits, and hashes\. Inference uses released inputs and the corpus; hidden labels and per\-question evaluator feedback are unavailable\.
## 2Task, Data, and Related Work
### 2\.1The three\-part output contract
LitTraceQA evaluates the complete path in Equation[1](https://arxiv.org/html/2609.38861#S1.E1), rather than treating citations as optional explanations after answering\([Liu et al\., 2026](https://arxiv.org/html/2609.38861#bib.bib2)\)\. Its evidence types include text spans, tables, figures, equations or algorithms, and citation contexts\. Paper and evidence sets receive macro precision, recall, and F1; multiple\-choice answers receive accuracy; and structured tables receive row F1 plus macro and micro cell accuracy\.
Our test input has 71 records: 50 request a multiple\-choice component and 21 request a table component; no test record requests both\. The candidate pool contains 27,487 papers\. This scale is modest for first\-stage retrieval but difficult for exact trace construction: the same question can name answer targets, evidence anchors, datasets, venues, and comparison criteria, only some of which denote papers that should be returned\.
### 2\.2Corpus and indexes
We retain the organizer paper identifier as the primary key and store released PDFs in Google Cloud Storage \(GCS\)\. PyMuPDF\([Artifex Software, Inc\., 2026](https://arxiv.org/html/2609.38861#bib.bib8)\)extracts page text and structured blocks and renders pages for visual analysis\. The frozen corpus build contains 1,409,382 passages, 500,928 detected objects, 3,711,590 aliases, and 492,892 citation/relation records\. A 384\-dimensionalBAAI/bge\-small\-en\-v1\.5\([Xiao et al\., 2023](https://arxiv.org/html/2609.38861#bib.bib6)\)cache embeds every title–abstract pair\. Pool order, record counts, model identity, and file hashes are checked as invariants before inference\.
### 2\.3Relation to prior systems
Our retrieval stage combines sparse and dense signals in the spirit of retrieval\-augmented generation\([Lewis et al\., 2020](https://arxiv.org/html/2609.38861#bib.bib4)\), BM25\([Robertson and Zaragoza, 2009](https://arxiv.org/html/2609.38861#bib.bib5)\), and rank fusion\([Cormack et al\., 2009](https://arxiv.org/html/2609.38861#bib.bib9)\); our main finding is that fusion must follow, not erase, target grouping\. For table construction, prior work shows that scientific cell identity depends on surrounding table and paper context\([Lou et al\., 2023](https://arxiv.org/html/2609.38861#bib.bib10)\), and that schema\-constrained extraction can outperform unconstrained generation across heterogeneous tables\([Bai et al\., 2024](https://arxiv.org/html/2609.38861#bib.bib11)\)\. ScheMatiQ makes the observation unit explicit before discovering and populating a question\-specific schema\([Levy et al\., 2026](https://arxiv.org/html/2609.38861#bib.bib12)\)\. We adapt this principle to a fixed evaluator schema: the row entity is inferred from the question and row\-key columns, while all accepted rows and locators must remain compatible with the shared\-task contract\.
## 3System Architecture
Figure[1](https://arxiv.org/html/2609.38861#S1.F1)separates development and checkpoint selection from the recorded inference path\. The system is not a monolithic agent: generative components propose typed intermediate objects, and deterministic components enforce identity, cardinality, and serialization contracts\.
### 3\.1Question plan and retrieval signals
Stage 2 uses a temperature\-zero planner to extract venue/year constraints, required modalities, multiplicity, desired paper count, named anchors, and target groups\. Each target receives a semantic role:*answer target*,*evidence anchor*, or*constraint*\. This prevents, for example, a dataset mentioned in an experimental criterion from being returned as though it were a requested paper\. Invalid planner output produces a visible conservative fallback rather than aborting or silently dropping the record\.
Stage 3 queries five complementary route families: \(i\) name, alias, and title resolution; \(ii\) BM25 property and target\-property search over passages; \(iii\) citation\-context search; \(iv\) role\-aware ownership signals; and \(v\) dense title–abstract retrieval\. Each candidate carries supporting snippets and route signals\(r,g,k,s,ρ\)\(r,g,k,s,\\rho\): routerr, target groupgg, group\-local rankkk, optional route scoress, and roleρ\\rho\. Detected\-object records are available to later localization and diagnostics, but the selected run did not activate the object index as a paper\-retrieval route\.
The group\-local rank is essential\. When results for four named methods are concatenated, global rank 35 may be rank 1 for the fourth method\. Flat reciprocal\-rank fusion sees weak evidence; the grouped representation sees strong coverage of a distinct requested target\. Stage 4 first applies answer\-scoped venue/year constraints and then covers target groups before spending remaining slots on evidence\-bearing relevance\. Explicit multiplicity determines the desired count, while a hard cap of five bounds PDF and vision work\.
### 3\.2Independent evidence localization
Stage 5 fetches each selected PDF and creates a common source representation\. Text spans keep page numbers; visual objects keep printed identifiers; references keep citation IDs and contexts\. We normalize forms such as “Eq\. \(6\)” and “Reference \[24\]” while rejecting arbitrary prose numbers as object IDs\.
At stage 6, evidence is retrieved independently of the answerer\. Gemini 2\.5 Flash examines bounded PDF text to propose typed locators\. Gemini 2\.5 Pro vision\([Gemini Team, Google, 2025](https://arxiv.org/html/2609.38861#bib.bib7)\)is used downstream for visual table and figure answer extraction, not for evidence localization\. Candidates are ranked by structural validity, localizer confidence, BM25 relevance, and stable source order\. They are deduplicated under the evaluator’s coarse key—paper, source type, page or section, and normalized object ID—before a cap of five is applied\. This replaces answer\-conditioned evidence, which had high apparent precision but omitted valid support not quoted by the final answer path\.
### 3\.3Observation\-unit\-first tables
The table schema is not merely an output template; it defines what one row means\. Stage 7 classifies the observation unit from every column marked as a row key\.*Paper Title*indicates a paper axis;*Method*,*Benchmark*,*Author*,*Reference*, or a multi\-key schema indicates an entity axis\. When a question lists the desired entities, the planner constructs a closed row ledger from their shortest literal names\.
Extraction then runs per source, not per output row\. Visual pages and non\-visual text, equation, and citation paths propose compatible rows and typed value cells\. The assembler groups by the same normalized row\-key tuple as the scorer, merges complementary cells across papers, removes all\-null records, and deduplicates\. For the selected clean track, deterministic row\-key matching preserves non\-null baseline cells and permits only source\-scoped, schema\-compatible fills\. Repeated visual proposals are accepted only when they agree; otherwise the baseline table is retained\.
Question \+ organizer schemarow\-key columns \| value columns \| answer typeRow contract
observation axis • expected key tuples • declared value types1Visual objectstables • figurescaptionsNative sourcestext • equationscitations2Source\-scoped candidate rows and cells
row key \+ typed cells
source paper \+ localized evidence3Scorer\-aligned assembly
normalize keys → merge cells → type\-check → deduplicate4Typed answer rows \+ record\-level evidencecanonical keys • source\-conditioned values • no invented columnsFigure 2:Observation\-unit\-first table construction\. Schema keys define the row contract; visual and native sources propose source\-scoped rows and cells; deterministic assembly normalizes keys, merges compatible cells, type\-checks, and deduplicates\. Exact PDF attestation is additionally required for any post\-generation correction\. The paper is a source container, not necessarily the row entity\.#### Public\-development example\.
One multi\-paper question requests four named methods \(TCM, sCT, ECM\-XL, and IMM\) under an experimental criterion\. The legacy generator created one row per paper, confusing the paper containing a comparison with the methods being compared\. The planned system instead fixes the four methods as candidate row identities, searches each method–criterion tuple, and accepts only rows whose keys normalize to the requested set\. The example illustrates the broader distinction between*source container*and*observation unit*\.
### 3\.4Fail\-closed execution
Stages 1 and 8 make operational validity part of the architecture\. Input normalization accepts object\- and list\-shaped multiple\-choice options while preserving organizer labels and exact table schemas\. Strict preflight checks 71 unique query IDs, 27,487 pool IDs, answer\-type counts, all four multiple\-choice labels, index record and byte counts, dense\-cache shape/model, and official file hashes\. The runner records timeouts, semantic fallbacks, repaired components, active configuration, and raw traces\. It writes atomically only after paper–evidence closure and the pinned organizer validator pass\.
Table[1](https://arxiv.org/html/2609.38861#S3.T1)summarizes the design as recovered structure rather than a list of prompts\.
Table 1:The main failure modes and the structure restored byTrace\. The common pattern is that a downstream model cannot reconstruct information already discarded at an upstream interface\.
## 4Experimental Setup
#### Models and infrastructure\.
The hybrid pipeline uses Python 3\.11, PyMuPDF, local BM25 indexes, and sentence\-transformer embeddings\. Index construction, retrieval scoring for a fixed plan, normalization, composition, and validation are deterministic; hosted generative proposals are not\. Gemini 2\.5 Flash performs question planning, text localization, and answer generation; Gemini 2\.5 Pro is reserved for visual table and figure extraction\. The corpus/index store is on GCS, and bounded workers with per\-record deadlines run on a Google Cloud VM\. Temperature is zero where supported, and raw replies are retained because hosted services can still vary between calls\. No task\-specific model weights are trained or fine\-tuned\.
#### Development and freezing\.
Architecture choices and local gates use the 55\-example public development split\. The table analysis below evaluates the same 11 public\-development records in both conditions with organizer\-compatible normalization\. Aggregate official evaluator scores informed checkpoint selection, but hidden labels and per\-question evaluator feedback were unavailable and do not enter the correction policies\. The selected official artifact has 71 unique records, passes the pinned validator, and has SHA\-256 prefix2dd56b6009\. It extends the clean 0\.757968 checkpoint with three disjoint, source\-attested record repairs: two table\-object relocations from mention pages to their unique caption pages and one canonical method\-key repair\. The terminal policy revisiona4962b9preserves the other 68 serialized records byte\-for\-byte\. Each accepted delta is derived from released questions, clean full\-run traces, and URL/SHA\-bound PDFs; the reports bind predecessor artifacts, source revisions, runtime archives, PDF manifests, the pinned validator, and the final digest\. Projected and unscored variants are excluded from reported results\.
## 5Results
### 5\.1Official result and score anatomy
Table[2](https://arxiv.org/html/2609.38861#S5.T2)reports every metric returned for the selected clean\-track official artifact\. Paper retrieval and multiple\-choice answering are the strongest components, but neither is saturated\. Figure[3](https://arxiv.org/html/2609.38861#S5.F3)shows the largest scorer\-visible headroom in evidence and table metrics; the analysis below discusses likely identity\-related causes\.
Table 2:Official test metrics for the selected clean\-trackTracesubmission\. Free\-form exact match was not applicable\.The selected result supersedes, but does not erase, the immediately preceding 0\.757968 checkpoint or the earlier clean results at 0\.739561, 0\.735774, and 0\.710662\. All remain in the verified clean\-result history\.
0\.25\.50\.751\.0Paper F10\.9728Evidence F10\.6847MC acc\.0\.9800Row F10\.5423Cell macro0\.3508Cell micro0\.4023Composite0\.7606Figure 3:Official score profile, including both table\-cell accuracies\. Metrics have different definitions and are shown together only to locate residual headroom, not as an additive decomposition of the composite\.
### 5\.2Public\-development table analysis
Table[3](https://arxiv.org/html/2609.38861#S5.T3)compares a clean general table baseline with the clean framework plus coordinate\-aware visual fill on the same 11 public\-development table records\. The framework preserves target structure through source\-container selection, then fills only schema\-compatible missing cells from repeated visual agreement\. Row F1 rises by 0\.120, macro cell accuracy by 0\.125, and micro cell accuracy by 0\.259\. An execution failure denotes a schema\-valid placeholder rather than a usable table; failed records were not removed\. The baseline has three such failures and the coordinate\-fill candidate has two, and the metrics score all 11 records\. Candidate evidence F1 falls from 0\.460 to 0\.397\. We therefore treat this as public\-development diagnosis, not a promotion gate or evidence about official\-test improvement\.
Table 3:Public\-development diagnostics on all 11 table\-answer records\. Generation failures emitted schema\-valid placeholder rows and remained in scoring; the baseline failed on 3/11 records and the coordinate\-fill candidate on 2/11\. These are not official\-test metrics\.
## 6Analysis: Where Correctness Is Lost
#### RQ1: Preserve target identity before ranking\.
Target grouping, scoped constraints, and desired cardinality solve different parts of paper selection\. The selected system’s paper F1 of 0\.9728 makes retrieval its strongest trace component while leaving measurable headroom\. The important negative result is flat fusion: no route weighting can recover which method produced a candidate after that group identity has been discarded\. Representation precedes ranking\.
#### RQ2: Source access does not guarantee exact identity\.
Paper F1 exceeds evidence F1 \(0\.9728 versus 0\.6847\), while macro cell accuracy is 0\.3508\. For evidence, an adjacent page or semantically equivalent source type is still the wrong locator tuple\. For tables, a correct number under a descriptive rather than canonical row key is still the wrong cell\. The observation\-unit decomposition improves the latter, but aliases, multi\-component rows, symbols, delimiters, and typed nulls remain difficult\. Our recall exceeds precision for evidence, so adding more locator candidates without stronger exact corroboration is unlikely to be the best next step\.
#### RQ3: Contracts turn silent failures into actionable ones\.
Several severe bugs produced schema\-valid output: empty indexes, constant\-label multiple\-choice fallbacks, all\-null rows, and repaired answer objects\. Record counts, content hashes, closure checks, and semantic fallback telemetry distinguish these cases from genuine model errors\. The lesson is broader than this task: when a pipeline combines retrieval, hosted models, PDF rendering, and structured output, the artifact boundary must be tested as rigorously as the model\.
#### What did not work\.
Unbounded multi\-paper plans propagated dozens of PDFs into per\-paper vision and exhausted deadlines\. Answer\-conditioned evidence improved apparent precision but cut recall\. Flat reciprocal\-rank fusion promoted generic high\-BM25 papers over later named targets\. Unconstrained table generation paraphrased row keys and attached baseline values to the container paper\. More model calls did not repair these losses reliably; explicit intermediate identities did\. The four\-record extension from 0\.739561 to 0\.757968 provides a sharper positive result: paper F1 rises from 0\.9587 to 0\.9728, evidence F1 from 0\.6753 to 0\.6847, row F1 from 0\.4709 to 0\.5185, and macro cell accuracy from 0\.3032 to 0\.3508, while multiple\-choice accuracy remains 0\.9800\. The macro table increase of 0\.0476 is consistent with one1/211/21record\-level increment and comes from binding requested metric rows and columns to physical PDF coordinates before canonicalizing decorative direction glyphs\. The evidence gain comes from source\-local paper correction and one uniquely re\-localized answer\-bearing page, rather than increasing candidates globally\. Source attestation is necessary, but table and evidence changes additionally require scorer\-contract identity and a fail\-closed mutation boundary\. The final three\-record extension raises only row F1, from 0\.5185 to 0\.5423; paper, evidence, multiple\-choice, and cell metrics are unchanged\. This isolates the observed gain to canonical method identity, while the two caption\-page relocations are source\-correct but evaluator\-neutral\.
### 6\.1Lessons from adaptive diagnosis
A historical adaptive artifact reached 0\.792252 only after repeated official\-score diagnosis and manual row/cell adjudication\. It is not a comparable system result and is excluded from our selected clean\-track claim\. Its value is diagnostic: the gap showed that source access and model capacity were not the principal bottlenecks; exact paper ownership, locator identity, observation units, row keys, and cell coordinates were\. Those findings motivated the identity ledger, source\-object contracts, and fail\-closed mutation boundaries described here\. We therefore report the number once as a lesson about system interfaces, not as the headline performance ofTrace\.
## 7Discussion and Reproducibility
The prior 0\.757968, 0\.739561, 0\.735774, and 0\.710662 clean checkpoints remain in the result ledger rather than being relabeled as adaptive or discarded\. The selected 0\.760613 artifact adds only generic, fail\-closed corrections: exact table\-caption localization and canonical method identity derived from immutable PDFs and the released schema\. Its composition applies complete records by query ID, rejects overlapping chains, and preserves 68 of 71 records from the preceding clean checkpoint byte\-for\-byte; no hidden labels or per\-question evaluator feedback enter these policies\. Aggregate official scores did inform checkpoint selection, which we distinguish from the source\-only inputs to each correction policy\.
The public full\-generation code implements and can execute the base architecture from released inputs and source assets, but hosted proposals may vary and the released configuration does not regenerate the exact selected artifact\. In particular, the selected base usedplanned\_visual\_filltable extraction, whereas the public general configuration usesplanned; the selected correction chain is retained in the audit package rather than exposed as the public full\-generation command\. An independent run of that public configuration matched 37 of 71 selected records as complete serialized objects, with most variation arising in table construction; we therefore do not claim exact output or score reproducibility\. The exact 0\.760613 JSONL is uploaded separately with the paper and is reported as an audited selected artifact; our retained audit package binds predecessor reports, source revisions, PDF manifests, output digests, and validator status\.
## 8Conclusion
The audited selected clean\-trackTraceartifact reaches 0\.760613 by preserving scorer\-visible paper, evidence, and answer identities through target\-aware retrieval, independent localization, observation\-unit\-first rows, and fail\-closed validation\.
## 9Limitations
The public\-development table analysis covers only 11 records and cannot establish official\-test improvement\. The fixed five\-paper cap can under\-recall unusually large answer sets\. PDF parsing remains brittle for scans, complex multi\-column layouts, and objects whose printed identifiers are absent\. Exact evidence evaluation can penalize semantically valid adjacent support; the LitTraceQA task paper itself notes that locator normalization remains a benchmark\-design challenge\([Liu et al\., 2026](https://arxiv.org/html/2609.38861#bib.bib2)\)\. Hosted model APIs introduce cost, version drift, and limited repeatability despite constrained prompts and retained traces\. We perform no weight updates, task\-specific fine\-tuning, synthetic training, or external factual augmentation\. The system operates only on the released scientific\-paper pool, but its predictions can still misattribute claims or overstate support and should not replace inspection of the cited source\.
## Acknowledgments
We thank the GroundLM 2026 organizers for organizing the shared task and maintaining its evaluation infrastructure\.
## References
- Artifex Software, Inc\. \(2026\)Artifex Software, Inc\.PyMuPDF: a high\-performance Python library for data extraction, analysis, conversion and manipulation of PDF documents\.Note:[https://pymupdf\.readthedocs\.io/](https://pymupdf.readthedocs.io/)Version 1\.28\.0Cited by:[§2\.2](https://arxiv.org/html/2609.38861#S2.SS2.p1.1)\.
- Baiet al\.\(2024\)F\. Bai, J\. Kang, G\. Stanovsky, D\. Freitag, M\. Dredze, and A\. RitterSchema\-driven information extraction from heterogeneous tables\.InFindings of the Association for Computational Linguistics: EMNLP 2024,pp\. 10252–10273\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.findings-emnlp.600)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Cormacket al\.\(2009\)G\. V\. Cormack, C\. L\. A\. Clarke, and S\. BuettcherReciprocal rank fusion outperforms condorcet and individual rank learning methods\.InProceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval,pp\. 758–759\.External Links:[Document](https://dx.doi.org/10.1145/1571941.1572114)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Gemini Team, Google \(2025\)Gemini Team, GoogleGemini 2\.5: pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities\.Technical report\.External Links:[Link](https://storage.googleapis.com/deepmind-media/gemini/gemini_v2_5_report.pdf)Cited by:[§3\.2](https://arxiv.org/html/2609.38861#S3.SS2.p2.1)\.
- Levyet al\.\(2026\)S\. Levy, E\. Habba, R\. Mintz, B\. Raveh, R\. Keydar, and G\. StanovskyScheMatiQ: from research question to structured data through interactive schema discovery\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 3: System Demonstrations\),pp\. 220–230\.External Links:[Document](https://dx.doi.org/10.18653/v1/2026.acl-demo.22),[Link](https://aclanthology.org/2026.acl-demo.22/)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Lewiset al\.\(2020\)P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel, S\. Riedel, and D\. KielaRetrieval\-augmented generation for knowledge\-intensive NLP tasks\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 9459–9474\.External Links:[Link](https://proceedings.neurips.cc/paper/2020/hash/6b493230205f780e1bc26945df7481e5-Abstract.html)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Liuet al\.\(2026\)X\. Liu, Y\. Wang, P\. Shi, B\. Xue, X\. Ke, S\. Cai, K\. Choi, D\. Wu, F\. Shi, and K\. CzarneckiLitTraceQA: a benchmark for multi\-stage grounding and verification in scientific question answering\.External Links:2608\.07370,[Link](https://arxiv.org/abs/2608.07370)Cited by:[§1](https://arxiv.org/html/2609.38861#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.38861#S2.SS1.p1.1),[§9](https://arxiv.org/html/2609.38861#S9.p1.1)\.
- Louet al\.\(2023\)Y\. Lou, B\. Kuehl, E\. Bransom, S\. Feldman, A\. Naik, and D\. DowneyS2abEL: a dataset for entity linking from scientific tables\.InProceedings of the 2023 Conference on Empirical Methods in Natural Language Processing,pp\. 3089–3101\.External Links:[Document](https://dx.doi.org/10.18653/v1/2023.emnlp-main.186)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Robertson and Zaragoza \(2009\)S\. Robertson and H\. ZaragozaThe probabilistic relevance framework: BM25 and beyond\.Foundations and Trends in Information Retrieval3\(4\),pp\. 333–389\.External Links:[Document](https://dx.doi.org/10.1561/1500000019)Cited by:[§2\.3](https://arxiv.org/html/2609.38861#S2.SS3.p1.1)\.
- Wanget al\.\(2026a\)Y\. Wang, Y\. M\. Choi, B\. Zhang, M\. N\. Azadani, S\. Sedwards, and K\. CzarneckiWhere does the answer come from? benchmarking view\-level visual evidence identification in multi\-view MLLMs for autonomous driving\.External Links:2606\.09644,[Link](https://arxiv.org/abs/2606.09644)Cited by:[§1](https://arxiv.org/html/2609.38861#S1.p1.1)\.
- Wanget al\.\(2026b\)Y\. Wang, X\. Liu, Y\. M\. Choi, B\. Xue,et al\.Findings of the first GroundLM shared tasks: evaluating grounded language models across visual and scientific evidence\.InProceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently \(GroundLM 2026\),Cited by:[§1](https://arxiv.org/html/2609.38861#S1.p1.1)\.
- Xiaoet al\.\(2023\)S\. Xiao, Z\. Liu, P\. Zhang, N\. Muennighoff, D\. Lian, and J\. NieC\-Pack: packed resources for general Chinese embeddings\.arXiv preprint arXiv:2309\.07597\.External Links:[Link](https://arxiv.org/abs/2309.07597)Cited by:[§2\.2](https://arxiv.org/html/2609.38861#S2.SS2.p1.1)\.
## Appendix AReproducibility Checklist
The public release includes implementation code, a general configuration, result documentation, and validation instructions; the OpenReview submission includes the ACL\-formatted PDF and exact 71\-line selected prediction file\. Our retained audit package additionally includes SHA\-256 manifests, source revisions, resolved selected\-run configuration, preprocessing/index statistics, predecessor reports, and validator records\. The historical adaptive artifact and public\-development table analysis are separately labeled and excluded from the selected\-system claim\. The official ACL style files are used without modifications to margins, spacing, fonts, or page dimensions\.相似文章
LitTraceQA:科学问答中多阶段证据定位与验证的基准
介绍了LitTraceQA,一个科学问答基准,要求系统检索相关论文、定位支持性证据,并以多种格式生成经过验证的答案。
TRACE:面向LLM智能体的自适应跨步证据聚合轨迹推理
TRACE是一个用于长周期LLM智能体轨迹的监控框架,它通过分诊-检查-判断(Triage-Inspect-Judge)循环来连接时间上相隔较远的动作证据,在规避性破坏检测任务上实现了高召回率和F1值。
DocTrace:通过分层证据图推理实现可追踪的长文档VQA
本文介绍了DocTrace,一个用于长文档视觉问答的分层框架,将该任务建模为显式证据图推理。它在三个基准上取得了最先进的结果,同时实现了可追踪的证据来源,比Qwen3-VL-8B-Instruct高出11-14个百分点。
TRACE: 可问责的智能体检索框架,用于数字档案中的来源发现
TRACE是一个无需训练的智能体检索框架,专为历史数字档案中的可问责来源发现而设计,在基准测试中以每问题低成本优于RAG基线。
WILDTRACE: 对长上下文推理中自然证据轨迹的基准测试
WildTrace 是一个包含 481 个任务的基准测试,利用来自技术报告和叙事等长文档中的自然出现的证据轨迹。它评估了 18 个前沿系统,并表明即使是最好的系统(75.3%)在反事实分支和因果归因等推理密集型几何结构中仍存在困难。