ICDAR 2026 HIPE-OCRepair Competition on LLM-Assisted OCR Post-Correction for Historical Documents
Summary
This paper presents the HIPE-OCRepair-2026 competition at ICDAR 2026, evaluating LLM-assisted OCR post-correction for historical documents in English, French, and German. Results show that modern LLM systems significantly improve OCR quality, but overcorrection on low-noise inputs remains a challenge.
View Cached Full Text
Cached at: 07/10/26, 06:13 AM
# ICDAR 2026 HIPE-OCRepair Competition on LLM-Assisted OCR Post-Correction for Historical Documents
Source: [https://arxiv.org/html/2607.08143](https://arxiv.org/html/2607.08143)
11institutetext:École Polytechnique Fédérale de Lausanne \(EPFL\), Switzerland
11email:22institutetext:University of Zurich, Switzerland
22email:Emanuela BorosJuri OpitzAndrianos MichailFlorian WagnerSimon Clematide
###### Abstract
We present the results of HIPE\-OCRepair\-2026, an ICDAR competition on LLM\-assisted OCR post\-correction of historical documents\. OCR post\-correction remains a long\-standing challenge in digital heritage: large\-scale collections of digitized documents are affected by legacy OCR errors, while re\-digitization at scale remains impractical\. Large language models \(LLMs\) offers a major opportunity to revisit this challenge, yet their effectiveness across languages, document types, and noise conditions — and their tendency to hallucinate — remains insufficiently understood\.
HIPE\-OCRepair\-2026 pursues two objectives: \(i\) to evaluate the capabilities of modern OCR post\-correction systems, and \(ii\) to provide a reproducible evaluation framework anchored in the HIPE\-OCRepair\-2026 dataset, a harmonized multilingual resource consolidating existing and newly curated historical datasets\. Participants were tasked with correcting noisy OCR transcripts from historical newspapers and printed works in English, French, and German \(17th–20th century\), working at the level of coherent transcription units \(paragraphs or articles\) without access to source images\. The evaluation adopts a retrieval\-oriented rather than diplomatic scoring approach, reflecting the practical use case of search and access over digitized collections\.
Four teams submitted systems ranging from zero\-shot prompting to continued pre\-training and fine\-tuning, offering insights into the merits of different adaptation strategies\. Results show that modern LLM\-assisted systems can significantly improve OCR quality, but performance varies across datasets, languages, and noise levels\. Overcorrection on low\-noise inputs emerges as a recurring challenge, highlighting the importance of evaluation beyond character error reduction\. The dataset, scorer, and evaluation pipeline are publicly released to support future research\.
## 1Introduction
The large\-scale digitization of historical collections has made millions of newspaper pages, books, and archival records searchable and available to researchers worldwide\[[17](https://arxiv.org/html/2607.08143#bib.bib22),[3](https://arxiv.org/html/2607.08143#bib.bib3)\]\. Yet the quality of the resulting text is uneven\. Many collections were processed years or decades ago with OCR systems whose performance was limited by the technology of the time, and even modern engines continue to struggle with the specific challenges posed by historical documents: degraded paper and ink, non\-standard typography, complex layouts, and multilingual content all contribute to recognition failures that remain difficult to avoid\[[14](https://arxiv.org/html/2607.08143#bib.bib15),[22](https://arxiv.org/html/2607.08143#bib.bib30)\]\. The result is a systematic gap between what digitization has made available and what downstream applications — from keyword search and information retrieval to named entity recognition and large\-scale corpus analysis — require to function reliably\[[8](https://arxiv.org/html/2607.08143#bib.bib8),[29](https://arxiv.org/html/2607.08143#bib.bib38),[12](https://arxiv.org/html/2607.08143#bib.bib14),[6](https://arxiv.org/html/2607.08143#bib.bib6),[9](https://arxiv.org/html/2607.08143#bib.bib44)\]\.
OCR post\-correction, the automatic improvement of existing transcripts without reprocessing source images, is a long\-standing response to this challenge\[[19](https://arxiv.org/html/2607.08143#bib.bib24)\]\. Despite decades of research spanning rule\-based methods, statistical models, and neural sequence\-to\-sequence approaches\[[1](https://arxiv.org/html/2607.08143#bib.bib2),[21](https://arxiv.org/html/2607.08143#bib.bib29)\], the problem remains far from solved\. Performance is highly sensitive to language, historical period, document type and noise characteristics, and robust generalization across heterogeneous collections has remained elusive\[[25](https://arxiv.org/html/2607.08143#bib.bib33)\]\. At the same time, the scale of the accumulated OCR debt — the vast backlog of already\-digitized pages with insufficient transcript quality — makes re\-digitization impractical, as reprocessing millions of pages requires infrastructure, funding, and coordination that most institutions cannot sustain\.
The rise of large language models \(LLMs\) offers a new opportunity to revisit this challenge\. Trained on large amounts of well\-formed text, these models can perform noisy\-to\-clean transformations in zero\-shot and few\-shot settings\. Their ability to exploit broad contextual information makes them promising candidates for correcting degraded historical transcripts at scale\. Recent studies explore a range of approaches: prompt\-based zero\-shot correction with large proprietary and open models\[[11](https://arxiv.org/html/2607.08143#bib.bib13),[31](https://arxiv.org/html/2607.08143#bib.bib41),[5](https://arxiv.org/html/2607.08143#bib.bib5),[15](https://arxiv.org/html/2607.08143#bib.bib16)\], fine\-tuning and instruction\-tuning of encoder\-decoder or decoder\-only architectures on aligned OCR/ground\-truth pairs\[[23](https://arxiv.org/html/2607.08143#bib.bib31),[28](https://arxiv.org/html/2607.08143#bib.bib34),[16](https://arxiv.org/html/2607.08143#bib.bib19)\], and hybrid pipelines combining error detection with generative correction\[[4](https://arxiv.org/html/2607.08143#bib.bib4),[16](https://arxiv.org/html/2607.08143#bib.bib19)\]\. Across these studies, fine\-tuned models generally outperform zero\-shot approaches, and metadata and contextual cues offer varying benefits\. The broader picture, however, remains unclear: LLM performance varies considerably across languages, historical periods, and error types, and existing results are scattered across heterogeneous experimental settings that are difficult to compare directly\[[5](https://arxiv.org/html/2607.08143#bib.bib5),[15](https://arxiv.org/html/2607.08143#bib.bib16)\]\.
Crucially, OCR post\-correction is not a form of unconstrained text generation, as historical documents are primary sources whose textual content should be preserved\. A model that silently modernizes vocabulary or introduces plausible but absent content — hallucinating rather than correcting — is not improving a transcript but altering the source\. Whether LLMs can reliably correct historical OCR across diverse collections without degrading or hallucinating content therefore remains an open question A primary application scenario is information retrieval: users searching digitized archives depend on accurate transcriptions to locate relevant documents, and character\-level errors, even at modest rates, can render words unsearchable and lead to incomplete retrieval results\.
HIPE\-OCRepair\-2026111[https://hipe\-eval\.github\.io/HIPE\-OCRepair\-2026/](https://hipe-eval.github.io/HIPE-OCRepair-2026/)addresses these questions directly: Can modern LLM\-based systems reduce OCR errors in legacy digitized collections while avoiding overcorrection and hallucination? Our evaluation campaign adopts a retrieval\-oriented perspective, favoring linguistic accuracy over fully diplomatic transcription\. In particular, it emphasizes the recovery of correct word forms over the faithful reproduction of typographic or layout features that are less consequential for search and text\-based analysis\. This design choice is reflected in the normalization applied prior to scoring \(Section[4](https://arxiv.org/html/2607.08143#S4)\)\.
OCR post\-correction has previously been addressed in ICDAR shared tasks\. The 2017 competition\[[7](https://arxiv.org/html/2607.08143#bib.bib7)\]introduced the first systematic evaluation on historical newspaper data, and the 2019 edition\[[20](https://arxiv.org/html/2607.08143#bib.bib27)\]expanded scope and refined the evaluation protocol\. HIPE\-OCRepair\-2026 builds on this lineage while extending it in three ways\. First, it explicitly targets LLM\-based and other modern generative approaches to OCR correction\. Second, it is built on HIPE\-OCRepair\-2026, a harmonized multilingual benchmark consolidating existing and newly curated datasets under unified segmentation and transcription guidelines, including selective correction of reference transcriptions where needed\. Third, it provides a fully reproducible evaluation framework with standardized metrics, an official scorer, and an evaluation pipeline for systematic cross\-system comparison\.
The remainder of this paper is structured as follows\. Section[2](https://arxiv.org/html/2607.08143#S2)defines the task\. Section[3](https://arxiv.org/html/2607.08143#S3)describes HIPE\-OCRepair\-2026 dataset\. Section[4](https://arxiv.org/html/2607.08143#S4)presents the evaluation framework\. Section[5](https://arxiv.org/html/2607.08143#S5)describes the baseline and participating systems\. Section[6](https://arxiv.org/html/2607.08143#S6)presents and discusses the results\. Section[7](https://arxiv.org/html/2607.08143#S7)concludes with findings and perspectives\.
## 2Task Definition
HIPE\-OCRepair\-2026 is a post\-correction task: given a noisy OCR transcript of a historical document, systems must produce a corrected transcription that more closely matches the manually verified reference\. In line with standard practice in OCR post\-correction, systems operate on text alone and have no access to the source document image\. This reflects the practical reality of OCR debt scenarios, where the goal is to improve existing transcripts at scale without reprocessing original scans\.
The input consists of an*OCR hypothesis*and associated*document metadata*\. The OCR hypothesis is the raw transcription of a*transcription unit*— a coherent piece of text providing sufficient context for correction, typically a paragraph or article — which may contain character substitutions, insertions, deletions, and layout artefacts\. The metadata specifies the language of the source document, as well as additional contextual information where available, such as the approximate date and publication title\. The expected output is a corrected transcription of the OCR hypothesis\. Systems are evaluated against a manually verified*reference transcription*of the same transcription unit222See also:[https://github\.com/hipe\-eval/HIPE\-OCRepair\-2026\-data/blob/main/README\-Participation\-Guidelines\.md](https://github.com/hipe-eval/HIPE-OCRepair-2026-data/blob/main/README-Participation-Guidelines.md)\.
This task presents particular challenges for LLM\-based approaches\. The input may contain severe distortions that obscure lexical and syntactic structure, yet systems must infer corrections from textual evidence alone, without access to the source image\. More fundamentally, post\-correction is a constrained task: systems are expected to restore intended word forms and improve transcription fidelity, but must not introduce content absent from the source or resolve ambiguities speculatively\. This distinguishes the task sharply from free text generation or paraphrasing\. It also means that characteristic properties of LLMs — their fluency, their bias toward contemporary language, their capacity for hallucination — can become potential liabilities as much as assets\. These difficulties are compounded by the diversity of languages, historical periods, document types, and noise profiles across which systems must operate; concrete examples of OCR hypotheses and their reference transcriptions are available on the task website\.
## 3Data: HIPE\-OCRepair\-2026 Dataset
The competition is grounded in the HIPE\-OCRepair\-2026 dataset, a harmonized multilingual benchmark of parallel OCR and ground\-truth text pairs for historical documents\. It covers three languages — English, French, and German – and two document types — historical newspapers and printed books — spanning the 17th to the 20th century\. The dataset combines four substantially re\-curated existing datasets with one dataset newly created for this shared task \(impresso\-snippets\)\. Table[1](https://arxiv.org/html/2607.08143#S3.T1)provides an overview333See also[https://github\.com/hipe\-eval/HIPE\-OCRepair\-2026\-data/blob/main/documentation/README\.md](https://github.com/hipe-eval/HIPE-OCRepair-2026-data/blob/main/documentation/README.md)\.
### 3\.1Curation Principles
Existing datasets exhibit substantial variation in transcription policies, segmentation strategies, and ground\-truth quality\. All datasets were therefore processed through a unified curation pipeline comprising format standardization, quality filtering \(removal of documents with CER\>0\.15\>0\.15or very short units\), transcription\-unit harmonization, and systematic manual revision of the development and test ground truths\. Harmonization ensured that correction targets were neither too short \(individual lines were avoided\) nor excessively long aggregations of unrelated content\. By contrast, the training sets retain their original transcriptions, with harmonization limited to segmentation and formatting\.
A central curation decision was to adopt a semi\-diplomatic transcription standard that prioritizes linguistically interpretable word forms while not preserving all historical graphemic or typographic detail, such as ligatures or non\-modern letterforms like long*s*\. In addition, whitespace artefacts inherited from legacy handling of hyphenated line breaks were regularized, for example where words split across lines had been represented with internal whitespace in the original ground truth\. This choice reflects the primary application scenario of information retrieval, for which mildly standardized word forms are more useful than strict preservation of historical or typographic variation\.
Where layout information was present in the original data, it was retained in the benchmark files to support potential layout\-aware use\. In particular, soft hyphens were explicitly curated to mark word splits across line breaks, rather than being discarded as incidental layout artefacts\. Systems were not required to reproduce layout information in their outputs\. Full documentation of the curation process and transcription guidelines will be provided in a dedicated benchmark paper\.
### 3\.2Dataset Descriptions
#### 3\.2\.1dta19
This dataset consists of pages sampled from 39 German books \(18th–19th century\) from theDeutsches Textarchiv\(DTA\)\[[24](https://arxiv.org/html/2607.08143#bib.bib32)\], printed in Fraktur\. Since the original dataset contains image/ground\-truth pairs but no OCR hypothesis, OCR was generated by applying a Tesseract Fraktur model444[https://ub\-backup\.bib\.uni\-mannheim\.de/~stweil/tesstrain/german\_print\_20231218/tessdata\_best/german\_print\_20\.traineddata](https://ub-backup.bib.uni-mannheim.de/~stweil/tesstrain/german_print_20231218/tessdata_best/german_print_20.traineddata)\[[30](https://arxiv.org/html/2607.08143#bib.bib42)\]\. Because OCR on the original images was too accurate for a challenging post\-correction setting, controlled image degradation was introduced at three noise levels: level 0 \(no added noise\), level 1 \(targeting≈3%\\approx 3\\%CER\), and level 2 \(targeting≈7%\\approx 7\\%CER\)\. Two sampling strategies were defined:*matched*\(same pages at all noise levels\) and*unmatched*\(different pages at each level to avoid information leakage in the shared task\)\. The official competition evaluation used the unmatched strategy\.
Table 1:Overview of theHIPE\-OCRepair\-2026 dataset\.
#### 3\.2\.2icdar2017
This dataset consists of historical newspapers from the ICDAR 2017 OCR Post\-Correction Competition\[[7](https://arxiv.org/html/2607.08143#bib.bib7)\], drawn from the National Library of France and the British Library, and digitized as part of the IMPACT project\[[2](https://arxiv.org/html/2607.08143#bib.bib47)\]\. The original material consists of very long concatenated text sequences and therefore required semantic chunking; low\-quality chunks were filtered out \(CER\>0\.15\>0\.15\)\. The ground truth of the development and test sets were manually re\-corrected\. Splits were derived from the original ICDAR 2017 train and test partitions\.
#### 3\.2\.3impresso\-snippets
Newly created for this benchmark, this dataset consists of paragraph\-level newspaper snippets \(9–15 lines each\) sampled from digitized collections in the Impresso project555[https://impresso\-project\.ch](https://impresso-project.ch/), covering German, French, and English materials from 1800–1959\. Ground truth was produced through manual correction by trained annotators with access to paragraph images\. Line information is preserved in full\. New train, dev and test splits were created per language\. For a few items, lines were reocrized using the same Tesseract model as fordta19\.
#### 3\.2\.4impresso\-nzz
This dataset consists of front pages of the Neue Zürcher Zeitung \(NZZ\), spanning 1780–1947, published in German Fraktur \(blackletter\) type\[[27](https://arxiv.org/html/2607.08143#bib.bib46),[26](https://arxiv.org/html/2607.08143#bib.bib45)\]\. OCR was produced with ABBYY FineReader Server 11, and the ground truth was manually corrected\. Pages with structural misalignments between OCR and ground truth were excluded\. Layout information \(line breaks, paragraph breaks, soft hyphens\) is fully preserved\.impresso\-nzzis available as training data, but it was not part of the official shared task ranking because the underlying test data was publicly available prior to the competition\.
#### 3\.2\.5overproof
This dataset consists of English newspaper articles from theSydney Morning Herald\(Trove / National Library of Australia\) andChronicling America\(Library of Congress\), covering the 19th–20th century\[[10](https://arxiv.org/html/2607.08143#bib.bib11)\]\. The ground truth is based on crowd\-sourced Trove corrections, entirely manually verified and enriched with explicit soft hyphen annotations from our side, using the facsimile\. As no original splits were available, train, development, and test splits were created for the HIPE\-OCRepair\-2026 benchmark\. However,overproofis not included in the official competition ranking because the underlying test data was publicly available prior to the competition, and is made available as training data only\.
### 3\.3Dataset Statistics and Format
Table[2](https://arxiv.org/html/2607.08143#S3.T2)summarizes dataset composition, including split sizes, transcription\-unit types, token counts, and average CER per test split\. The competition test sets comprise 740 transcription units across eight test files, while the benchmark, including training and development splits, contains 995k tokens\. CER values vary substantially across datasets and languages, ranging from near\-zero noise indta19\-l0to moderate noise levels around 0\.09 inoverproof, reflecting the diversity of OCR conditions represented in the benchmark\.
Table 2:Statistical profile of the HIPE\-OCRepair\-2026 dataset\. Tokens are reported across all splits; avg\. CER \(macro\) is reported for the test splits, after text normalization;\*not part of the official ranking\.DatasetLangUnitTrainDevTestTokensCERdta19\-l0depage1901103070,6340\.004dta19\-l1depage1901103073,2310\.024dta19\-l2depage1901103072,2980\.057icdar2017enchunk455188100256,4040\.030icdar2017frchunk391–100198,8810\.018impresso\-snippetsdeparagraph501010012,7640\.032impresso\-snippetsenparagraph501010015,2530\.017impresso\-snippetsfrparagraph501010013,0130\.018impresso\-nzz\*depage150–17221,1030\.099overproof\*enarticle146303261,4370\.090All datasets are serialized in JSON Lines format, following a common schema,666[https://github\.com/hipe\-eval/HIPE\-OCRepair\-2026\-data/blob/main/schema/hipe\-ocrepair\.schema\.json](https://github.com/hipe-eval/HIPE-OCRepair-2026-data/blob/main/schema/hipe-ocrepair.schema.json)with one JSON object per transcription unit\. Each object containsdocument metadata\(identifier, language, date, publication title\) and anOCR hypothesis\(text to correct, with optional sub\-segmentation offsets at line, sentence, and chunk levels\), together with either ground truth in reference files or post\-correction output in system submission files\.
HIPE\-OCRepair\-2026 dataset is released on GitHub under versionv0\.9, with release tag[v0\.9\.5](https://github.com/hipe-eval/HIPE-OCRepair-2026-data/releases/tag/v0.9.5)\. Full statistics, including character counts and CER distributions per split, are available in the data repository\.777[https://github\.com/hipe\-eval/HIPE\-OCRepair\-2026\-data](https://github.com/hipe-eval/HIPE-OCRepair-2026-data)
## 4Evaluation Framework
### 4\.1Metrics
#### 4\.1\.1Primary metric: Character Match Error rate\.
Our primary evaluation metric is character\-level Match Error Rate \(cMER\), defined as:
cMER=S\+D\+IH\+S\+D\+I\\mathrm\{cMER\}=\\frac\{S\+D\+I\}\{H\+S\+D\+I\}whereHHdenotes hits,SSsubstitutions,DDdeletions, andIIinsertions in the character\-level alignment between hypothesis and reference\. Unlike standard Character Error Rate \(CER\), cMER is bounded in\[0,1\]\[0,1\]because insertions appear in the denominator, reducing sensitivity to over\-generation\[[18](https://arxiv.org/html/2607.08143#bib.bib48)\]\. Character\-level metrics are generally preferred over word\-level metrics for historical OCR correction, as they better accommodate historical spelling variation\.
cMER is reported at two levels of aggregation\. The micro\-averaged cMER \(cmer\_micro\) sums counts \(HH,SS,DD,II\) across all transcription units in a dataset before computing the ratio, thereby giving proportionally more weight to longer units\.cmer\_microis the primary system ranking criterion\. We additionally report the macro\-averaged cMER \(cmer\_macro\), the arithmetic mean of per\-unit scores, which gives equal weight to each transcription unit regardless of length\.
#### 4\.1\.2Secondary metric: preference score
Aggregate error rates such as cMER summarize the overall*magnitude*of error reduction but can mask inconsistent behavior: a system that corrects a few documents substantially while degrading many others may still achieve a favorable average score\. To capture the*consistency*of improvement across transcription units, we complement cMER with a sign\-based item\-level preference score\.
For each transcription unitii, the score is defined as:
si=sign\(cMERocr,i−cMERcor,i\)∈\{\+1,0,−1\},s\_\{i\}=\\operatorname\{sign\}\\\!\\big\(\\mathrm\{cMER\}\_\{\\mathrm\{ocr\},i\}\-\\mathrm\{cMER\}\_\{\\mathrm\{cor\},i\}\\big\)\\in\\\{\+1,0,\-1\\\},wherecMERocr,i\\mathrm\{cMER\}\_\{\\mathrm\{ocr\},i\}is the error rate of the OCR hypothesis andcMERcor,i\\mathrm\{cMER\}\_\{\\mathrm\{cor\},i\}is that of the post\-correction output\. A score of\+1\+1indicates improvement over the OCR hypothesis,0no change, and−1\-1degradation\. The reported metric \(pref\_score\_cmer\_macro\) is the macro\-average ofsis\_\{i\}across all transcription units, so each unit contributes equally and large gains on a few units cannot dominate the score\. The metric therefore complements cMER by highlighting how often post\-correction helps or harms individual transcription units\.
#### 4\.1\.3Additional metrics and confidence intervals
We also report word\-level MER at both micro and macro aggregation levels \(wmer\_micro,wmer\_macro\), computed over word\-level alignments under the same normalization used for character\-level scoring\. All reported metrics are accompanied by 95% bootstrap confidence intervals based on 10,000 resamples of transcription units, enabling assessment of sampling uncertainty and supporting assessment of result stability\.
### 4\.2Text Normalization Before Scoring
Before scoring, both the post\-correction output and the reference transcription are normalized in two steps\. First,*layout normalization*removes soft hyphens followed by line breaks \(¬\\\\neg\\backslashn\) and joins the surrounding word parts; remaining line breaks are converted to spaces\. Second,*IR\-style normalization*lowercases the text, replaces punctuation and other non\-word characters with spaces, and collapses repeated whitespace to a single space\. The evaluation is thus case\- and punctuation\-insensitive, but remains sensitive to accented characters \(e\.g\.éandeare distinct\)\. This normalization policy reflects the IR application scenario of the benchmark where indexing systems often apply comparable transformations\. Systems are therefore not penalized for layout differences in their output\.
### 4\.3Ranking Protocol And Submission Rules
#### 4\.3\.1Per\-dataset and overall rankings
Scoring is performed per dataset, usingcmer\_microas the primary criterion andpref\_score\_cmer\_macroas the secondary criterion\. The official competition ranking is computed as a weighted mean of per\-datasetcmer\_microscores across the eight official test sets, with weights chosen to balance language\-level contributions\. English and French each contribute two equally weighted test sets\. For German,impresso\-snippetscarries weight 1, while the threedta19noise levels \(dta19\-l0,dta19\-l1,dta19\-l2\) carry weight1/3\\nicefrac\{\{1\}\}\{\{3\}\}each, so that the threedta19sets together contribute the same total weight as one other test set\. Per\-language rankings are reported using the same weighting logic within each language\.
#### 4\.3\.2Submission rules
Teams were allowed to submit up to three runs per dataset and language\. External resources and pre\-trained models were permitted provided they were documented\. If a system did not provide a post\-correction output for a transcription unit, the original OCR hypothesis was used unchanged for scoring\.
### 4\.4Evaluation Infrastructure
The evaluation toolkit consists of two components\. The*HIPE\-OCRepair scorer*888[https://github\.com/hipe\-eval/HIPE\-OCRepair\-scorer](https://github.com/hipe-eval/HIPE-OCRepair-scorer)is a Python package999[https://pypi\.org/project/hipe\-ocrepair\-scorer/](https://pypi.org/project/hipe-ocrepair-scorer/)that computes all reported metrics, enabling participants to evaluate their systems locally before submission\. The*evaluation repository*101010[https://github\.com/hipe\-eval/HIPE\-OCRepair\-2026\-eval](https://github.com/hipe-eval/HIPE-OCRepair-2026-eval)contains the official test data \(also present in the data repository\), all system submissions, scoring scripts, and a Makefile for reproducing the full evaluation pipeline, ensuring transparent and reproducible scoring\.
## 5System Descriptions
Table 3:Overview of participating systems\.### 5\.1Baseline
As a minimal reference, we include a no\-correction baseline that returns the OCR hypothesis unchanged\. Its performance provides a lower bound for system comparison and directly reflects the underlying OCR quality of each test set, as measured by the initial cMER\. It is particularly informative in low\-noise settings, where unnecessary modifications by post\-correction systems can degrade otherwise accurate transcriptions\.
### 5\.2Participating Systems
Four teams submitted a total of 50 distinct runs, covering all official test datasets and languages\. Table[3](https://arxiv.org/html/2607.08143#S5.T3)summarizes the submitted systems\. The approaches span a broad methodological spectrum: from zero\-shot prompting of off\-the\-shelf models to continued pre\-training followed by supervised fine\-tuning and multi\-step inference pipelines\. All teams used decoder\-only large language models ranging from 8B to 24B parameters\. A common thread across all submissions is the use of task\-specific prompting designed to guide the model toward faithful correction rather than free rewriting; teams differ substantially, however, in how much they further adapt the model to the task and in the strategies they employ to control hallucination and output quality\. The following system descriptions are compiled from information provided by the participants\.111111Participating teams may publish further technical details in separate system papers\.
#### 5\.2\.1Zakaria\-ENSIAS
TeamZakaria\-ENSIAS, affiliated withENSIAS\(Morocco\), submitted 7 runs covering all official test sets exceptdta19\-l2\. Their system performs zero\-shot OCR post\-correction using Qwen3\-8B served locally via Ollama\. Each document is processed independently: a prompt constructed from the OCR hypothesis and document metadata \(language, publication date, document type\) instructs the model to correct character recognition errors, fix hyphenation artefacts and spurious word splits, remove garbled fragments, and preserve historical spelling without modernization\. A temperature of 0\.1 favors conservative, faithful corrections\. To guard against degenerate outputs, a length\-ratio safeguard rejects responses outside a predefined range relative to the input length \(accepting outputs between 0\.35×\\timesand 2\.8×\\timesthe input length\) and falls back to the original OCR text after up to two retries\. A post\-processing step strips chain\-of\-thought content and any echoed prompt fragments from the model output\. No fine\-tuning, retrieval augmentation, or external lexicons were used\.
Table 4:Methodological features of participating systems\.FeatureZakariaL3iBLOCRBnF\-MistralApproachzero\-shotfine\-tunedzero\-shotCPT \+ FTTraining datacompetitioncompetitionselectioncomp\. \+ synth\.Continued pre\-training–––✓Fine\-tuning–✓–✓Synthetic data–––✓Task\-specific prompt✓✓✓✓Metadata in prompt✓–––Error type guidance✓✓✓–Output validation✓–✓✓Hallucination control✓partial–✓Routing to larger model–––✓
#### 5\.2\.2L3i
TeamL3i, affiliated with theUniversity of La Rochelle\(France\), submitted 11 runs: run 1 covered all official test sets, while run 2 was submitted for theimpresso\-snippetsdatasets only \(all three languages\)\. Both runs fine\-tuned Qwen3\-14B with instruction tuning on all available training pairs, using a single prompt written in English across all languages and datasets\. The prompt provided the OCR text to correct, with instructions to preserve meaning, historical spelling, names, numbers, and dates, and to avoid paraphrasing\. No document metadata was included\. Long inputs were split into non\-overlapping chunks of 256 tokens, processed independently during both training and inference\.
Run 2 explored a detection\-augmented variant in which likely erroneous tokens were first identified by a token classification model and inserted into the prompt as explicit correction targets, with all other settings identical to run 1\. It underperformed run 1, which the team attributed to insufficient training data for the more complex pipeline\.
#### 5\.2\.3BLOCR
TeamBLOCR, affiliated with theBritish Library\(United Kingdom\), submitted 8 runs, corresponding to a single approach applied across all official test sets\. Their approach begins with a model selection phase: six candidate models were evaluated via the Hugging Face Inference API for inference stability and performance, using a sample of approximately 10k tokens per language drawn from the training data\. DeepSeek was selected for English and Gemma 3 for French and German based on cMER and preference score on this sample\.
The same prompt was used for both model selection and final submission\. It combines the OCR hypothesis with the document language and instructions to correct four error classes: over\-segmentation, under\-segmentation, misrecognized characters, and missing characters, following the taxonomy of\[[23](https://arxiv.org/html/2607.08143#bib.bib31)\]\. Document metadata such as date, publication title, and document type were not included\. The model was instructed to return a corrected version of the text alongside a CSV file listing detected errors, classified by type and confidence level; the latter was produced for analysis purposes and did not feed back into the correction pipeline\. Generation used a temperature of 0\.2 with no other parameters explicitly set beyond a token buffer to avoid truncation\.
#### 5\.2\.4BnF\-Mistral
TeamBnF\-Mistral, affiliated with theNational Library of France\(France\) and theMistral AI, submitted 24 runs with the most elaborate pipeline of the competition\. Their base model is a version of Mistral Small 3 \(24B\) that underwent continued pre\-training on historical BnF documents predating 1900 \(ca 80B tokens\), and broader multilingual corpora\. An intermediate post\-training checkpoint was then fine\-tuned using LoRA on approximately 10,000 samples drawn from the competition datasets, supplemented by synthetic OCR pairs in French, English, and German\. The latter were generated by artificially degrading periodical documents from the 18th to 20th century using confusion matrices and insertion/deletion probabilities derived from the competition data, retaining only hard examples after filtering\. Different runs reflect different data mixtures and LoRA configurations\.
At inference, language\-specific system prompts are applied, with more detailed anti\-hallucination constraints for German and English\. An iterative judge\-and\-retry loop flags suspicious corrections \(hallucination, missing text, overcorrection\) and triggers up to three retries, reducing the flagging rate from 42% to 6%\. Documents where the CER between raw OCR and corrected output exceeds 15% are additionally routed to a larger model\. The participating team reports that the full post\-processing pipeline yields a 27% improvement in cMER on the validation splits\.
Table 5:Overall competition ranking on the test split\. For readability, only distinct runs are shown; runs whose predictions were identical to another run for most official test sets are omitted from this summary table\. Lower cMER is better; higher preference score is better\. Full results, including 95% confidence intervals and omitted runs, are available in the online evaluation report\.
### 5\.3Summary of Approaches
Table[4](https://arxiv.org/html/2607.08143#S5.T4)maps the main methodological features across teams\. The approaches span three broad levels of task\-specific adaptation: continued pre\-training combined with fine\-tuning and a multi\-step inference pipeline \(BnF\-Mistral\); supervised fine\-tuning with task\-specific prompting \(L3i\); and zero\-shot prompting with output validation strategies \(Zakaria\-ENSIAS,BLOCR\)\. Among all submissions,BnF\-Mistralachieves the strongest overall performance, consistent with the depth of its adaptation to the task\. The two zero\-shot systems invest in complementary strategies — metadata use, error type guidance, retry loops, and output length constraints — that partially compensate for the absence of task\-specific training\. The impact of individual design choices, including the use of document metadata, explicit error modeling, and hallucination control mechanisms, is examined in detail in the next Section on results\.
## 6Results and Discussion
As shown in Table[5](https://arxiv.org/html/2607.08143#S5.T5), the overall ranking is dominated by variants ofBnF\-Mistral\. The no\-correction baseline ranks last, which is notable because abstaining from any edits is a competitive strategy in low\-noise settings\[[5](https://arxiv.org/html/2607.08143#bib.bib5)\]\. Notably, the bestBnF\-Mistralruns achieve preference scores close to 0\.9, indicating highly consistent improvements\.
Table 6:Per\-language ranking \(test split\)\. Scores are weighted means over the official test sets for each language\. Only distinct runs with complete coverage for the respective language are shown\.Table[6](https://arxiv.org/html/2607.08143#S6.T6)shows that this pattern holds across all three languages\.BnF\-Mistral\(run1\) ranks first for German, English, and French, with cMER scores of 0\.0061, 0\.0046, and 0\.0042, respectively\. The strongest alternative system isBLOCR, which ranks fourth for German, third for English, and fourth for French\. English shows the closest competition among the top systems, withBLOCRapproaching theBnF\-Mistralruns more closely than in the other language\-level rankings\.
Table 7:Best\-performing system\(s\) per dataset on the primary metric \(cmer\_micro\), together with the no\-correction baseline\. Where the top\-ranked system was not significantly better than the next\-ranked system under paired bootstrap testing, both systems are reported\.Δ\\Deltadenotes the absolute improvement over the no\-correction baseline\.Table[7](https://arxiv.org/html/2607.08143#S6.T7)summarizes the best\-performing system\(s\) for each official test set together with the no\-correction baseline, making baseline\-relative gains directly visible\. The strongest systems reduce cMER on all datasets, but the absolute gain depends strongly on initial OCR quality, ranging from 0\.0011 cMER on the already low\-noisedta19\-l0condition to 0\.0464 ondta19\-l2\. ABnF\-Mistralrun is top\-ranked on all eight official test sets\. On seven of them, the topBnF\-Mistralrun is significantly better than the next\-ranked system under paired bootstrap testing oncmer\_micro\. The only exception isimpresso\-snippetsEnglish, whereBnF\-Mistral\(run1\) andBLOCR\(run1\) are statistically indistinguishable at the top, both reaching a rounded cMER of 0\.0049\.
Overall, the results show that LLM\-based OCR post\-correction can substantially improve retrieval\-oriented text quality across heterogeneous historical collections\. At the same time, the variation across datasets confirms the importance of reporting baseline\-relative gains: a low absolute cMER may reflect either strong correction or an already accurate OCR hypothesis\. The no\-correction baseline is therefore not a trivial reference point, but an indicator of dataset difficulty and over\-correction risk\. The consistent outperformance ofBnF\-Mistralvariants across all conditions reflects the depth of task\-specific adaptation described in Section[5](https://arxiv.org/html/2607.08143#S5): the gap between the top fine\-tuned system and the best zero\-shot alternative \(BLOCR\) is itself a finding about the relative merits of different adaptation strategies for this task\.
## 7Conclusion
HIPE\-OCRepair\-2026 set out to assess whether modern LLMs can effectively reduce OCR error in historical document collections under realistic constraints, and to provide a reproducible benchmark for this task\.
The results provide a clear, though nuanced, answer\. Across most datasets, LLM\-based systems, in particular theBnF\-Mistralruns, achieve substantial gains over the raw OCR input, represented by a no\-correction baseline, demonstrating that LLMs can effectively reduce accumulated OCR debt without access to source images, even in multilingual and historically heterogeneous settings\.
At the same time, performance is not uniform\. Gains are strongest under moderate to high OCR noise, whereas low\-noise historical text remains inherently sensitive to over\-correction: when the input is already relatively accurate, even small unnecessary edits can degrade the transcription\. Performance also varies across languages and datasets, with some settings \(notably English and French datasets\) showing tighter competition at the top and smaller margins between systems\. The preference score further shows that successful post\-correction is not only a matter of reducing average error, but also of avoiding degradation at the level of individual transcription units\. This highlights a central tension in LLM\-based approaches: while their generative capacity enables effective correction, it also introduces a risk of over\-correction or unintended alteration, which must be controlled\.
The design of the benchmark — in particular its information\-retrieval\-oriented normalization — shapes the interpretation of these results\. By abstracting away from orthographic variation and layout features, the evaluation emphasizes lexical recoverability and downstream usability rather than strict diplomatic fidelity\. Reported gains should therefore be understood primarily as improvements in searchability and text\-based processing, rather than full restoration of historically faithful transcriptions\.
Beyond the competition itself, the HIPE\-OCRepair\-2026 dataset, scorer, and evaluation toolkit constitute a set of durable, openly available assets for the community\. These will be further consolidated and extended into a comprehensive benchmark, including a public leaderboard\.
Future work should focus on improving robustness across languages and domains, developing methods to control overcorrection and hallucination, and extending evaluation to settings that require stricter fidelity to historical form\. The integration of layout\-aware and image\-informed approaches also remains an important direction for bridging the gap between post\-correction and full OCR reprocessing, especially given recent evidence that visually degraded inputs can also induce OCR hallucinations in vision\-language models\[[13](https://arxiv.org/html/2607.08143#bib.bib43)\]\.
\{credits\}
#### 7\.0\.1Acknowledgements
The authors thank the ICDAR 2026 Conference and Competition Committees for hosting the task and Corina Raclé for helping with the manual correction of theimpresso\-snippetsdata\. This work was carried out within the[Impresso](https://impresso-project.ch/)project \(SNSF grant[No\. CRSII5\_213585](https://data.snf.ch/grants/grant/213585)and FNR grant No\. 17498891\)
#### 7\.0\.2\\discintname
The authors have no competing interests to declare that are relevant to the content of this article\.
## References
- \[1\]C\. Amrhein and S\. Clematide\(2018\)Supervised OCR Error Detection and Correction Using Statistical and Neural Machine Translation Methods\.Journal for Language Technology and Computational Linguistics \(JLCL\)33\(1\),pp\. 49–76\.External Links:ISSN 0175\-1336,[Link](https://jlcl.org/content/2-allissues/1-heft1-2018/jlcl_2018-1_3.pdf)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p2.1)\.
- \[2\]H\. Balk and L\. Ploeger\(2009\-10\)IMPACT: working together to address the challenges involving mass digitization of historical printed text\.OCLC Systems & Services: International digital library perspectives\.External Links:ISSN 1065\-075X,[Link](https://www.emerald.com/insight/content/doi/10.1108/10650750911001824/full/html)Cited by:[§3\.2\.2](https://arxiv.org/html/2607.08143#S3.SS2.SSS2.p1.1)\.
- \[3\]M\. Beals, E\. Bell, R\. Cordell, P\. Fyfe, I\. G\. Russell, T\. Hauswedell, C\. Neudecker, J\. Nyhan, M\. Oiva, S\. Pado, M\. P\. Pimentel, L\. Rose, H\. Salmi, M\. Terras, and L\. Viola\(2020\-05\)The Atlas of Digitised Newspapers: Reports from Oceanic Exchanges\.Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[4\]A\. Beshirov, M\. Dobreva, D\. Dimitrov, M\. Hardalov, I\. Koychev, and P\. Nakov\(2025\-02\)Post\-ocr text correction for Bulgarian historical documents\.International Journal on Digital Libraries26\(1\),pp\. 4\.External Links:ISSN 1432\-1300,[Link](https://doi.org/10.1007/s00799-025-00415-x)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.
- \[5\]E\. Boros, M\. Ehrmann, M\. Romanello, S\. Najem\-Meyer, and F\. Kaplan\(2024\-03\)Post\-Correction of Historical Text Transcripts with Large Language Models: An Exploratory Study\.InProc\. of the 8th Joint SIGHUM / LaTeCH\-CLfL 2024 Workshop,St\. Julians, Malta,pp\. 133–159\.External Links:[Link](https://aclanthology.org/2024.latechclfl-1.14/)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1),[§6](https://arxiv.org/html/2607.08143#S6.p1.1)\.
- \[6\]E\. Boros, N\. K\. Nguyen, G\. Lejeune, and A\. Doucet\(2022\)Assessing the impact of OCR noise on multilingual event detection over digitised documents\.International Journal on Digital Libraries23\(3\),pp\. 241–266\.Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[7\]G\. Chiron, A\. Doucet, M\. Coustaty, and J\. Moreux\(2017\-11\)ICDAR2017 Competition on Post\-OCR Text Correction\.In2017 14th IAPR International Conference on Document Analysis and Recognition \(ICDAR\),Vol\.01,pp\. 1423–1428\.External Links:ISSN 2379\-2140,[Link](https://ieeexplore.ieee.org/document/8270163)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p6.1),[§3\.2\.2](https://arxiv.org/html/2607.08143#S3.SS2.SSS2.p1.1)\.
- \[8\]G\. Chiron, A\. Doucet, M\. Coustaty, M\. Visani, and J\. Moreux\(2017\)Impact of OCR Errors on the Use of Digital Libraries: Towards a Better Access to Information\.InProc\. of the 17th ACM/IEEE Joint Conference on Digital Libraries,USA,pp\. 249–252\.External Links:[Link](http://dl.acm.org/citation.cfm?id=3200334.3200364),ISBN 978\-1\-5386\-3861\-3Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[9\]M\. Ehrmann, A\. Hamdi, E\. L\. Pontes, M\. Romanello, and A\. Doucet\(2023\)Named Entity Recognition and Classification in Historical Documents: A Survey\.ACM Computing Surveys56\(2\),pp\. 27:1–27:47\.External Links:ISSN 0360\-0300,[Link](https://dl.acm.org/doi/10.1145/3604931)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[10\]J\. Evershed and K\. Fitch\(2014\-05\)Correcting noisy OCR: context beats confusion\.InProc\. of the First International Conference on Digital Access to Textual Cultural Heritage,DATeCH ’14,New York, NY, USA,pp\. 45–51\.External Links:[Link](https://dl.acm.org/doi/10.1145/2595188.2595200),ISBN 978\-1\-4503\-2588\-2Cited by:[§3\.2\.5](https://arxiv.org/html/2607.08143#S3.SS2.SSS5.p1.1)\.
- \[11\]H\. Gupta, L\. Del Corro, S\. Broscheit, J\. Hoffart, and E\. Brenner\(2021\)Unsupervised multi\-view post\-OCR error correction with language models\.InProc\. of the 2021 Conference on Empirical Methods in Natural Language Processing,pp\. 8647–8652\.Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.
- \[12\]A\. Hamdi, A\. Jean\-Caurant, N\. Sidère, M\. Coustaty, and A\. Doucet\(2020\)Assessing and Minimizing the Impact of OCR Quality on Named Entity Recognition\.InDigital Libraries for Open Knowledge,Lecture Notes in Computer Science,Cham,pp\. 87–101\.External Links:[Document](https://dx.doi.org/10.1007/978-3-030-54956-5%5F7),ISBN 978\-3\-030\-54956\-5Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[13\]Z\. He, C\. Zhang, Z\. Wu, Z\. Chen, Y\. Zhan, Y\. Li, Z\. Zhang, X\. Wang, and M\. Qiu\(2025\)Seeing is believing? mitigating ocr hallucinations in multimodal large language models\.External Links:[Link](https://arxiv.org/abs/2506.20168)Cited by:[§7](https://arxiv.org/html/2607.08143#S7.p6.1)\.
- \[14\]J\. Jarlbrink and P\. Snickars\(2017\-10\)Cultural heritage as digital noise: Nineteenth century newspapers in the digital archive\.Journal of Documentation73\(6\),pp\. 1228–1243\.External Links:ISSN 0022\-0418,[Link](http://www.emerald.com/jd/article/73/6/1228-1243/203503)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[15\]J\. Kanerva, C\. Ledins, S\. Käpyaho, and F\. Ginter\(2025\-03\)OCR Error Post\-Correction with LLMs in Historical Documents: No Free Lunches\.InProc\. of the Third Workshop on Resources and Representations for Under\-Resourced Languages and Domains,Estonia,pp\. 38–47\.External Links:[Link](https://aclanthology.org/2025.resourceful-1.8/),ISBN 978\-9908\-53\-121\-2Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.
- \[16\]S\. Kim, J\. Baudru, W\. Ryckbosch, H\. Bersini, and V\. Ginis\(2025\)Early evidence of how LLMs outperform traditional systems on OCR/HTR tasks for historical records\.arXiv preprint arXiv:2501\.11623\.External Links:2501\.11623Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.
- \[17\]C\. Neudecker and A\. Antonacopoulos\(2016\-04\)Making Europe’s Historical Newspapers Searchable\.In2016 12th IAPR Workshop on Document Analysis Systems \(DAS\),Santorini, Greece,pp\. 405–410\.External Links:[Link](http://ieeexplore.ieee.org/document/7490152/),ISBN 978\-1\-5090\-1792\-8Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[18\]C\. Neudecker, K\. Baierer, M\. Federbusch, M\. Boenig, K\. Würzner, V\. Hartmann, and E\. Herrmann\(2019\-05\)OCR\-D: An End\-to\-End Open Source OCR Framework for Historical Printed Documents\.InProc\. of the 3rd International Conference on Digital Access to Textual Cultural Heritage,DATeCH2019,New York, USA,pp\. 53–58\.External Links:[Link](https://dl.acm.org/doi/10.1145/3322905.3322917),ISBN 978\-1\-4503\-7194\-0Cited by:[§4\.1\.1](https://arxiv.org/html/2607.08143#S4.SS1.SSS1.p1.5)\.
- \[19\]T\. T\. H\. Nguyen, A\. Jatowt, M\. Coustaty, and A\. Doucet\(2021\-07\)Survey of Post\-OCR Processing Approaches\.ACM Computing Surveys54\(6\),pp\. 124:1–124:37\.External Links:ISSN 0360\-0300,[Link](https://dl.acm.org/doi/10.1145/3453476)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p2.1)\.
- \[20\]C\. Rigaud, A\. Doucet, M\. Coustaty, and J\. Moreux\(2019\)ICDAR 2019 competition on post\-OCR text correction\.In2019 International Conference on Document Analysis and Recognition \(ICDAR\),pp\. 1588–1593\.Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p6.1)\.
- \[21\]R\. Schaefer and C\. Neudecker\(2020\-12\)A Two\-Step Approach for Automatic OCR Post\-Correction\.InProc\. of the The 4th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature,Online,pp\. 52–57\.External Links:[Link](https://aclanthology.org/2020.latechclfl-1.6)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p2.1)\.
- \[22\]D\. Smith and R\. Cordell\(2023\-06\)A Research Agenda for Historical and Multilingual Optical Character Recognition\.Technical reportNortheastern University\.External Links:2047/D20297452,[Link](http://hdl.handle.net/2047/D20297452)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[23\]E\. Soper, S\. Fujimoto, and Y\. Yu\(2021\-11\)BART for Post\-Correction of OCR Newspaper Text\.InProc\. of the Seventh Workshop on Noisy User\-generated Text \(W\-NUT 2021\),Online,pp\. 284–290\.External Links:[Link](https://aclanthology.org/2021.wnut-1.31/)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1),[§5\.2\.3](https://arxiv.org/html/2607.08143#S5.SS2.SSS3.p2.1)\.
- \[24\]U\. Springmann, C\. Reul, S\. Dipper, and J\. Baiter\(2018\-07\)Ground Truth for training OCR engines on historical documents in German Fraktur and Early Modern Latin\.Journal for Language Technology and Computational Linguistics33\(1\),pp\. 97–114\.External Links:ISSN 2190\-6858,[Link](https://jlcl.org/article/view/220)Cited by:[§3\.2\.1](https://arxiv.org/html/2607.08143#S3.SS2.SSS1.p1.2)\.
- \[25\]P\. B\. Ströbel, S\. Clematide, T\. Hodel, and M\. Volk\(2022\-06\)Transformer\-based HTR for Historical Documents\.InWorkshop on Computational Methods in the Humanities 2022,External Links:[Link](https://www.zora.uzh.ch/handle/20.500.14742/207406)Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p2.1)\.
- \[26\]P\. Ströbel and S\. Clematide\(2019\-07\)Ground truth for Neue Zürcher Zeitung black letter period\.Zenodo\.External Links:[Link](https://zenodo.org/record/3333627)Cited by:[§3\.2\.4](https://arxiv.org/html/2607.08143#S3.SS2.SSS4.p1.1)\.
- \[27\]P\. Ströbel and S\. Clematide\(2019\)Improving OCR of black letter in historical newspapers: The unreasonable effectiveness of HTR models on low\-resolution images\.InProc\. of the Digital Humanities 2019, \(DH2019\),Cited by:[§3\.2\.4](https://arxiv.org/html/2607.08143#S3.SS2.SSS4.p1.1)\.
- \[28\]A\. Thomas, R\. Gaizauskas, and H\. Lu\(2024\)Leveraging LLMs for post\-OCR correction of historical newspapers\.InProc\. of the Third Workshop on Language Technologies for Historical and Ancient Languages \(LT4HALA\)@ LREC\-COLING\-2024,pp\. 116–121\.Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.
- \[29\]D\. van Strien, K\. Beelen, M\. Ardanuy, K\. Hosseini, B\. McGillivray, and G\. Colavizza\(2020\)Assessing the Impact of OCR Quality on Downstream NLP Tasks:\.InProc\. of the 12th International Conference on Agents and Artificial Intelligence,Valletta, Malta,pp\. 484–496\.External Links:[Link](http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0009169004840496),ISBN 978\-989\-758\-395\-7Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p1.1)\.
- \[30\]S\. Weil\(2021\-06\)Neue Modelle dank GT\-Aufwertung und Anreicherung\.Note:Workshop presentation, OCR\-BW, 9 June 2021External Links:[Link](https://ocr-bw.bib.uni-mannheim.de/wp-content/uploads/2021/06/2021-06-09_WS_Neue_Modelle.pdf)Cited by:[§3\.2\.1](https://arxiv.org/html/2607.08143#S3.SS2.SSS1.p1.2)\.
- \[31\]J\. Zhang, W\. Haverals, M\. Naydan, and B\. W\. Kernighan\(2024\-09\)Post\-OCR Correction with OpenAI’s GPT Models on Challenging English Prosody Texts\.InProc\. of the ACM Symposium on Document Engineering 2024,DocEng’24,New York, USA,pp\. 1–4\.External Links:[Link](https://dl.acm.org/doi/10.1145/3685650.3685669),ISBN 979\-8\-4007\-1169\-5Cited by:[§1](https://arxiv.org/html/2607.08143#S1.p3.1)\.Similar Articles
Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models
This paper introduces ARI, a framework that uses retrieval-augmented large language models to restore illegible portions of historical documents, significantly improving named entity restoration by combining implicit LLM knowledge with explicitly retrieved external historical context.
@DanKornas: Dicklesworthstone/llm_aided_ocr OCR for scanned PDFs with LLM-powered text correction GitHub: Archive:
A GitHub project, llm_aided_ocr, performs OCR on scanned PDFs and uses LLMs to correct and improve the extracted text.
DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth
DocOCR-Eval proposes an annotation-free framework that uses a correction and ranking strategy to evaluate and select OCR tools without ground truth labels, showing that aggregating multiple multimodal large language models improves alignment with human rankings.
We benchmarked 18 LLMs on OCR (7k+ calls) — cheaper/old models oftentimes win. Full dataset + framework open-sourced. [R]
A comprehensive benchmark of 18 LLMs on OCR tasks (7k+ calls) reveals that cheaper and older models often match premium accuracy at a fraction of the cost, with full dataset and framework open-sourced.
Vision-capable LLMs vs. OCR for long-document (including charts, images, tables, etc.) QA
A benchmark comparing vision-capable LLMs (native PDF reading) against OCR-based pipelines on 30 long, image-heavy PDFs finds that OCR with layout extraction still outperforms vision models on chart/table-heavy pages and has a 0% failure rate vs. 7% for native PDF, though the sample size is small and many gaps are within noise.