TurboOCR v3 — high-speed document OCR server (C++/CUDA), ~520 img/s on RTX 5090

Reddit r/LocalLLaMA Tools

Summary

TurboOCR v3 is a self-hosted, high-speed OCR server that achieves ~520 images per second on an RTX 5090 using PP-OCRv6 models, with new structured parsing for tables and formulas.

TurboOCR is a self-hosted, high-speed document OCR server, runs fully local. Here's What's New in v3: Speed: Full pipeline now on the newest PP-OCRv6 models (up from v5): ~270 → ~520 img/s on FUNSD (v6 tiny, RTX 5090). Still fully local, HTTP + gRPC. Structured parsing (the main addition): End-to-end now: layout → tables to HTML → formulas to LaTeX → reading-order Markdown. Tables and formulas are strict per-request opt-in, so you only pay the cost when you actually need them. Stack: C++, TensorRT FP16, multi-stream, gRPC/HTTP, direct PDF endpoint, PP-OCRv6. Repo: https://github.com/aiptimizer/TurboOCR
Original Article

Similar Articles

Building a Fast Multilingual OCR Model with Synthetic Data

Hugging Face Blog

NVIDIA introduces Nemotron OCR v2, a fast multilingual OCR model built using synthetic data generation. The model achieves 34.7 pages/second on a single A100 GPU by using a unified FOTS-based architecture with feature reuse across detection, recognition, and relational components.

OvisOCR2: a promising 0.8B local document parser

Reddit r/LocalLLaMA

OvisOCR2 is a new 0.8B end-to-end OCR model based on Qwen3.5-0.8B that converts full document pages directly into structured Markdown, including text, tables, formulas, and reading order. It achieves strong benchmark scores and is released under Apache 2.0 with vLLM support.