inference-backend

Tag

Cards List
#inference-backend

Ninfer Stahp

Reddit r/LocalLLaMA ↗ · 2026-10-02

A user benchmarks the new Ninfer inference backend on a Blackwell MaxQ GPU, reporting 130-180 t/s on qwen3.8-27b-nvfp4 with minimal slowdown under parallel decoding — claiming vLLM-level concurrency and far faster throughput than llama-server, even after installing it on Windows 10.

0 favorites 0 likes
#inference-backend

@AdinaYakup: Big update from @Baidu_Inc @PaddlePaddle Baidu's PaddleOCR now supports Transformers as an inference backend Really coo…

X AI KOLs Following ↗ · 2026-05-19 Cached

Baidu's PaddleOCR now supports Transformers as an inference backend, making it easier to integrate with the Hugging Face ecosystem.

0 favorites 0 likes
#inference-backend

PaddleOCR 3.5: Running OCR and Document Parsing Tasks with a Transformers Backend

Hugging Face Blog ↗ · 2026-05-18 Cached

PaddleOCR 3.5 adds a Transformers inference backend, enabling OCR and document parsing models like PP-OCRv5 and PaddleOCR-VL 1.5 to run seamlessly within the Hugging Face ecosystem.

0 favorites 0 likes
← Back to home

Submit Feedback