document-ingestion

Tag

Cards List
#document-ingestion

We spent some time fixing PDF parsing in PipesHub. Sharing what worked and what didn’t.

Reddit r/LocalLLaMA ↗ · 2026-10-29

PipesHub 的创始团队分享了他们优化 PDF 解析的工程实践:用基于 pdfplumber 的轻量解析路径替代部分 Docling 流程,将解析中位时间从 0.98 降至 0.48 秒/页,峰值内存从 2.91GB 降至 1.97GB,同时减少文本丢失。

0 favorites 0 likes
#document-ingestion

@pauliusztin_: I used to think ingesting 1,000,000 documents into an AI memory system was mostly a compute problem. But I've been prov…

X AI KOLs Timeline ↗ · 2026-07-04 Cached

The author discusses the architecture for scaling AI memory ingestion from thousands to millions of documents, emphasizing orchestration and parallelism over raw compute power, and using Prefect for workflow management.

0 favorites 0 likes
← Back to home

Submit Feedback