Built a tool that maps research gaps from PDFs — beta, would love ML researchers to break it

Reddit r/AI_Agents Tools

Summary

The author introduces Papira, a beta tool that analyzes uploaded research papers to map coverage and identify gaps in machine learning and NLP subfields.

I built Papira to solve my own problem: understanding where a subfield stands before writing a paper. Upload 3 papers from an area you're studying. It builds a coverage matrix (problems, approaches, benchmarks, and where the gaps are) across all three papers at once. Beta, so it's not perfect. Works best on empirical ML/NLP/systems papers. Full refund if it fails to produce a result.
Original Article

Similar Articles

Show HN: TikTok but for Scientific Papers

Hacker News Top

Papel is a new research-focused social platform that leverages AI-powered vector search and on-device RAG to help researchers discover, discuss, and quiz themselves on academic papers. It offers personalized feeds, local AI chat via Apple Intelligence or MLX, and gamified learning features.

PaperBench: Evaluating AI’s Ability to Replicate AI Research

OpenAI Blog

OpenAI introduces PaperBench, a benchmark evaluating AI agents' ability to replicate state-of-the-art AI research by replicating 20 ICML 2024 papers with 8,316 gradable tasks. The best-performing model (Claude 3.5 Sonnet) achieves only 21% replication score, below human PhD-level performance, highlighting current limitations in autonomous research capabilities.