How we built a SOTA search engine using PostgreSQL, pgvector, and Qwen3 embeddings [P]
Summary
A technical breakdown of how Papers with Code built a state-of-the-art hybrid search engine combining keyword and semantic search using PostgreSQL, pgvector, and Qwen3 embeddings, powered by Hugging Face infrastructure.
Similar Articles
How Hugging Face Inference Endpoints, Jobs, and Buckets Power Search on Papers with Code
This blog post explains how Hugging Face's Inference Endpoints, Jobs, and Buckets are used to power a hybrid search system for Papers with Code, combining keyword and vector search to improve AI research accessibility.
I shipped a multimodal semantic search over 68k artworks. Modal + L40S + Qwen3-VL-Embedding
A developer built a multimodal semantic search over 68k artworks from the National Gallery of Art using Qwen3-VL-Embedding, FAISS, Modal, and Cloudflare R2. The system achieves warm response times of ~1.3s and cold starts of ~44s, supporting both text-to-image and image-to-image queries.
Efficient GPU Retrieval for Semantic Search
This paper introduces a policy-aligned retrieval framework for semantic search on LinkedIn, leveraging embeddings partitioned into category-supervised segments and a two-stage GPU architecture to improve recall and precision, with significant gains validated in A/B testing.
@NielsRogge: Added web search to Papers with Code's upcoming chat interface This runs on @huggingface Inference Providers via @baset…
Niels Rogge adds web search to Papers with Code's upcoming chat interface, powered by Hugging Face Inference Providers, Baseten's DeepSeek-V4 Flash, Exa's MCP server, and Modal. He invites HF usernames for feedback.
We tried vectors, ASTs, and brute-force context stuffing for code retrieval. Graphs with LLM-generated semantics worked best. Here's what we learned.
The authors detail their experience building a code indexing system, concluding that graph-based retrieval with LLM-generated semantics outperforms vector embeddings and pure AST parsing. They open-sourced the system, Bytebell, which uses Neo4j to store semantic context for efficient and precise code retrieval.