Witchcraft, fast local semantic search on top of SQLite [P]
Summary
Witchcraft is an open-source re-implementation of Stanford's XTR-Warp semantic search engine in Rust, using SQLite for fast local search. It includes Pickbrain CLI for indexing code session transcripts and equipping AI agents with global memory.
Similar Articles
Rethinking Search as Code Generation (25 minute read)
Perplexity introduces Search as Code (SaC), a new architecture that atomizes search primitives for AI agents to compose via code, moving beyond traditional monolithic search pipelines to enable fine-grained control over retrieval.
@techwith_ram: A 10M document corpus eats 31 GB of RAM as float32 Most teams hit that wall & reach for a managed vector database. $400…
turbovec is an open-source Rust vector index using Google Research's TurboQuant algorithm, achieving 16x compression and faster search than FAISS, with integrations for RAG frameworks like LangChain, LlamaIndex, and Haystack.
I built a rust database for agent traces (sub-ms p95 at 1B rows)
ZenithDB is a new open-source Rust database designed for storing and querying AI agent traces. It achieves sub-millisecond trace fetch latency at 1 billion rows by colocating all spans of a trace during compaction, and includes embedded full-text search and late materialization.
Sage launched! Local AI inference engine
Sage is a local AI inference engine built in Rust that runs entirely on the user's machine with kernel-level sandbox security, no telemetry, and no cloud dependency.
We tried vectors, ASTs, and brute-force context stuffing for code retrieval. Graphs with LLM-generated semantics worked best. Here's what we learned.
The authors detail their experience building a code indexing system, concluding that graph-based retrieval with LLM-generated semantics outperforms vector embeddings and pure AST parsing. They open-sourced the system, Bytebell, which uses Neo4j to store semantic context for efficient and precise code retrieval.