vector-index

#vector-index

Cost-Governed RAG: Unified Per-Tenant Cost Attribution Across Retrieval and Generation in Multi-Tenant LLM Systems

arXiv cs.AI ↗ · 2026-07-15 Cached

This paper introduces Cost-Governed RAG, an architecture combining a codebook-oblivious vector index (TurboVec) with a multi-tenant LLM governance gateway to enable per-tenant cost attribution across retrieval and generation, achieving 99.96% attribution accuracy with minimal overhead.

0 favorites 0 likes

#vector-index

@vintcessun: Compressing 10 million vectors from 31GB to 4GB, with search even faster than FAISS — sounds crazy, but Turbovec actually did it. The core is Google's TurboQuant data-independent quantization: no training, no parameter tuning, just add vectors and index. Handwritten NEON/AVX-512 implementations are genuinely 12-20% faster, supporting filtered search by ID, saving a ton of post-processing hassle. Rust under the hood + pip install, minimal maintenance cost.

X AI KOLs Timeline ↗ · 2026-06-07 Cached

Turbovec, based on Google's TurboQuant algorithm, compresses 10 million vectors from 31GB to 4GB, with search speed 12-20% faster than FAISS, supports filtered search, and offers a Rust implementation with a Python package.

0 favorites 0 likes

vector-index

Cost-Governed RAG: Unified Per-Tenant Cost Attribution Across Retrieval and Generation in Multi-Tenant LLM Systems

Submit Feedback