Tag
Redis promoted three capabilities for reducing AI application costs: semantic caching via LangCache, persistent agent memory, and RAM-to-SSD storage tiering with Redis Flex, framed as a sponsored post by @svpino.
The author added Conformal Risk Control to a semantic cache verifier for provable error rate guarantees, but discovered in online simulations that the cache's own decisions can break the exchangeability assumption, increasing realized error rates.
A tweet promoting Redis LangCache as a managed semantic caching solution for AI production, claiming up to 90% reduction in API costs.
MiniCache is a program caching framework that reuses computation across similar requests by parameterizing Program-of-Thought programs, using small models for semantic variable extraction and speculative drafting to improve LLM inference efficiency.
This article introduces an LLM cache built in Rust to reduce API costs and speed up response times by reusing previous answers through exact and semantic matching.
This paper presents a formal theory for defining reuse of answers in governed conversational AI systems, replacing similarity heuristics with mathematically characterized quotient spaces of resolved utterances.
Firn is an open-source, multi-tenant vector and full-text search engine backed by object storage like AWS S3, providing a tiered storage architecture with RAM and NVMe caching for performance. It achieves sub-second cold queries with IVF_PQ indexes and microsecond warm hits via result caching.
The article describes how building an intelligent caching gateway (Hawiyat Composer) saved significant AI API costs by eliminating repeated token waste through exact-match caching, semantic caching, model routing, and local routing.
This paper proposes a memory-augmented multi-agent architecture using nested learning, continuum memory systems, and semantic caching to mitigate hallucination in LLM pipelines, achieving significant reductions in factual errors while improving operational efficiency.
The article discusses the emergence of 'agent context engines' like Redis Iris as a runtime layer that combines retrieval, memory, data sync, and caching, enabling agents to work with live business data without custom integration per workflow.