Tag
Delta is Meta's object storage service that uses chain replication to achieve high availability and strong consistency, designed for critical bootstrap and disaster recovery workloads.
RustFS 1.0 is released as an open-source, high-performance distributed object storage system built in Rust, offering a migration path for MinIO users after its maintenance ended.
This blog post explains how to run Git on object storage by inventing a new packfile format native to object storage, solving performance issues with traditional Git packfiles for production-sized repositories.
Tigris demonstrates using its object storage as a database substitute by implementing essential primitives such as unique constraints and transactions directly on its distributed key-value store built on FoundationDB.
Bookshelf is a self-hosted eBook library that uses object storage for managing and reading EPUB and PDF files, with support for Cloudflare R2 and local storage.
PicoMQ is a system for durable real-time streams over HTTP, built on S3-compatible object storage, allowing for independent and scalable streams per use case.
Walgit is a Git server implementation that runs as a single binary, using object storage like S3 or GCS as the backend, enabling scalable hosting of Git repositories without local state.
The article demonstrates a method for building fast drilldown dashboards from a single Parquet data cube using the Hyparquet JavaScript reader and HTTP range requests against object storage, eliminating the need for a traditional database.
This article explores storage engine write durability trade-offs, explaining how different storage layers (memory, local SSD, remote storage) move latency and durability, and analyzes the cost of operations in an append-only key-value store built on object storage.
Hugging Face introduces Storage Buckets, a scalable object storage service for AI teams with per-TB pricing, Xet deduplication, built-in CDN, and no git overhead, designed for datasets, model checkpoints, and ML artifacts.
A technical comparison between ZeroFS and Amazon S3 Files, two systems that expose POSIX filesystems backed by object storage. The article highlights differences in storage layout, object interoperability, and trade-offs between direct S3 access and ZeroFS's packing, compression, and encryption.
HydraDB OSS is an open-source graph database designed for AI applications, offering fast, low-latency performance with minimal operational overhead by leveraging object storage.
Firn is an open-source, multi-tenant vector and full-text search engine backed by object storage like AWS S3, providing a tiered storage architecture with RAM and NVMe caching for performance. It achieves sub-second cold queries with IVF_PQ indexes and microsecond warm hits via result caching.
The TiDB Cloud team built an AI Agent cloud disk called drive9.ai based on TiDB, aiming to provide a queryable, programmable, and governable file system layer for Agents, solving engineering pain points such as file and metadata consistency, object storage latency, and file understanding in AI scenarios.
The author demonstrates how to use the billy filesystem abstraction to make a Tigris object storage bucket behave like a filesystem, enabling go-git to treat it as a git repository server directly.
Mixedbread announces that users can now bring their own cloud bucket, enabling zero-retention indexing and search with late-interaction models.
LangChain engineers detail how they built a custom inverted index for SmithDB to support full-text search and JSON filtering over large agent traces stored in object storage, achieving median latency of 400ms despite huge payload sizes.
A tweet discusses the idea of building a transactional database with infinite throughput using S3-like object storage and content-addressing, where blocks are written in parallel and the root hash is updated periodically.
ObjectCache proposes using S3-compatible object storage for LLM KV cache reuse to reduce cost and increase capacity, with a co-designed storage protocol and transfer schedule that minimizes latency overhead. Experiments show it adds only 5.6% latency over local DRAM for 64K contexts.
Gergely Orosz announces turbopuffer as a season sponsor for The Pragmatic Engineer Podcast, highlighting the database's innovative use of object storage and smart caching that helped companies like Cursor scale while cutting costs by 95%.