@almoggavra: this is now deployed at Dropbox and their SlateDB startup time dropped 60x LIST calls are expensive, folk
Summary
Almog Gavra announces that a performance optimization using HEAD requests instead of LIST calls has been deployed at Dropbox, reducing SlateDB startup time by 60x.
View Cached Full Text
Cached at: 05/30/26, 06:31 AM
this is now deployed at Dropbox and their SlateDB startup time dropped 60x
LIST calls are expensive, folk
Almog Gavra (@almoggavra): Know your S3 op latency/costs. Sometimes it’s better to probe for a file using HEAD requests instead of LIST.
Just merged in Slate: https://t.co/q65sgsTmkB uses exponential probes + binary search on sequential files
Similar Articles
@Greptime: GreptimeDB's flat-format queries can now prefilter on any column — tags, fields, timestamps — not just primary keys. Wh…
GreptimeDB's flat-format queries now support prefiltering on any column (tags, fields, timestamps), not just primary keys, delivering up to 4.5x faster performance. Additionally, the mito2 storage engine removed its legacy scan path, cleaning up about 1,800 lines of code.
@cognition: Beau Rothrock had been at @AngelList for two months when he walked into a Redshift-to-Snowflake migration in deep troub…
Beau Rothrock used Devin, an AI coding agent, to migrate 14,000 dashboards from Redshift to Snowflake in five weeks, overcoming a delayed project.
@vanstriendaniel: You can now run SQL over 2.19 BILLION web pages. Zero download! @CommonCrawl April 2026 crawl + URL index are on @huggi…
A Hugging Face Space allows running SQL queries over 2.19 billion web pages from Common Crawl without downloading, using DuckDB to read directly from Hugging Face storage buckets.
Launch HN: Ardent (YC P26) – Postgres sandboxes in seconds with zero migration
Ardent is a YC-backed startup that provides Postgres database sandboxes in seconds with zero migration, allowing coding agents to test code on production-like data without risk.
@msimoni: One thing I keep thinking about: with S3-like object storage as primitive, you could build a transactional database wit…
A tweet discusses the idea of building a transactional database with infinite throughput using S3-like object storage and content-addressing, where blocks are written in parallel and the root hash is updated periodically.