Tag
The article demonstrates a method for building fast drilldown dashboards from a single Parquet data cube using the Hyparquet JavaScript reader and HTTP range requests against object storage, eliminating the need for a traditional database.
DuckDB is introducing asynchronous I/O for Parquet and CSV files in v2.0, improving remote storage query performance by avoiding blocking worker threads during data fetches.
DuckDB's file_row_number option for paging through Parquet files is 2.53x faster than using LIMIT/OFFSET, as it leverages row group metadata to skip irrelevant blocks, but the benefit depends on having many row groups.
This blog post describes an optimization for Apache Parquet to efficiently store and decode fixed-length lists like vector embeddings, achieving decoding performance comparable to flat columns by bypassing Dremel reconstruction for fixed-size data pages.
Databricks introduces Lakebase LTAP architecture that stores Postgres data in Parquet on S3, enabling transactions and analytics on a single copy of data without CDC or mirroring.
A developer shares their experience building a points-of-interest feature for a running app using Geonames data, DuckDB, and AI assistance from Claude, encountering challenges with biases and hallucination.
GreptimeDB's Mito2 storage engine uses an LSM-tree design with columnar Parquet SSTs, three-level scan pruning, and TWCS compaction. The blog post provides a full walkthrough of its architecture.