Tag
PostHog 决定将数据仓库从 DuckDB/DuckLake 迁出,原因是单节点引擎和 DuckLake 的目录设计难以支撑云端大规模、复杂的工作负载。文章详述了容量预估、S3 异步抓取、目录统计膨胀以及 Postgres 连接扩展等实际瓶颈。
Show HN: xarray-sql lets you query Xarray datasets with SQL, pivoting them into tables so you can run queries on engines like DuckDB, Polars, PostgreSQL, BigQuery, and Arrow Flight SQL, with lazy round-tripping back to Xarray.
MiniLake 是一个开源的本地 Databricks API 模拟器,提供真实的 SQL 执行(DuckDB)、真实的 Delta Lake 文件和真实运行的 Spark 作业,可在无云账号、无 API key 的情况下驱动 databricks-sdk、CLI、Terraform、Asset Bundles 及 MCP 智能体。
DuckDB 2.0.0 LTS "Cinnamon Teal" is announced as the biggest feature release yet, shipping a polished Quack client-server protocol, asynchronous I/O, a first-class VARIANT type, agent mode, triggers, and an extensible SQL parser, built from nearly 20,000 commits since DuckDB 1.5.
croft 是一款开源 TypeScript 数据管道工具,从 API 和文件拉取数据,用 SQL 或 TypeScript 转换,并通过调度保持更新,全部存储在一个 DuckDB 文件中,可由 Claude Code 驱动,无需 Python。
介绍 duckdb_object_storage——一个基于 SlateDB 与 Apache OpenDAL 的 DuckDB 社区扩展,可将原生 DuckDB 数据库直接存于 S3 等对象存储,无需额外运行目录服务或协调器,支持单写多读且性能接近本地原生 DuckDB。
MotherDuck 的技术博客详细解析 DuckDB 2.0 alpha 版本为何更快,重点介绍了通过独立下载线程池实现的异步 I/O,使 S3 上的 Parquet 查询性能显著提升,并分享了实际基准测试数据。
Helix Foundry 是一个基于 HelixDB 和 DuckDB 的本地优先数据工作台,可连接公司现有的数据库、Stripe、WorkOS、PostHog、文件和 API,并自动生成跨数据源的统一本体,全部在本地运行且默认使用本地 AI。
Helix Foundry 是一个开源的本地优先数据工作空间,基于 HelixDB 和 DuckDB 构建,可将公司各种数据源连接成统一的本体(ontology),被推广为 Palantir Foundry 的开源替代方案。
DuckLake 是一个基于 SQL 和 Parquet 构建的开放 Lakehouse 格式,其 DuckDB 扩展允许直接读写 DuckLake 数据,支持时间旅行、Schema 演进和变更数据流(CDC)等功能。
The author shares an experiment where an AI autonomously developed and iterated on a database from scratch over 50 rounds, using self-evolution rules and profiling guidance, ultimately reaching 2x DuckDB's performance on TPC-DS SF100 with only 2 queries still slower.
Amazon Aurora PostgreSQL now embeds DuckDB to let users directly query live operational data alongside historical data in Apache Iceberg and Parquet formats stored in S3 data lakes, eliminating the need for ETL pipelines and data duplication.
Twin is a free, open-source, local-first AI buddy that floats on your Mac desktop — catching you up on texts, tracking your calendar, responding by voice, and nudging you before you forget, all stored in a local DuckDB file with no cloud or accounts. Users bring their own Claude, GPT, Gemini, or Grok API keys.
Duckherder is a new DuckDB extension that enables distributed query execution across multiple worker nodes using Arrow Flight, aiming to enhance data engineering workflows with parallel processing.
DuckDB-Wasm now supports persistent databases in browsers using the Origin Private File System (OPFS), enabling data to survive page reloads and browser restarts with built-in storage.
The article argues that Pandas, a Python DataFrame library, should be replaced by more efficient alternatives like Polars and DuckDB due to its inefficiencies, based on analysis of data sizes and adoption patterns.
Keenable SELECT is an MCP server that enables AI agents to execute SQL queries on live web data, using semantic operators for efficient search and extraction, and generating HTML reports.
AWS acquires DuckLabs, the company behind the DuckDB analytical database, ensuring projects remain open-source under the MIT license while leveraging AWS resources for growth.
DuckDB v2.0 replaces its PostgreSQL-derived SQL parser with a PEG-based parser that is easier to evolve and can be extended at runtime.
memFrame is an open-source dataframe API that translates Python DataFrame operations to SQL, enabling computation to stay within databases like DuckDB, PostgreSQL, and ClickHouse, and includes a multiagent architecture for natural language data interaction.