duckdb

Tag

Cards List
#duckdb

Moving our warehouse off DuckDB

Hacker News Top ↗ · yesterday Cached

PostHog 决定将数据仓库从 DuckDB/DuckLake 迁出,原因是单节点引擎和 DuckLake 的目录设计难以支撑云端大规模、复杂的工作负载。文章详述了容量预估、S3 异步抓取、目录统计膨胀以及 Postgres 连接扩展等实际瓶颈。

0 favorites 0 likes
#duckdb

Show HN: Automatic deduction of FlashAttention kernel from ~25 lines of SQL

Hacker News Top ↗ · 3d ago Cached

Show HN: xarray-sql lets you query Xarray datasets with SQL, pivoting them into tables so you can run queries on engines like DuckDB, Polars, PostgreSQL, BigQuery, and Arrow Flight SQL, with lazy round-tripping back to Xarray.

0 favorites 0 likes
#duckdb

MiniLake Is a Local Databricks API Emulator with SQL, Delta Lake and Spark

Hacker News Top ↗ · 2026-10-27 Cached

MiniLake 是一个开源的本地 Databricks API 模拟器,提供真实的 SQL 执行(DuckDB)、真实的 Delta Lake 文件和真实运行的 Spark 作业,可在无云账号、无 API key 的情况下驱动 databricks-sdk、CLI、Terraform、Asset Bundles 及 MCP 智能体。

0 favorites 0 likes
#duckdb

DuckDB 2.0.0 LTS "Cinnamon Teal"

Hacker News Top ↗ · 2026-10-21 Cached

DuckDB 2.0.0 LTS "Cinnamon Teal" is announced as the biggest feature release yet, shipping a polished Quack client-server protocol, asynchronous I/O, a first-class VARIANT type, agent mode, triggers, and an extensible SQL parser, built from nearly 20,000 commits since DuckDB 1.5.

0 favorites 0 likes
#duckdb

croft

Product Hunt ↗ · 2026-10-19 Cached

croft 是一款开源 TypeScript 数据管道工具,从 API 和文件拉取数据,用 SQL 或 TypeScript 转换,并通过调度保持更新,全部存储在一个 DuckDB 文件中,可由 Claude Code 驱动,无需 Python。

0 favorites 0 likes
#duckdb

@siddontang: Love this: DuckDB + SlateDB + S3. A real, writable database. One writer, many readers. No always-on server. Beautifully…

X AI KOLs Timeline ↗ · 2026-10-15 Cached

介绍 duckdb_object_storage——一个基于 SlateDB 与 Apache OpenDAL 的 DuckDB 社区扩展,可将原生 DuckDB 数据库直接存于 S3 等对象存储,无需额外运行目录服务或协调器,支持单写多读且性能接近本地原生 DuckDB。

0 favorites 0 likes
#duckdb

Why DuckDB 2.0 is faster

Hacker News Top ↗ · 2026-10-10 Cached

MotherDuck 的技术博客详细解析 DuckDB 2.0 alpha 版本为何更快,重点介绍了通过独立下载线程池实现的异步 I/O,使 S3 上的 Parquet 查询性能显著提升,并分享了实际基准测试数据。

0 favorites 0 likes
#duckdb

@QingQ77: A local-first data workbench built on top of HelixDB and DuckDB, connecting your company's existing databases, Stripe, …

X AI KOLs Timeline ↗ · 2026-10-10 Cached

Helix Foundry 是一个基于 HelixDB 和 DuckDB 的本地优先数据工作台,可连接公司现有的数据库、Stripe、WorkOS、PostHog、文件和 API,并自动生成跨数据源的统一本体,全部在本地运行且默认使用本地 AI。

0 favorites 0 likes
#duckdb

@georgecurtiss: I just KILLED Palantir! Foundry lets you build your own company ontology. It uses @helixdb for the s3-backed ontology a…

X AI KOLs Timeline ↗ · 2026-10-09 Cached

Helix Foundry 是一个开源的本地优先数据工作空间,基于 HelixDB 和 DuckDB 构建,可将公司各种数据源连接成统一的本体(ontology),被推广为 Palantir Foundry 的开源替代方案。

0 favorites 0 likes
#duckdb

DuckDB Ducklake

Hacker News Top ↗ · 2026-10-07 Cached

DuckLake 是一个基于 SQL 和 Parquet 构建的开放 Lakehouse 格式,其 DuckDB 扩展允许直接读写 DuckLake 数据,支持时间旅行、Schema 演进和变更数据流(CDC)等功能。

0 favorites 0 likes
#duckdb

@BohuTANG: I had the AI start from scratch, independently develop and iterate on a database, with the goal of making every query o…

X AI KOLs Timeline ↗ · 2026-10-06 Cached

The author shares an experiment where an AI autonomously developed and iterated on a database from scratch over 50 rounds, using self-evolution rules and profiling guidance, ultimately reaching 2x DuckDB's performance on TPC-DS SF100 with only 2 queries still slower.

0 favorites 0 likes
#duckdb

@ajassy: A painful part of working with your data has always been that your live data and historical data are stuck in separate …

X AI KOLs Following ↗ · 2026-10-01 Cached

Amazon Aurora PostgreSQL now embeds DuckDB to let users directly query live operational data alongside historical data in Apache Iceberg and Parquet formats stored in S3 data lakes, eliminating the need for ETL pipelines and data duplication.

0 favorites 0 likes
#duckdb

Twin

Product Hunt ↗ · 2026-09-30 Cached

Twin is a free, open-source, local-first AI buddy that floats on your Mac desktop — catching you up on texts, tracking your calendar, responding by voice, and nudging you before you forget, all stored in a local DuckDB file with no cloud or accounts. Users bring their own Claude, GPT, Gemini, or Grok API keys.

0 favorites 0 likes
#duckdb

@guizmaii: DuckDB is the final boss of Data Engineering

X AI KOLs Timeline ↗ · 2026-09-27 Cached

Duckherder is a new DuckDB extension that enables distributed query execution across multiple worker nodes using Arrow Flight, aiming to enhance data engineering workflows with parallel processing.

0 favorites 0 likes
#duckdb

Persistent Databases in the Browser with DuckDB-Wasm and OPFS

Lobsters Hottest ↗ · 2026-09-19 Cached

DuckDB-Wasm now supports persistent databases in browsers using the Origin Private File System (OPFS), enabling data to survive page reloads and browser restarts with built-in storage.

0 favorites 0 likes
#duckdb

Pandas Should Go Extinct

Lobsters Hottest ↗ · 2026-09-12 Cached

The article argues that Pandas, a Python DataFrame library, should be replaced by more efficient alternatives like Polars and DuckDB due to its inefficiencies, based on analysis of data sizes and adoption patterns.

0 favorites 0 likes
#duckdb

Keenable SELECT: an agent that searches the web in SQL

Hacker News Top ↗ · 2026-09-01 Cached

Keenable SELECT is an MCP server that enables AI agents to execute SQL queries on live web data, using semantic operators for efficient search and extraction, and generating HTML reports.

0 favorites 0 likes
#duckdb

AWS Acquires DuckDB

Hacker News Top ↗ · 2026-08-26 Cached

AWS acquires DuckLabs, the company behind the DuckDB analytical database, ensuring projects remain open-source under the MIT license while leveraging AWS resources for growth.

0 favorites 0 likes
#duckdb

DuckDB V2 PEG-based SQL parser

Hacker News Top ↗ · 2026-08-21 Cached

DuckDB v2.0 replaces its PostgreSQL-derived SQL parser with a PEG-based parser that is easier to evolve and can be extended at runtime.

0 favorites 0 likes
#duckdb

Pandas API for DuckDB, PostgreSQL & ClickHouse — keeping computation inside the database[P]

Reddit r/MachineLearning ↗ · 2026-08-19

memFrame is an open-source dataframe API that translates Python DataFrame operations to SQL, enabling computation to stay within databases like DuckDB, PostgreSQL, and ClickHouse, and includes a multiagent architecture for natural language data interaction.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback