DuckDB
Running fast data processing scripts locally on a laptop, Querying and introspecting large CSV/Parquet files (including in S3), Figuring out the shape of large structured data via CLI probing queries
It's an embeddable SQL database that excels at fast, local analysis of large data files without needing a separate database server.
Related Tools
FIRST-HAND READS
What people reported, in their own words. Every line links to where it was said.
“migrated to using ibis with a duckdb backend to smooth out the memory spikes”
POSITIVE · performance · Hacker News · 2026-07-08
“DuckDB is already far faster than R for the ETL/wrangling around the stats”
POSITIVE · performance · Hacker News · 2026-06-24
“the CSV parser is really good too. Anyone who's struggled with consuming CSV/TSV knows this is not trivial. DuckDB uses hueristics to be very liberal in what it accepts without crapping out like many parsers.”
POSITIVE · performance · Hacker News · 2026-06-19
“almost everyone was better off with a DuckDB database running locally, often in the browser”
POSITIVE · performance · Hacker News · 2026-06-19
“it's been a game changer. I'm sifting through terabytes of data multiple times a day, mixing, matching, updating, filtering, DuckDB is second to none. For anyone that hasn't used it: you are missing out.”
POSITIVE · performance · Hacker News · 2026-06-19
“DuckDB shines for analytical workloads (OLAP), especially time-series data and aggregations”
POSITIVE · performance · Hacker News · 2026-06-19
“DuckDB recently provided an extension point for providing your own transport layer”
MIXED · features · Hacker News · 2026-06-19
“just so much easier to write sql against csv/json/whatever format data in jupyter/marimo notebooks through duckdb”
POSITIVE · ease of use · Hacker News · 2026-06-19
“Only downside is that inspecting the results moves from vi on the output file to duckdb and a select * from.”
LUKEWARM · ease of use · Hacker News · 2026-06-19
“DuckDB has very good JSON support, like you can do `CREATE TABLE name AS `SELECT * FROM 'data.json';` and it'll infer the schema when possible”
MIXED · features · Hacker News · 2026-06-19
“it can query across heterogeneous sources, so the same query can use a duckdb table, sqlite, csv, and parquet (including predicate pushdown)”
POSITIVE · features · Hacker News · 2026-06-19
“DuckDB bundles with the CLI and travels around any platform, is super lightweight, allows for easily running in CI, on a user's machine, against datasets of all sizes, and so on. There are other embeddable options out there but I found DuckDb fit better for the potentially massive datasets, and also because of how naturally it ingests the types of data we work with, some of its unique features, and how trivial it was to learn and integrate with the project”
POSITIVE · features · Hacker News · 2026-06-19
“You can get pretty crazy with parquet in S3 with an engine like duckdb. And it's dirt cheap to keep that stuff hanging around for future reference and sanity checking your understanding of things.”
POSITIVE · performance · Hacker News · 2026-06-19
“any analytical queries on the data are 10+ times faster in DuckDB over native Postgres”
MIXED · performance · Hacker News · 2026-06-19
“pre-building queries for extremely fast lookup tables. This gets saved to Duckdb”
POSITIVE · performance · Hacker News · 2026-06-08
“really excited to use DuckDB for things like structs and enums”
MIXED · features · Hacker News · 2026-06-04
“I really like DuckDB, it's just SQL for such file formats. And it manages to be super fast at it too.”
POSITIVE · performance · Hacker News · 2026-05-30
“DuckDB is slowly replacing it in the context of python, simply because of the ease of pushing a UDF into the SQL. Also because I really like expressing things as LEAD/LAG with a UDF on top.”
POSITIVE · ease of use · Hacker News · 2026-05-29
“DuckDB SQL scripts scale better in terms of complexity and maintainability (and often also performance)”
POSITIVE · performance · Hacker News · 2026-05-29
“DuckDB is 5x-10x better than SQLite and orders of magnitude simpler/faster than spinning up a dedicated Postgres database”
POSITIVE · performance · Hacker News · 2026-05-29
“I use DuckDB/Iceberg combination extensively for columnar data and connect DuckDB to PG when I need it”
POSITIVE · features · Hacker News · 2026-05-28
“with duckdb is so cheap was simpler than really implementing concurrent writes and mutations”
POSITIVE · performance · Hacker News · 2026-05-15
“DuckDB is awesome partially because of how effortless it is and how little ceremony there is. Like SQLite, but even less friction. Having duckdb -ui as a little work bench is brilliant.”
POSITIVE · ease of use · Hacker News · 2026-05-13
“duckdb's bets have been tasteful, and mostly ignorable if you don't happen to use them”
POSITIVE · features · Hacker News · 2026-05-13
“duckdb is my favourite technology of 2025/26. It has worked its way into so many of my workflows. It's integral to how I work with LLMs, how I store all kinds of data, analytics, data pipelines... I love it.”
POSITIVE · features · Hacker News · 2026-05-13
Have You Used This Tool?
Sign in to share your experience with this tool.
Sign in