Rusty Conover
Data infrastructure engineer and founder of Query.Farm. Building DuckDB extensions, scaling data platforms, and writing about what I learn along the way.
Recent Activity
View all →Rusty went full whack-a-mole across the Query-farm extension ecosystem, dropping 26 commits across 18 different repos—from tributary and airport to the delightfully named shellfs and fuzzycomplete. While tending to this expansive DuckDB extension garden (including updates to quickjs, rapidfuzz, textplot, and friends), he also slipped behind closed doors for some classified tinkering on classified project and classified project.
Rusty spent the day deep in the shadows, channeling all five commits into classified operations. Four commits went into classified project while one landed in classified project—both shrouded in the usual secrecy and intrigue. No public repos saw action today, making this a full-fledged behind-closed-doors affair where the only witnesses are his IDE and whatever NDAs he's sworn to uphold.
Rusty went on an extension upgrade spree, opening eight PRs to enable DuckDB 1.5 builds for his community extensions (textplot, marisa, jsonata, json_schema, inflector, httpserver, httpclient, and adbc_scanner). He also gave fair-weather a friendlier rebrand to Fair Weather Friend, laid the foundation for snacks-report with production deployment fixes, and squeezed in a dozen classified commits split between classified project and classified project—because even open-source stewards need their secrets.
DuckDB Extension Development Workshop
DuckDB Developer Meeting #1 — Amsterdam, Netherlands
Building on Flight: Real-World Lessons from the DuckDB Airport Extension
Apache Arrow Summit 2025 — Paris, France
Query.Farm: Growing DuckDB Community Extensions
DuckDB Amsterdam Meetup #3 — Amsterdam, Netherlands
DuckDB, Apache Arrow, & the Future of Data Engineering
The Hedgineer Podcast (S2E3)
Streaming Data into DuckDB with Arrow and Python Generators
How to use Python generators and Apache Arrow's RecordBatchReader to stream large datasets into DuckDB without loading everything into memory at once.
Airport for DuckDB: Letting DuckDB take Apache Arrow Flights
DuckCon #6 — Amsterdam, Netherlands
Cron Expressions For DuckDB
Introducing a DuckDB extension that interprets cron expressions to generate scheduled timestamps directly in SQL, built with the Rust croner crate.
Enhancing DuckDB with Unix Pipe Integration: Introducing the shellfs Extension
Introducing shellfs, a DuckDB extension that enables seamless integration with Unix pipes for both input and output, allowing command-line programs to be used directly within DuckDB queries.
What I've Been Working On
Full activity log →I've been deep in the DuckDB ecosystem these past few months, orchestrating a massive migration of 33+ extensions to version 1.5 while shipping new tools like the PWA-enhanced fair-weather app and the adbc_scanner bulk ingestion system. Behind the scenes, I've also contributed meaningful improvements to Apache Arrow's IPC infrastructure and maintained steady community stewardship across the extension landscape. Between public open-source work and some fascinating classified projects, I've managed to balance shipping production code with the kind of foundational maintenance that keeps distributed systems humming.
- Executed a telemetry standardization crusade spanning 33 DuckDB extensions, systematically upgrading to version 1.5 and modernizing instrumentation across the entire Query-farm ecosystem.
- Enhanced
fair-weatherwith PWA capabilities, cycling mode, stargazing calculations, and a dog walking feature complete with pavement temperature scoring for heat safety. - Contributed to Apache Arrow's serialization APIs, improving dictionary handling in C++ and Python while tackling multiple edge cases in the broader data infrastructure layer.