Rusty Conover
Data infrastructure engineer and founder of Query.Farm. Building DuckDB extensions, scaling data platforms, and writing about what I learn along the way.
Recent Activity
View all →Rusty went full Apache Arrow mode, embarking on a multi-language crusade to add custom metadata support for RecordBatch IPC messages across arrow-swift, arrow-go, arrow-rs, and arrow-js. Between opening 5 PRs, filing issues, and providing thorough code reviews on the Go implementation, he's clearly on a mission to bring this feature to every Arrow runtime. Meanwhile, he squeezed in updates to inflector (addressing issue #3 on snake_case digit handling) and fielded community questions on rapidfuzz. Behind closed doors, classified project and classified project demanded attention with 13 combined classified events—because even arrow-wielding open source warriors have their secrets.
Rusty went full PR artillery mode, launching 15 pull requests across the Apache Arrow and DuckDB ecosystems without merging a single one—planting seeds for future glory. He deep-dove into arrow-js with multiple review rounds on Apache's repo, while simultaneously carpet-bombing community-extensions and duckdb-web with improvements and chipping in community support on issue #6531. Behind closed doors, classified project and classified project consumed 19 classified events, suggesting covert operations are heating up nicely.
Rusty went full whack-a-mole across the Query-farm extension ecosystem, dropping 26 commits across 18 different repos—from tributary and airport to the delightfully named shellfs and fuzzycomplete. While tending to this expansive DuckDB extension garden (including updates to quickjs, rapidfuzz, textplot, and friends), he also slipped behind closed doors for some classified tinkering on classified project and classified project.
Releasing vgi-rpc: An RPC Framework Built on Apache Arrow
I built an RPC framework for Python that uses Apache Arrow IPC as the wire format and Python Protocol classes as the interface definition. No .proto files, no codegen — just type annotations.
Acronym-Aware Case Conversions in the DuckDB Inflector Extension
The Inflector extension for DuckDB now supports configurable acronyms, so case conversions preserve terms like HTML, API, and URL as fully uppercase — configured through a native DuckDB setting.
DuckDB Extension Development Workshop
DuckDB Developer Meeting #1 — Amsterdam, Netherlands
Building on Flight: Real-World Lessons from the DuckDB Airport Extension
Apache Arrow Summit 2025 — Paris, France
Query.Farm: Growing DuckDB Community Extensions
DuckDB Amsterdam Meetup #3 — Amsterdam, Netherlands
DuckDB, Apache Arrow, & the Future of Data Engineering
The Hedgineer Podcast (S2E3)
Streaming Data into DuckDB with Arrow and Python Generators
How to use Python generators and Apache Arrow's RecordBatchReader to stream large datasets into DuckDB without loading everything into memory at once.
Airport for DuckDB: Letting DuckDB take Apache Arrow Flights
DuckCon #6 — Amsterdam, Netherlands
What I've Been Working On
Full activity log →I've been deep in the DuckDB ecosystem these past few months, orchestrating a massive migration of 33+ extensions to version 1.5 while shipping new tools like the PWA-enhanced fair-weather app and the adbc_scanner bulk ingestion system. Behind the scenes, I've also contributed meaningful improvements to Apache Arrow's IPC infrastructure and maintained steady community stewardship across the extension landscape. Between public open-source work and some fascinating classified projects, I've managed to balance shipping production code with the kind of foundational maintenance that keeps distributed systems humming.
- Executed a telemetry standardization crusade spanning 33 DuckDB extensions, systematically upgrading to version 1.5 and modernizing instrumentation across the entire Query-farm ecosystem.
- Enhanced
fair-weatherwith PWA capabilities, cycling mode, stargazing calculations, and a dog walking feature complete with pavement temperature scoring for heat safety. - Contributed to Apache Arrow's serialization APIs, improving dictionary handling in C++ and Python while tackling multiple edge cases in the broader data infrastructure layer.