Rusty Conover
Data infrastructure engineer and founder of Query.Farm. Building DuckDB extensions, scaling data platforms, and writing about what I learn along the way.
Recent Activity
View all →Rusty was on a 28-commit tear across the vgi-rpc ecosystem, turning vgi-rpc-python into a polished, production-ready package. Highlights include shipping v0.1.2 with Windows CI fixes, Unix domain socket documentation, PyPI trusted publishing setup, SEO improvements, and a freshly rewritten external storage guide. He also fortified vgi-rpc-cpp with LargeListArray support and pkg-config validation, launched vgi-rpc-go with hardening fixes, and kept the lights on behind closed doors with work on classified project and classified project. To cap it off, he jumped into the community sandbox with feedback on PR #45 in airport and opened issue #27433 on anthropics/claude-code to surface a content filtering snag with license generation. A masterclass in shipping velocity.
Rusty went full polyglot today, orchestrating a cross-language Arrow metadata symphony across four major Apache Arrow repos. He shipped custom metadata support for RecordBatch IPC messages in apache/arrow-js, apache/arrow-swift, apache/arrow-rs, and apache/arrow-go — opening PRs #136, #9445, and #669 respectively. Meanwhile, behind closed doors on classified project, classified project, and classified project, classified operations hummed along with 8 commits of mysterious brilliance. On the Query-farm front, vgi-rpc-cpp got its CI/CD foundation poured (fresh workflows and production polish), while inflector received a thoughtful overhaul with acronym handling and digit-aware case conversions via the convert_case crate. He also played open-source steward, triaging community questions on inflector, rapidfuzz, and tributary with helpful replies. A day of building infrastructure, expanding capabilities across ecosystems, and keeping the community humming.
Rusty went full extension enablement mode today, kickstarting vgi-rpc-typescript with a complete HTTP transport layer, documentation overhaul, and dependency updates. The real fireworks came from a systematic sweep across the DuckDB community extensions ecosystem—he opened 16 PRs enabling 1.5 builds for extensions like webmacro, tsid, textplot, and a dozen others, essentially future-proofing the entire extension gallery. Meanwhile, he contributed upstream polish to duckdb-web with spelling and grammar fixes (PR #6531 and PR #6528), and leveled up arrow-js with PR #385 adding schema parameters to factory functions. It's the kind of day where Rusty systematized infrastructure improvements across multiple projects—thoughtful stewardship of the open-source ecosystem wrapped in meticulous attention to detail.
Releasing vgi-rpc: An RPC Framework Built on Apache Arrow
I built an RPC framework for Python that uses Apache Arrow IPC as the wire format and Python Protocol classes as the interface definition. No .proto files, no codegen — just type annotations.
Acronym-Aware Case Conversions in the DuckDB Inflector Extension
The Inflector extension for DuckDB now supports configurable acronyms, so case conversions preserve terms like HTML, API, and URL as fully uppercase — configured through a native DuckDB setting.
DuckDB Extension Development Workshop
DuckDB Developer Meeting #1 — Amsterdam, Netherlands
Building on Flight: Real-World Lessons from the DuckDB Airport Extension
Apache Arrow Summit 2025 — Paris, France
Query.Farm: Growing DuckDB Community Extensions
DuckDB Amsterdam Meetup #3 — Amsterdam, Netherlands
DuckDB, Apache Arrow, & the Future of Data Engineering
The Hedgineer Podcast (S2E3)
Streaming Data into DuckDB with Arrow and Python Generators
How to use Python generators and Apache Arrow's RecordBatchReader to stream large datasets into DuckDB without loading everything into memory at once.
Airport for DuckDB: Letting DuckDB take Apache Arrow Flights
DuckCon #6 — Amsterdam, Netherlands
What I've Been Working On
Full activity log →I've been balancing open-source stewardship with core database improvements across the DuckDB ecosystem, from orchestrating massive extension migrations and modernizing telemetry infrastructure to hunting down serialization bugs in Apache Arrow and shipping cryptographic enhancements. Recent months have seen me juggle community support—debugging everything from WASM compatibility gremlins to dictionary serialization mysteries—alongside meaningful contributions to database core like profiler hooks and improved query explanations. Throughout it all, I've maintained a healthy portfolio of pet projects, from turning a weather app into a progressive web app to building geospatial indexing and templating extensions.
- Modernized telemetry across 33 extensions and migrated the DuckDB ecosystem through major version bumps, systematically addressing compiler warnings and build compatibility issues across 15+ repositories.
- Discovered and fixed Apache Arrow's vanishing dictionary messages in IPC serialization, filing upstream PR #49262 to surface proper public APIs while contributing improvements to DuckDB core including profiler callbacks and enhanced table scan explanations.
- Shipped five new DuckDB community extensions including geospatial indexing, templating engines, and expression evaluation, plus transformed fair-weather into a progressive web app with domain-specific features like cycling safety modes and stargazing conditions.