Rusty Conover
Data infrastructure engineer and founder of Query.Farm. Building DuckDB extensions, scaling data platforms, and writing about what I learn along the way.
Recent Activity
View all →Rusty tackled a variety of integration and compatibility challenges across the DuckDB ecosystem today.
Rusty focused on low-level transport and worker lifecycle improvements across the vgi-rpc-typescript and vgi-rpc-python codebases, with parallel development on private infrastructure.
Rusty spent the day working across two main repositories, with significant activity in private repos as well.
DuckDB ↔ Arrow Compatibility: A Status Page
A working status page for the Arrow-related issues and PRs I've filed against duckdb/duckdb — the UNION saga, schema/data disagreements in nested appenders, type fidelity through round-trips, and the bigger question of how defensive the C Data Interface should be.
GeoSilo vs GeoArrow + Byte Stream Split: Two Approaches to Geometry Compression
A detailed comparison of GeoSilo's delta-integer encoding against GeoArrow's columnar float64 layout with Parquet BYTE_STREAM_SPLIT, covering compression ratios, precision tradeoffs, and when each approach wins.
VGI Injector: A Tiny HTTPS Download-and-Execute Binary in Zig
I needed a self-contained binary that downloads a program over HTTPS and exec's it — small enough to run in a FROM scratch container with nothing else. Go and Rust couldn't get small enough. Zig could.
TIME Data Type Compatibility Across Databases
A survey of the TIME data type across 14 databases, comparing supported ranges, maximum values, and whether the special value 24:00:00 is accepted.
Telemetry for DuckDB Extensions Without the Pain
I open-sourced the telemetry client I use across Query.Farm's DuckDB extensions. It's two files, one function call, and it only collects platform and version info.
Releasing vgi-rpc: An RPC Framework Built on Apache Arrow
I built an RPC framework for Python that uses Apache Arrow IPC as the wire format and Python Protocol classes as the interface definition. No .proto files, no codegen — just type annotations.
Acronym-Aware Case Conversions in the DuckDB Inflector Extension
The Inflector extension for DuckDB now supports configurable acronyms, so case conversions preserve terms like HTML, API, and URL as fully uppercase — configured through a native DuckDB setting.
DuckDB Extension Development Workshop
DuckDB Developer Meeting #1 — Amsterdam, Netherlands
What I've Been Working On
Full activity log →I've been deep in infrastructure and ecosystem work these past months—modernizing the DuckDB extension universe for compatibility, shipping production-ready implementations across multiple languages, and contributing upstream enhancements to Apache Arrow that fix silent data corruption bugs. February culminated in launching the complete vgi-rpc ecosystem with unified branding and documentation, while January and December focused on systematic dependency management, core database improvements, and cross-language standardization across dozens of repositories. Sprinkled throughout were classified projects that kept things appropriately mysterious.
- Led DuckDB 1.5 compatibility upgrades across 40+ extensions while standardizing documentation and API patterns across the entire Query-farm portfolio
- Contributed upstream Arrow enhancements in JavaScript, Swift, Rust, and Go for custom metadata and dictionary serialization, fixing production data loss issues
- Shipped Fair Weather Friend weather app with PWA support, specialized modes for cyclists and dog walkers, and astronomical features alongside the full vgi-rpc ecosystem in four languages