← All projects
August 2024 – Present
Data Pipeline for Charlottesville
ETL pipelines for city government and local non-profits, improving data accuracy and usability by 35%.
Code for Charlottesville is a volunteer civic-tech brigade that builds software for local government and non-profit organizations. I work on the data side: getting messy, inconsistent public data into a shape people can actually use.
The problem
Partner organizations collect data across spreadsheets, legacy systems, and manual entry. The same field is formatted three different ways, records are duplicated, and nothing lines up between sources — so analysis is slow and its conclusions are shaky.
What I built
- ETL pipelines that extract from each source system, transform records into a consistent schema, and load them into a queryable database.
- Automated cleaning and transformation that replaced manual spreadsheet work — normalizing formats, deduplicating records, and flagging anomalies for human review instead of silently dropping them.
Impact
Data accuracy and usability improved by 35%, and the recurring manual cleanup that used to precede every analysis is now automated.