-
Created a general-purpose join service using Apache Flink and Scala to extract, filter, denormalize, sort, and summarize structured data for Elasticsearch indexing, which led to an over 50% improvement in data freshness for the Campus Labs Insight product. Typical queries processed hundreds of millions of source rows from over one-hundred tables across several databases multiple times per day. Service runs on Kubernetes and provides a GraphQL-inspired API for describing the relationships between data sources and the desired shape of the results. Supports automatic RDBMS schema discovery, parallel extraction, throttling, Vault-based credential management, and recursive joins using delta-iteration.
-
Built a scheduled ETL process using Flink and Scala to transform and load over 1 billion rows daily into a Data Vault-based data warehouse. Implemented keyset table slicing to parallelize extraction of large tables across multiple cluster nodes and wrote a Postgres binary output format to improve load performance. Deployed Prometheus and Alertmanager to Kubernetes for monitoring and alerting.
-
Prototyped a system to improve the quality of OrgSync application notifications. Used Flink's streaming model to implement message grouping, recipient expansion, read-aware multi-channel delivery, template rendering, and periodic digests. Open sourced at: orgsync/oskr-events.
-
Created a Clojure service that forms the speed layer of OrgSync's lambda architecture-based search system. Used Kafka log retention to replay realtime updates onto the latest consistent Elasticsearch index from the batch layer, providing fresh data and time-bounded consistency to search results.
-
Built OrgSync's position experience feature and a new general-purpose request system to replace existing ad-hoc workflow systems in a Ruby on Rails monolith. Features immutable policies with user-driven approval logic and a durable history of all data changes.
-
Created a Kafka producer service using Clojure to allow single-threaded Ruby processes to reliably send messages to Kafka topics without holding open requests. Open sourced at: orgsync/arion.
-
Led the effort to containerize the monolithic OrgSync application and its associated services, reducing the time to get developers up and running from roughly two weeks down to two hours. This later resulted in Slack-triggered blue/green container deployments for almost all production services using ECS.
-
Built a Kafka-driven append-only event timeline service in JRuby that aggregates entity events and comments and pushes live updates to users using Redis pub/sub channels. Created React components to display timeline change events.
-
Host for the monthly Dallas/Fort Worth Clojure Meetup.
-
Created a process to capture and analyze maintenance transactions for Target, discovering $9.6 million in potential savings stemming from price distortion, process inefficiency, and fraud. Built a Ruby on Rails application to facilitate data capture, linking, categorization, verification, coding, and analysis of scanned documents. Linked invoices to accounting information, vendor records, and satellite imagery. Performed price distribution analysis and constructed models determining geographic differences in labor rates.
-
Developed an iPhone application for HVAC/R field service technicians to capture asset information and report problems. Worked with Jones Lang LaSalle to translate data into a format readable by their systems, eliminating the expense of document scanning and overseas data entry.
-
Designed and implemented a system to capture, aggregate, and present real-time power meter measurements using a broker-based publisher/subscriber message bus architecture written in Clojure with core.async and ØMQ. Publishers featured flexible register-map definition, adaptive Modbus/TCP connection pooling, failure recovery, and subscription-driven polling. Used WebSockets to transport measurements to HTML5 dashboard clients with minimal latency.
-
Built an energy audit reporting application that, given energy conservation measures compiled during an audit, generated a savings and ROI report, based on account material, labor costs, and reductions in thermal load.
-
Optimized the geometry and thermal uniformity of an innovative solar collector by writing a MATLAB model that used unconstrained nonlinear optimization with a numerical differential equation solver. Optimized design achieved much improved total system efficiency and met infrastructure cost targets.
-
Improved the efficiency of a desalination startup's capacitive carbon aerogel cell, leading to a verified reduction in regeneration cycle time from 30% to 13%. Designed and analyzed several improved cell geometries for optimal ion transfer and flow characteristics.
-
Reduced the deployment cost of new wireless network hubs by more than $475,000 (over 28% reduction in infrastructure cost) by designing and building an improved IP encapsulation gateway. Decreased the total wireless downlink protocol overhead from 33% to 13% yielding a verified increased system capacity of 20%.
-
Constructed numerical models to simulate signal propagation, network capacity, and infrastructure cost. Specified and managed the upgrade of tower-based microwave equipment, on time and under budget. Built an automated network testing system that produced daily PDF reports containing node performance graphs and metrics.
Worked with a team to perform several energy audits for a Fortune 100 retailer, uncovering up to $75,000 per store in annual energy savings. Presented results and energy action plan to senior management, outlining a more efficient utilization of their existing facility maintenance personnel, and means for recognizing and implementing energy-saving opportunities. Work led to systemic changes in the organization’s building maintenance division.
Assisted in the launch of a start-up wireless Internet service provider. Designed and built an application for handling user accounts, billing, credit card transactions, and customer service inquiries. Simulated wireless network topology using NS2, determining average speed and capacity. Coordinated network integration; recruited and worked with network consultants through design and implementation phases.
- 6/2003–6/2004 Contract Application Developer, RipDigital, New York, NY
- 6/2001–8/2003 Web & Application Developer, North Carolina State University (recurrent), Raleigh, NC
- 2/2000–6/2000 Component Testing Engineer, Powerware Incorporated, Raleigh, NC
- 6/1998–8/1999 Digital Content Creator, Design Magic Incorporated, Raleigh, NC
Senior Design Project: designed a positional, real-time wireless asset tracking technology.