Software engineering stuff
Managing Kafka topic configuration
The lack of tooling available for managing Kafka topic configuration has been in the back of my mind for a while. It seems like a...
04 Feb 2019
Kafka is your escape hatch
I’ve become much more comfortable with the idea of vendor lock-in. Or rather, I don’t feel as locked in as I used to. The odd...
22 Jan 2019
Research in cell, animal, and human software simulation can speed up experimentation
I recently came across a Wired story about Jim Allison, a Nobel Prize winning researcher in cancer immunotherapy. The story is a long form piece that’s half character study, and...
15 Jan 2019
In defense of design documents
Design documents aren’t just a chore; something that you begrudgingly slog through before getting to the fun work of writing code. Writing a design document might be challenging, but it...
27 Nov 2018
Minimum viable infrastructure
We’ve been discussing building some new infrastructure at work. The project involves writing some fresh code and interfacing with some other systems that we’ve never used before. There are a...
19 Nov 2018
Don't tell people what to do, ask them how to do it
When I first joined LinkedIn, there was very little automation in production deployments. Believe it or not, each deployment day had a wiki page with a run book of all...
12 Nov 2018
Kafka change data capture breaks database encapsulation
Realtime change data capture (CDC) is becoming a popular architecture for data integration and data pipelines. The rise of Kafka connect, in particular, has triggered a lot of interest in...
05 Nov 2018
Models and microservices should be running on the same continuous delivery stack
I’ve been interested in data science platforms for a long time. My fascination began when I was at LinkedIn, and helped build out the first model building and deployment system...
29 Oct 2018
Never miss a
from me, subscribe to my newsletter