Software engineering stuff
In defense of design documents
Design documents aren’t just a chore; something that you begrudgingly slog through before getting to the fun work of writing code. Writing a design document...
27 Nov 2018
Minimum viable infrastructure
We’ve been discussing building some new infrastructure at work. The project involves writing some fresh code and interfacing with some other systems that we’ve never...
19 Nov 2018
Don't tell people what to do, ask them how to do it
When I first joined LinkedIn, there was very little automation in production deployments. Believe it or not, each deployment day had a wiki page with a run book of all...
12 Nov 2018
Kafka change data capture breaks database encapsulation
Realtime change data capture (CDC) is becoming a popular architecture for data integration and data pipelines. The rise of Kafka connect, in particular, has triggered a lot of interest in...
05 Nov 2018
Models and microservices should be running on the same continuous delivery stack
I’ve been interested in data science platforms for a long time. My fascination began when I was at LinkedIn, and helped build out the first model building and deployment system...
29 Oct 2018
Your First Technical Presentation
Congratulations! You’ve been picked you to give a technical presentation. People are interested in what you have to say, and you’re excited and nervous. What now?
23 Oct 2018
Trust, but automate
If you want to enforce a technical guideline or rule, you must automate the enforcement mechanism. Relying on human beings to do the enforcement is too error prone, yet this...
11 Sep 2017
Using YARN with Cgroups
I’m still a novice with Cgroups, but I thought it would be worth documenting how to set YARN up with them, since there seems to be a surprising lack of...
14 Jun 2013
Never miss a
from me, subscribe to my newsletter