Software engineering stuff
Minimum viable infrastructure
We’ve been discussing building some new infrastructure at work. The project involves writing some fresh code and interfacing with some other systems that we’ve never...
19 Nov 2018
Don't tell people what to do, ask them how to do it
When I first joined LinkedIn, there was very little automation in production deployments. Believe it or not, each deployment day had a wiki page with...
12 Nov 2018
Kafka change data capture breaks database encapsulation
Realtime change data capture (CDC) is becoming a popular architecture for data integration and data pipelines. The rise of Kafka connect, in particular, has triggered a lot of interest in...
05 Nov 2018
Models and microservices should be running on the same continuous delivery stack
I’ve been interested in data science platforms for a long time. My fascination began when I was at LinkedIn, and helped build out the first model building and deployment system...
29 Oct 2018
Your First Technical Presentation
Congratulations! You’ve been picked you to give a technical presentation. People are interested in what you have to say, and you’re excited and nervous. What now?
23 Oct 2018
Trust, but automate
If you want to enforce a technical guideline or rule, you must automate the enforcement mechanism. Relying on human beings to do the enforcement is too error prone, yet this...
11 Sep 2017
Using YARN with Cgroups
I’m still a novice with Cgroups, but I thought it would be worth documenting how to set YARN up with them, since there seems to be a surprising lack of...
14 Jun 2013
What follows is a brain dump of some things that I’ve learned about the way that software companies are sold on the public and private market.
22 Oct 2012
Never miss a
from me, subscribe to my newsletter