Designing Safe Database Schema Changes
Of all the operational risks I worry about as a CTO in regulated payments, the one that keeps recurring in postmortems is not a fancy distributed-systems...
Of all the operational risks I worry about as a CTO in regulated payments, the one that keeps recurring in postmortems is not a fancy distributed-systems...
I have managed engineering teams through payment outages on the busiest shopping day of the year, through regulatory audits that arrived with two weeks notice,...
For the first decade of my career, observability meant one thing: logs. When something broke, you SSH'd into a box, tailed a file, and grepped for the word...
Every engineering leader I know has a build-versus-buy decision sitting in their backlog right now, and most of them are getting it wrong in one of two...
Of all the categories of bugs I have seen ship to production over a twenty-year career, the ones rooted in date and time handling are the most insidious. They...
Settlement is the part of a payments business that nobody talks about and everybody fights about in production. It is the machinery that takes the noisy stream...
Most of the worst production incidents I have managed in fintech did not start with a dramatic failure. They started quietly, with a service that was perfectly...
Notifications look like a small feature until you operate one at scale. Then you discover that the humble "we just send the customer an email" requirement is...
Every engineering organization eventually learns that incidents are not the exception. They are part of the operating model. Systems fail, dependencies...
Every few months a product manager or a board member asks me some version of the same question: "We encrypt the card numbers, so we are PCI compliant and safe,...
Every distributed system fails. That is not a pessimistic statement; it is an operational one. In the payments platforms I have run, the question was never...
Every engineering organization I have led has reached the same uncomfortable moment. A senior engineer leaves, a critical incident hits at two in the morning,...