Intuitions for Tranformer Circuits
In a previous post on language modeling, I implemented a GPT-style transformer. Lately I’ve been learning mechanistic interpretability to go deeper and understand why the transformer works on a mathematical level. This post is a brain dump of what I’ve learned so far after reading A Mathematical Framework for Transformer Circuits (herein: “Framework”) and working […]
Migrating the American Express Payment Network, Twice
If you tuned in to Monster Scale Summit this year, you may have seen our talk on migrating the American Express Payments Network – not once, but twice — with zero customer-impacting downtime — meaning no transactions were interrupted and no planned maintenance windows were required during either migration. The session focused on how we […]
My DIY FPGA board can run Quake II
22-mar-2026 Time to design a new board I didn’t want to simply recreate what I had before. Making something more advanced meant soldering BGA. I wasn’t sure if I could do it, but I decided to try anyway. Specifically, I wanted a more advanced FPGA – I chose the Efinix Ti60F256 – and more modern memory – IM8G16D3FFBG, which is a […]
Diverse perspectives on AI from Rust contributors and maintainers
Starting on Feb 6, the project began collecting perspectives around AI into a shared document. This document is a summary of those comments, authored by nikomatsakis on Feb 27 or so. The goal of this document is to cover the full range of points made so that we can understand the landscape of opinion and […]
We indexed the Delve audit leak: 533 reports, 455 companies, 99.8% identical
Gated Intelligence Get the full company exposure list 455 companies with compromised audits. Get the complete list with report types, dates, and risk indicators — delivered to your inbox. Get the List No spam. Unsubscribe anytime. Your email is never shared.
Teaching Claude to QA a mobile app
“When life looks like Easy Street, there is danger at your door” — Grateful Dead, “Uncle John’s Band” (A note on picking this quote: I asked Claude to find me a Grateful Dead lyric that fit the theme. It couldn’t — searching for “dead lyrics” triggers the content filtering policy: API Error: 400 {”type”:”error”,”error”:{”type”:”invalid_request_error”,”message”:”Output blocked […]
The gold standard of optimization: A look under the hood of RollerCoaster Tycoon
The gold standard of optimization: A look under the hood of RollerCoaster Tycoon Due to some lucky circumstances, I recently had the chance to appear in one of the biggest German gaming podcasts, Stay Forever, to talk about the technology of RollerCoaster Tycoon (1999). It was a great interview, and I strongly recommend to listen to […]
PC Gamer Recommends RSS Readers in a 37MB Article That Just Keeps Downloading
There’s not much worth quoting in this PC Gamer article but I do want to draw your attention to three things. First, what you see when you navigate to the page: a notification popup, a newsletter popup that obscures the article, and a dimmed background with at least five visible ads. Welcome Mat Second, once […]
OpenClaw Is a Security Nightmare Dressed Up as a Daydream
Back in 2023, the internet was buzzing about AutoGPT and BabyAGI. It was just after GPT-4 had arrived. Everyone was talking about autonomous agents taking jobs, how they can, and I remember how scared and paranoid people looked. However, they didn’t stand up to their promise. The conversations died off in a few weeks. Fast […]
Why I love NixOS
22 Mar 2026 What I love about NixOS has less to do with Linux and more to do with the Nix package manager. To me, NixOS is the operating system artifact of a much more important idea: a deterministic and reproducible functional package manager. That is the core of why I love NixOS. It is […]