A diagonal attack for LLM truth probes shows why no probe on a language model’s embedding space can pin down truth. A linear dream Modern LLMs famously encode input texts as vectors in some embedding space. One of the most … Read more
I vividly remember most of my own journey into engineering management over the years. Throughout my career, I’ve also mentored several people taking the step from engineer to engineering manager. It’s a challenging and often lonely journey, and here are … Read more
On April 23, 1976, the Ramones’ first, self‑titled album was released. It was recorded over seven days on the eighth floor of New York’s Radio City Music Hall and cost $6,400 at the time — an almost laughably small amount … Read more
They haven’t replaced teachers with AI. They have replaced poor kids with rich kids. If you spent any part of your holiday scrolling the tech press on your phone, you doubtlessly saw headlines announcing that the Arizona State Board for … Read more
In early 2022, I started noticing something strange in Spotify’s jazz playlists. I listen to jazz every day, and pay close attention to new releases. But these Spotify playlists were filled with artists I’d never heard of before. Who were … Read more
The Truth About Linear Regression This is basically a compilation of the lecture notes I wrote when teaching 36-401, Modern Regression, in fall 2015. I offer it here on the chance that it might be of interest to those learning, … Read more
(Part 8 in a series on the scientific method) In the last installment I advanced a hypothesis about what truth is, which is to say, I suggested a way to explain the broad consensus that appears to exist about truth. … Read more
More Americans are opting to purchase an electric vehicle, but some EV owners are surprised to find out how much their car’s driving range is compromised by winter weather. Why it matters: Getting over the hurdles of buying an EV … Read more
There is nothing more essential to secular humanism than the truth. Secular humanists are the people who looked at thousands of years of received authority and said, “Yeah, sorry, no.” We needed more than ancient books and the near universal … Read more
Inflation is always and everywherea phenomenon of structural change. — Jonathan Nitzan Milton Friedman has been dead for more than a decade, but his ghost still haunts us. In the 1960s, Friedman declared that inflation is ‘always and everywhere a … Read more