I don’t know much about about formal methods, so a while back I read Hillel Wayne’s post Let’s prove Leftpad with interest. However: So I thought I’d take a peek and do some testing on these Leftpad implementations that are … Read more
Abstract:We give a deterministic $O(mlog^{2/3}n)$-time algorithm for single-source shortest paths (SSSP) on directed graphs with real non-negative edge weights in the comparison-addition model. This is the first result to break the $O(m+nlog n)$ time bound of Dijkstra’s algorithm on sparse … Read more
If you want to solve a tricky problem, it often helps to get organized. You might, for example, break the problem into pieces and tackle the easiest pieces first. But this kind of sorting has a cost. You may end … Read more
GPT/GLP-1 Illustration Hello and happy Sunday! Was this newsletter forwarded to you? Sign up to get it in your inbox. I’ve just got back from HLTH in Amsterdam, nursing what might be the worst three-day hangover of my adult life. … Read more
tl;dr: On Unix-like platforms, if you use git clone –recursive on an untrusted repo, it could achieve remote code execution. Update to a fixed version of git and other software that embeds Git (including GitHub Desktop). If you’ve ever used … Read more
{{ message }} Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions … Read more
Abstract:We present a novel non attention based architecture for large language models (LLMs) that efficiently handles very long context windows, on the order of hundreds of thousands to potentially millions of tokens. Unlike traditional Transformer designs, which suffer from quadratic … Read more
This post was first written in March 2024, but at the time, I was asked not to publish it for reasons that will shortly become apparent. Circumstances have changed since, so I’ve gone ahead and published it now with some … Read more
You know when you are on a hike, and there is a point where you are exactly midway through it? There is always a reflection moment in there, where some thinking happens. Sometimes you look back and realize: it’s been … Read more
Edited on March 14th 2025: expand in the “AI” section Introduction# This article is about why on-call in its current state in big-tech is flawed, or how to properly develop software. Surprisingly, from my experience, smaller companies get this right, … Read more