So you’ve found a new programming language called V. It looks nice, has a lot of promises on the website, nice syntax, but how does it really work? Everything described here is correct for the b66447cf11318d5499bd2d797b97b0b3d98c3063 commit. This is a … Read more
Written 2024-02-09 A few days ago, a blog post was posted on the website of Modular, the company behind the new high-performance programming language Mojo. The post made the case for using Mojo in bioinformatics due to Mojo’s dual features … Read more
Anyone who has learned a second language will have made an exhilarating (and yet somehow unsettling) discovery: there is never a one-to-one correspondence in meaning between the words and phrases of one language and another. Even the most banal expressions … Read more
{{ message }} This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. You can’t perform that action at this time.
I just added a big new section to learntla: Optimizing TLA+ Model Checking. I take a spec and then show 15 different optimizations, many of them getting a 10x runtime improvement. Patreon notes here. Besides that I’ve done very little … Read more
In this post, I will explain the details of how RWKV generates text. For a high level overview of what RWKV is and what is so special about it, check out the other post about RWKV. To explain exactly how … Read more
I already have a dedicated post about a hypothetical Zig language server. But perhaps the most important thing I’ve written so far on the topic is the short note at the end of Zig and Rust. If you want to … Read more
Summary: The code that gets written is the code that’s easier to write. Anything not forbidden by the language semantics will be done as a “temporary fix”. Codebases decay along the gradient of expedient hacks. Programming languages have syntax, semantics, … Read more
Nora Kassner suspected her computer wasn’t as smart as people thought. In October 2018, Google released a language model algorithm called BERT, which Kassner, a researcher in the same field, quickly loaded on her laptop. It was Google’s first language … Read more
For a while, I’ve been following and contributing to the RWKV language model, an open source large language model with great potential. As ChatGPT and large language models in general have gotten a lot of attention recently, I think it’s … Read more