This paper is from Pat Helland, the apostate philosopher of database systems, overall a superb person, and a good friend of mine. The paper appeared this week at CIDR’24. (Check out the program for other interesting papers). The motivating question … Read more
Most systems we regularly interact with, such as computer operating systems, are faced with the challenge of providing good performance, while managing limited resources like computational time and memory. Since it is challenging to optimally manage these resources, there is … Read more
Abstract Large language models (LLMs) have enabled the generation of high-quality synthetic text, often indistinguishable from human-written content, at a scale that can markedly affect the nature of the information ecosystem1,2,3. Watermarking can help identify synthetic text and limit accidental … Read more
Abstract:Matrix multiplication (MatMul) typically dominates the overall computational cost of large language models (LLMs). This cost only grows as LLMs scale to larger embedding dimensions and context lengths. In this work, we show that MatMul operations can be completely eliminated … Read more
{{ message }} This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. You can’t perform that action at this time.
In my last post about Zig and Rust, I mentioned that Rust is a “scalable language”. Let me expand on this a bit. Rust is vertically scalable, in that you can write all kinds of software in it. You can … Read more
GitHub – yandex/odyssey: Scalable PostgreSQL connection pooler {{ message }} You can’t perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload … Read more
In the last decade or so, quite a few new state machine replication protocols emerged in the literature and the internet. I am “guilty” of this myself, with the PigPaxos appearing in this year’s SIGMOD and the PQR paper at … Read more
You probably shouldn’t read this article. If you want to start learning a programming language – write a BF interpreter in it. For may years this has been a common suggestion to many newcomers into programming. And we all know … Read more