The Miserable State of Modems and Mobile Network Operators
Golioth recently received a number of customer reports regarding connectivity issues on a specific vendor’s cellular chipset series. We immediately contacted the vendor and began working towards reproducing and isolating the behavior. What ensued was a lengthy investigation that ultimately revealed some unexpected and highly undesirable behavior. This is a story of the complexities of […]
The FFT Strikes Back: An Efficient Alternative to Self-Attention
Abstract:Conventional self-attention mechanisms incur quadratic complexity, limiting their scalability on long sequences. We introduce FFTNet, an adaptive spectral filtering framework that leverages the Fast Fourier Transform (FFT) to achieve global token mixing in $mathcal{O}(nlog n)$ time. By transforming inputs into the frequency domain, FFTNet exploits the orthogonality and energy preservation guaranteed by Parseval’s theorem to […]
Telescope – an open-source web-based log viewer for logs stored in ClickHouse
A handy tool that manages to make close what once was far Introduction Telescope is a web application designed to provide an intuitive interface for exploring log data. It is built to work with any type of logs, as long as they are stored in ClickHouse. Users can easily configure connections to their ClickHouse databases […]
Iterated Log Coding
Iterated log coding 2025-01-01 Floats with just the sign bits I’ve created a new format for encoding real numbers on computers. I’m proud of it! Let’s dive in. Real number formats We have some real value . Could be positive or negative or zero, large or small. How can we store it in a bitstring? […]
Gustatory Wisdom: Bruegel the Elder’s Twelve Proverbs (1558)
Wooden roundels or “trenchers” (teljoren in Dutch) were a not uncommon fixture of middling and well-to-do dinner parties in sixteenth-century Europe. And, as with the backgrounds for Bruegel’s Twelve Proverbs, they were often “uniformly painted in red”. In an era when sugar was becoming more accessible and affordable than ever before, sweet confections and marzipan […]
Toyota completes phase 1 construction of futuristic city
Toyota Motor has completed the first phase construction of a futuristic city southwest of Tokyo that will weave new technologies into urban living. It unveiled the development on Saturday on a site that will eventually cover 175 acres or more than 700,000 square meters. The Japanese automaker started work in 2021 on what it calls […]
Y Combinator deletes posts after a startup’s demo goes viral
A demo from Optifye.ai, a member of Y Combinator’s current cohort, sparked a social media backlash that ended up with YC deleting it off its socials. Optifye says it’s building software to help factory owners know who’s working — and who isn’t — in “real-time” thanks to AI-powered security cameras it places on assembly lines, […]
DeepSeek Open Sources DeepGEMM: Clean and efficient FP8 GEMM kernels
DeepGEMM is a library designed for clean and efficient FP8 General Matrix Multiplications (GEMMs) with fine-grained scaling, as proposed in DeepSeek-V3. It supports both normal and Mix-of-Experts (MoE) grouped GEMMs. Written in CUDA, the library has no compilation need during installation, by compiling all kernels at runtime using a lightweight Just-In-Time (JIT) module. Currently, DeepGEMM […]
From Reform to Ruin in the USSR
“A nation so poorly prepared to act independently could not attempt total reform without total destruction. An absolute monarch would have been a less dangerous innovator.” – Alexis de Tocqueville “History is a capricious lady. But I hope that it will judge me fairly.” – Mikhail Gorbachev The Soviet reform experience remains a repository of […]
Material Theme has been pulled from VS Code’s marketplace
{{ message }} 👍 1 reacted with thumbs up emoji 👎 1 reacted with thumbs down emoji 😄 1 reacted with laugh emoji 🎉 1 reacted with hooray emoji 😕 1 reacted with confused emoji ❤️ 1 reacted with heart emoji 🚀 1 reacted with rocket emoji 👀 1 reacted with eyes emoji You can’t […]