Pretraining Language Models via Neural Cellular Automata
Research Paper Blog What if the path to smarter language models doesn’t require more text — but synthetic data from abstract dynamical systems? 6% Perplexity gain 1.6× Faster convergence 164M NCA tokens used 01 — The Problem We’re running out of text Large language models are hungry. They require exponentially more data to keep improving, […]
Learning athletic humanoid tennis skills from imperfect human motion data
Zhikai Zhang1,3*, Haofei Lu1,3*, Yunrui Lian1,3*, Ziqing Chen1,3, Yun Liu1,3, Chenghuai Lin3, Han Xue1,3, Zicheng Zeng3, Zekun Qi1,3, Shaolin Zheng3, Qing Luan3, Jingbo Wang5, Junliang Xing1, He Wang2,3, Li Yi1,4† * Equal contribution † Corresponding author 1Tsinghua University, 2Peking University, 3Galbot, 4Shanghai Qi Zhi Institute, 5Shanghai AI Laboratory
Separating the Wayland Compositor and Window Manager
Traditional Wayland compositors have a monolithic architecture that combines the compositor and window manager into a single program. This has the downside of requiring Wayland window managers to do the significant work of implementing an entire Wayland compositor as well. The new 0.4.0 release of river, a non-monolithic Wayland compositor, breaks from this traditional architecture […]
What makes Intel Optane stand out (2023)
Once in a while new hardware is released that makes a difference. Such a device is the Intel Optane series of high-performance SSD’s for professional use, which was released in late 2017. In this case I’m talking about the Intel Optane P4800X and P5800X and their consumer counterparts (900P and 905P). All drives are based […]
Glassworm Is Back: A New Wave of Invisible Unicode Attacks Hits Repositories
The invisible threat we’ve been tracking for nearly a year is back. While the PolinRider campaign has been making headlines for compromising hundreds of GitHub repositories, we are separately seeing a new wave of Glassworm activity hitting GitHub, npm, and VS Code. In October last year, we wrote about how hidden Unicode characters were being […]
Show HN: What if your synthesizer was powered by APL (or a dumb K clone)?
ksynth retro guide readme
A Theory of the World as run by large adult children
I have been thinking a lot lately about these two fellows. If you are not lucky enough to know them already, those are Harold and George from the Captain Underpants series of books (among others). Two supposedly prototypical boys whose wonderful imaginations are in the process of being destroyed by educators who do not recognize their […]
Hollywood Enters Oscars Weekend in Existential Crisis
A group of young assistants from WME — the talent agency representing Martin Scorsese and Ben Affleck — were debating their career choices between rounds of bourbon and line dancing on a recent evening at the Desert 5 Spot bar in Hollywood. “I got into this business because I love movies, but everyone is really […]
I’m 60 years old. Claude Code killed a passion
I stumble upon a post from shannoncc called ”I’m 60 years old. Claude Code has re-ignited a passion”, and it made me think. I am also (almost) 60, but AI just killed the passion. I remember all the pre-AI days, where I was enjoying coding during the day, the evening, the weekends and the vacations. […]
OpenRocket
Connect with fellow rocket enthusiasts, ask questions about rocket designs, share your experiences, and get in touch with our developers. Our Discord server is the perfect place to discuss, learn, and have fun with like-minded individuals. Click the button below to join: Join our Discord Server