Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch
Low-rank adaptation (LoRA) is a machine learning technique that modifies a pretrained model (for example, an LLM or vision transformer) to better suit a specific, often smaller, dataset by adjusting only a small, low-rank subset of the model’s parameters. This approach is important because it allows for efficient finetuning of large models on task-specific data, […]
Sent – simple plaintext presentation tool
Simple plaintext presentation tool. sent does not need latex, libreoffice or any other fancy file format, it uses plaintext files to describe the slides and can also display images. Every paragraph represents a slide in the presentation. Especially for presentations using the Takahashi method this is very nice and allows you to write down the […]
I taught the Iliad to Chinese teenagers
Several years ago I had the chance to lead two seminars with a group of high-performing Chinese high school seniors. Each seminar had between 20-35 kids; each of these students was a graduating senior enrolled in the international department of a prestigious high school in Beijing. The purpose of these seminars was twofold. First, they […]
A random dungeon generator that fits on a business card
I used the language’s vector operations and some additional refactoring to significantly cut down on the amount of “math” the original does. // based on: https://gist.github.com/munificent/b1bcd969063da3e6c298be070a22b604 // via: https://gist.github.com/Joker-vD/cc5372a349559b9d1a3b220d5eaf2b01 include std include vec include color let TILE_VOID = ‘ ‘ let TILE_FLOOR = ‘.’ let TILE_WALL = ‘#’ let TILE_CORNER = ‘!’ let TILE_OPEN_DOOR = […]
Everything Is a Linear Model
18 March 2022 Let’s imagine you’re incredibly lazy and you want to learn R, but you only want to learn one function to do statistics. What function do you learn? I’d recommend to learn to use the lm() function. Why? Because most common statistical tests are in fact nothing more than some variation of a […]
Canned Air is Unexpectedly Supersonic [video]
![canned-air-is-unexpectedly-supersonic-[video]](https://cdn-y.objects.dc-sto1.glesys.net/A1da965d3ac0f2e44c08f1ae072687d311/uploads/2024/02/395212-canned-air-is-unexpectedly-supersonic-video-1024x576.jpg)
No focus, no fights, and a bad back – 16 ways technology has ruined my life
Let’s be fair: technology has improved my life in ways that still surprise and delight me on a daily basis. My phone is also a torch! My TV remembers how far I got in last night’s episode, even if I don’t! The bus stop knows when the bus is coming, and I can watch my […]
Access over 181,000 USGS Historical Topographic Maps
In collaboration with the US Geological Survey (USGS), we recently updated Esri’s online USGS historical topographic map collection with over 1,745 new maps, bringing the total number of maps in our collection to over 181,000 (181,008 to be exact). We also corrected a number of maps that our users reported as having georeferencing or other […]
SPAD: Spatially Aware Multiview Diffusers
SPAD : Spatially Aware Multiview Diffusers Citation @article{spad2023, title={SPAD: Spatially Aware Multiview Diffusers}, author={Kant, Yash and Wu, Ziyi and Vasilkovsky, Michael and Qian, Guocheng and Ren, Jian and Guler, Riza Alp and Ghanem, Bernard and Tulyakov, Sergey and Gilitschenski, Igor and Siarohin, Aliaksandr}, journal={arXiv preprint arXiv:TODO}, year={2023} } Overview: SPAD Given a text prompt, our […]
The Linux Kernel Prepares for Rust 1.77 Upgrade
With Linux 6.8 the kernel’s Rust code was brought up to Rust 1.75 while new patches posted this weekend port the code over to Rust 1.76 and then the upcoming Rust 1.77. Posted on Saturday was this patch series taking the kernel’s Rust infrastructure up to Rust 1.76 compatibility. That was immediately followed by the […]