I Run LLMs Locally

i-run-llms-locally

A HN user asked me0 how I run LLMs locally with some specific questions, I’m documenting it here for everyone. Before I begin I would like to credit the thousands or millions of unknown artists, coders and writers upon whose work the Large Language Models(LLMs) are trained, often without due credit or compensation. Get Started […]

We’ve not been trained for this: life after the Newag DRM disclosure [video]

we’ve-not-been-trained-for-this:-life-after-the-newag-drm-disclosure-[video]

We’ve not been trained for this: life after the Newag DRM disclosure – media.ccc.de Michał Kowalczyk, q3k and Jakub Stepniewicz Saal 1 Hardware & Making Playlists: ’38c3′ videos starting here / audio You’ve probably already heard the story: we got contracted to analyze a bunch of trains breaking down after being serviced by independent workshops. […]

BioTerrorism Will Save Your Life with the 4 Thieves Vinegar Collective [video]

bioterrorism-will-save-your-life-with-the-4-thieves-vinegar-collective-[video]

BioTerrorism Will Save Your Life with the 4 Thieves Vinegar Collective – media.ccc.de Dr. Mixæl Swan Laufer Ethics, Society & Politics Playlists: ’38c3′ videos starting here / audio Governments have criminalized the practice of managing your own health. Despite the fact that for most of human history bodily autonomy, and self-managed health was the norm, […]

38C3: Illegal Instructions

38c3:-illegal-instructions

Full playlist: Video / Audio The 38th Chaos Communication Congress (38C3) takes place in Hamburg, 27.-30.12.2024, and is the 2024 edition of the annual four-day conference on technology, society and utopia organised by the Chaos Computer Club (CCC) and volunteers. Congress offers lectures and workshops and various events on a multitude of topics including (but […]

Can LLMs Accurately Recall the Bible

can-llms-accurately-recall-the-bible

I’ve often found myself uneasy when LLMs (Large Language Models) are asked to quote the Bible. While they can provide insightful discussions about faith, their tendency to hallucinate responses raises concerns when dealing with scripture, which we regard as the inspired Word of God. To explore these concerns, I created a benchmark to evaluate how […]

Personal Mail Server on OpenBSD

It’s time to host your email yourself! A step-by-step guide for installing and configuring a mail server on OpenBSD. As most of the entries in this blog, this is more of a reminder for me in case I need to do it again. But I publish it in the hope it might be useful to […]

All You Need Is 4x 4090 GPUs to Train Your Own Model

all-you-need-is-4x-4090-gpus-to-train-your-own-model

My journey into Large Language Models (LLMs) began with the excitement of seeing ChatGPT in action. I started by exploring diffusion models, drawn to their ability to create beautiful visuals. However, working on an M1 chip had its limitations, which motivated me to build a custom rig with an NVIDIA 4090 GPU. As I continued […]

What Happens to Relicensed Open Source Projects and Their Forks?

what-happens-to-relicensed-open-source-projects-and-their-forks?

What Happens to Relicensed Open Source Projects and Their Forks? – The New Stack Join our community of software engineering leaders and aspirational developers. Always stay in-the-know by getting the most important news and exclusive content delivered fresh to your inbox to learn more about at-scale software development. RESUBSCRIPTION REQUIRED   It seems that you’ve […]

Finding and exploiting hidden features of Animal Crossing’s NES emulator (2018)

finding-and-exploiting-hidden-features-of-animal-crossing’s-nes-emulator-(2018)

While looking for ways to activate the developer menus left over in Animal Crossing, including the NES emulator game selection menu, I found an interesting feature that exists in the original game that was always active, but never used by Nintendo. In addition to the NES/Famicom games that can be obtained in-game, it was possible […]

Fish 4.0: The Fish of Theseus

About two years ago, our head maintainer @ridiculousfish opened what quickly became our most-read pull request: Truth be told, we did not quite expect that to be as popular as it was. It was written as a bit of an in-joke for the fish developers first, and not really as a press release to be […]