We Found an Neuron in GPT-2

clementneo.com
we-found-an-neuron-in-gpt-2

Written in collaboration with Joseph Miller. See the discussion of this post over on LessWrong. We started out with the question: How does GPT-2 know when to use the word an over a? The choice depends on whether the word … Read more

I found a bug in SQLite

philipotoole.com
i-found-a-bug-in-sqlite

rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. Recently I introduced a high-performance write-path into rqlite and, to my great surprise, it exposed a bug in SQLite. The SQLite team … Read more

AI found a bug in my code

joel.tools

AI Found a Bug in My Code I was playing around with the SalesForce CodeGen language model. It is set up to generate new code from a prompt. But I wanted to see how it would analyze existing code. I … Read more