The Neural Net Tank Urban Legend

gwern.net
the-neural-net-tank-urban-legend

Drawing on the usual suspects (Google/​Google Books/​Google Scholar/​Libgen/​LessWrong/​Hacker News⁠/ ​Twitter) in investigating leprechauns⁠, I have compiled a large number of variants of the story; below, in reverse chronological order by decade, letting us trace the evolution of the story back towards … Read more

Neural Networks: Zero to Hero

karpathy.ai

A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to … Read more

C++ Neural Network in a Weekend (2020)

jeremyong.com
c++-neural-network-in-a-weekend-(2020)

Content mirrored from the Github repository Introduction Would you like to write a neural network from start to finish? Are you perhaps shaky on some of the fundamental concepts and derivations, such as categorical cross-entropy loss or backpropagation? Alternatively, would … Read more

Neural Networks and the Chomsky Hierarchy

arxiv.org
neural-networks-and-the-chomsky-hierarchy

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. … Read more

The hunt for the M1’s neural engine

eclecticlight.co
the-hunt-for-the-m1’s-neural-engine

After yesterday’s explanation of the Apple Neural Engine (ANE) in M1 series Macs, it’s time to go in search of this elusive part of Apple Silicon chips, and discover how it’s used. So far, all I have seen of the … Read more