Understanding GPT Tokenizers

simonwillison.net
understanding-gpt-tokenizers

Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing around with these tokens is an interesting way to get … Read more

Understanding Passkeys

michal.sapka.me
understanding-passkeys

Understanding Passkeys May 17, 2023 With all the buzz about Passkeys recently, I found myself pushed toward something I know nothing about. Is it some magical thingy that will secure my accounts on the Web? Unfortunately, marketing buzz and lack … Read more

Understanding ChatGPT

atmosera.com
understanding-chatgpt

Unless you’ve lived in a cave for the last few months, you’ve heard of ChatGPT. It’s a deep-learning model (neural network) created by OpenAI whose ability to generate human-like prose has made AI the topic of dinner-table conversations around the … Read more

Understanding Glibc Malloc

sploitfun.wordpress.com
understanding-glibc-malloc

I always got fascinated by heap memory. Questions such as How heap memory is obtained from kernel?How efficiently memory is managed?Is it managed by kernel or by library or by application itself?Can heap memory be exploited? were in my mind for quite … Read more