Edward Z. Yang (@ezyang) · July 25, 2026 · 4 min readcompilertorch.compileautogradverificationllm A reference implementation is a simplified but complete version of a system that trades performance in return for clarity. We might then say a reference “language” is the … Read more
Introduction Using PyTorch custom operations is common in PyTorch models. PyTorch custom operations can be custom classes and custom functions implemented in C++ and CUDA and used in both Python and C++ inference programs. In this blog post, I would … Read more
Introduction to Helion In modern machine learning, the demand for high-performance computation has led to a proliferation of custom kernels. While these kernels can deliver impressive performance, they are often written in low-level, hardware-specific languages. This creates a long-term maintenance … Read more
We now live in a world where ML workflows (pre-training, post training, etc) are heterogeneous, must contend with hardware failures, are increasingly asynchronous and highly dynamic. Traditionally, PyTorch has relied on an HPC-style multi-controller model, where multiple copies of the … Read more
This is an example of how to hotswap PyTorch training code without unloading your model weights from VRAM. For large LLMs it can take upwards of 30 seconds to load a model from disk to VRAM. Waiting 30 seconds every … Read more
This post is a long form essay version of a talk about PyTorch internals, that I gave at the PyTorch NYC meetup on May 14, 2019. Hi everyone! Today I want to talk about the internals of PyTorch. This talk … Read more
by Team PyTorch We’re happy to officially launch torchao, a PyTorch native library that makes models faster and smaller by leveraging low bit dtypes, quantization and sparsity. torchao is an accessible toolkit of techniques written (mostly) in easy to read … Read more
Assumed audience: ML researchers who frequently work with PyTorch, but are interested in trying out JAX or have yet to be convinced. Usually, people start these ‘critiques’ with a disclaimer that they are not trying to trash the framework, and … Read more
{{ message }} This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. You can’t perform that action at this time.
{{ message }} This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. You can’t perform that action at this time.