Running Featured 28 Distilling 100B+ Models 40x Faster with TRL π 28 TRL distillation for 100B+ teachers, 40x faster
Running on CPU Upgrade 219 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 219 Explore synthetic data experiments on a virtual bookshelf
Running on CPU Upgrade Featured 3.1k The Smol Training Playbook π 3.1k The secrets to building world-class LLMs
Running Featured 70 QED-Nano: Teaching a Tiny Model to Prove Hard Theorems π 70 Who needs 1T parameters? Olympiad proofs with a 4B model
Running 3.78k The Ultra-Scale Playbook π 3.78k The ultimate guide to training LLM on large GPU Clusters
Running Featured 1.04k Can You Run It? LLM version π 1.04k Calculate GPU needs for running LLMs on your hardware
Running on CPU Upgrade 22 Accelerate Examples π 22 Generate code samples for model training and configuration