π©
nanochat is a minimal, hackable framework for training GPT-2 capability LLMs from scratch. Train compute-optimal models by setting a single complexity dial (depth), with automatic hyperparameter optimization. Includes full pipeline: tokenization, pretraining, finetuning, evaluation, and inference. Train GPT-2-grade models for ~$15-48 in under 2 hours on 8xH100.