nanochat
Build your own ChatGPT for $100 on a single GPU
242 followers
Build your own ChatGPT for $100 on a single GPU
242 followers
nanochat is a full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase. Run tokenization, pretraining, finetuning, evaluation, inference, and web UI on a single 8XH100 node.
Raycast
nanochat is Andrej Karpathy's capstone project for LLM101n by Eureka Labs.
It's a full-stack LLM implementation in ~1000 lines of clean, hackable code (Python, Rust, HTML, Shell).
You can run the entire pipeline—tokenization, pretraining, finetuning, evaluation, inference, and web UI—on a single 8XH100 node for under $1000.
It achieves competitive performance (~4e19 FLOPs, $100 tier model) without massive frameworks.
Its purpose is to make LLMs accessible and understandable for developers who want to learn by doing!
nice concept. can i run on macbook m1 pro? if i can, it might be awesome.
Amazing concept—democratizing LLMs at this price point is a founder’s dream!!