PicoGPT

A complete GPT — autograd, multi-head attention, AdamW optimizer — trained from scratch in your browser.
Small enough to fit in a QR code.

Vocab —

Params —

Docs —

Fetching training data…

Step 0/500

Loss —

LR —

Generated Names

Architecture

Layers 1
Heads 4
Dim 16
Context 8
MLP 64
Act ReLU²

QR Code

QR Code

Scan → opens in browser → trains a GPT from scratch. No install needed. Version 39, error correction L.