Andrej Karpathy 64b48d0e5c validated that \p{N}{1,2} is the correct number of digits to group up to in the regex pattern of the GPT-4 tokenizer (2 down from 3), leading to the best val_bpb for 32K vocabs

2026-01-13 17:45:06 +00:00

..

estimate_gpt3_core.ipynb

add notebook on deriving the CORE estimates for the GPT-3 miniseries.

2026-01-05 18:40:28 +00:00

gen_synthetic_data.py

sane secrets management

2026-01-04 19:29:22 +00:00

generate_logo.html

initial commit

2025-10-13 06:49:24 -07:00

LOG.md

validated that \p{N}{1,2} is the correct number of digits to group up to in the regex pattern of the GPT-4 tokenizer (2 down from 3), leading to the best val_bpb for 32K vocabs

2026-01-13 17:45:06 +00:00

nanochat.png

Update logo

2025-10-14 14:19:44 -04:00

repackage_data_reference.py

initial commit

2025-10-13 06:49:24 -07:00

runcpu.sh

remove rust compilation as rustbpe is now installed from separate package (#416)

2026-01-08 06:18:37 -08:00

scaling_analysis.ipynb

add notebook used for scaling laws analysis

2026-01-07 22:28:53 +00:00