Andrej Karpathy e85db6b4a4 alternating design

2026-01-16 23:52:12 +00:00

..

__init__.py

initial commit

2025-10-13 06:49:24 -07:00

adamw.py

fuse adamw into a single torch compiled kernel similar to muon. it's about 1.7X faster, but overall it's so tiny that it's not making a major dent

2026-01-15 23:30:44 +00:00

checkpoint_manager.py

minor helpful message

2026-01-15 03:20:21 +00:00

common.py

fix: safe DDP cleanup (check initialized PG, not just env) (#256)

2025-12-27 20:27:40 -08:00

core_eval.py

initial commit

2025-10-13 06:49:24 -07:00

dataloader.py

Big DataLoader refactor: BOS-aligned dataloaders with epoch tracking for pre/mid-training

2026-01-13 20:05:47 +00:00

dataset.py

initial commit

2025-10-13 06:49:24 -07:00

engine.py

integrate Flash Attention 3. +9% tok_per_sec for d12 with ctx even as low as 2048 out of the box nice. also, ready to tune windows huge

2026-01-11 20:33:19 +00:00

execution.py

nit delete redundant catch/raise in execute

2025-10-29 08:10:03 -07:00

flash_attention.py

naturally i failed to include the actual code in the previous commit facepalm

2026-01-16 17:39:41 +00:00

gpt.py

alternating design

2026-01-16 23:52:12 +00:00

logo.svg

initial commit

2025-10-13 06:49:24 -07:00

loss_eval.py

fix typos

2025-11-14 11:20:25 +01:00

muon.py

changes and optimizations to muon, making it more efficient and simpler/cleaner a bit

2026-01-15 03:20:48 +00:00

report.py

fix small bug where this would break if git stage has deleted files

2026-01-04 19:11:43 +00:00

tokenizer.py

adjust the comment on the regex pattern per recent experimnet see dev/LOG.md

2026-01-13 17:50:39 +00:00

ui.html

Fix conversation scroll to bottom on some browsers + remove duplicated padding (#348)

2025-12-31 13:03:22 -08:00