nanoGPT

Creator

Creator

Seonglae Cho

Created

Created

2023 Jan 9 16:41

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Jun 9 12:57

Refs

Refs

Andrej Karpathy

torch.distributed

nanoGPT is focusing on
Transformer Pretraining stage

nanoGPT Structure

nanoGPT prepare.py

nanoGPT model.py

nanoGPT train.py

nanoGPT sample.py

3D Visualization

Recommendations

//////////