The simplest, fastest repository for training/finetuning medium-sized GPTs. A simple reproduction of the nanoGPT project, throwing a lot of more complex things.
To run the training process, first download the dataset under the guidance of the README in data/shakespeare_char folder.
Then run:
python3 train.py