GitHub - Norod/TrainGPT2-127M-FromScratch: A trio of Google-Colab notebooks (ipynb) for training a GPT-2 (127M) model from scratch (useful for other / non-English languages) using gpt-2-simple

This repository was archived by the owner on Jan 9, 2023. It is now read-only.

Name		Name	Last commit message	Last commit date
TrainGPT2_FromScratch_02_encode_dataset.ipynb		TrainGPT2_FromScratch_02_encode_dataset.ipynb
TrainGPT2_FromScratch_03_Training.ipynb		TrainGPT2_FromScratch_03_Training.ipynb
Train_GPT2_FromScratch_01_Tokenizer.ipynb		Train_GPT2_FromScratch_01_Tokenizer.ipynb

About

A trio of Google-Colab notebooks (ipynb) for training a GPT-2 (127M) model from scratch (useful for other / non-English languages) using gpt-2-simple

17 stars

1 watching