Large Language Model from Scratch

This repo is for me to practice implementing large language models from scratch.

Acknowledgement

This implementation is guided by the book Build a Large Language Model (From Scratch) by Sebastian Raschka.

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
.gitignore		.gitignore
01-tokenizer.ipynb		01-tokenizer.ipynb
02-attention-mechanisms.ipynb		02-attention-mechanisms.ipynb
03-gpt-model.ipynb		03-gpt-model.ipynb
04-pretraining.ipynb		04-pretraining.ipynb
README.md		README.md
dataloader.py		dataloader.py
gpt.py		gpt.py
the-verdict.txt		the-verdict.txt