Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
COMMITS
/ README.md March 3, 2026
S
Qwen3.5 from scratch (#969)
Sebastian Raschka committed
February 19, 2026
S
Add Tiny Aya from scratch (#962)
Sebastian Raschka committed
January 18, 2026
S
link GRPO notebook (#950)
Sebastian Raschka committed
January 9, 2026
S
Chapter 5 with alternative LLMs (Qwen3, Llama 3) (#943)
Sebastian Raschka committed
November 23, 2025
S
Olmo 3 from scratch (#914)
Sebastian Raschka committed
November 13, 2025
S
Write-up on how to get the most out of this book (#909)
Sebastian Raschka committed
November 6, 2025
R
Use consistent title case
rasbt committed
November 3, 2025
S
Gated DeltaNet write-up (#901)
Sebastian Raschka committed
October 20, 2025
S
Mixture-of-Experts intro (#888)
Sebastian Raschka committed
October 13, 2025
S
Add alternative attention structure (#880)
Sebastian Raschka committed
S
sliding window attention (#879)
Sebastian Raschka committed
S
Add other appendices for completeness (#878)
Sebastian Raschka committed
October 12, 2025
S
Multi-Head Latent Attention (#876)
Sebastian Raschka committed
October 11, 2025
S
Grouped-Query Attention memory (#874)
Sebastian Raschka committed
October 9, 2025
S
Add simpler BPE, and make previous BPE better (#870)
Sebastian Raschka committed
October 8, 2025
S
Qwen3 and evaluation bonus materials (#869)
Sebastian Raschka committed
September 6, 2025
S
Fix IMDb spelling (#811)
Sebastian Raschka committed
August 28, 2025
S
reasoning-from-scratch (#793)
Sebastian Raschka committed
August 17, 2025
S
Gemma 3 270M From Scratch (#771)
Sebastian Raschka committed
August 2, 2025
S
Qwen3 Coder Flash & MoE from Scratch (#760)
Sebastian Raschka committed
July 13, 2025
S
Add link to official video course (#741)
Sebastian Raschka committed
July 8, 2025
S
Simplify KV cache usage (#728)
Sebastian Raschka committed
July 6, 2025
S
Update README.md
Sebastian Raschka committed
S
Add prerequisite section (#723)
Sebastian Raschka committed
June 24, 2025
S
Add link to free exercise PDF (#706)
Sebastian Raschka committed
June 19, 2025
S
Qwen3 From Scratch (#678)
Sebastian Raschka committed
June 15, 2025
S
Add KV cache (#671)
Sebastian Raschka committed
March 28, 2025
S
Alt weight loading code via PyTorch (#585)
Sebastian Raschka committed
February 23, 2025
S
GitHub markdown updates (#545)
Sebastian Raschka committed
February 17, 2025
S
Badge url updates
Sebastian Raschka committed
R
update badges
rasbt committed
R
update badges
rasbt committed
R
update readme badges
rasbt committed
February 16, 2025
S
Update README.md
Sebastian Raschka committed
February 12, 2025
S
PyTorch tips for better training performance (#525)
Sebastian Raschka committed
January 22, 2025
S
Bonus material: extending tokenizers (#496)
Sebastian Raschka committed
January 17, 2025
S
Implementingthe BPE Tokenizer from Scratch (#487)
Sebastian Raschka committed
November 8, 2024
S
Add chapter names
Sebastian Raschka committed
October 30, 2024
S
Update README.md
Sebastian Raschka committed
October 14, 2024
S
Memory efficient weight loading (#401)
Sebastian Raschka committed
October 5, 2024
S
Llama 3 (#384)
Sebastian Raschka committed
September 23, 2024
S
GPT to Llama (#368)
Sebastian Raschka committed
September 22, 2024
S
Add user interface to ch06 and ch07 (#366)
Sebastian Raschka committed
September 17, 2024
S
Add chatpgpt-like user interface (#360)
Sebastian Raschka committed
September 11, 2024
S
reflection-tuning dataset generation (#349)
Sebastian Raschka committed
September 7, 2024
D
nbviewer links / typo (#346)
Daniel Kleine committed
September 5, 2024
S
Revert nbviewer links
Sebastian Raschka committed
August 29, 2024
S
use nbviewer links (#339)
Sebastian Raschka committed
August 24, 2024
S
Update README.md
Sebastian Raschka committed
August 8, 2024
S
Update README.md
Sebastian Raschka committed