Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
COMMITS
/ ch04/01_main-chapter-code/ch04.ipynb March 24, 2025
S
Add PyPI package (#576)
Sebastian Raschka committed
February 16, 2025
S
Uv workflow improvements (#531)
Sebastian Raschka committed
February 6, 2025
S
Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519)
Sebastian Raschka committed
September 22, 2024
R
note about random numbers
rasbt committed
September 20, 2024
S
update gpt-2 paper url
Sebastian Raschka committed
September 9, 2024
R
update gpt-2 paper link
rasbt committed
September 8, 2024
R
update gpt-2 paper link
rasbt committed
July 25, 2024
S
Test code in pytorch 2.4 (#285)
Sebastian Raschka committed
July 17, 2024
T
fix typos & inconsistent texts (#269)
Thanh Tran committed
July 16, 2024
J
fix typos, add codespell pre-commit hook (#264)
Jeroen Van Goey committed
July 15, 2024
R
add missing "be" to figure
rasbt committed
July 2, 2024
R
use correct chapter reference
rasbt committed
June 29, 2024
R
add links to summary sections
rasbt committed
R
add clarifying note about GELU
rasbt committed
R
force refresh figure
rasbt committed
R
remove redundant plus sign
rasbt committed
June 25, 2024
D
minor fixes (#246)
Daniel Kleine committed
May 24, 2024
R
update formatting
rasbt committed
R
flops analysis
rasbt committed
May 2, 2024
R
fix swiglu acronym
rasbt committed
April 28, 2024
S
Rename drop_resid to drop_shortcut (#136)
Sebastian Raschka committed
April 20, 2024
R
update figures
rasbt committed
April 4, 2024
S
Rename variable to context_length to make it easier on readers (#106)
Sebastian Raschka committed
S
Remove reundant dropout in MLP module (#105)
Sebastian Raschka committed
March 19, 2024
S
Ch05 supplementary code (#81)
Sebastian Raschka committed
March 17, 2024
R
add more notes and embed figures externally to save space
rasbt committed
March 16, 2024
R
add imports and version on top
rasbt committed
March 10, 2024
J
Remove duplicate cells
joel-foo committed
March 4, 2024
R
add dropout for embedding layers
rasbt committed
March 1, 2024
R
remove redundant import
rasbt committed
February 27, 2024
R
Update ch04.ipynb
Rayed Bin Wahed committed
R
improve code comments
rasbt committed
February 25, 2024
R
use .shape instead of .size() for consistency
rasbt committed
February 16, 2024
R
R
make a new example for shortcut connections
rasbt committed
February 15, 2024
R
use attn_scores from sec 3.4 instead of 3.3
rasbt committed
February 13, 2024
R
use less ambiguous var name
rasbt committed
February 11, 2024
R
ch4 exercise solutions
rasbt committed
R
make softmax explicit
rasbt committed
R
make softmax explicit
rasbt committed
R
update name of last section
rasbt committed
February 10, 2024
R
variable name fix
rasbt committed
R
format the other GPT architecture sizes
rasbt committed
R
add print statements for illustration purposes
rasbt committed
February 9, 2024
R
add shape information for clarity
rasbt committed
February 5, 2024
R
add and update readme files
rasbt committed
February 4, 2024
R
move overview up
rasbt committed
R
adjust figure width
rasbt committed