Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Comment typo: head_dim -> head_dim // 2
R
rasbt committed
4aa398c79d09a7bf6a8a50af6bda470cbb58f725
Parent: b12dbf6
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step