SIGN IN SIGN UP

Allow model to tokenize strings longer than context length and set add_bos. Closes #92

A
Andrei Betlen committed
7a536e86c260872c0551e52df37ba8b45317068e
Parent: 8740ddc