🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
COMMITS
/ tests/utils/test_convert_slow_tokenizer.py August 21, 2025
Y
Update `test_spm_converter_bytefallback_warning` (#40284)
Yih-Dar committed
April 6, 2023
N
Revert error back into warning for byte fallback conversion. (#22607)
Nicolas Patry committed
N
Adding Llama FastTokenizer support. (#22264)
Nicolas Patry committed
May 12, 2022
S
Black preview (#17217)
Sylvain Gugger committed
May 3, 2022
Y
Move test model folders (#17034)
Yih-Dar committed
April 11, 2022