🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
[Json configs] Make json prettier for all saved tokenizer files & ensure same json format for all processors (tok + feat_extract) (#17457)
* [Json dump] Make json prettier * correct more tokenizeirs * more patterns * add aggressive test * the aggressive test was actually useful :-) * more tests * Apply suggestions from code review
P
Patrick von Platen committed
f394a2a50d8729cd1ca9b368e330ec50664c3292
Parent: 6ee1474
Committed by GitHub <[email protected]>
on 5/31/2022, 3:07:30 PM