🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
[CB] Keep order of incoming requests (#43626)
* CB now keeps the order of incoming requests despite sorting * Fix test order * Add reordering for generate batch * Lower nb of generated tokens and add details
R
Rémi Ouazan committed
cf3fda19cc3d0c7360e08f45d8f6819c1548b185
Parent: c640b63
Committed by GitHub <[email protected]>
on 2/3/2026, 9:59:44 AM