🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Make using safetensors files automated. (#27571)
* [WIP] Make using safetensors files automated. If `use_safetensors=True` is used, and it doesn't exist: - Don't crash just yet - Lookup for an open PR containing it. - If yes, use that instead - If not, touch the space to convert, wait for conversion to be finished and the PR to be opened - Use that new PR - Profit. * Remove the token. * [Auto Safetensors] Websocket -> SSE (#27656) * Websocket -> SSE * Support sharded + tests +cleanup a * env var * Apply suggestions from code review * Thanks Simon * Thanks Wauplin Co-authored-by: Wauplin <[email protected]> * Cleanup * Update tests * Tests should pass * Apply to other tests * Extend extension * relax requirement on latest hfh * Revert * Correct private handling & debug statements * Skip gated repos as of now * Address review comments Co-authored-by: ArthurZucker <[email protected]> --------- Co-authored-by: Lysandre Debut <[email protected]> Co-authored-by: Lysandre <[email protected]> Co-authored-by: Wauplin <[email protected]> Co-authored-by: Lysandre <[email protected]> Co-authored-by: ArthurZucker <[email protected]>
N
Nicolas Patry committed
7b6324e18ee1b43d130a381fedddeb2b544e9e1a
Parent: 9590091
Committed by GitHub <[email protected]>
on 12/1/2023, 2:51:10 PM