Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Add support for deepspeeds `exclude_frozen_parameters` (#21060)
* add to deepspeed strategies * add testing * changelog * GLOO_SOCKET_IFNAME --------- Co-authored-by: Jirka Borovec <[email protected]> Co-authored-by: Jirka B <[email protected]>
N
Nicki Skafte Detlefsen committed
5071a04ae5e06a52e438e5be0b40cf188bf87b57
Parent: 4824cc1
Committed by GitHub <[email protected]>
on 9/2/2025, 2:15:38 PM