Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Add support for deepspeeds `exclude_frozen_parameters` (#21060)
* add to deepspeed strategies * add testing * changelog * GLOO_SOCKET_IFNAME --------- Co-authored-by: Jirka Borovec <[email protected]> Co-authored-by: Jirka B <[email protected]> (cherry picked from commit 5071a04ae5e06a52e438e5be0b40cf188bf87b57)
N
Nicki Skafte Detlefsen committed
d9118afe1e3d35363abc26ea7af947dfed1cc33c
Parent: e72fc19
Committed by Luca Antiga <[email protected]>
on 9/5/2025, 1:14:02 PM