Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Add support for deepspeeds `exclude_frozen_parameters` (#21060)
* add to deepspeed strategies * add testing * changelog * GLOO_SOCKET_IFNAME --------- Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com> Co-authored-by: Jirka B <j.borovec+github@gmail.com>
N
Nicki Skafte Detlefsen committed
5071a04ae5e06a52e438e5be0b40cf188bf87b57
Parent: 4824cc1
Committed by GitHub <noreply@github.com>
on 9/2/2025, 2:15:38 PM