Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
let `_get_default_process_group_backend_for_device` support more hardware platforms (#21057)
* support more hardware platforms and no longer hard code cuda when call _get_default_process_group_backend_for_device * Apply suggestions from code review --------- Signed-off-by: taozhiwei <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Nicki Skafte Detlefsen <[email protected]> Co-authored-by: Jirka Borovec <[email protected]>
T
taozhiwei committed
119a640e43ee676d8491609f739a31b69857f4fe
Parent: a9deada
Committed by GitHub <[email protected]>
on 8/15/2025, 7:52:30 AM