Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ examples/fabric/tensor_parallel/model.py November 25, 2024
J
bump python 3.9+ (#20413)
Jirka Borovec committed
May 19, 2024
A
(6/n) Support 2D Parallelism - Trainer example (#19879)
awaelchli committed
May 7, 2024
A
(1/n) Support 2D Parallelism (#19846)
awaelchli committed