Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ examples/pytorch/tensor_parallel/data.py May 19, 2024
A
(6/n) Support 2D Parallelism - Trainer example (#19879)
awaelchli committed
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.