Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ tests/plugins/__init__.py October 22, 2020
W
enable ddp as a plugin (#4285)
William Falcon committed
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.