Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ tests/plugins/test_custom_plugin.py April 15, 2021
E
Add typings for evaluation_loop.py and remove some dead code (#7015)
Ethan Harris committed
April 7, 2021
S
Supporting Adding DDP Communication Hooks (#6736)
shuyingsunshine21 committed
March 19, 2021
A
Automatically set sync_batchnorm for training_type_plugin (#6536)
Amog Kamsetty committed