Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ tests/plugins/test_double_plugin.py June 1, 2021
E
Fix double precision + ddp_spawn (#6924)
Ethan Harris committed
April 20, 2021
T
[bugfix] Add set_default_tensor_type to torch.DoubleTensor with precision=64 (#7108)
thomas chaton committed
March 30, 2021
T
DeepSpeed ZeRO Update (#6546)
thomas chaton committed
March 24, 2021
E
Feature/double precision (#6595)
Ethan Harris committed