Making large AI models cheaper, faster and more accessible
[zero] support all-gather overlap (#5898)
* [zero] support all-gather overlap * [zero] add overlap all-gather flag * [misc] fix typo * [zero] update api
H
Hongxin Liu committed
c068ef0fa0777c57cb756dbba61ce9ca49e5f5b6
Parent: dd9e1cd
Committed by GitHub <noreply@github.com>
on 7/11/2024, 10:59:59 AM