Making large AI models cheaper, faster and more accessible
[Tensor] initialize the ColoOptimizer (#898)
* [Tensor] activation is an attr of ColoTensor * [Tensor] add optimizer * only detach parameters in context * polish code
J
Jiarui Fang committed
d16671da75ccb6aecacb2a15826a6d34367373d1
Parent: 676f191
Committed by GitHub <noreply@github.com>
on 4/28/2022, 7:23:40 AM