SIGN IN SIGN UP
hpcaitech / ColossalAI UNCLAIMED

Making large AI models cheaper, faster and more accessible

0 0 96 Python

[shardformer] Support customized policy for llamav2 based model with HybridParallelPlugin (#4624)

* Enable policy assignment in HybridPlugin and enable llama policy for llamav2

* Remove Policy from Plugin

* revert changes of plugin

HybridParallelModule

* revert changes in plugin

* upgrade transformers

* revert transformers version

---------

Co-authored-by: flybird11111 <1829166702@qq.com>
E
eric8607242 committed
c3d5fa3bac85baa07e30e2978a7517034ba7e0aa
Parent: 9709b8f
Committed by GitHub <noreply@github.com> on 9/7/2023, 2:15:13 AM