Making large AI models cheaper, faster and more accessible
[lora] add lora APIs for booster, support lora for TorchDDP (#4981)
* add apis and peft requirement * add liscense and implement apis * add checkpointio apis * add torchddp fwd_bwd test * add support_lora methods * add checkpointio test and debug * delete unneeded codes * remove peft from LICENSE * add concrete methods for enable_lora * simplify enable_lora api * fix requirements
B
Baizhou Zhang committed
14b0d4c7e5340b475d75319a43bbdb77b7fcc7a5
Parent: c1594e4
Committed by Hongxin Liu <lhx0217@gmail.com>
on 4/28/2024, 2:51:27 AM