Making large AI models cheaper, faster and more accessible
COMMITS
/ extensions/csrc/common/micros.h April 24, 2024
April 1, 2024
傅
[Inference] Add Reduce Utils (#5537)
傅剑寒 committed
March 28, 2024
Y
The writing style of tail processing and the logic related to macro definitions have been optimized. (#5519)
yuehuayingxueluo committed
March 25, 2024
Y
[Inference]Support FP16/BF16 Flash Attention 2 And Add high_precision Flag To Rotary Embedding (#5461)
yuehuayingxueluo committed
March 8, 2024
X
refactor code
xs_courtesy committed