mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 66 Go

feat: add flash-attn in nvidia and rocm envs (#1995)

Signed-off-by: Ludovic LEROUX <ludovic@inpher.io>

Ludovic Leroux committed 2y ago

b4548ad72dc31a00a2a819c3bf540012bf11432a

Parent: e152b07

Committed by GitHub <noreply@github.com> on 4/11/2024, 7:44:39 AM