mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

feat(llama.cpp): allow to set cache-ram and ctx_shift (#7009)

* feat(llama.cpp): allow to set cache-ram and ctx_shift

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

Ettore Di Giacinto committed 7mo ago

424acd66adab533cf4bd7e687d49dc68a45b7a39

Parent: 3cd8234

Committed by GitHub <noreply@github.com> on 11/2/2025, 4:33:29 PM