mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 66 Go

feat: allow to run parallel requests (#1290)

* feat: allow to run parallel requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixup

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

Ettore Di Giacinto committed 2y ago

fdd95d1d8695d005f7047bd03fbe6a2257652c60

Parent: 66a558f

Committed by GitHub <noreply@github.com> on 11/16/2023, 7:20:05 AM