mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

feat: queue up requests if not running parallel requests (#1296)

Return a GRPC which handles a lock in case it is not meant to be
parallel.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

Ettore Di Giacinto committed 2y ago

548959b50fd9218d0276fc41710b516dab8ae848

Parent: 2addb9f

Committed by GitHub <noreply@github.com> on 11/16/2023, 9:20:16 PM