mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 66 Go

fix(base-grpc): close channel in base grpc server (#3734)

If the LLM does not implement any logic for PredictStream, we close the
channel immediately to not leave the process hanging.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

Ettore Di Giacinto committed 1y ago

092bb0bd6b071daeb5d3b57fd0c0cb2853389efb

Parent: e28e808

Committed by GitHub <noreply@github.com> on 10/5/2024, 1:14:27 PM