mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 64 Go

feat(shutdown): allow force shutdown of backends (#3733)

We default to a soft kill, however, we might want to force killing
backends after a while to avoid hanging requests (which may hallucinate
indefinetly)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

Ettore Di Giacinto committed 1y ago

e28e80857b1aebbb8bb57c88664e9cdcddb60150

Parent: 905473c

Committed by GitHub <noreply@github.com> on 10/5/2024, 8:41:35 AM