mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

feat(extra-backends): Improvements, adding mamba example (#1618)

* feat(extra-backends): Improvements

vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat

* examples(mamba-chat): add

* docs: update

Ettore Di Giacinto committed 2y ago

06cd9ef98d898818766fec8aa630fe9fa676f6da

Parent: f3d71f8

Committed by GitHub <noreply@github.com> on 1/20/2024, 4:56:08 PM