mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

fix(vllm): set default top_p with vllm (#1078)

**Description**

This PR fixes vllm when called with a request with an empty top_p

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

Ettore Di Giacinto committed 2y ago

453e9c5da99c1ea7225f5a22a466b88b96574f3c

Parent: 3a69bd3

Committed by GitHub <noreply@github.com> on 9/19/2023, 4:10:23 PM