mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

Add tensor_parallel_size setting to vllm setting items (#2085)

Signed-off-by: Taikono-Himazin <kazu@po.harenet.ne.jp>

Taikono-Himazin committed 2y ago

03adc1f60d97ae7cd5d3b1e58c5511e36c5f4eba

Parent: b319ed5

Committed by GitHub <noreply@github.com> on 4/20/2024, 2:37:02 PM