SIGN IN SIGN UP
mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 70 Go

fix(doc/examples): set defaults to mirostat (#1820)

The default sampler on some models don't return enough candidates which
leads to a false sense of randomness. Tracing back the code it looks
that with the temperature sampler there might not be enough
candidates to pick from, and since the seed and "randomness" take effect
while picking a good candidate this yields to the same results over and
over.

Fixes https://github.com/mudler/LocalAI/issues/1723 by updating the
examples and documentation to use mirostat instead.
E
Ettore Di Giacinto committed
bc8f648a91a2f07b061b3ae1ee1944131c61cda2
Parent: 8e57f4d
Committed by GitHub <noreply@github.com> on 3/11/2024, 6:49:03 PM