Morph MORPH
SIGN IN SIGN UP
mudler / LocalAI UNCLAIMED

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

0 0 66 Go

COMMITS

/ core/backend/llm.go
master
May 30, 2026
L
feat: prefix-cache-aware routing for distributed mode (#10071)
LocalAI [bot] committed
a44bdb2
May 25, 2026
L
feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)
LocalAI [bot] committed
06e777b
May 23, 2026
L
fix(traces): cap backend trace Data to keep admin UI responsive (#9960)
LocalAI [bot] committed
1198d10
May 18, 2026
R
feat(gallery): verify backend OCI images with keyless cosign (#9823)
Richard Palethorpe committed
5d0b549
April 21, 2026
L
Respect explicit reasoning config during GGUF thinking probe (#9463)
leinasi2014 committed
d18d434
April 18, 2026
E
fix(vision): propagate mtmd media marker from backend via ModelMetadata (#9412)
Ettore Di Giacinto committed
7809c5f
April 4, 2026
E
feat(autoparser): prefer chat deltas from backends when emitted (#9224)
Ettore Di Giacinto committed
716ddd6
March 29, 2026
E
feat: add distributed mode (#9124)
Ettore Di Giacinto committed
59108fb
March 18, 2026
R
feat(ui): Per model backend logs and various fixes (#9028)
Richard Palethorpe committed
35d509d
March 16, 2026
E
chore: refactor endpoints to use same inferencing path, add automatic retrial mechanism in case of errors (#9029)
Ettore Di Giacinto committed
ee96e5e
March 13, 2026
R
feat(realtime): WebRTC support (#8790)
Richard Palethorpe committed
f9a850c
March 8, 2026
E
feat(functions): add peg-based parsing and allow backends to return tool calls directly (#8838)
Ettore Di Giacinto committed
b2f81bf
March 5, 2026
E
feat: pass-by metadata to predict options (#8795)
Ettore Di Giacinto committed
580517f
February 20, 2026
R
feat(traces): Add backend traces (#8609)
Richard Palethorpe committed
51eec4e
January 22, 2026
E
feat: detect thinking support from backend automatically if not explicitly set (#8167)
Ettore Di Giacinto committed
c0b21a9
December 21, 2025
E
chore(refactor): move logging to common package based on slog (#7668)
Ettore Di Giacinto committed
c37785b
December 12, 2025
E
feat(loader): enhance single active backend to support LRU eviction (#7535)
Ettore Di Giacinto committed
fc5b9eb
November 16, 2025
E
feat: add support to logitbias and logprobs (#7283)
Ettore Di Giacinto committed
d7f9f3a
November 13, 2025
E
feat(ui): allow to cancel ops (#7264)
Ettore Di Giacinto committed
735ca75
November 7, 2025
E
feat(llama.cpp): consolidate options and respect tokenizer template when enabled (#7120)
Ettore Di Giacinto committed
02cc8cb
August 28, 2025
E
fix: register backends to model-loader during installation (#6159)
Ettore Di Giacinto committed
79a41a5
August 14, 2025
E
feat(backends): add system backend, refactor (#6059)
Ettore Di Giacinto committed
089efe0
June 29, 2025
E
fix(gallery): automatically install model from name (#5757)
Ettore Di Giacinto committed
33f9ee0
June 27, 2025
E
feat(gallery): automatically install missing backends along models (#5736)
Ettore Di Giacinto committed
bb54f2d
May 31, 2025
E
fix(streaming): stream complete runes (#5539)
Ettore Di Giacinto committed
3bac472
May 25, 2025
R
feat: Realtime API support reboot (#5392)
Richard Palethorpe committed
bf6426a
April 1, 2025
E
feat(loader): enhance single active backend by treating as singleton (#5107)
Ettore Di Giacinto committed
2c425e9
March 2, 2025
E
feat: allow to specify a reply prefix (#4931)
Ettore Di Giacinto committed
a7b4001
February 10, 2025
D
feat: Centralized Request Processing middleware (#3847)
Dave committed
3cddf24
January 17, 2025
M
feat: add machine tag and inference timings (#4577)
mintyleaf committed
96f8ec0
December 18, 2024
M
feat: stream tokens usage (#4415)
mintyleaf committed
2bc4b56
December 8, 2024
E
Revert "feat: include tokens usage for streamed output" (#4336)
Ettore Di Giacinto committed
f943c4b
November 28, 2024
M
feat: include tokens usage for streamed output (#4282)
mintyleaf committed
0d6c3a7
November 8, 2024
E
chore(refactor): drop unnecessary code in loader (#4096)
Ettore Di Giacinto committed
6daef00
October 17, 2024
E
feat(templates): extract text from multimodal requests (#3866)
Ettore Di Giacinto committed
d5da8c3
October 2, 2024
E
feat: track internally started models by ID (#3693)
Ettore Di Giacinto committed
0965c6c
September 22, 2024
S
feat: auto load into memory on startup (#3627)
Sertaç Özercan committed
ee21b00
September 19, 2024
E
feat(api): allow to pass audios to backends (#3603)
Ettore Di Giacinto committed
191bc2e
E
feat(api): allow to pass videos to backends (#3601)
Ettore Di Giacinto committed
fbb9fac
September 13, 2024
E
feat: extract output with regexes from LLMs (#3491)
Ettore Di Giacinto committed
cf747bc
August 24, 2024
D
feat: elevenlabs `sound-generation` api (#3355)
Dave committed
81ae92f
July 10, 2024
D
feat: HF `/scan` endpoint (#2566)
Dave committed
133987b
June 24, 2024
E
refactor: gallery inconsistencies (#2647)
Ettore Di Giacinto committed
a181dd0
June 23, 2024
S
chore: fix go.mod module (#2635)
Sertaç Özercan committed
5866fc8
June 13, 2024
E
feat(gallery): uniform download from CLI (#2559)
Ettore Di Giacinto committed
7b20551
April 17, 2024
E
Revert #1963 (#2056)
Ettore Di Giacinto committed
af9e5a2
April 15, 2024
E
feat(grpc): return consumed token count and update response accordingly (#2035)
Ettore Di Giacinto committed
e843d7d
April 13, 2024
D
refactor: backend/service split, channel-based llm flow (#1963)
Dave committed
eed5706
April 11, 2024
L
feat: use tokenizer.apply_chat_template() in vLLM (#1990)
Ludovic Leroux committed
12c0d94
March 13, 2024
E
fix(config): set better defaults for inferencing (#1822)
Ettore Di Giacinto committed
f895d06