server : enable KV cache defrag by default (#10233)
ggml-ci
G
Georgi Gerganov committed
b141e5f6efbab3a00633df88c4f9425bfe8b78ab
Parent: 4b3a921
Committed by GitHub <noreply@github.com>
on 11/11/2024, 6:38:43 AM