feat: Support batch embeddings (#1186)
* handle batched embeddings * fix normalization issue * fix type hints, ensure no breaking changes to embed * Clear kv cache / reset internal state after embedding complete --------- Co-authored-by: Andrei <abetlen@gmail.com>
D
Douglas Hanley committed
d7a67917ba5b601e146377c6d877893dc49bba83
Parent: 36b8432
Committed by GitHub <noreply@github.com>
on 2/14/2024, 9:26:09 AM