feat: Generic chatml Function Calling (#957)
* Add demo notebook * Add initial chat handler * Update OpenAI types * Add generic chatml function calling (wip) * Update chatml generic function calling. * Progress on auto-tool calls * fix streaming functions * Remove print statements * fix: Suppress output from llama.cpp init and grammar creation * Add OpenAI v1 python api compatible chat completion function * Support non-streaming multi-tool calls * Format * Include function_call in response.
A
Andrei committed
153a0049d90329dec2fc44628fdc6fc8c5f31ae4
Parent: 69413ce
Committed by GitHub <noreply@github.com>
on 2/12/2024, 8:56:07 PM