SIGN IN SIGN UP

feat: Generic chatml Function Calling (#957)

* Add demo notebook

* Add initial chat handler

* Update OpenAI types

* Add generic chatml function calling (wip)

* Update chatml generic function calling.

* Progress on auto-tool calls

* fix streaming functions

* Remove print statements

* fix: Suppress output from llama.cpp init and grammar creation

* Add OpenAI v1 python api compatible chat completion function

* Support non-streaming multi-tool calls

* Format

* Include function_call in response.
A
Andrei committed
153a0049d90329dec2fc44628fdc6fc8c5f31ae4
Parent: 69413ce
Committed by GitHub <noreply@github.com> on 2/12/2024, 8:56:07 PM