llama.cpp/examples/notebooks
Andrei 153a0049d9
feat: Generic chatml Function Calling (#957)
* Add demo notebook

* Add initial chat handler

* Update OpenAI types

* Add generic chatml function calling (wip)

* Update chatml generic function calling.

* Progress on auto-tool calls

* fix streaming functions

* Remove print statements

* fix: Suppress output from llama.cpp init and grammar creation

* Add OpenAI v1 python api compatible chat completion function

* Support non-streaming multi-tool calls

* Format

* Include function_call in response.
2024-02-12 15:56:07 -05:00
..
Batching.ipynb Migrate inference to llama_batch and llama_decode api (#795) 2023-11-02 20:13:57 -04:00
Clients.ipynb Add clients example. Closes #46 2023-04-08 09:35:32 -04:00
Functions.ipynb Update Functions notebook 2023-11-10 13:02:30 -05:00
Guidance.ipynb Add Guidance example 2023-05-19 03:16:58 -04:00
Multimodal.ipynb Update Multimodal notebook 2023-11-08 00:48:25 -05:00
OpenHermesFunctionCalling.ipynb feat: Generic chatml Function Calling (#957) 2024-02-12 15:56:07 -05:00
PerformanceTuning.ipynb Add performance tuning notebook 2023-04-05 04:09:19 -04:00