llama.cpp/examples/notebooks
Andrei 3af7b21ff1
Add functionary support (#784)
* Add common grammars and json-schema-to-grammar utility function from llama.cpp

* Pass functions to format function

* Add basic functionary formatting

* Add LlamaChatHandler for more complex chat use cases

* Add function calling example notebook

* Add support for regular chat completions alongside function calling
2023-11-03 02:12:14 -04:00
..
Batching.ipynb Migrate inference to llama_batch and llama_decode api (#795) 2023-11-02 20:13:57 -04:00
Clients.ipynb Add clients example. Closes #46 2023-04-08 09:35:32 -04:00
Functions.ipynb Add functionary support (#784) 2023-11-03 02:12:14 -04:00
Guidance.ipynb Add Guidance example 2023-05-19 03:16:58 -04:00
PerformanceTuning.ipynb Add performance tuning notebook 2023-04-05 04:09:19 -04:00