5ab40e6167
* Support multiple chat templates - step 1 As a first step, allow user to to select template from metadata with chat_format parameter in the form of `chat_template.name`. * register chat templates to self.chat_formats instead of globally * Don't expose internal chat handlers yet --------- Co-authored-by: Andrei <abetlen@gmail.com> |
||
|---|---|---|
| .. | ||
| server | ||
| __init__.py | ||
| _internals.py | ||
| _logger.py | ||
| _utils.py | ||
| llama.py | ||
| llama_cache.py | ||
| llama_chat_format.py | ||
| llama_cpp.py | ||
| llama_grammar.py | ||
| llama_speculative.py | ||
| llama_tokenizer.py | ||
| llama_types.py | ||
| llava_cpp.py | ||
| py.typed | ||