llama.cpp/llama_cpp/server
khimaros b73c73c0c6
feat: add disable_ping_events flag (#1257)
for backward compatibility, this is false by default

it can be set to true to disable EventSource pings
which are not supported by some OpenAI clients.

fixes https://github.com/abetlen/llama-cpp-python/issues/1256
2024-04-17 10:08:19 -04:00
..
__init__.py llama_cpp server: app is now importable, still runnable as a module 2023-04-29 11:41:25 -07:00
__main__.py feat: Add support for yaml based configs 2024-04-10 02:47:01 -04:00
app.py feat: add disable_ping_events flag (#1257) 2024-04-17 10:08:19 -04:00
cli.py Fix python3.8 support 2024-01-19 08:17:49 -05:00
errors.py misc: Format 2024-02-28 14:27:40 -05:00
model.py feat: add support for KV cache quantization options (#1307) 2024-04-01 10:19:28 -04:00
settings.py feat: add disable_ping_events flag (#1257) 2024-04-17 10:08:19 -04:00
types.py feat: Add logprobs support to chat completions (#1311) 2024-03-31 13:30:13 -04:00