baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Check if completion_tokens is none in error handler.

Browse source
This commit is contained in:
Andrei Betlen 2023-12-22 13:41:06 -05:00
parent 12b7f2f4e9
commit 99ff175562
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
llama_cpp/server/errors.py
View file

@ -72,7 +72,7 @@ class ErrorResponseFormatters:
return 400, ErrorResponse( return 400, ErrorResponse(
message=message.format( message=message.format(
context_window, context_window,
completion_tokens + prompt_tokens, (completion_tokens or 0) + prompt_tokens,
prompt_tokens, prompt_tokens,
completion_tokens, completion_tokens,
), # type: ignore ), # type: ignore