baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Enable logprobs on completion endpoint

Browse source
This commit is contained in:
Andrei Betlen 2023-04-12 19:08:11 -04:00
parent 19598ac4e8
commit 0daf16defc
1 changed files with 0 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
llama_cpp/server/__main__.py
View file

@ -118,7 +118,6 @@ def create_completion(request: CreateCompletionRequest, llama: llama_cpp.Llama=D
exclude={ exclude={
"model", "model",
"n", "n",
"logprobs",
"frequency_penalty", "frequency_penalty",
"presence_penalty", "presence_penalty",
"best_of", "best_of",