baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

fixed Llama._create_completion suffix check, it can be either None or str instance (#854)

Browse source
This commit is contained in:
Marko Tasic 2023-11-01 23:52:50 +01:00 committed by GitHub
parent 5f8f369d1b
commit 9c8f4dca5f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
llama_cpp/llama.py
View file

@ -921,6 +921,7 @@ class Llama:
grammar: Optional[LlamaGrammar] = None, grammar: Optional[LlamaGrammar] = None,
) -> Union[Iterator[Completion], Iterator[CompletionChunk]]: ) -> Union[Iterator[Completion], Iterator[CompletionChunk]]:
assert self.ctx is not None assert self.ctx is not None
assert suffix is None or suffix.__class__ is str
completion_id: str = f"cmpl-{str(uuid.uuid4())}" completion_id: str = f"cmpl-{str(uuid.uuid4())}"
created: int = int(time.time()) created: int = int(time.time())