baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Fix example documentation

Browse source
This commit is contained in:
Andrei Betlen 2023-04-01 17:39:35 -04:00
parent a836639822
commit eef627c09c
1 changed files with 5 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
llama_cpp/llama.py
View file

@ -127,10 +127,11 @@ class Llama:
]: ]:
"""Generate tokens. """Generate tokens.
>>> llama = Llama("models/117M") Examples:
>>> tokens = llama.tokenize(b"Hello, world!") >>> llama = Llama("models/ggml-7b.bin")
>>> for token in llama.generate(tokens, top_k=40, top_p=0.95, temp=1.0, repeat_penalty=1.1): >>> tokens = llama.tokenize(b"Hello, world!")
... print(llama.detokenize([token])) >>> for token in llama.generate(tokens, top_k=40, top_p=0.95, temp=1.0, repeat_penalty=1.1):
... print(llama.detokenize([token]))
Args: Args:
tokens: The prompt tokens. tokens: The prompt tokens.