baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Fix typo in 70B path

Browse source
This commit is contained in:
Ihsan Soydemir 2023-07-25 20:49:44 +02:00 committed by GitHub
parent c7c700b0d4
commit 0687a3092b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -140,7 +140,7 @@ llm = Llama(model_path="./models/7B/ggml-model.bin", n_ctx=2048)
Llama2 70b must set the `n_gqa` parameter (grouped-query attention factor) to 8 when loading:
```python
llm = Llama(model_path="./models/7B/ggml-model.bin", n_gqa=8)
llm = Llama(model_path="./models/70B/ggml-model.bin", n_gqa=8)
```
## Web Server