baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Merge branch 'main' into v0.2-wip

Browse source
This commit is contained in:
Andrei 2023-07-18 18:54:27 -04:00 committed by GitHub
commit 5eab1db0d0
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 21 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

21
README.md
View file

@ -71,6 +71,27 @@ To install with Metal (MPS), set the `LLAMA_METAL=on` environment variable befor
CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python
``` ```
#### Windows remarks
To set the variables `CMAKE_ARGS` and `FORCE_CMAKE` in PowerShell, follow the next steps (Example using, OpenBLAS):
```ps
$env:CMAKE_ARGS = "-DLLAMA_OPENBLAS=on"
```
```ps
$env:FORCE_CMAKE = 1
```
Then, call `pip` after setting the variables:
```
pip install llama-cpp-python
```
See the above instructions and set `CMAKE_ARGS` to the BLAS backend you want to use.
#### MacOS remarks
Detailed MacOS Metal GPU install documentation is available at [docs/install/macos.md](docs/install/macos.md) Detailed MacOS Metal GPU install documentation is available at [docs/install/macos.md](docs/install/macos.md)
## High-level API ## High-level API