chore: add note for Mac m1 installation

This commit is contained in:
Anchen 2023-05-15 20:46:59 +10:00 committed by GitHub
parent c804efe3f0
commit 3718799b37
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -26,6 +26,12 @@ pip install llama-cpp-python
The above command will attempt to install the package and build build `llama.cpp` from source. The above command will attempt to install the package and build build `llama.cpp` from source.
This is the recommended installation method as it ensures that `llama.cpp` is built with the available optimizations for your system. This is the recommended installation method as it ensures that `llama.cpp` is built with the available optimizations for your system.
Note: If you are using Apple Silicon (M1) Mac, make sure you have installed a version of Python that supports arm64 architecture. For example:
```
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh
```
Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.
### Installation with OpenBLAS / cuBLAS / CLBlast ### Installation with OpenBLAS / cuBLAS / CLBlast