baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

docs: Update README to include CUDA 12.4 wheels

Browse source
This commit is contained in:
Andrei Betlen 2024-04-30 03:12:46 -04:00
parent f417cce28a
commit c8cd8c17c6
1 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -121,7 +121,7 @@ CMAKE_ARGS="-DLLAMA_CUDA=on" pip install llama-cpp-python
It is also possible to install a pre-built wheel with CUDA support. As long as your system meets some requirements: It is also possible to install a pre-built wheel with CUDA support. As long as your system meets some requirements:
- CUDA Version is 12.1, 12.2 or 12.3 - CUDA Version is 12.1, 12.2, 12.3, or 12.4
- Python Version is 3.10, 3.11 or 3.12 - Python Version is 3.10, 3.11 or 3.12
```bash ```bash
@ -133,6 +133,7 @@ Where `<cuda-version>` is one of the following:
- `cu121`: CUDA 12.1 - `cu121`: CUDA 12.1
- `cu122`: CUDA 12.2 - `cu122`: CUDA 12.2
- `cu123`: CUDA 12.3 - `cu123`: CUDA 12.3
- `cu124`: CUDA 12.4
For example, to install the CUDA 12.1 wheel: For example, to install the CUDA 12.1 wheel: