ollama/docs
Daniel Hiltgen d7c94e0ca6
Better support for AMD multi-GPU on linux (#7212)
* Better support for AMD multi-GPU

This resolves a number of problems related to AMD multi-GPU setups on linux.

The numeric IDs used by rocm are not the same as the numeric IDs exposed in
sysfs although the ordering is consistent.  We have to count up from the first
valid gfx (major/minor/patch with non-zero values) we find starting at zero.

There are 3 different env vars for selecting GPUs, and only ROCR_VISIBLE_DEVICES
supports UUID based identification, so we should favor that one, and try
to use UUIDs if detected to avoid potential ordering bugs with numeric IDs

* ROCR_VISIBLE_DEVICES only works on linux

Use the numeric ID only HIP_VISIBLE_DEVICES on windows
2024-10-26 14:04:14 -07:00
..
images Fix import image width (#6528) 2024-08-27 14:19:47 -07:00
tutorials update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
api.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
development.md Re-introduce the llama package (#5034) 2024-10-08 08:53:54 -07:00
docker.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
faq.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
gpu.md Better support for AMD multi-GPU on linux (#7212) 2024-10-26 14:04:14 -07:00
import.md fix typo in import docs (#6828) 2024-09-16 11:48:14 -07:00
linux.md docs: improve linux install documentation (#6683) 2024-09-06 22:05:37 -07:00
modelfile.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
openai.md fix #7247 - invalid image input (#7249) 2024-10-23 10:31:04 -07:00
README.md Doc container usage and workaround for nvidia errors 2024-05-09 09:26:45 -07:00
template.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00
troubleshooting.md Verify permissions for AMD GPU (#6736) 2024-09-11 11:38:25 -07:00
tutorials.md Created tutorial for running Ollama on NVIDIA Jetson devices (#1098) 2023-11-15 12:32:37 -05:00
windows.md update default model to llama3.2 (#6959) 2024-09-25 11:11:22 -07:00