From 90860b6a7e1cd8ce6a200ff39f9779041d3726e3 Mon Sep 17 00:00:00 2001 From: Michael Yang Date: Fri, 17 Nov 2023 08:42:58 -0800 Subject: [PATCH] update faq (#1176) --- docs/faq.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/docs/faq.md b/docs/faq.md index f95137fe..1beb95a1 100644 --- a/docs/faq.md +++ b/docs/faq.md @@ -148,3 +148,9 @@ Build and run this image: docker build -t ollama-with-ca . docker run -d -e HTTPS_PROXY=https://my.proxy.example.com -p 11434:11434 ollama-with-ca ``` + +### How do I use Ollama with GPU acceleration in Docker? + +The Ollama Docker container can be configured with GPU acceleration in Linux or Windows (with WSL2). This requires the [nvidia-container-toolkit](https://github.com/NVIDIA/nvidia-container-toolkit). + +GPU acceleration is not available for Docker Desktop in macOS due to the lack of GPU passthrough and emulation.