ollama/docs/tutorials/nvidia-jetson.md

Running Ollama on NVIDIA Jetson Devices

Ollama runs well on NVIDIA Jetson Devices and should run out of the box with the standard installation instructions.

The following has been tested on JetPack 5.1.2, but should also work on JetPack 6.0.

• Install Ollama via standard Linux command (ignore the 404 error): curl https://ollama.com/install.sh | sh
• Pull the model you want to use (e.g. mistral): ollama pull mistral
• Start an interactive session: ollama run mistral

And that's it!

Running Ollama in Docker

When running GPU accelerated applications in Docker, it is highly recommended to use dusty-nv jetson-containers repo.