2023-10-25 21:47:49 +00:00
|
|
|
|
# Ollama on Linux
|
2023-09-25 04:34:44 +00:00
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
## Install
|
2023-09-25 04:38:23 +00:00
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
Install Ollama running this one-liner:
|
|
|
|
|
>
|
2023-10-01 18:51:01 +00:00
|
|
|
|
```bash
|
2023-10-25 21:47:49 +00:00
|
|
|
|
curl https://ollama.ai/install.sh | sh
|
2023-09-25 04:38:23 +00:00
|
|
|
|
```
|
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
## Manual install
|
2023-09-25 04:34:44 +00:00
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
### Download the `ollama` binary
|
2023-09-25 04:34:44 +00:00
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
Ollama is distributed as a self-contained binary. Download it to a directory in your PATH:
|
2023-09-25 04:34:44 +00:00
|
|
|
|
|
2023-10-01 18:51:01 +00:00
|
|
|
|
```bash
|
2023-10-25 21:47:49 +00:00
|
|
|
|
sudo curl -L https://ollama.ai/download/ollama-linux-amd64 -o /usr/bin/ollama
|
|
|
|
|
sudo chmod +x /usr/bin/ollama
|
2023-09-25 04:34:44 +00:00
|
|
|
|
```
|
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
### Adding Ollama as a startup service (recommended)
|
2023-09-25 04:34:44 +00:00
|
|
|
|
|
|
|
|
|
Create a user for Ollama:
|
|
|
|
|
|
2023-10-01 18:51:01 +00:00
|
|
|
|
```bash
|
2023-09-25 04:34:44 +00:00
|
|
|
|
sudo useradd -r -s /bin/false -m -d /usr/share/ollama ollama
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Create a service file in `/etc/systemd/system/ollama.service`:
|
|
|
|
|
|
|
|
|
|
```ini
|
|
|
|
|
[Unit]
|
|
|
|
|
Description=Ollama Service
|
|
|
|
|
After=network-online.target
|
|
|
|
|
|
|
|
|
|
[Service]
|
|
|
|
|
ExecStart=/usr/bin/ollama serve
|
|
|
|
|
User=ollama
|
|
|
|
|
Group=ollama
|
|
|
|
|
Restart=always
|
|
|
|
|
RestartSec=3
|
|
|
|
|
|
|
|
|
|
[Install]
|
|
|
|
|
WantedBy=default.target
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then start the service:
|
|
|
|
|
|
2023-10-01 18:51:01 +00:00
|
|
|
|
```bash
|
2023-09-25 04:34:44 +00:00
|
|
|
|
sudo systemctl daemon-reload
|
|
|
|
|
sudo systemctl enable ollama
|
|
|
|
|
```
|
2023-09-25 23:10:32 +00:00
|
|
|
|
|
2023-10-25 21:47:49 +00:00
|
|
|
|
### Install CUDA drivers (optional – for Nvidia GPUs)
|
|
|
|
|
|
|
|
|
|
[Download and install](https://developer.nvidia.com/cuda-downloads) CUDA.
|
|
|
|
|
|
|
|
|
|
Verify that the drivers are installed by running the following command, which should print details about your GPU:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
nvidia-smi
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
### Start Ollama
|
|
|
|
|
|
|
|
|
|
Start Ollama using `systemd`:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
sudo systemctl start ollama
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## Update
|
|
|
|
|
|
|
|
|
|
Update ollama by running the install script again:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
curl https://ollama.ai/install.sh | sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Or by downloading the ollama binary:
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
sudo curl -L https://ollama.ai/download/ollama-linux-amd64 -o /usr/bin/ollama
|
|
|
|
|
sudo chmod +x /usr/bin/ollama
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## Viewing logs
|
2023-09-25 23:10:32 +00:00
|
|
|
|
|
|
|
|
|
To view logs of Ollama running as a startup service, run:
|
|
|
|
|
|
2023-10-01 18:51:01 +00:00
|
|
|
|
```bash
|
2023-09-25 23:10:32 +00:00
|
|
|
|
journalctl -u ollama
|
|
|
|
|
```
|
2023-10-24 18:07:05 +00:00
|
|
|
|
|
|
|
|
|
## Uninstall
|
|
|
|
|
|
|
|
|
|
Remove the ollama service:
|
2023-10-25 21:47:49 +00:00
|
|
|
|
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```bash
|
2023-10-25 21:47:49 +00:00
|
|
|
|
sudo systemctl stop ollama
|
|
|
|
|
sudo systemctl disable ollama
|
|
|
|
|
sudo rm /etc/systemd/system/ollama.service
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Remove the ollama binary from your bin directory (either `/usr/local/bin`, `/usr/bin`, or `/bin`):
|
2023-10-25 21:47:49 +00:00
|
|
|
|
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```bash
|
2023-10-25 21:47:49 +00:00
|
|
|
|
sudo rm $(which ollama)
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```
|
|
|
|
|
|
2024-01-12 05:07:00 +00:00
|
|
|
|
Remove the downloaded models and Ollama service user and group:
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```bash
|
2023-10-25 21:47:49 +00:00
|
|
|
|
sudo rm -r /usr/share/ollama
|
|
|
|
|
sudo userdel ollama
|
2024-01-12 05:07:00 +00:00
|
|
|
|
sudo groupdel ollama
|
2023-10-24 18:07:05 +00:00
|
|
|
|
```
|