Development

ollama is built and run using Poetry.

Running

Start backend service:

Install dependencies:

poetry install --extras server

Run a server:

poetry run ollama serve

If using Apple silicon, you need a Python version that supports arm64:

wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh

Get the dependencies:

poetry install --extras server

Then build a binary for your current platform:

poetry build

In the root directory, run:

pipreqs . --force