No description
Find a file
2023-07-18 17:25:19 -07:00
api add new list command (#97) 2023-07-18 09:09:45 -07:00
app app: use llama2 instead of orca 2023-07-18 12:36:03 -07:00
cmd fix mkdir blob path 2023-07-18 11:24:19 -07:00
docs First stab at a modelfile doc 2023-07-18 08:22:17 -07:00
examples add mario example 2023-07-18 14:27:36 -07:00
format add new list command (#97) 2023-07-18 09:09:45 -07:00
llama fix multibyte responses 2023-07-14 20:11:44 -07:00
parser convert commands to uppercase in parser 2023-07-17 15:34:08 -07:00
scripts build app in publish script 2023-07-12 19:16:39 -07:00
server Merge pull request #109 from jmorganca/fix-create-memory 2023-07-18 17:25:19 -07:00
web web: fix typos and add link to discord 2023-07-18 17:03:40 -07:00
.dockerignore update Dockerfile 2023-07-06 16:34:44 -04:00
.gitignore fix compilation issue in Dockerfile, remove from README.md until ready 2023-07-11 19:51:08 -07:00
.prettierrc.json move .prettierrc.json to root 2023-07-02 17:34:46 -04:00
Dockerfile fix compilation issue in Dockerfile, remove from README.md until ready 2023-07-11 19:51:08 -07:00
ggml-metal.metal look for ggml-metal in the same directory as the binary 2023-07-11 15:58:56 -07:00
go.mod add new list command (#97) 2023-07-18 09:09:45 -07:00
go.sum add new list command (#97) 2023-07-18 09:09:45 -07:00
LICENSE proto -> ollama 2023-06-26 15:57:13 -04:00
main.go continue conversation 2023-07-13 17:13:00 -07:00
models.json update vicuna model 2023-07-12 09:42:26 -07:00
README.md README typo fix (#106) 2023-07-18 16:24:57 -07:00

logo

Ollama

Create, run, and share self-contained large language models (LLMs). Ollama bundles a models weights, configuration, prompts, and more into self-contained packages that run anywhere.

Note: Ollama is in early preview. Please report any issues you find.

Download

  • Download for macOS on Apple Silicon (Intel coming soon)
  • Download for Windows and Linux (coming soon)
  • Build from source

Examples

Quickstart

ollama run llama2
>>> hi
Hello! How can I help you today?

Creating a custom model

Create a Modelfile:

FROM llama2
PROMPT """
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.

User: {{ .Prompt }}
Mario:
"""

Next, create and run the model:

ollama create mario -f ./Modelfile
ollama run mario
>>> hi
Hello! It's your friend Mario.

Model library

Ollama includes a library of open-source, pre-trained models. More models are coming soon.

Model Parameters Size Download
Llama2 7B 3.8GB ollama pull llama2
Orca Mini 3B 1.9GB ollama pull orca
Vicuna 7B 3.8GB ollama pull vicuna
Nous-Hermes 13B 7.3GB ollama pull nous-hermes

Building

go build .

To run it start the server:

./ollama server &

Finally, run a model!

./ollama run llama2