2023-07-18 19:45:38 +00:00
< div align = "center" >
2024-05-01 17:39:38 +00:00
< img alt = "ollama" height = "200px" src = "https://github.com/ollama/ollama/assets/3325447/0d0b44e2-8f4a-4e99-9b52-a5c1c741c8f7" >
2023-07-18 19:45:38 +00:00
< / div >
2023-07-05 19:37:33 +00:00
2023-06-27 16:08:52 +00:00
# Ollama
2023-06-22 16:45:31 +00:00
2023-07-19 19:31:48 +00:00
[](https://discord.gg/ollama)
2023-07-19 19:28:50 +00:00
2024-06-04 20:25:25 +00:00
Get up and running with large language models.
2023-07-20 15:33:28 +00:00
2023-09-26 06:44:53 +00:00
### macOS
2023-08-08 22:50:23 +00:00
2024-02-09 23:19:30 +00:00
[Download ](https://ollama.com/download/Ollama-darwin.zip )
2023-07-18 20:31:25 +00:00
2024-10-30 16:24:59 +00:00
### Windows
2023-10-15 06:23:03 +00:00
2024-02-15 18:32:40 +00:00
[Download ](https://ollama.com/download/OllamaSetup.exe )
2023-10-15 06:23:03 +00:00
2024-02-15 18:32:40 +00:00
### Linux
2023-09-26 06:44:53 +00:00
```
2024-02-09 23:19:30 +00:00
curl -fsSL https://ollama.com/install.sh | sh
2023-09-26 06:44:53 +00:00
```
2024-03-26 20:04:17 +00:00
[Manual install instructions ](https://github.com/ollama/ollama/blob/main/docs/linux.md )
2023-09-26 06:44:53 +00:00
2023-10-15 06:23:03 +00:00
### Docker
2023-09-26 06:44:53 +00:00
2023-11-04 19:24:24 +00:00
The official [Ollama Docker image ](https://hub.docker.com/r/ollama/ollama ) `ollama/ollama` is available on Docker Hub.
2023-07-18 20:31:25 +00:00
2024-01-24 00:08:15 +00:00
### Libraries
- [ollama-python ](https://github.com/ollama/ollama-python )
- [ollama-js ](https://github.com/ollama/ollama-js )
2023-07-19 19:28:50 +00:00
## Quickstart
2024-09-25 18:11:22 +00:00
To run and chat with [Llama 3.2 ](https://ollama.com/library/llama3.2 ):
2023-07-19 19:28:50 +00:00
```
2024-09-25 18:11:22 +00:00
ollama run llama3.2
2023-07-19 19:28:50 +00:00
```
## Model library
2024-02-20 01:15:24 +00:00
Ollama supports a list of models available on [ollama.com/library ](https://ollama.com/library 'ollama model library' )
2023-08-17 02:53:27 +00:00
2024-02-20 01:15:24 +00:00
Here are some example models that can be downloaded:
2023-07-19 19:28:50 +00:00
2024-11-10 21:36:25 +00:00
| Model | Parameters | Size | Download |
| ------------------ | ---------- | ----- | -------------------------------- |
| Llama 3.2 | 3B | 2.0GB | `ollama run llama3.2` |
| Llama 3.2 | 1B | 1.3GB | `ollama run llama3.2:1b` |
| Llama 3.2 Vision | 11B | 7.9GB | `ollama run llama3.2-vision` |
| Llama 3.2 Vision | 90B | 55GB | `ollama run llama3.2-vision:90b` |
| Llama 3.1 | 8B | 4.7GB | `ollama run llama3.1` |
| Llama 3.1 | 70B | 40GB | `ollama run llama3.1:70b` |
| Llama 3.1 | 405B | 231GB | `ollama run llama3.1:405b` |
| Phi 3 Mini | 3.8B | 2.3GB | `ollama run phi3` |
| Phi 3 Medium | 14B | 7.9GB | `ollama run phi3:medium` |
| Gemma 2 | 2B | 1.6GB | `ollama run gemma2:2b` |
| Gemma 2 | 9B | 5.5GB | `ollama run gemma2` |
| Gemma 2 | 27B | 16GB | `ollama run gemma2:27b` |
| Mistral | 7B | 4.1GB | `ollama run mistral` |
| Moondream 2 | 1.4B | 829MB | `ollama run moondream` |
| Neural Chat | 7B | 4.1GB | `ollama run neural-chat` |
| Starling | 7B | 4.1GB | `ollama run starling-lm` |
| Code Llama | 7B | 3.8GB | `ollama run codellama` |
| Llama 2 Uncensored | 7B | 3.8GB | `ollama run llama2-uncensored` |
| LLaVA | 7B | 4.5GB | `ollama run llava` |
| Solar | 10.7B | 6.1GB | `ollama run solar` |
2023-07-19 19:28:50 +00:00
2024-07-22 20:34:56 +00:00
> [!NOTE]
> You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models.
2023-07-20 19:21:29 +00:00
2023-12-23 16:18:12 +00:00
## Customize a model
2023-06-27 21:13:07 +00:00
2023-10-15 06:23:03 +00:00
### Import from GGUF
2023-09-01 14:54:31 +00:00
2023-10-15 06:23:03 +00:00
Ollama supports importing GGUF models in the Modelfile:
2023-09-01 14:54:31 +00:00
2023-10-15 06:23:03 +00:00
1. Create a file named `Modelfile` , with a `FROM` instruction with the local filepath to the model you want to import.
2023-09-01 14:54:31 +00:00
2023-09-26 06:44:53 +00:00
```
FROM ./vicuna-33b.Q4_0.gguf
```
2023-06-30 16:39:25 +00:00
2023-10-11 23:24:06 +00:00
2. Create the model in Ollama
2023-06-22 16:45:31 +00:00
2023-09-26 06:44:53 +00:00
```
2023-10-15 06:23:03 +00:00
ollama create example -f Modelfile
2023-09-26 06:44:53 +00:00
```
2023-08-10 15:22:28 +00:00
2023-10-11 23:24:06 +00:00
3. Run the model
2023-09-01 20:44:14 +00:00
2023-09-26 06:44:53 +00:00
```
2023-10-15 06:23:03 +00:00
ollama run example
2023-09-26 06:44:53 +00:00
```
2023-09-01 20:44:14 +00:00
2023-10-15 06:23:03 +00:00
### Import from PyTorch or Safetensors
See the [guide ](docs/import.md ) on importing models for more information.
2023-09-26 06:44:53 +00:00
### Customize a prompt
2023-09-01 20:44:14 +00:00
2024-09-25 18:11:22 +00:00
Models from the Ollama library can be customized with a prompt. For example, to customize the `llama3.2` model:
2023-07-19 19:28:50 +00:00
```
2024-09-25 18:11:22 +00:00
ollama pull llama3.2
2023-07-19 19:28:50 +00:00
```
2023-08-08 22:41:48 +00:00
2023-07-18 20:22:33 +00:00
Create a `Modelfile` :
2023-07-05 19:37:33 +00:00
2023-06-30 16:31:00 +00:00
```
2024-09-25 18:11:22 +00:00
FROM llama3.2
2023-07-20 15:17:09 +00:00
# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1
2023-12-12 19:43:19 +00:00
# set the system message
2023-07-20 09:21:51 +00:00
SYSTEM """
2023-07-18 20:32:06 +00:00
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
2023-07-18 20:22:33 +00:00
"""
2023-06-29 22:25:02 +00:00
```
2023-07-07 20:14:58 +00:00
2023-07-18 20:22:33 +00:00
Next, create and run the model:
2023-07-07 20:14:58 +00:00
```
2023-07-18 20:22:33 +00:00
ollama create mario -f ./Modelfile
ollama run mario
>>> hi
Hello! It's your friend Mario.
2023-07-07 20:14:58 +00:00
```
2023-10-11 23:24:06 +00:00
For more examples, see the [examples ](examples ) directory. For more information on working with a Modelfile, see the [Modelfile ](docs/modelfile.md ) documentation.
2023-09-26 06:44:53 +00:00
## CLI Reference
### Create a model
`ollama create` is used to create a model from a Modelfile.
2023-07-19 19:28:50 +00:00
2023-12-22 17:10:01 +00:00
```
ollama create mymodel -f ./Modelfile
```
2023-09-26 06:44:53 +00:00
### Pull a model
2023-07-06 20:21:01 +00:00
2023-07-19 19:28:50 +00:00
```
2024-09-25 18:11:22 +00:00
ollama pull llama3.2
2023-07-19 19:28:50 +00:00
```
2023-06-28 13:57:36 +00:00
2023-09-26 06:44:53 +00:00
> This command can also be used to update a local model. Only the diff will be pulled.
### Remove a model
2023-07-20 19:21:29 +00:00
```
2024-09-25 18:11:22 +00:00
ollama rm llama3.2
2023-07-20 19:21:29 +00:00
```
2023-09-26 06:44:53 +00:00
### Copy a model
```
2024-09-25 18:11:22 +00:00
ollama cp llama3.2 my-model
2023-09-26 06:44:53 +00:00
```
### Multiline input
For multiline input, you can wrap text with `"""` :
```
>>> """Hello,
... world!
... """
I'm a basic program that prints the famous "Hello, world!" message to the console.
```
2023-12-13 19:38:47 +00:00
### Multimodal models
```
2024-07-31 01:08:34 +00:00
ollama run llava "What's in this image? /Users/jmorgan/Desktop/smile.png"
2023-12-13 19:38:47 +00:00
The image features a yellow smiley face, which is likely the central focus of the picture.
```
2024-05-01 17:39:38 +00:00
### Pass the prompt as an argument
2023-09-26 06:44:53 +00:00
```
2024-09-25 18:11:22 +00:00
$ ollama run llama3.2 "Summarize this file: $(cat README.md)"
2023-09-26 06:44:53 +00:00
Ollama is a lightweight, extensible framework for building and running language models on the local machine. It provides a simple API for creating, running, and managing models, as well as a library of pre-built models that can be easily used in a variety of applications.
```
2024-06-21 22:52:09 +00:00
### Show model information
```
2024-09-25 18:11:22 +00:00
ollama show llama3.2
2024-06-21 22:52:09 +00:00
```
2023-09-26 06:44:53 +00:00
### List models on your computer
2023-07-20 19:21:29 +00:00
2023-09-26 06:44:53 +00:00
```
ollama list
```
2023-07-20 19:21:29 +00:00
2024-09-18 23:26:42 +00:00
### List which models are currently loaded
```
ollama ps
```
### Stop a model which is currently running
```
2024-09-25 18:11:22 +00:00
ollama stop llama3.2
2024-09-18 23:26:42 +00:00
```
2023-09-26 06:44:53 +00:00
### Start Ollama
2023-07-20 19:21:29 +00:00
2023-09-26 06:44:53 +00:00
`ollama serve` is used when you want to start ollama without running the desktop application.
2023-07-20 19:21:29 +00:00
2023-07-03 20:32:48 +00:00
## Building
2024-05-23 21:24:07 +00:00
See the [developer guide ](https://github.com/ollama/ollama/blob/main/docs/development.md )
2023-10-17 00:41:40 +00:00
### Running local builds
2024-02-01 19:16:24 +00:00
2023-08-30 21:54:02 +00:00
Next, start the server:
2023-06-27 17:46:46 +00:00
2023-07-05 19:37:33 +00:00
```
2023-08-30 21:54:02 +00:00
./ollama serve
2023-07-05 19:37:33 +00:00
```
2023-09-01 14:54:31 +00:00
Finally, in a separate shell, run a model:
2023-07-05 19:37:33 +00:00
```
2024-09-25 18:11:22 +00:00
./ollama run llama3.2
2023-07-05 19:37:33 +00:00
```
2023-07-21 07:47:17 +00:00
## REST API
2023-10-27 07:10:23 +00:00
Ollama has a REST API for running and managing models.
2023-12-10 18:53:36 +00:00
### Generate a response
2023-07-21 07:47:17 +00:00
```
2023-11-17 14:50:38 +00:00
curl http://localhost:11434/api/generate -d '{
2024-09-25 18:11:22 +00:00
"model": "llama3.2",
2023-08-08 22:48:47 +00:00
"prompt":"Why is the sky blue?"
}'
2023-07-23 22:01:05 +00:00
```
2023-07-31 20:59:39 +00:00
2023-12-10 18:53:36 +00:00
### Chat with a model
2023-12-05 19:57:33 +00:00
```
curl http://localhost:11434/api/chat -d '{
2024-09-25 18:11:22 +00:00
"model": "llama3.2",
2023-12-07 17:41:56 +00:00
"messages": [
{ "role": "user", "content": "why is the sky blue?" }
2023-12-05 19:57:33 +00:00
]
}'
```
2023-10-27 07:10:23 +00:00
See the [API documentation ](./docs/api.md ) for all endpoints.
2023-09-26 06:44:53 +00:00
## Community Integrations
2023-11-08 08:03:29 +00:00
### Web & Desktop
2024-02-01 19:16:24 +00:00
2024-04-23 00:29:08 +00:00
- [Open WebUI ](https://github.com/open-webui/open-webui )
- [Enchanted (macOS native) ](https://github.com/AugustDev/enchanted )
2024-05-07 20:17:35 +00:00
- [Hollama ](https://github.com/fmaclen/hollama )
2024-04-01 15:16:31 +00:00
- [Lollms-Webui ](https://github.com/ParisNeo/lollms-webui )
2024-03-25 18:59:18 +00:00
- [LibreChat ](https://github.com/danny-avila/LibreChat )
2023-12-15 19:33:04 +00:00
- [Bionic GPT ](https://github.com/bionic-gpt/bionic-gpt )
2023-10-28 21:02:13 +00:00
- [HTML UI ](https://github.com/rtcfirefly/ollama-ui )
2024-03-25 18:54:09 +00:00
- [Saddle ](https://github.com/jikkuatwork/saddle )
2023-10-28 21:18:38 +00:00
- [Chatbot UI ](https://github.com/ivanfioravanti/chatbot-ollama )
2024-04-23 00:09:55 +00:00
- [Chatbot UI v2 ](https://github.com/mckaywrigley/chatbot-ui )
2023-10-28 21:02:13 +00:00
- [Typescript UI ](https://github.com/ollama-interface/Ollama-Gui?tab=readme-ov-file )
2023-10-28 21:18:38 +00:00
- [Minimalistic React UI for Ollama Models ](https://github.com/richawo/minimal-llm-ui )
2023-11-08 19:01:09 +00:00
- [Ollamac ](https://github.com/kevinhermawan/Ollamac )
2024-02-21 06:24:48 +00:00
- [big-AGI ](https://github.com/enricoros/big-AGI/blob/main/docs/config-local-ollama.md )
2023-11-16 16:30:54 +00:00
- [Cheshire Cat assistant framework ](https://github.com/cheshire-cat-ai/core )
2023-11-27 15:44:37 +00:00
- [Amica ](https://github.com/semperai/amica )
2023-11-30 02:18:21 +00:00
- [chatd ](https://github.com/BruceMacD/chatd )
2024-01-02 14:47:50 +00:00
- [Ollama-SwiftUI ](https://github.com/kghandour/Ollama-SwiftUI )
2024-03-25 19:06:39 +00:00
- [Dify.AI ](https://github.com/langgenius/dify )
2024-01-31 15:48:37 +00:00
- [MindMac ](https://mindmac.app )
2024-02-20 02:57:36 +00:00
- [NextJS Web Interface for Ollama ](https://github.com/jakobhoeg/nextjs-ollama-llm-ui )
2024-02-20 19:03:33 +00:00
- [Msty ](https://msty.app )
2024-02-23 12:17:28 +00:00
- [Chatbox ](https://github.com/Bin-Huang/Chatbox )
2024-03-04 08:40:36 +00:00
- [WinForm Ollama Copilot ](https://github.com/tgraupmann/WinForm_Ollama_Copilot )
2024-02-29 20:12:13 +00:00
- [NextChat ](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web ) with [Get Started Doc ](https://docs.nextchat.dev/models/ollama )
2024-03-25 19:00:18 +00:00
- [Alpaca WebUI ](https://github.com/mmo80/alpaca-webui )
2024-03-25 18:58:28 +00:00
- [OllamaGUI ](https://github.com/enoch1118/ollamaGUI )
2024-03-25 18:57:40 +00:00
- [OpenAOE ](https://github.com/InternLM/OpenAOE )
2024-03-06 19:57:49 +00:00
- [Odin Runes ](https://github.com/leonid20000/OdinRunes )
2024-05-06 20:42:16 +00:00
- [LLM-X ](https://github.com/mrdjohnson/llm-x ) (Progressive Web App)
2024-03-25 18:54:48 +00:00
- [AnythingLLM (Docker + MacOs/Windows/Linux native app) ](https://github.com/Mintplex-Labs/anything-llm )
2024-03-26 14:46:36 +00:00
- [Ollama Basic Chat: Uses HyperDiv Reactive UI ](https://github.com/rapidarchitect/ollama_basic_chat )
- [Ollama-chats RPG ](https://github.com/drazdra/ollama-chats )
2024-05-06 20:42:16 +00:00
- [QA-Pilot ](https://github.com/reid41/QA-Pilot ) (Chat with Code Repository)
- [ChatOllama ](https://github.com/sugarforever/chat-ollama ) (Open Source Chatbot based on Ollama with Knowledge Bases)
- [CRAG Ollama Chat ](https://github.com/Nagi-ovo/CRAG-Ollama-Chat ) (Simple Web Search with Corrective RAG)
- [RAGFlow ](https://github.com/infiniflow/ragflow ) (Open-source Retrieval-Augmented Generation engine based on deep document understanding)
- [StreamDeploy ](https://github.com/StreamDeploy-DevRel/streamdeploy-llm-app-scaffold ) (LLM Application Scaffold)
- [chat ](https://github.com/swuecho/chat ) (chat web app for teams)
2024-04-23 00:18:15 +00:00
- [Lobe Chat ](https://github.com/lobehub/lobe-chat ) with [Integrating Doc ](https://lobehub.com/docs/self-hosting/examples/ollama )
2024-05-06 20:42:16 +00:00
- [Ollama RAG Chatbot ](https://github.com/datvodinh/rag-chatbot.git ) (Local Chat with multiple PDFs using Ollama and RAG)
- [BrainSoup ](https://www.nurgo-software.com/products/brainsoup ) (Flexible native client with RAG & multi-agent automation)
2024-05-07 20:31:34 +00:00
- [macai ](https://github.com/Renset/macai ) (macOS client for Ollama, ChatGPT, and other compatible API back-ends)
2024-11-21 09:02:46 +00:00
- [Ollama Grid Search ](https://github.com/dezoito/ollama-grid-search ) (app to evaluate and compare models)
2024-05-28 00:22:01 +00:00
- [Olpaka ](https://github.com/Otacon/olpaka ) (User-friendly Flutter Web App for Ollama)
2024-05-28 02:58:26 +00:00
- [OllamaSpring ](https://github.com/CrazyNeil/OllamaSpring ) (Ollama Client for macOS)
2024-06-04 21:43:59 +00:00
- [LLocal.in ](https://github.com/kartikm7/llocal ) (Easy to use Electron Desktop Client for Ollama)
2024-11-21 08:16:18 +00:00
- [Shinkai Desktop ](https://github.com/dcSpark/shinkai-apps ) (Two click install Local AI using Ollama + Files + RAG)
2024-09-05 20:10:44 +00:00
- [AiLama ](https://github.com/zeyoyt/ailama ) (A Discord User App that allows you to interact with Ollama anywhere in discord )
2024-07-01 02:00:57 +00:00
- [Ollama with Google Mesop ](https://github.com/rapidarchitect/ollama_mesop/ ) (Mesop Chat Client implementation with Ollama)
2024-11-21 08:31:27 +00:00
- [Ollama-Kis ](https://github.com/elearningshow/ollama-kis ) (A simple easy to use GUI with sample custom LLM for Drivers Education)
2024-11-21 08:13:54 +00:00
- [OpenGPA ](https://opengpa.org ) (Open-source offline-first Enterprise Agentic Application)
2024-09-03 20:15:54 +00:00
- [Painting Droid ](https://github.com/mateuszmigas/painting-droid ) (Painting app with AI integrations)
2024-07-13 15:33:46 +00:00
- [Kerlig AI ](https://www.kerlig.com/ ) (AI writing assistant for macOS)
2024-07-16 21:24:27 +00:00
- [AI Studio ](https://github.com/MindWorkAI/AI-Studio )
2024-07-17 17:24:44 +00:00
- [Sidellama ](https://github.com/gyopak/sidellama ) (browser-based LLM client)
2024-07-23 18:40:23 +00:00
- [LLMStack ](https://github.com/trypromptly/LLMStack ) (No-code multi-agent framework to build LLM agents and workflows)
2024-07-31 15:44:58 +00:00
- [BoltAI for Mac ](https://boltai.com ) (AI Chat Client for Mac)
2024-08-03 00:03:46 +00:00
- [Harbor ](https://github.com/av/harbor ) (Containerized LLM Toolkit with Ollama as default backend)
2024-11-21 09:54:39 +00:00
- [PyGPT ](https://github.com/szczyglis-dev/py-gpt ) (AI desktop assistant for Linux, Windows and Mac)
2024-11-21 08:51:38 +00:00
- [AutoGPT ](https://github.com/Significant-Gravitas/AutoGPT/blob/master/docs/content/platform/ollama.md ) (AutoGPT Ollama integration)
2024-09-02 19:34:26 +00:00
- [Go-CREW ](https://www.jonathanhecl.com/go-crew/ ) (Powerful Offline RAG in Golang)
2024-09-03 16:28:01 +00:00
- [PartCAD ](https://github.com/openvmp/partcad/ ) (CAD model generation with OpenSCAD and CadQuery)
2024-09-03 20:08:50 +00:00
- [Ollama4j Web UI ](https://github.com/ollama4j/ollama4j-web-ui ) - Java-based Web UI for Ollama built with Vaadin, Spring Boot and Ollama4j
2024-09-04 03:10:53 +00:00
- [PyOllaMx ](https://github.com/kspviswa/pyOllaMx ) - macOS application capable of chatting with both Ollama and Apple MLX models.
2024-09-04 13:32:26 +00:00
- [Claude Dev ](https://github.com/saoudrizwan/claude-dev ) - VSCode extension for multi-file/whole-repo coding
2024-09-04 14:53:36 +00:00
- [Cherry Studio ](https://github.com/kangfenmao/cherry-studio ) (Desktop client with Ollama support)
2024-09-04 21:26:02 +00:00
- [ConfiChat ](https://github.com/1runeberg/confichat ) (Lightweight, standalone, multi-platform, and privacy focused LLM chat interface with optional encryption)
2024-09-06 21:06:01 +00:00
- [Archyve ](https://github.com/nickthecook/archyve ) (RAG-enabling document library)
2024-09-08 07:35:59 +00:00
- [crewAI with Mesop ](https://github.com/rapidarchitect/ollama-crew-mesop ) (Mesop Web Interface to run crewAI with Ollama)
2024-11-21 08:19:24 +00:00
- [Tkinter-based client ](https://github.com/chyok/ollama-gui ) (Python tkinter-based Client for Ollama)
2024-09-24 00:49:46 +00:00
- [LLMChat ](https://github.com/trendy-design/llmchat ) (Privacy focused, 100% local, intuitive all-in-one chat interface)
2024-09-29 20:01:01 +00:00
- [ARGO ](https://github.com/xark-argo/argo ) (Locally download and run Ollama and Huggingface models with RAG on Mac/Windows/Linux)
2024-10-05 18:57:53 +00:00
- [G1 ](https://github.com/bklieger-groq/g1 ) (Prototype of using prompting strategies to improve the LLM's reasoning through o1-like reasoning chains.)
2024-11-21 09:46:20 +00:00
- [Promptery ](https://github.com/promptery/promptery ) (desktop client for Ollama.)
2024-10-15 16:57:32 +00:00
- [Ollama App ](https://github.com/JHubi1/ollama-app ) (Modern and easy-to-use multi-platform client for Ollama)
2024-11-21 07:30:10 +00:00
- [ollama-chat-app ](https://github.com/anan1213095357/ollama-chat-app ) (Flutter-based chat app)
2024-11-17 23:19:26 +00:00
- [Perfect Memory AI ](https://www.perfectmemory.ai/ ) (Productivity AI assists personalized by what you have seen on your screen, heard and said in the meetings)
2024-11-05 17:06:38 +00:00
- [Hexabot ](https://github.com/hexastack/hexabot ) (A conversational AI builder)
2024-11-18 03:30:22 +00:00
- [Reddit Rate ](https://github.com/rapidarchitect/reddit_analyzer ) (Search and Rate Reddit topics with a weighted summation)
2024-11-20 18:42:55 +00:00
- [OpenTalkGpt ](https://github.com/adarshM84/OpenTalkGpt )
2024-11-18 03:30:22 +00:00
- [VT ](https://github.com/vinhnx/vt.ai ) (A minimal multimodal AI chat app, with dynamic conversation routing. Supports local models via Ollama)
2024-11-18 00:33:10 +00:00
- [Witsy ](https://github.com/nbonamy/witsy ) (An AI Desktop application avaiable for Mac/Windows/Linux)
2024-11-20 05:37:15 +00:00
- [Abbey ](https://github.com/US-Artificial-Intelligence/abbey ) (A configurable AI interface server with notebooks, document storage, and YouTube support)
2024-09-04 21:26:02 +00:00
2023-11-08 08:03:29 +00:00
### Terminal
2023-11-08 07:52:31 +00:00
2023-10-28 21:02:13 +00:00
- [oterm ](https://github.com/ggozad/oterm )
- [Ellama Emacs client ](https://github.com/s-kostyaev/ellama )
- [Emacs client ](https://github.com/zweifisch/ollama )
2023-11-06 19:27:02 +00:00
- [gen.nvim ](https://github.com/David-Kunz/gen.nvim )
2023-11-13 22:00:17 +00:00
- [ollama.nvim ](https://github.com/nomnivore/ollama.nvim )
2024-03-25 19:06:08 +00:00
- [ollero.nvim ](https://github.com/marco-souza/ollero.nvim )
2024-02-20 02:14:29 +00:00
- [ollama-chat.nvim ](https://github.com/gerazov/ollama-chat.nvim )
2023-11-20 15:39:14 +00:00
- [ogpt.nvim ](https://github.com/huynle/ogpt.nvim )
2023-11-09 20:53:24 +00:00
- [gptel Emacs client ](https://github.com/karthink/gptel )
2023-11-21 11:47:43 +00:00
- [Oatmeal ](https://github.com/dustinblackman/oatmeal )
2023-12-19 03:04:40 +00:00
- [cmdh ](https://github.com/pgibler/cmdh )
2024-03-25 19:08:33 +00:00
- [ooo ](https://github.com/npahlfer/ooo )
2024-04-23 00:10:34 +00:00
- [shell-pilot ](https://github.com/reid41/shell-pilot )
2024-02-20 04:13:03 +00:00
- [tenere ](https://github.com/pythops/tenere )
2024-02-03 23:40:50 +00:00
- [llm-ollama ](https://github.com/taketwo/llm-ollama ) for [Datasette's LLM CLI ](https://llm.datasette.io/en/stable/ ).
2024-03-25 19:05:04 +00:00
- [typechat-cli ](https://github.com/anaisbetts/typechat-cli )
2024-02-20 03:18:05 +00:00
- [ShellOracle ](https://github.com/djcopley/ShellOracle )
2024-03-25 18:53:26 +00:00
- [tlm ](https://github.com/yusufcanb/tlm )
2024-04-23 00:29:08 +00:00
- [podman-ollama ](https://github.com/ericcurtin/podman-ollama )
2024-06-05 21:13:39 +00:00
- [gollama ](https://github.com/sammcj/gollama )
2024-08-11 01:43:08 +00:00
- [Ollama eBook Summary ](https://github.com/cognitivetech/ollama-ebook-summary/ )
2024-09-12 01:36:26 +00:00
- [Ollama Mixture of Experts (MOE) in 50 lines of code ](https://github.com/rapidarchitect/ollama_moe )
2024-09-16 01:20:36 +00:00
- [vim-intelligence-bridge ](https://github.com/pepo-ec/vim-intelligence-bridge ) Simple interaction of "Ollama" with the Vim editor
2024-11-21 08:03:11 +00:00
- [bb7 ](https://github.com/drunkwcodes/bb7 )
2024-11-20 18:49:15 +00:00
- [SwollamaCLI ](https://github.com/marcusziade/Swollama ) bundled with the Swollama Swift package. [Demo ](https://github.com/marcusziade/Swollama?tab=readme-ov-file#cli-usage )
2024-11-12 00:44:46 +00:00
- [aichat ](https://github.com/sigoden/aichat ) All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI tools & agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
2024-11-21 07:24:05 +00:00
- [orbiton ](https://github.com/xyproto/orbiton ) Configuration-free text editor and IDE with support for tab completion with Ollama.
2023-10-28 21:02:13 +00:00
2024-09-05 05:30:19 +00:00
### Apple Vision Pro
- [Enchanted ](https://github.com/AugustDev/enchanted )
2023-12-11 23:05:10 +00:00
### Database
2024-04-15 22:35:29 +00:00
- [MindsDB ](https://github.com/mindsdb/mindsdb/blob/staging/mindsdb/integrations/handlers/ollama_handler/README.md ) (Connects Ollama models with nearly 200 data platforms and apps)
2024-04-01 15:17:37 +00:00
- [chromem-go ](https://github.com/philippgille/chromem-go/blob/v0.5.0/embed_ollama.go ) with [example ](https://github.com/philippgille/chromem-go/tree/v0.5.0/examples/rag-wikipedia-ollama )
2023-12-12 19:43:19 +00:00
2023-11-21 15:25:32 +00:00
### Package managers
2023-11-21 14:40:59 +00:00
2023-11-21 15:25:26 +00:00
- [Pacman ](https://archlinux.org/packages/extra/x86_64/ollama/ )
2024-09-05 16:58:14 +00:00
- [Gentoo ](https://github.com/gentoo/guru/tree/master/app-misc/ollama )
2024-02-20 03:05:14 +00:00
- [Helm Chart ](https://artifacthub.io/packages/helm/ollama-helm/ollama )
2024-05-09 18:10:24 +00:00
- [Guix channel ](https://codeberg.org/tusharhero/ollama-guix )
2024-08-29 16:45:35 +00:00
- [Nix package ](https://search.nixos.org/packages?channel=24.05&show=ollama&from=0&size=50&sort=relevance&type=packages&query=ollama )
- [Flox ](https://flox.dev/blog/ollama-part-one )
2023-11-21 14:40:59 +00:00
2023-10-28 21:02:13 +00:00
### Libraries
2023-11-08 07:52:31 +00:00
2024-10-08 01:16:56 +00:00
- [LangChain ](https://python.langchain.com/docs/integrations/llms/ollama ) and [LangChain.js ](https://js.langchain.com/docs/integrations/chat/ollama/ ) with [example ](https://js.langchain.com/docs/tutorials/local_rag/ )
2024-07-31 01:40:09 +00:00
- [Firebase Genkit ](https://firebase.google.com/docs/genkit/plugins/ollama )
2024-09-08 07:36:24 +00:00
- [crewAI ](https://github.com/crewAIInc/crewAI )
2024-11-21 10:02:14 +00:00
- [Spring AI ](https://github.com/spring-projects/spring-ai ) with [reference ](https://docs.spring.io/spring-ai/reference/api/chat/ollama-chat.html ) and [example ](https://github.com/tzolov/ollama-tools )
2023-11-20 15:35:07 +00:00
- [LangChainGo ](https://github.com/tmc/langchaingo/ ) with [example ](https://github.com/tmc/langchaingo/tree/main/examples/ollama-completion-example )
2024-02-22 19:09:08 +00:00
- [LangChain4j ](https://github.com/langchain4j/langchain4j ) with [example ](https://github.com/langchain4j/langchain4j-examples/tree/main/ollama-examples/src/main/java )
2024-06-09 00:29:36 +00:00
- [LangChainRust ](https://github.com/Abraxas-365/langchain-rust ) with [example ](https://github.com/Abraxas-365/langchain-rust/blob/main/examples/llm_ollama.rs )
2024-11-21 08:54:26 +00:00
- [LLPhant ](https://github.com/theodo-group/LLPhant?tab=readme-ov-file#ollama )
2024-09-24 19:15:43 +00:00
- [LlamaIndex ](https://docs.llamaindex.ai/en/stable/examples/llm/ollama/ ) and [LlamaIndexTS ](https://ts.llamaindex.ai/modules/llms/available_llms/ollama )
2023-10-28 21:02:13 +00:00
- [LiteLLM ](https://github.com/BerriAI/litellm )
2024-09-02 20:05:36 +00:00
- [OllamaFarm for Go ](https://github.com/presbrey/ollamafarm )
2023-10-28 21:18:38 +00:00
- [OllamaSharp for .NET ](https://github.com/awaescher/OllamaSharp )
2024-01-07 03:31:39 +00:00
- [Ollama for Ruby ](https://github.com/gbaptista/ollama-ai )
2023-11-05 00:12:18 +00:00
- [Ollama-rs for Rust ](https://github.com/pepperoni21/ollama-rs )
2024-06-11 18:15:05 +00:00
- [Ollama-hpp for C++ ](https://github.com/jmont-dev/ollama-hpp )
2024-09-03 20:08:50 +00:00
- [Ollama4j for Java ](https://github.com/ollama4j/ollama4j )
2023-11-06 19:27:02 +00:00
- [ModelFusion Typescript Library ](https://modelfusion.dev/integration/model-provider/ollama )
2023-11-11 22:41:42 +00:00
- [OllamaKit for Swift ](https://github.com/kevinhermawan/OllamaKit )
2023-11-13 19:50:42 +00:00
- [Ollama for Dart ](https://github.com/breitburg/dart-ollama )
2023-11-20 15:48:35 +00:00
- [Ollama for Laravel ](https://github.com/cloudstudio/ollama-laravel )
2023-12-19 19:04:52 +00:00
- [LangChainDart ](https://github.com/davidmigloz/langchain_dart )
2024-01-11 19:40:23 +00:00
- [Semantic Kernel - Python ](https://github.com/microsoft/semantic-kernel/tree/main/python/semantic_kernel/connectors/ai/ollama )
2024-01-18 21:38:32 +00:00
- [Haystack ](https://github.com/deepset-ai/haystack-integrations/blob/main/integrations/ollama.md )
2024-02-20 19:03:02 +00:00
- [Elixir LangChain ](https://github.com/brainlid/langchain )
2024-01-30 19:56:51 +00:00
- [Ollama for R - rollama ](https://github.com/JBGruber/rollama )
2024-05-07 16:52:30 +00:00
- [Ollama for R - ollama-r ](https://github.com/hauselin/ollama-r )
2024-02-13 19:40:44 +00:00
- [Ollama-ex for Elixir ](https://github.com/lebrunel/ollama-ex )
2024-02-22 18:12:27 +00:00
- [Ollama Connector for SAP ABAP ](https://github.com/b-tocs/abap_btocs_ollama )
2024-03-23 18:55:25 +00:00
- [Testcontainers ](https://testcontainers.com/modules/ollama/ )
2024-05-06 17:25:23 +00:00
- [Portkey ](https://portkey.ai/docs/welcome/integration-guides/ollama )
2024-05-09 16:39:05 +00:00
- [PromptingTools.jl ](https://github.com/svilupp/PromptingTools.jl ) with an [example ](https://svilupp.github.io/PromptingTools.jl/dev/examples/working_with_ollama )
2024-05-12 15:24:21 +00:00
- [LlamaScript ](https://github.com/Project-Llama/llamascript )
2024-11-20 18:53:14 +00:00
- [llm-axe ](https://github.com/emirsahin1/llm-axe ) (Python Toolkit for Building LLM Powered Apps)
2024-09-04 18:19:41 +00:00
- [Gollm ](https://docs.gollm.co/examples/ollama-example )
2024-11-20 05:31:43 +00:00
- [Gollama for Golang ](https://github.com/jonathanhecl/gollama )
2024-09-02 19:34:26 +00:00
- [Ollamaclient for Golang ](https://github.com/xyproto/ollamaclient )
2024-09-04 14:52:46 +00:00
- [High-level function abstraction in Go ](https://gitlab.com/tozd/go/fun )
2024-09-05 05:01:14 +00:00
- [Ollama PHP ](https://github.com/ArdaGnsrn/ollama-php )
2024-09-16 20:42:52 +00:00
- [Agents-Flex for Java ](https://github.com/agents-flex/agents-flex ) with [example ](https://github.com/agents-flex/agents-flex/tree/main/agents-flex-llm/agents-flex-llm-ollama/src/test/java/com/agentsflex/llm/ollama )
2024-11-21 10:00:32 +00:00
- [Parakeet ](https://github.com/parakeet-nest/parakeet ) is a GoLang library, made to simplify the development of small generative AI applications with Ollama.
2024-11-21 08:11:39 +00:00
- [Haverscript ](https://github.com/andygill/haverscript ) with [examples ](https://github.com/andygill/haverscript/tree/main/examples )
2024-10-22 05:29:11 +00:00
- [Ollama for Swift ](https://github.com/mattt/ollama-swift )
2024-11-20 18:49:15 +00:00
- [Swollama for Swift ](https://github.com/marcusziade/Swollama ) with [DocC ](https://marcusziade.github.io/Swollama/documentation/swollama/ )
2024-11-11 06:38:18 +00:00
- [GoLamify ](https://github.com/prasad89/golamify )
2024-11-17 23:18:04 +00:00
- [Ollama for Haskell ](https://github.com/tusharad/ollama-haskell )
2024-11-18 00:33:10 +00:00
- [multi-llm-ts ](https://github.com/nbonamy/multi-llm-ts ) (A Typescript/JavaScript library allowing access to different LLM in unified API)
2024-06-05 21:13:39 +00:00
2023-11-16 21:46:38 +00:00
### Mobile
2023-12-15 19:37:29 +00:00
- [Enchanted ](https://github.com/AugustDev/enchanted )
2024-01-02 14:47:08 +00:00
- [Maid ](https://github.com/Mobile-Artificial-Intelligence/maid )
2024-10-15 16:57:32 +00:00
- [Ollama App ](https://github.com/JHubi1/ollama-app ) (Modern and easy-to-use multi-platform client for Ollama)
2024-09-04 21:26:02 +00:00
- [ConfiChat ](https://github.com/1runeberg/confichat ) (Lightweight, standalone, multi-platform, and privacy focused LLM chat interface with optional encryption)
2023-11-16 21:46:38 +00:00
2023-11-08 07:52:31 +00:00
### Extensions & Plugins
2023-09-26 06:44:53 +00:00
- [Raycast extension ](https://github.com/MassimilianoPasquini97/raycast_ollama )
- [Discollama ](https://github.com/mxyng/discollama ) (Discord bot inside the Ollama discord channel)
- [Continue ](https://github.com/continuedev/continue )
2024-11-20 18:45:10 +00:00
- [Vibe ](https://github.com/thewh1teagle/vibe ) (Transcribe and analyze meetings with Ollama)
2023-09-26 06:44:53 +00:00
- [Obsidian Ollama plugin ](https://github.com/hinterdupfinger/obsidian-ollama )
2023-11-07 17:58:13 +00:00
- [Logseq Ollama plugin ](https://github.com/omagdy7/ollama-logseq )
2024-03-04 09:18:10 +00:00
- [NotesOllama ](https://github.com/andersrex/notesollama ) (Apple Notes Ollama plugin)
2023-09-26 06:44:53 +00:00
- [Dagger Chatbot ](https://github.com/samalba/dagger-chatbot )
- [Discord AI Bot ](https://github.com/mekb-turtle/discord-ai-bot )
2023-12-03 19:19:55 +00:00
- [Ollama Telegram Bot ](https://github.com/ruecat/ollama-telegram )
2023-11-07 17:58:13 +00:00
- [Hass Ollama Conversation ](https://github.com/ej52/hass-ollama-conversation )
2023-11-20 15:36:47 +00:00
- [Rivet plugin ](https://github.com/abrenneke/rivet-plugin-ollama )
2023-11-22 19:32:30 +00:00
- [Obsidian BMO Chatbot plugin ](https://github.com/longy2k/obsidian-bmo-chatbot )
2024-03-25 19:07:19 +00:00
- [Cliobot ](https://github.com/herval/cliobot ) (Telegram bot with Ollama support)
2024-02-22 19:17:20 +00:00
- [Copilot for Obsidian plugin ](https://github.com/logancyang/obsidian-copilot )
2024-02-22 15:52:36 +00:00
- [Obsidian Local GPT plugin ](https://github.com/pfrankov/obsidian-local-gpt )
2024-01-23 18:29:10 +00:00
- [Open Interpreter ](https://docs.openinterpreter.com/language-model-setup/local-models/ollama )
2024-05-05 21:45:32 +00:00
- [Llama Coder ](https://github.com/ex3ndr/llama-coder ) (Copilot alternative using Ollama)
- [Ollama Copilot ](https://github.com/bernardo-bruning/ollama-copilot ) (Proxy that allows you to use ollama as a copilot like Github copilot)
2024-01-31 14:25:06 +00:00
- [twinny ](https://github.com/rjmacarthy/twinny ) (Copilot and Copilot chat alternative using Ollama)
2024-07-29 17:53:30 +00:00
- [Wingman-AI ](https://github.com/RussellCanfield/wingman-ai ) (Copilot code and chat alternative using Ollama and Hugging Face)
2024-02-20 19:03:58 +00:00
- [Page Assist ](https://github.com/n4ze3m/page-assist ) (Chrome Extension)
2024-09-06 21:04:12 +00:00
- [Plasmoid Ollama Control ](https://github.com/imoize/plasmoid-ollamacontrol ) (KDE Plasma extension that allows you to quickly manage/control Ollama model)
2024-03-25 18:56:42 +00:00
- [AI Telegram Bot ](https://github.com/tusharhero/aitelegrambot ) (Telegram bot using Ollama in backend)
2024-03-31 17:10:05 +00:00
- [AI ST Completion ](https://github.com/yaroslavyaroslav/OpenAI-sublime-text ) (Sublime Text 4 AI assistant plugin with Ollama support)
2024-04-23 00:14:20 +00:00
- [Discord-Ollama Chat Bot ](https://github.com/kevinthedang/discord-ollama ) (Generalized TypeScript Discord Bot w/ Tuning Documentation)
2024-05-16 20:55:14 +00:00
- [Discord AI chat/moderation bot ](https://github.com/rapmd73/Companion ) Chat/moderation bot written in python. Uses Ollama to create personalities.
2024-06-09 01:51:16 +00:00
- [Headless Ollama ](https://github.com/nischalj10/headless-ollama ) (Scripts to automatically install ollama client & models on any OS for apps that depends on ollama server)
2024-11-21 09:09:37 +00:00
- [node-red-contrib-ollama ](https://github.com/jakubburkiewicz/node-red-contrib-ollama )
2024-11-11 06:14:22 +00:00
- [Local AI Helper ](https://github.com/ivostoykov/localAI ) (Chrome and Firefox extensions that enable interactions with the active tab and customisable API endpoints. Includes secure storage for user prompts.)
2024-09-04 23:46:02 +00:00
- [vnc-lm ](https://github.com/jk011ru/vnc-lm ) (A containerized Discord bot with support for attachments and web links)
2024-09-05 05:17:34 +00:00
- [LSP-AI ](https://github.com/SilasMarvin/lsp-ai ) (Open-source language server for AI-powered functionality)
2024-09-11 20:19:49 +00:00
- [QodeAssist ](https://github.com/Palm1r/QodeAssist ) (AI-powered coding assistant plugin for Qt Creator)
2024-09-15 03:52:37 +00:00
- [Obsidian Quiz Generator plugin ](https://github.com/ECuiDev/obsidian-quiz-generator )
2024-11-04 00:53:51 +00:00
- [TextCraft ](https://github.com/suncloudsmoon/TextCraft ) (Copilot in Word alternative using Ollama)
2024-11-19 03:33:23 +00:00
- [Alfred Ollama ](https://github.com/zeitlings/alfred-ollama ) (Alfred Workflow)
2024-04-17 17:48:14 +00:00
2024-06-05 21:13:39 +00:00
### Supported backends
2024-05-05 21:45:32 +00:00
- [llama.cpp ](https://github.com/ggerganov/llama.cpp ) project founded by Georgi Gerganov.
