d88c527be3
This reduces the built-in linux version to not use any vector extensions which enables the resulting builds to run under Rosetta on MacOS in Docker. Then at runtime it checks for the actual CPU vector extensions and loads the best CPU library available |
||
|---|---|---|
| .. | ||
| tutorials | ||
| api.md | ||
| development.md | ||
| faq.md | ||
| import.md | ||
| linux.md | ||
| modelfile.md | ||
| README.md | ||
| troubleshooting.md | ||
| tutorials.md | ||
Documentation
To get started, see the project's quickstart.
Ollama is a tool for running AI models on your hardware. Many users will choose to use the Command Line Interface (CLI) to work with Ollama. Learn more about all the commands in the CLI in the Main Readme.
Use the RESTful API using any language, including Python, JavaScript, Typescript, Go, Rust, and many more. Learn more about using the API in the API Documentation.
Create new models or modify models already in the library using the Modelfile. Learn more about the Modelfile syntax in the Modelfile Documentation.
Import models using source model weights found on Hugging Face and similar sites by referring to the Import Documentation.
Installing on Linux in most cases is easy using the script on Ollama.ai. To get more detail about the install, including CUDA drivers, see the Linux Documentation.
Many of our users like the flexibility of using our official Docker Image. Learn more about using Docker with Ollama using the Docker Documentation.
It is easy to install on Linux and Mac, but many users will choose to build Ollama on their own. To do this, refer to the Development Documentation.
If encountering a problem with Ollama, the best place to start is the logs. Find more information about them here in the Troubleshooting Guide.
Finally for all the questions that don't fit anywhere else, there is the FAQ
Tutorials apply the documentation to tasks.
For working code examples of using Ollama, see Examples.