baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Update import.md

Browse source
This commit is contained in:
Jeffrey Morgan 2023-10-23 17:44:53 -07:00 committed by GitHub
parent 9afea9e3b9
commit 914428351a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 12 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
docs/import.md
View file

@ -1,17 +1,6 @@
# Import a model # Import a model
This guide walks through importing a PyTorch, Safetensors or GGUF model. This guide walks through importing a GGUF, PyTorch or Safetensors model.
## Supported models
Ollama supports a set of model architectures, with support for more coming soon:
- Llama & Mistral
- Falcon & RW
- GPT-NeoX
- BigCode
To view a model's architecture, check the `config.json` file in its HuggingFace repo. You should see an entry under `architectures` (e.g. `LlamaForCausalLM`).
## Importing (GGUF) ## Importing (GGUF)
@ -48,6 +37,17 @@ ollama run example "What is your favourite condiment?"
## Importing (PyTorch & Safetensors) ## Importing (PyTorch & Safetensors)
### Supported models
Ollama supports a set of model architectures, with support for more coming soon:
- Llama & Mistral
- Falcon & RW
- GPT-NeoX
- BigCode
To view a model's architecture, check the `config.json` file in its HuggingFace repo. You should see an entry under `architectures` (e.g. `LlamaForCausalLM`).
### Step 1: Clone the HuggingFace repository (optional) ### Step 1: Clone the HuggingFace repository (optional)
If the model is currently hosted in a HuggingFace repository, first clone that repository to download the raw model. If the model is currently hosted in a HuggingFace repository, first clone that repository to download the raw model.