baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Update import.md

Browse source
This commit is contained in:
Jeffrey Morgan 2024-06-17 19:44:14 -04:00 committed by GitHub
parent 8ed51cac37
commit 176d0f7075
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
docs/import.md
View file

@ -47,19 +47,13 @@ success
### Supported Quantizations ### Supported Quantizations
<details>
<summary>Legacy Quantization</summary>
- `Q4_0` - `Q4_0`
- `Q4_1` - `Q4_1`
- `Q5_0` - `Q5_0`
- `Q5_1` - `Q5_1`
- `Q8_0` - `Q8_0`
</details> #### K-means Quantizations
<details>
<summary>K-means Quantization</summary>`
- `Q3_K_S` - `Q3_K_S`
- `Q3_K_M` - `Q3_K_M`
@ -70,11 +64,6 @@ success
- `Q5_K_M` - `Q5_K_M`
- `Q6_K` - `Q6_K`
</details>
> [!NOTE]
> Activation-aware Weight Quantization (i.e. IQ) are not currently supported for automatic quantization however you can still import the quantized model into Ollama, see [Import GGUF](#import-gguf).
## Template Detection ## Template Detection
> [!NOTE] > [!NOTE]