Commit graph

1633 commits

Author SHA1 Message Date
Bruce MacDonald
2416a5ba6c Update models.json 2023-07-06 16:34:44 -04:00
Michael Yang
1b7183c5a1 enable metal gpu acceleration
ggml-metal.metal must be in the same directory as the ollama binary
otherwise llama.cpp will not be able to find it and load it.

1. go generate llama/llama_metal.go
2. go build .
3. ./ollama serve
2023-07-06 16:34:44 -04:00
Jeffrey Morgan
b9fb988112 fix api docs 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
944bd13de1 Go 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
0998d4f0a4 remove debug print statements 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
79a999e95d fix crash in bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
6559a5b48f updated readme 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
b0e986fb96 add binary to .gitignore 2023-07-06 16:34:44 -04:00
Bruce MacDonald
8ea5e5e147 separate routes 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
fd962a36e5 client updates 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
6292f4b64c update Dockerfile 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
0240165388 fix llama.cpp build 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
9164981d72 move prompt templates out of python bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
6093a88c1a add llama.cpp go bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan
76cb60d496 wip go engine
Co-authored-by: Patrick Devine <pdevine@sonic.net>
2023-07-06 16:34:44 -04:00
Jeffrey Morgan
172274b809 fix auto update route 2023-07-06 16:18:40 -04:00
Jeffrey Morgan
7bf3212c5b auto updater for macos 2023-07-06 00:04:06 -04:00
Jeffrey Morgan
8cc92447e3 fix web build 2023-07-05 21:15:49 -04:00
Jeffrey Morgan
39b289c6a8 use typescript for website 2023-07-05 20:14:54 -04:00
Michael Yang
585e863eab
Merge pull request #37 from jmorganca/upgrade-fuzzy
upgrade fuzzy search library
2023-07-05 12:16:18 -07:00
Michael Yang
6ce9a58c35 upgrade fuzzy search library
use process.extract to produce a list of fuzzy matches instead of
process.extractOne
2023-07-05 11:13:45 -07:00
Bruce MacDonald
27ead750c3 try next runner if load fails 2023-07-04 11:55:10 -04:00
Bruce MacDonald
a86a4f8c26 resume download of models from directory 2023-07-04 11:16:50 -04:00
Jeffrey Morgan
35f202f573 use app router 2023-07-02 22:05:26 -04:00
Jeffrey Morgan
0efa1f9fb2 format models.json 2023-07-02 20:33:23 -04:00
Jeffrey Morgan
d972647e7c simple website 2023-07-02 19:52:40 -04:00
Jeffrey Morgan
8685a5ad18 move .prettierrc.json to root 2023-07-02 17:34:46 -04:00
Jeffrey Morgan
3cd59936a2 move desktop -> app 2023-07-02 17:26:55 -04:00
Jeffrey Morgan
55898a3382 Move python docs to separate file 2023-07-01 17:54:29 -04:00
Jeffrey Morgan
0d2f41e9a4 remove unused build.py 2023-07-01 13:48:36 -04:00
Jeffrey Morgan
1dd3282f08 update desktop/README.md 2023-07-01 13:45:59 -04:00
Bruce MacDonald
23c589d578 output confirmation after pull 2023-06-30 16:40:28 -04:00
Bruce MacDonald
4c8c61c9cf
Update README.md 2023-06-30 16:30:35 -04:00
Bruce MacDonald
f1d5036f1e v0.0.9 2023-06-30 16:28:20 -04:00
Bruce MacDonald
d01be075b6 search command 2023-06-30 16:27:47 -04:00
Jeffrey Morgan
fd1207a44b bump version to 0.0.8 2023-06-30 16:05:14 -04:00
Michael Chiang
76918ddb67
change name.json 2023-06-30 15:15:18 -04:00
Michael Yang
9e5dfc66a3
Merge pull request #29 from jmorganca/pull-model-name
Pull model name
2023-06-30 11:58:58 -07:00
Michael Yang
76fb9eea1e use Path / operator 2023-06-30 11:57:28 -07:00
Michael Yang
3ce3caaf65 fix pull model name 2023-06-30 11:57:28 -07:00
Jeffrey Morgan
3c5a543642 bump version to 0.0.7 2023-06-30 14:54:29 -04:00
Michael Yang
cc329b3dd8
Merge pull request #20 from jmorganca/close-matches
use difflib.get_close_matches
2023-06-30 11:54:07 -07:00
Michael Yang
ba3cbbbb4c use difflib.get_close_matches 2023-06-30 11:53:14 -07:00
Michael Yang
e69a08f1b1
Merge pull request #17 from jmorganca/ctransformers
use ctransformers as backup to llama.cpp
2023-06-30 11:46:13 -07:00
Michael Yang
07d8d56177 use all caps for constants 2023-06-30 10:36:10 -07:00
Bruce MacDonald
9dfef44a54
Update models.json format 2023-06-30 13:33:05 -04:00
Michael Yang
4d0eb7639a use ctransformers as backup to llama-cpp 2023-06-30 10:33:01 -07:00
Michael Yang
5cea13ce00 rename model to model_name to avoid collision 2023-06-30 10:33:01 -07:00
Michael Chiang
af66c5695a
Update with some examples 2023-06-30 13:08:46 -04:00
Jeffrey Morgan
efba500dd6 better README.md install instructions 2023-06-30 12:39:25 -04:00