Michael Yang
567e74e7d7
Merge pull request #81 from jmorganca/fix-race-2
...
fix race
2023-07-14 15:12:01 -07:00
Michael Yang
5ade3db040
fix race
...
block on write which only returns when the channel is closed. this is
contrary to the previous arrangement where the handler may return but
the stream hasn't finished writing. it can lead to the client receiving
unexpected responses (since the request has been handled) or worst case
a nil-pointer dereference as the stream tries to flush a nil writer
2023-07-14 15:10:46 -07:00
Michael Yang
965f9ad033
Merge pull request #77 from jmorganca/mem
...
continue conversation
2023-07-14 14:57:42 -07:00
Michael Yang
5d1c6b7499
Merge pull request #79 from jmorganca/fix-typo
...
fix typo
2023-07-14 10:50:44 -07:00
Michael Yang
5fefaa5d4d
fix typo
2023-07-14 10:47:18 -07:00
Michael Yang
1775647f76
continue conversation
...
feed responses back into the llm
2023-07-13 17:13:00 -07:00
Michael Yang
77dc1a6d74
Merge pull request #74 from jmorganca/timings
...
Timings
2023-07-13 10:17:13 -07:00
Michael Yang
05e08d2310
return more info in generate response
2023-07-13 09:37:32 -07:00
Michael Yang
31590284a7
fix route
2023-07-12 19:21:49 -07:00
Michael Yang
f2863cc7f8
Merge pull request #76 from jmorganca/fix-pull
...
fix pull race
2023-07-12 19:21:13 -07:00
Jeffrey Morgan
4dd296e155
build app in publish script
2023-07-12 19:16:39 -07:00
Jeffrey Morgan
304f419429
update README.md API reference
2023-07-12 19:16:28 -07:00
Michael Yang
2666d3c206
fix pull race
2023-07-12 19:07:23 -07:00
Jeffrey Morgan
787d965331
web: disable signup button while submitting
2023-07-12 17:32:27 -07:00
Jeffrey Morgan
e6eee0732c
web: fix npm build
2023-07-12 17:28:00 -07:00
Jeffrey Morgan
4c2b4589ac
web: newsletter signup on download page
2023-07-12 17:26:20 -07:00
Michael Yang
5571ed5248
Merge pull request #73 from jmorganca/generate-eof
...
fix eof error in generate
2023-07-12 11:09:23 -07:00
Michael Yang
0944b01e7d
pull fixes
2023-07-12 09:55:07 -07:00
Jeffrey Morgan
5028de2901
update vicuna model
2023-07-12 09:42:26 -07:00
Michael Yang
e1f0a0dc74
fix eof error in generate
2023-07-12 09:36:16 -07:00
Michael Yang
b227261f21
Merge pull request #71 from jmorganca/llama-errors
...
error checking new model
2023-07-12 09:20:33 -07:00
Jeffrey Morgan
c63f811909
return error if model fails to load
2023-07-11 20:32:26 -07:00
Jeffrey Morgan
7c71c10d4f
fix compilation issue in Dockerfile, remove from README.md until ready
2023-07-11 19:51:08 -07:00
Michael Yang
c5f7eadd87
error checking new model
2023-07-11 17:07:41 -07:00
Jeffrey Morgan
dcb6ba389a
app: trim server lines before logging
2023-07-11 16:43:19 -07:00
Jeffrey Morgan
ed6abba75a
app: bundle real ggml-metal.metal instead of symlink
2023-07-11 16:36:39 -07:00
Jeffrey Morgan
b52a400cdf
use go build on publish
2023-07-11 16:17:45 -07:00
Jeffrey Morgan
2ed26f0047
tweak logging
2023-07-11 16:16:38 -07:00
Jeffrey Morgan
e64ef69e34
look for ggml-metal in the same directory as the binary
2023-07-11 15:58:56 -07:00
Jeffrey Morgan
3d0a9b477b
log to console as well as file
2023-07-11 15:52:22 -07:00
Michael Yang
7226980fb6
Merge pull request #70 from jmorganca/offline-fixes
...
offline fixes
2023-07-11 15:50:19 -07:00
Michael Yang
a806b03f62
no errgroup
2023-07-11 14:58:10 -07:00
Michael Yang
948323fa78
rename partial file
2023-07-11 13:50:26 -07:00
Michael Yang
e243329e2e
check api status
2023-07-11 13:42:05 -07:00
Michael Yang
2a66a1164a
common stream producer
2023-07-11 13:42:05 -07:00
Michael Yang
62620914e9
Merge pull request #65 from jmorganca/bindings
...
call llama.cpp directly from go
2023-07-11 12:01:03 -07:00
Michael Yang
442dec1c6f
vendor llama.cpp
2023-07-11 11:59:18 -07:00
Michael Yang
fd4792ec56
call llama.cpp directly from go
2023-07-11 11:59:18 -07:00
hoyyeva
abaf7d3bda
Merge pull request #67 from jmorganca/log
...
writing logs to `./ollama/logs`
2023-07-11 14:45:21 -04:00
Eva Ho
7762584fb1
address comments
2023-07-11 14:38:38 -04:00
Jeffrey Morgan
317615fd5c
web: remove unused code
2023-07-11 11:05:45 -07:00
Eva Ho
acc31427dd
add logs to ~/.ollama/logs folder
2023-07-11 13:33:32 -04:00
Jeffrey Morgan
a3ec1ec2a0
consistent error handling for pull and generate
2023-07-10 21:34:15 -07:00
Eva Ho
407a5cabf4
when app is running, server restarts when it exits or disconnects
2023-07-10 17:14:25 -04:00
Michael Yang
0859d50942
Merge pull request #58 from jmorganca/generate-errors
...
return error in generate response
2023-07-10 14:03:47 -07:00
Jeffrey Morgan
66bbf05918
start server in both dev and when packaged
2023-07-10 13:46:31 -07:00
Michael Yang
edba935d67
return error in generate response
2023-07-10 13:30:10 -07:00
Bruce MacDonald
2d49197b3b
increase default model size to 512
2023-07-10 21:24:41 +02:00
Bruce MacDonald
f5e2e150b8
allow overriding default generate options
2023-07-10 20:58:02 +02:00
Jeffrey Morgan
268e362fa7
fix binding build
2023-07-10 11:33:43 -07:00
