Daniel Hiltgen
d4cd695759
Add cgo implementation for llama.cpp
...
Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.
2023-12-19 09:05:46 -08:00
Bruce MacDonald
811b1f03c8
deprecate ggml
...
- remove ggml runner
- automatically pull gguf models when ggml detected
- tell users to update to gguf in the case automatic pull fails
Co-Authored-By: Jeffrey Morgan <jmorganca@gmail.com>
2023-12-19 09:05:46 -08:00
Jeffrey Morgan
85e4441c6a
cache docker builds
2023-11-18 08:51:38 -05:00
Jeffrey Morgan
d7849a1dc9
add .env to .dockerignore
2023-09-23 00:53:48 -04:00
Jeffrey Morgan
f997e29e45
Add Dockerfile.build for building linux binaries ( #558 )
...
Add `Dockerfile.build` for building linux binaries
---------
Co-authored-by: Michael Yang <mxyng@pm.me>
2023-09-22 15:20:12 -04:00
Michael Yang
a8da0bacbe
update dockerignore
2023-09-07 13:36:25 -07:00
Michael Yang
9795b43d93
update dockerfile
2023-09-06 15:31:25 -07:00
Jeffrey Morgan
e3054fc74e
add .env to .dockerignore
2023-08-21 09:32:02 -07:00
Jeffrey Morgan
6292f4b64c
update Dockerfile
2023-07-06 16:34:44 -04:00
