Daniel Hiltgen
|
697bea6939
|
Guard integration tests with a tag
This should help CI avoid running the integration test logic in a
container where it's not currently possible.
|
2023-12-22 16:33:27 -08:00 |
|
Daniel Hiltgen
|
51082535e1
|
Add automated test for multimodal
A simple test case that verifies llava:7b can read text in an image
|
2023-12-19 09:05:46 -08:00 |
|
Daniel Hiltgen
|
35934b2e05
|
Adapted rocm support to cgo based llama.cpp
|
2023-12-19 09:05:46 -08:00 |
|
Daniel Hiltgen
|
d4cd695759
|
Add cgo implementation for llama.cpp
Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.
|
2023-12-19 09:05:46 -08:00 |
|