58d95cc9bd
This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently. |
||
---|---|---|
.. | ||
gen_common.sh | ||
gen_darwin.sh | ||
gen_linux.sh | ||
gen_windows.ps1 | ||
generate_darwin.go | ||
generate_linux.go | ||
generate_windows.go |