1f50356e8e
This also adjusts our algorithm to favor our bundled ROCm. I've confirmed VRAM reporting still doesn't work properly so we can't yet enable concurrency by default. |
||
---|---|---|
.. | ||
ext_server | ||
generate | ||
llama.cpp@a8db2a9ce6 | ||
patches | ||
filetype.go | ||
ggla.go | ||
ggml.go | ||
ggml_test.go | ||
gguf.go | ||
llm.go | ||
llm_darwin_amd64.go | ||
llm_darwin_arm64.go | ||
llm_linux.go | ||
llm_windows.go | ||
memory.go | ||
memory_test.go | ||
payload.go | ||
server.go | ||
status.go |