f457d63400
If the system has multiple numa nodes, enable numa support in llama.cpp If we detect numactl in the path, use that, else use the basic "distribute" mode. |
||
---|---|---|
.. | ||
ext_server | ||
generate | ||
llama.cpp@6eeaeba126 | ||
patches | ||
filetype.go | ||
ggla.go | ||
ggml.go | ||
ggml_test.go | ||
gguf.go | ||
llm.go | ||
llm_darwin_amd64.go | ||
llm_darwin_arm64.go | ||
llm_linux.go | ||
llm_windows.go | ||
memory.go | ||
memory_test.go | ||
payload.go | ||
server.go | ||
status.go |