ollama/llm
Daniel Hiltgen 325d74985b Fix CPU performance on hyperthreaded systems
The default thread count logic was broken and resulted in 2x the number
of threads as it should on a hyperthreading CPU
resulting in thrashing and poor performance.
2023-12-21 16:23:36 -08:00
..
llama.cpp Fix CPU performance on hyperthreaded systems 2023-12-21 16:23:36 -08:00
dynamic_shim.c Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
dynamic_shim.h Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
ext_server.go Fix CPU performance on hyperthreaded systems 2023-12-21 16:23:36 -08:00
ggml.go deprecate ggml 2023-12-19 09:05:46 -08:00
gguf.go remove per-model types 2023-12-11 09:40:21 -08:00
llama.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
llm.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
shim_darwin.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
shim_ext_server.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
utils.go partial decode ggml bin for more info 2023-08-10 09:23:10 -07:00