ollama/gpu
Daniel Hiltgen d88c527be3 Build multiple CPU variants and pick the best
This reduces the built-in linux version to not use any vector extensions
which enables the resulting builds to run under Rosetta on MacOS in
Docker.  Then at runtime it checks for the actual CPU vector
extensions and loads the best CPU library available
2024-01-11 08:42:47 -08:00
..
gpu.go Build multiple CPU variants and pick the best 2024-01-11 08:42:47 -08:00
gpu_darwin.go Build multiple CPU variants and pick the best 2024-01-11 08:42:47 -08:00
gpu_info.h calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cpu.c calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cuda.c Harden GPU mgmt library lookup 2024-01-10 15:06:41 -08:00
gpu_info_cuda.h Harden GPU mgmt library lookup 2024-01-10 15:06:41 -08:00
gpu_info_rocm.c Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00
gpu_info_rocm.h Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00
gpu_test.go calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
types.go Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00