ollama/gpu
Daniel Hiltgen de2fbdec99
Merge pull request #1819 from dhiltgen/multi_variant
Support multiple LLM libs; ROCm v5 and v6; Rosetta, AVX, and AVX2 compatible CPU builds
2024-01-11 14:00:48 -08:00
..
cpu_common.go Always dynamically load the llm server library 2024-01-11 08:42:47 -08:00
gpu.go Build multiple CPU variants and pick the best 2024-01-11 08:42:47 -08:00
gpu_darwin.go Always dynamically load the llm server library 2024-01-11 08:42:47 -08:00
gpu_info.h calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cpu.c calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cuda.c Harden GPU mgmt library lookup 2024-01-10 15:06:41 -08:00
gpu_info_cuda.h Harden GPU mgmt library lookup 2024-01-10 15:06:41 -08:00
gpu_info_rocm.c Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00
gpu_info_rocm.h Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00
gpu_test.go Merge pull request #1819 from dhiltgen/multi_variant 2024-01-11 14:00:48 -08:00
types.go Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00