Daniel Hiltgen 8da7bef05f Support multiple variants for a given llm lib type ... In some cases we may want multiple variants for a given GPU type or CPU. This adds logic to have an optional Variant which we can use to select an optimal library, but also allows us to try multiple variants in case some fail to load. This can be useful for scenarios such as ROCm v5 vs v6 incompatibility or potentially CPU features.		2024-01-10 17:27:51 -08:00
..
gpu.go	Support multiple variants for a given llm lib type	2024-01-10 17:27:51 -08:00
gpu_darwin.go	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
gpu_info.h	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
gpu_info_cpu.c	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
gpu_info_cuda.c	Harden GPU mgmt library lookup	2024-01-10 15:06:41 -08:00
gpu_info_cuda.h	Harden GPU mgmt library lookup	2024-01-10 15:06:41 -08:00
gpu_info_rocm.c	Support multiple variants for a given llm lib type	2024-01-10 17:27:51 -08:00
gpu_info_rocm.h	Support multiple variants for a given llm lib type	2024-01-10 17:27:51 -08:00
gpu_test.go	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
types.go	Support multiple variants for a given llm lib type	2024-01-10 17:27:51 -08:00