Daniel Hiltgen d74ce6bd4f Detect very old CUDA GPUs and fall back to CPU ... If we try to load the CUDA library on an old GPU, it panics and crashes the server. This checks the compute capability before we load the library so we can gracefully fall back to CPU mode.		2024-01-06 21:40:29 -08:00
..
gpu.go	Detect very old CUDA GPUs and fall back to CPU	2024-01-06 21:40:29 -08:00
gpu_darwin.go	set num_gpu to 1 only by default on darwin arm64 (#1771)	2024-01-03 14:10:29 -05:00
gpu_info.h	Fix windows system memory lookup	2024-01-03 08:50:01 -08:00
gpu_info_cpu.c	Fix windows system memory lookup	2024-01-03 08:50:01 -08:00
gpu_info_cuda.c	Detect very old CUDA GPUs and fall back to CPU	2024-01-06 21:40:29 -08:00
gpu_info_cuda.h	Detect very old CUDA GPUs and fall back to CPU	2024-01-06 21:40:29 -08:00
gpu_info_rocm.c	Fix windows system memory lookup	2024-01-03 08:50:01 -08:00
gpu_info_rocm.h	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00
gpu_test.go	Fix windows system memory lookup	2024-01-03 08:50:01 -08:00
types.go	Fix windows system memory lookup	2024-01-03 08:50:01 -08:00