ollama/gpu
Daniel Hiltgen b32ebb4f29 Use DRM driver for VRAM info for amd
The amdgpu drivers free VRAM reporting omits some other apps, so leverage the
upstream DRM driver which keeps better tabs on things
2024-06-14 14:51:40 -07:00
..
amd_common.go Support Fedoras standard ROCm location 2024-05-01 15:47:12 -07:00
amd_hip_windows.go Record more GPU information 2024-05-09 14:18:14 -07:00
amd_linux.go Use DRM driver for VRAM info for amd 2024-06-14 14:51:40 -07:00
amd_windows.go lint windows 2024-06-04 11:13:30 -07:00
assets.go lint 2024-06-04 11:13:30 -07:00
cpu_common.go Wait for GPU free memory reporting to converge 2024-05-09 14:56:01 -07:00
cuda_common.go lint linux 2024-06-04 11:13:30 -07:00
gpu.go Revert "Limit GPU lib search for now (#4777)" 2024-06-14 14:51:40 -07:00
gpu_darwin.go Bump VRAM buffer back up 2024-05-10 09:15:28 -07:00
gpu_info.h support ollama run on Intel GPUs 2024-05-24 11:18:27 +08:00
gpu_info_cpu.c Record more GPU information 2024-05-09 14:18:14 -07:00
gpu_info_cudart.c Request and model concurrency 2024-04-22 19:29:12 -07:00
gpu_info_cudart.h Add CUDA Driver API for GPU discovery 2024-04-30 18:00:45 -07:00
gpu_info_darwin.h darwin: no partial offloading if required memory greater than system 2024-04-16 11:22:38 -07:00
gpu_info_darwin.m darwin: no partial offloading if required memory greater than system 2024-04-16 11:22:38 -07:00
gpu_info_nvcuda.c Record more GPU information 2024-05-09 14:18:14 -07:00
gpu_info_nvcuda.h Record more GPU information 2024-05-09 14:18:14 -07:00
gpu_info_oneapi.c support ollama run on Intel GPUs 2024-05-24 11:18:27 +08:00
gpu_info_oneapi.h support ollama run on Intel GPUs 2024-05-24 11:18:27 +08:00
gpu_oneapi.go support ollama run on Intel GPUs 2024-05-24 11:18:27 +08:00
gpu_test.go lint 2024-06-04 11:13:30 -07:00
types.go Record more GPU information 2024-05-09 14:18:14 -07:00