ollama/gpu
Daniel Hiltgen be330174dd Allow setting max vram for workarounds
Until we get all the memory calculations correct, this can provide
and escape valve for users to workaround out of memory crashes.
2024-03-06 17:15:06 -08:00
..
amd.go Harden AMD driver lookup logic 2024-02-16 16:20:16 -08:00
cpu_common.go Mechanical switch from log to slog 2024-01-18 14:12:57 -08:00
gpu.go Allow setting max vram for workarounds 2024-03-06 17:15:06 -08:00
gpu_darwin.go Allow setting max vram for workarounds 2024-03-06 17:15:06 -08:00
gpu_info.h Ignore AMD integrated GPUs 2024-01-26 09:21:35 -08:00
gpu_info_cpu.c calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cuda.c fix: print usedMemory size right (#2827) 2024-02-29 11:11:04 -08:00
gpu_info_cuda.h More logging for gpu management 2024-01-24 10:32:36 -08:00
gpu_info_darwin.h Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 2024-02-25 18:16:45 -05:00
gpu_info_darwin.m Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 2024-02-25 18:16:45 -05:00
gpu_info_rocm.c Update gpu_info_rocm.c 2024-01-26 22:08:27 -08:00
gpu_info_rocm.h More logging for gpu management 2024-01-24 10:32:36 -08:00
gpu_test.go Merge pull request #1819 from dhiltgen/multi_variant 2024-01-11 14:00:48 -08:00
types.go Detect AMD GPU info via sysfs and block old cards 2024-02-12 08:19:41 -08:00