ollama/gpu
peanut256 a189810df6
Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354)
* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak
2024-02-25 18:16:45 -05:00
..
amd.go Harden AMD driver lookup logic 2024-02-16 16:20:16 -08:00
cpu_common.go Mechanical switch from log to slog 2024-01-18 14:12:57 -08:00
gpu.go Harden AMD driver lookup logic 2024-02-16 16:20:16 -08:00
gpu_darwin.go Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 2024-02-25 18:16:45 -05:00
gpu_info.h Ignore AMD integrated GPUs 2024-01-26 09:21:35 -08:00
gpu_info_cpu.c calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
gpu_info_cuda.c Fix crash on cuda ml init failure 2024-01-26 09:18:33 -08:00
gpu_info_cuda.h More logging for gpu management 2024-01-24 10:32:36 -08:00
gpu_info_darwin.h Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 2024-02-25 18:16:45 -05:00
gpu_info_darwin.m Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) 2024-02-25 18:16:45 -05:00
gpu_info_rocm.c Update gpu_info_rocm.c 2024-01-26 22:08:27 -08:00
gpu_info_rocm.h More logging for gpu management 2024-01-24 10:32:36 -08:00
gpu_test.go Merge pull request #1819 from dhiltgen/multi_variant 2024-01-11 14:00:48 -08:00
types.go Detect AMD GPU info via sysfs and block old cards 2024-02-12 08:19:41 -08:00