ollama

baalajimaestro/ollama

Fork 0

Commit graph

Author SHA1 Message Date

Author	SHA1	Message	Date
Michael Yang	41a272de9f	darwin: no partial offloading if required memory greater than system	2024-04-16 11:22:38 -07:00
peanut256	a189810df6	Determine max VRAM on macOS using `recommendedMaxWorkingSetSize` (#2354 ) * read iogpu.wired_limit_mb on macOS Fix for https://github.com/ollama/ollama/issues/1826 * improved determination of available vram on macOS read the recommended maximal vram on macOS via Metal API * Removed macOS-specific logging * Remove logging from gpu_darwin.go * release Core Foundation object fixes a possible memory leak	2024-02-25 18:16:45 -05:00

Michael Yang

41a272de9f

darwin: no partial offloading if required memory greater than system

2024-04-16 11:22:38 -07:00

peanut256

a189810df6

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354 )

* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak

2024-02-25 18:16:45 -05:00

2 commits