ollama/envconfig
Daniel Hiltgen cc269ba094 Remove no longer supported max vram var
The OLLAMA_MAX_VRAM env var was a temporary workaround for OOM
scenarios.  With Concurrency this was no longer wired up, and the simplistic
value doesn't map to multi-GPU setups.  Users can still set `num_gpu`
to limit memory usage to avoid OOM if we get our predictions wrong.
2024-07-22 09:08:11 -07:00
..
config.go Remove no longer supported max vram var 2024-07-22 09:08:11 -07:00
config_test.go Only set default keep_alive on initial model load 2024-07-03 15:29:56 -07:00