ollama/envconfig
Daniel Hiltgen 9929751cc8 Disable concurrency for AMD + Windows
Until ROCm v6.2 ships, we wont be able to get accurate free memory
reporting on windows, which makes automatic concurrency too risky.
Users can still opt-in but will need to pay attention to model sizes otherwise they may thrash/page VRAM or cause OOM crashes.
All other platforms and GPUs have accurate VRAM reporting wired
up now, so we can turn on concurrency by default.
2024-06-21 15:45:05 -07:00
..
config.go Disable concurrency for AMD + Windows 2024-06-21 15:45:05 -07:00
config_test.go move OLLAMA_HOST to envconfig (#5009) 2024-06-12 18:48:16 -04:00