Jeffrey Morgan
|
c336693f07
|
calculate overhead based number of gpu devices (#1875)
|
2024-01-09 15:53:33 -05:00 |
|
Daniel Hiltgen
|
a2ad952440
|
Fix windows system memory lookup
This refines the gpu package error handling and fixes a bug with the
system memory lookup on windows.
|
2024-01-03 08:50:01 -08:00 |
|
Daniel Hiltgen
|
1b991d0ba9
|
Refine build to support CPU only
If someone checks out the ollama repo and doesn't install the CUDA
library, this will ensure they can build a CPU only version
|
2023-12-19 09:05:46 -08:00 |
|
Daniel Hiltgen
|
35934b2e05
|
Adapted rocm support to cgo based llama.cpp
|
2023-12-19 09:05:46 -08:00 |
|