baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
2061 commits 1 branch 0 tags 14 MiB
Commit graph

5 commits

Author SHA1 Message Date
Daniel Hiltgen
9d7b5d6c91 Ignore AMD integrated GPUs 
Detect and ignore integrated GPUs reported by rocm.
 2024-01-26 09:21:35 -08:00
Daniel Hiltgen
987c16b2f7 Report more information about GPUs in verbose mode 
This adds additional calls to both CUDA and ROCm management libraries to
discover additional attributes about the GPU(s) detected in the system, and
wires up runtime verbosity selection.  When users hit problems with GPUs we can
ask them to run with `OLLAMA_DEBUG=1 ollama serve` and share the results.
 2024-01-23 11:37:02 -08:00
Jeffrey Morgan
c336693f07
calculate overhead based number of gpu devices (#1875) 2024-01-09 15:53:33 -05:00
Daniel Hiltgen
a2ad952440 Fix windows system memory lookup 
This refines the gpu package error handling and fixes a bug with the
system memory lookup on windows.
 2024-01-03 08:50:01 -08:00
Daniel Hiltgen
35934b2e05 Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00