baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Set corret CUDA minimum compute capability version

Browse source 
If you attempt to run the current CUDA build on compute capability 5.2
cards, you'll hit the following failure:
cuBLAS error 15 at ggml-cuda.cu:7956: the requested functionality is not supported
This commit is contained in:
Daniel Hiltgen 2024-01-09 11:28:24 -08:00
parent 8a8c7e7f8d
commit 1961a81f03
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
gpu/gpu.go
View file

@ -26,8 +26,8 @@ type handles struct {
var gpuMutex sync.Mutex var gpuMutex sync.Mutex
var gpuHandles *handles = nil var gpuHandles *handles = nil
// TODO verify this is the correct min version // With our current CUDA compile flags, 5.2 and older will not work properly
const CudaComputeMajorMin = 5 const CudaComputeMajorMin = 6
// Note: gpuMutex must already be held // Note: gpuMutex must already be held
func initGPUHandles() { func initGPUHandles() {