baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
ollama/llm/llama.cpp
History
65a f8ef4439e9 Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. 
The build tags rocm or cuda must be specified to both go generate and go build.
ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well
as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the
CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also
used to switch VRAM detection between cuda and rocm implementations, using
added "accelerator_foo.go" files which contain architecture specific functions
and variables. accelerator_none is used when no tags are set, and a helper
function addRunner will ignore it if it is the chosen accelerator. Fix go
generate commands, thanks @deadmeu for testing.
2023-12-19 09:05:46 -08:00
..
gguf@a7aee47b98 update runner submodule 2023-12-18 17:33:46 -05:00
patches Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
gen_common.sh Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
gen_darwin.sh Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
gen_linux.sh Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
gen_windows.ps1 Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
generate_darwin.go Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
generate_linux.go Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
generate_linux_cuda.go Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. 2023-12-19 09:05:46 -08:00
generate_linux_rocm.go Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. 2023-12-19 09:05:46 -08:00
generate_windows.go Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00