baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
ollama/llm/llama.cpp
History
Daniel Hiltgen 7555ea44f8 Revamp the dynamic library shim 
This switches the default llama.cpp to be CPU based, and builds the GPU variants
as dynamically loaded libraries which we can select at runtime.

This also bumps the ROCm library to version 6 given 5.7 builds don't work
on the latest ROCm library that just shipped.
2023-12-20 14:45:57 -08:00
..
gguf@328b83de23 Bump llama.cpp to b1662 and set n_parallel=1 2023-12-19 09:05:46 -08:00
patches Bump llama.cpp to b1662 and set n_parallel=1 2023-12-19 09:05:46 -08:00
gen_common.sh Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
gen_darwin.sh Fix darwin intel build 2023-12-19 13:32:24 -08:00
gen_linux.sh Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
gen_windows.ps1 Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00
generate_darwin.go Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00
generate_linux.go Adapted rocm support to cgo based llama.cpp 2023-12-19 09:05:46 -08:00
generate_windows.go Add cgo implementation for llama.cpp 2023-12-19 09:05:46 -08:00