ollama/llm/generate
Daniel Hiltgen 8da7bef05f Support multiple variants for a given llm lib type
In some cases we may want multiple variants for a given GPU type or CPU.
This adds logic to have an optional Variant which we can use to select
an optimal library, but also allows us to try multiple variants in case
some fail to load.

This can be useful for scenarios such as ROCm v5 vs v6 incompatibility
or potentially CPU features.
2024-01-10 17:27:51 -08:00
..
gen_common.sh remove unused generate patches (#1810) 2024-01-05 11:25:45 -05:00
gen_darwin.sh clean up cmake build directory when cross compiling macOS builds 2024-01-09 17:13:56 -05:00
gen_linux.sh Support multiple variants for a given llm lib type 2024-01-10 17:27:51 -08:00
gen_windows.ps1 remove unused generate patches (#1810) 2024-01-05 11:25:45 -05:00
generate_darwin.go Code shuffle to clean up the llm dir 2024-01-04 12:12:05 -08:00
generate_linux.go Code shuffle to clean up the llm dir 2024-01-04 12:12:05 -08:00
generate_windows.go Code shuffle to clean up the llm dir 2024-01-04 12:12:05 -08:00