Jeffrey Morgan c4cf8ad559 llm: avoid loading model if system memory is too small (#5637) ... * llm: avoid loading model if system memory is too small * update log * Instrument swap free space On linux and windows, expose how much swap space is available so we can take that into consideration when scheduling models * use `systemSwapFreeMemory` in check --------- Co-authored-by: Daniel Hiltgen <daniel@ollama.com>		2024-07-11 16:42:57 -07:00
..
ext_server	llm: allow gemma 2 to context shift (#5534)	2024-07-07 13:41:51 -04:00
generate	llm: dont link cuda with compat libs (#5621)	2024-07-10 20:01:52 -07:00
llama.cpp@a8db2a9ce6	Update llama.cpp submodule to a8db2a9c (#5530)	2024-07-07 13:03:09 -04:00
patches	Update llama.cpp submodule to a8db2a9c (#5530)	2024-07-07 13:03:09 -04:00
filetype.go	Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)	2024-05-23 13:21:49 -07:00
ggla.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
ggml.go	chatglm graph	2024-07-10 13:43:47 -07:00
ggml_test.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
gguf.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
llm.go	Statically link c++ and thread lib	2024-07-09 11:34:30 -07:00
llm_darwin_amd64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_darwin_arm64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_linux.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_windows.go	Move nested payloads to installer and zip file on windows	2024-04-23 16:14:47 -07:00
memory.go	handle asymmetric embedding KVs	2024-06-20 09:57:27 -07:00
memory_test.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
payload.go	Fix corner cases on tmp cleaner on mac	2024-07-03 13:10:14 -07:00
server.go	llm: avoid loading model if system memory is too small (#5637)	2024-07-11 16:42:57 -07:00
status.go	fix error detection by limiting model loading error parsing (#5472)	2024-07-03 20:04:30 -04:00