Jeffrey Morgan d89454de80 Use slot with cached prompt instead of least recently used (#5492) ... * Use common prefix to select slot * actually report `longest`		2024-07-05 12:32:47 -04:00
..
ext_server	Use slot with cached prompt instead of least recently used (#5492)	2024-07-05 12:32:47 -04:00
generate	Merge pull request #5072 from dhiltgen/windows_path	2024-06-19 09:13:39 -07:00
llama.cpp@7c26775adb	llm: update llama.cpp commit to 7c26775 (#4896)	2024-06-17 15:56:16 -04:00
patches	Fix assert on small embedding inputs (#5491)	2024-07-05 11:20:57 -04:00
filetype.go	Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)	2024-05-23 13:21:49 -07:00
ggla.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
ggml.go	gemma2 graph	2024-06-27 13:34:52 -07:00
ggml_test.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
gguf.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
llm.go	revert tokenize ffi (#4761)	2024-05-31 18:54:21 -07:00
llm_darwin_amd64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_darwin_arm64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_linux.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_windows.go	Move nested payloads to installer and zip file on windows	2024-04-23 16:14:47 -07:00
memory.go	handle asymmetric embedding KVs	2024-06-20 09:57:27 -07:00
memory_test.go	llm: speed up gguf decoding by a lot (#5246)	2024-06-24 21:47:52 -07:00
payload.go	Fix corner cases on tmp cleaner on mac	2024-07-03 13:10:14 -07:00
server.go	Merge pull request #5243 from dhiltgen/modelfile_use_mmap	2024-07-03 13:59:42 -07:00
status.go	fix error detection by limiting model loading error parsing (#5472)	2024-07-03 20:04:30 -04:00