Michael Yang 829ff87bd1 revert tokenize ffi (#4761) ... * Revert "use `int32_t` for call to tokenize (#4738)" This reverts commit 763bb65dbb. * Revert "vocab only" This reverts commit bf54c845e9. * Revert "use ffi for tokenizing/detokenizing" This reverts commit 26a00a0410.		2024-05-31 18:54:21 -07:00
..
ext_server	revert tokenize ffi (#4761)	2024-05-31 18:54:21 -07:00
generate	speed up tests by only building static lib (#4740)	2024-05-30 21:43:15 -07:00
llama.cpp@5921b8f089	Update llama.cpp submodule to 5921b8f0 (#4731)	2024-05-30 16:20:22 -07:00
patches	Update llama.cpp submodule to 5921b8f0 (#4731)	2024-05-30 16:20:22 -07:00
filetype.go	Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)	2024-05-23 13:21:49 -07:00
ggla.go	simplify safetensors reading	2024-05-21 11:28:22 -07:00
ggml.go	Update llm/ggml.go	2024-05-24 16:10:43 -07:00
gguf.go	simplify safetensors reading	2024-05-21 11:28:22 -07:00
llm.go	revert tokenize ffi (#4761)	2024-05-31 18:54:21 -07:00
llm_darwin_amd64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_darwin_arm64.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_linux.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00
llm_windows.go	Move nested payloads to installer and zip file on windows	2024-04-23 16:14:47 -07:00
memory.go	Move envconfig and consolidate env vars (#4608)	2024-05-24 14:57:15 -07:00
payload.go	Move nested payloads to installer and zip file on windows	2024-04-23 16:14:47 -07:00
server.go	revert tokenize ffi (#4761)	2024-05-31 18:54:21 -07:00
status.go	Switch back to subprocessing for llama.cpp	2024-04-01 16:48:18 -07:00