Okabintaro 10b0cb727b fix: Make LLamaState pickable for disk cache ... I fixed the issue by making the saved state a bytes object instead of the ctypes one which can't be pickled.		2023-06-13 12:03:31 +02:00
..
server	Fix cache implementation breaking changes	2023-06-08 13:19:23 -04:00
__init__.py	Black formatting	2023-03-24 14:59:29 -04:00
llama.py	fix: Make LLamaState pickable for disk cache	2023-06-13 12:03:31 +02:00
llama_cpp.py	Update llama.cpp	2023-06-10 12:17:38 -04:00
llama_types.py	Allow first logprob token to be null to match openai api	2023-05-19 02:04:57 -04:00