Commit graph

1516 commits

Author SHA1 Message Date
Andrei Betlen
51dbcf2693 Bugfix: wrong signature for quantize function 2023-04-04 22:36:59 -04:00
Andrei Betlen
8279fb7d92 Bump version 2023-04-04 17:17:11 -04:00
Andrei Betlen
c137789143 Add verbose flag. Closes #19 2023-04-04 13:09:24 -04:00
Andrei Betlen
5075c16fcc Bugfix: n_batch should always be <= n_ctx 2023-04-04 13:08:21 -04:00
Mug
c862e8bac5 Fix repeating instructions and an antiprompt bug 2023-04-04 17:54:47 +02:00
Andrei Betlen
248b0566fa Update README 2023-04-04 10:57:22 -04:00
Mug
9cde7973cc Fix stripping instruction prompt 2023-04-04 16:20:27 +02:00
Mug
da5a6a7089 Added instruction mode, fixed infinite generation, and various other fixes 2023-04-04 16:18:26 +02:00
Mug
0b32bb3d43 Add instruction mode 2023-04-04 11:48:48 +02:00
Andrei Betlen
ffe34cf64d Allow user to set llama config from env vars 2023-04-04 00:52:44 -04:00
Andrei Betlen
05eb2087d8 Small fixes for examples 2023-04-03 20:33:07 -04:00
Andrei Betlen
caf3c0362b Add return type for default __call__ method 2023-04-03 20:26:08 -04:00
Andrei Betlen
4aa349d777 Add docstring for create_chat_completion 2023-04-03 20:24:20 -04:00
Andrei Betlen
4615f1e520 Add chat completion method to docs 2023-04-03 20:14:03 -04:00
Andrei Betlen
5cf29d0231 Bump version 2023-04-03 20:13:46 -04:00
Andrei Betlen
7fedf16531 Add support for chat completion 2023-04-03 20:12:44 -04:00
Andrei Betlen
3dec778c90 Update to more sensible return signature 2023-04-03 20:12:14 -04:00
Andrei Betlen
f7ab8d55b2 Update context size defaults Close #11 2023-04-03 20:11:13 -04:00
Andrei Betlen
c0a5c0171f Add embed back into documentation 2023-04-03 18:53:00 -04:00
Andrei Betlen
adf656d542 Bump version 2023-04-03 18:46:49 -04:00
Andrei Betlen
ae004eb69e Fix #16 2023-04-03 18:46:19 -04:00
Mug
f1615f05e6 Chat llama.cpp example implementation 2023-04-03 22:54:46 +02:00
Andrei Betlen
7d1977e8f0 Bump version 2023-04-03 14:49:36 -04:00
Andrei Betlen
4530197629 Update llama.cpp 2023-04-03 14:49:07 -04:00
Andrei
1d9a988644
Merge pull request #10 from MillionthOdin16/patch-1
Improve Shared Library Loading Mechanism
2023-04-03 14:47:11 -04:00
MillionthOdin16
a0758f0077
Update llama_cpp.py with PR requests
lib_base_name and load_shared_library
to 
_lib_base_name and _load_shared_library
2023-04-03 13:06:50 -04:00
MillionthOdin16
a40476e299
Update llama_cpp.py
Make shared library code more robust with some platform specific functionality and more descriptive errors when failures occur
2023-04-02 21:50:13 -04:00
Andrei Betlen
b9a4513363 Update README 2023-04-02 21:03:39 -04:00
Andrei Betlen
7284adcaa8 Bump version 2023-04-02 13:36:07 -04:00
Andrei Betlen
1ed8cd023d Update llama_cpp and add kv_cache api support 2023-04-02 13:33:49 -04:00
Andrei Betlen
74061b209d Bump version 2023-04-02 03:59:47 -04:00
Andrei Betlen
4f509b963e Bugfix: Stop sequences and missing max_tokens check 2023-04-02 03:59:19 -04:00
Andrei Betlen
42dd11c2b4 Bump version 2023-04-02 00:10:46 -04:00
Andrei Betlen
2bc184dc63 Add new methods to docs 2023-04-02 00:09:51 -04:00
Andrei Betlen
353e18a781 Move workaround to new sample method 2023-04-02 00:06:34 -04:00
Andrei Betlen
a4a1bbeaa9 Update api to allow for easier interactive mode 2023-04-02 00:02:47 -04:00
Andrei Betlen
eef627c09c Fix example documentation 2023-04-01 17:39:35 -04:00
Andrei Betlen
a836639822 Bump version 2023-04-01 17:37:05 -04:00
Andrei Betlen
1e4346307c Add documentation for generate method 2023-04-01 17:36:30 -04:00
Andrei Betlen
33f1529c50 Bump version 2023-04-01 17:30:47 -04:00
Andrei Betlen
f14a31c936 Document generate method 2023-04-01 17:29:43 -04:00
Andrei Betlen
67c70cc8eb Add static methods for beginning and end of sequence tokens. 2023-04-01 17:29:30 -04:00
Andrei Betlen
caff127836 Remove commented out code 2023-04-01 15:13:01 -04:00
Andrei Betlen
f28bf3f13d Bugfix: enable embeddings for fastapi server 2023-04-01 15:12:25 -04:00
Andrei Betlen
c25b7dfc86 Bump version 2023-04-01 13:06:05 -04:00
Andrei Betlen
ed6f2a049e Add streaming and embedding endpoints to fastapi example 2023-04-01 13:05:20 -04:00
Andrei Betlen
0503e7f9b4 Update api 2023-04-01 13:04:12 -04:00
Andrei Betlen
9f975ac44c Add development section 2023-04-01 13:03:56 -04:00
Andrei Betlen
9fac0334b2 Update embedding example to new api 2023-04-01 13:02:51 -04:00
Andrei Betlen
5e011145c5 Update low level api example 2023-04-01 13:02:10 -04:00