Andrei Betlen
|
70b8a1ef75
|
Add support to get embeddings from high-level api. Closes #4
|
2023-03-28 04:59:54 -04:00 |
|
Andrei Betlen
|
9ba5c3c3b7
|
Bump version
|
2023-03-28 04:04:35 -04:00 |
|
Andrei Betlen
|
3dbb3fd3f6
|
Add support for stream parameter. Closes #1
|
2023-03-28 04:03:57 -04:00 |
|
Andrei Betlen
|
30fc0f3866
|
Extract generate method
|
2023-03-28 02:42:22 -04:00 |
|
Andrei Betlen
|
1c823f6d0f
|
Refactor Llama class and add tokenize / detokenize methods Closes #3
|
2023-03-28 01:45:37 -04:00 |
|
Andrei Betlen
|
6dbff7679c
|
Add docs link
|
2023-03-27 18:30:12 -04:00 |
|
Andrei Betlen
|
c210635c9b
|
Update llama.cpp
|
2023-03-27 01:35:51 -04:00 |
|
Andrei Betlen
|
0ea84df91c
|
Update llama.cpp
|
2023-03-26 14:00:37 -04:00 |
|
Andrei Betlen
|
4250380c0a
|
Bump version
|
2023-03-25 16:26:35 -04:00 |
|
Andrei Betlen
|
8ae3beda9c
|
Update Llama to add params
|
2023-03-25 16:26:23 -04:00 |
|
Andrei Betlen
|
4525236214
|
Update llama.cpp
|
2023-03-25 16:26:03 -04:00 |
|
Andrei Betlen
|
b121b7c05b
|
Update docstring
|
2023-03-25 12:33:18 -04:00 |
|
Andrei Betlen
|
206efa39df
|
Bump version
|
2023-03-25 12:12:39 -04:00 |
|
Andrei Betlen
|
fa92740a10
|
Update llama.cpp
|
2023-03-25 12:12:09 -04:00 |
|
Andrei Betlen
|
dfe8608096
|
Update examples
|
2023-03-24 19:10:31 -04:00 |
|
Andrei Betlen
|
5533ed7aa8
|
Update docs
|
2023-03-24 19:02:36 -04:00 |
|
Andrei Betlen
|
cbf8a62b64
|
Add repo url
|
2023-03-24 18:59:02 -04:00 |
|
Andrei Betlen
|
df15caa877
|
Add mkdocs
|
2023-03-24 18:57:59 -04:00 |
|
Andrei Betlen
|
a61fd3b509
|
Add example based on stripped down version of main.cpp from llama.cpp
|
2023-03-24 18:57:25 -04:00 |
|
Andrei Betlen
|
da9b71cfe5
|
Bump version
|
2023-03-24 18:44:04 -04:00 |
|
Andrei Betlen
|
4da5faa28b
|
Bugfix: cross-platform method to find shared lib
|
2023-03-24 18:43:29 -04:00 |
|
Andrei Betlen
|
b93675608a
|
Handle errors returned by llama.cpp
|
2023-03-24 15:47:17 -04:00 |
|
Andrei Betlen
|
bcde1f19b7
|
Bump version
|
2023-03-24 15:00:10 -04:00 |
|
Andrei Betlen
|
7786edb0f9
|
Black formatting
|
2023-03-24 14:59:29 -04:00 |
|
Andrei Betlen
|
c784d83131
|
Update llama.cpp and re-organize low-level api
|
2023-03-24 14:58:42 -04:00 |
|
Andrei Betlen
|
b9c53b88a1
|
Use n_ctx provided from actual context not params
|
2023-03-24 14:58:10 -04:00 |
|
Andrei Betlen
|
2cc499512c
|
Black formatting
|
2023-03-24 14:35:41 -04:00 |
|
Andrei Betlen
|
d29b05bb67
|
Update example to match alpaca training prompt
|
2023-03-24 14:34:15 -04:00 |
|
Andrei Betlen
|
e24c581b5a
|
Implement prompt batch processing as in main.cpp
|
2023-03-24 14:33:38 -04:00 |
|
Andrei Betlen
|
a28cb92d8f
|
Remove model_name param
|
2023-03-24 04:04:29 -04:00 |
|
Andrei Betlen
|
15e3dc7897
|
Add fastapi example
|
2023-03-24 01:41:24 -04:00 |
|
Andrei Betlen
|
281b5cfa6b
|
Update README.md
|
2023-03-24 00:06:24 -04:00 |
|
Andrei Betlen
|
27a5649cde
|
Update README.md
|
2023-03-23 23:55:42 -04:00 |
|
Andrei Betlen
|
9af16b63fd
|
Added low-level api inference example
|
2023-03-23 23:45:59 -04:00 |
|
Andrei Betlen
|
327365149e
|
Bump Version
|
2023-03-23 23:13:08 -04:00 |
|
Andrei Betlen
|
8680332203
|
Update examples
|
2023-03-23 23:12:42 -04:00 |
|
Andrei Betlen
|
2c25257c62
|
Update llama.cpp
|
2023-03-23 23:00:56 -04:00 |
|
Andrei Betlen
|
02760f8fa7
|
Update llama.cpp and shared library build process
|
2023-03-23 17:01:06 -04:00 |
|
Andrei Betlen
|
90c78723de
|
Add basic langchain demo
|
2023-03-23 16:25:24 -04:00 |
|
Andrei Betlen
|
eec9256a42
|
Bugfix: avoid decoding partial utf-8 characters
|
2023-03-23 16:25:13 -04:00 |
|
Andrei Betlen
|
6c596f4f5a
|
Update README
|
2023-03-23 16:00:10 -04:00 |
|
Andrei Betlen
|
73757a31ae
|
Version bump
|
2023-03-23 16:00:02 -04:00 |
|
Andrei Betlen
|
e63ea4dbbc
|
Add support for logprobs
|
2023-03-23 15:51:05 -04:00 |
|
Andrei Betlen
|
3d6eb32c76
|
Update basic example
|
2023-03-23 14:57:31 -04:00 |
|
Andrei Betlen
|
dba6df282d
|
Update repo url
|
2023-03-23 14:57:18 -04:00 |
|
Andrei Betlen
|
e34edfa7c7
|
Update pip instructions in readme
|
2023-03-23 14:24:34 -04:00 |
|
Andrei Betlen
|
93f074a4fa
|
Initial pypi release
|
2023-03-23 14:24:08 -04:00 |
|
Andrei Betlen
|
465238b179
|
Updated package to build with skbuild
|
2023-03-23 13:54:14 -04:00 |
|
Andrei Betlen
|
5bd6efb18a
|
Add llama.cpp to vendor folder
|
2023-03-23 05:37:26 -04:00 |
|
Andrei Betlen
|
79b304c9d4
|
Initial commit
|
2023-03-23 05:33:06 -04:00 |
|