Commit graph

249 commits

Author SHA1 Message Date
Andrei Betlen
788394c096 Update llama.cpp 2023-12-21 13:16:46 -05:00
Andrei Betlen
ffceb772d1 Update llama.cpp 2023-12-19 17:05:40 -05:00
Andrei Betlen
2fc48c54be Update llama.cpp 2023-12-18 15:32:15 -05:00
Andrei Betlen
534b1ea9b5 Update llama.cpp 2023-12-16 18:57:43 -05:00
Andrei Betlen
c0fc0a1e82 Update llama.cpp 2023-12-13 21:43:16 -05:00
Andrei Betlen
f1edc66b21 Update llama.cpp 2023-12-11 10:21:35 -05:00
Andrei Betlen
f3b844ed0a Update llama.cpp 2023-11-29 05:40:22 -05:00
Andrei Betlen
74f1949206 Update llama.cpp 2023-11-28 04:54:51 -05:00
Andrei Betlen
f99b2385ee Update llama.cpp 2023-11-27 19:03:10 -05:00
Andrei Betlen
f03a38e62a Update llama.cpp 2023-11-26 15:38:22 -05:00
Andrei Betlen
36048d46af Update llama.cpp 2023-11-23 16:26:00 -05:00
Andrei Betlen
dbfaf53fe0 Update llama.cpp 2023-11-21 18:12:38 -05:00
Andrei Betlen
63fe1370ed Update llama.cpp 2023-11-20 23:19:47 -05:00
Andrei Betlen
2c2afa320f Update llama.cpp 2023-11-20 14:11:33 -05:00
Andrei Betlen
55efc9e6b2 Update llama.cpp 2023-11-16 18:51:55 -05:00
Andrei Betlen
a14f46a720 Update llama.cpp 2023-11-14 14:08:52 -05:00
Andrei Betlen
020945049a Update llama.cpp 2023-11-13 22:20:19 -05:00
Andrei Betlen
7e3e85b53d Update llama.cpp 2023-11-10 16:33:55 -05:00
Andrei Betlen
fb743f6c87 Update llama.cpp 2023-11-10 06:21:14 -05:00
Andrei Betlen
80f4162bf4 Update llama.cpp 2023-11-08 11:18:15 -05:00
Andrei Betlen
9a8e64d29d Update llama.cpp 2023-11-07 23:14:19 -05:00
Damian Stewart
aab74f0b2b
Multimodal Support (Llava 1.5) (#821)
* llava v1.5 integration

* Point llama.cpp to fork

* Add llava shared library target

* Fix type

* Update llama.cpp

* Add llava api

* Revert changes to llama and llama_cpp

* Update llava example

* Add types for new gpt-4-vision-preview api

* Fix typo

* Update llama.cpp

* Update llama_types to match OpenAI v1 API

* Update ChatCompletionFunction type

* Reorder request parameters

* More API type fixes

* Even More Type Updates

* Add parameter for custom chat_handler to Llama class

* Fix circular import

* Convert to absolute imports

* Fix

* Fix pydantic Jsontype bug

* Accept list of prompt tokens in create_completion

* Add llava1.5 chat handler

* Add Multimodal notebook

* Clean up examples

* Add server docs

---------

Co-authored-by: Andrei Betlen <abetlen@gmail.com>
2023-11-07 22:48:51 -05:00
Andrei Betlen
f0b30ef7dc Update llama.cpp 2023-11-05 16:57:10 -05:00
Andrei Betlen
dccbac82eb Update llama.cpp 2023-11-03 18:12:22 -04:00
Andrei Betlen
df9362eeea Update llama.cpp 2023-11-03 11:34:50 -04:00
Andrei Betlen
f436e0c872 Update llama.cpp 2023-11-02 17:34:01 -04:00
Andrei Betlen
9ffe62d665 Update llama.cpp 2023-11-02 15:45:27 -04:00
Andrei Betlen
fa83cc5f9c Update llama.cpp
Fix build examples

Exclude examples directory

Revert cmake changes

Try actions/checkout@v4

Try to update submodules

Revert

Update llama.cpp

Fix build examples

Exclude examples directory

Revert cmake changes

Try actions/checkout@v4

Try to update submodules

Revert
2023-11-02 14:28:15 -04:00
Andrei Betlen
bdf5254658 Update llama.cpp 2023-11-01 14:15:56 -04:00
Andrei Betlen
d808fd436c Update llama.cpp 2023-10-31 21:29:35 -04:00
Andrei Betlen
53861c9e53 Update llama.cpp 2023-10-24 03:13:32 -04:00
Andrei Betlen
acf50f179a Update llama.cpp 2023-10-20 11:17:31 -04:00
Andrei Betlen
5a045fcbbc Update llama.cpp 2023-10-19 17:37:07 -04:00
Andrei Betlen
ff580031d2 Update llama.cpp 2023-10-19 02:55:08 -04:00
Andrei Betlen
d989ac86e6 Update llama.cpp 2023-10-15 15:12:57 -04:00
Andrei Betlen
f30aa20126 Update llama.cpp 2023-10-12 02:24:50 -04:00
Andrei Betlen
622bff19b2 Update llama.cpp 2023-10-10 19:23:35 -04:00
Andrei Betlen
43dfe1e2ab Update llama.cpp 2023-10-05 16:07:49 -04:00
Andrei Betlen
2c0456acf0 Update llama.cpp 2023-10-04 20:19:31 -04:00
Andrei Betlen
a7d17b8ac9 Update llama.cpp 2023-10-03 15:23:35 -04:00
Andrei Betlen
f0af1c7201 Update llama.cpp 2023-09-30 19:09:50 -04:00
Andrei Betlen
3720c739d4 Update llama.cpp 2023-09-29 19:58:21 -04:00
Andrei Betlen
a72efc77de Update llama.cpp 2023-09-28 23:25:14 -04:00
Andrei Betlen
1a1c3dc418 Update llama.cpp 2023-09-28 22:42:03 -04:00
Andrei Betlen
5da57734bc Update llama.cpp 2023-09-25 13:56:52 -04:00
Andrei Betlen
15000fca69 Update llama.cpp 2023-09-20 14:38:44 -04:00
Andrei Betlen
38e34c97f0 Update llama.cpp 2023-09-18 16:11:27 -04:00
Andrei Betlen
c7f45a7468 Update llama.cpp 2023-09-15 14:16:34 -04:00
Andrei Betlen
482ecd79c9 Revert "Update llama.cpp"
This reverts commit f73e385c33.
2023-09-14 17:03:18 -04:00
Andrei Betlen
f73e385c33 Update llama.cpp 2023-09-14 16:37:33 -04:00
Andrei Betlen
ca4eb952a6 Revert "Update llama.cpp"
This reverts commit aa2f8a5008.
2023-09-14 15:28:50 -04:00
Andrei Betlen
aa2f8a5008 Update llama.cpp 2023-09-14 14:44:59 -04:00
Andrei Betlen
cacfd562ba Update llama.cpp 2023-09-13 16:51:00 -04:00
Andrei Betlen
9bc912b150 Update llama.cpp 2023-09-12 16:08:51 -04:00
Andrei Betlen
d3f63211ef Update llama.cpp 2023-09-09 12:12:32 -04:00
Andrei Betlen
186626d58e Update llama.cpp 2023-09-01 14:26:13 -04:00
Andrei Betlen
47de3ab104 Update llama.cpp 2023-08-29 07:36:20 -04:00
Andrei Betlen
e0dcbc28a1 Update llama.cpp 2023-08-28 10:33:45 -04:00
Andrei Betlen
4887973c22 Update llama.cpp 2023-08-27 12:59:20 -04:00
Andrei Betlen
3a29d65f45 Update llama.cpp 2023-08-26 23:36:24 -04:00
Andrei Betlen
ef23d1e545 Update llama.cpp 2023-08-25 14:35:53 -04:00
Andrei Betlen
c2d1deaa8a Update llama.cpp 2023-08-24 18:01:42 -04:00
Andrei Betlen
bbbf0f4fc4 Update llama.cpp 2023-08-24 00:17:00 -04:00
Andrei Betlen
da1ef72c51 Update llama.cpp 2023-08-17 23:02:20 -04:00
Andrei Betlen
b345d60987 Update llama.cpp 2023-08-14 22:33:30 -04:00
Andrei Betlen
f6a7850e1a Update llama.cpp 2023-08-08 14:30:58 -04:00
Andrei Betlen
d8a3ddbb1c Update llama.cpp 2023-07-24 13:08:06 -04:00
Andrei Betlen
985d559971 Update llama.cpp 2023-07-24 13:04:34 -04:00
Andrei Betlen
b83728ad1e Update llama.cpp 2023-07-21 12:33:27 -04:00
Andrei Betlen
01435da740 Update llama.cpp 2023-07-20 18:54:25 -04:00
Andrei Betlen
9127bc2777 Update llama.cpp 2023-07-18 13:54:42 -04:00
Andrei Betlen
f72b6e9b73 Update llama.cpp 2023-07-15 15:01:08 -04:00
Andrei Betlen
e6c67c8f7d Update llama.cpp 2023-07-14 16:40:31 -04:00
Andrei Betlen
896ab7b88a Update llama.cpp 2023-07-13 23:24:55 -04:00
Andrei Betlen
9aa64163db Update llama.cpp 2023-07-09 11:40:59 -04:00
Andrei Betlen
00da643929 Update llama.cpp 2023-07-08 20:30:34 -04:00
Andrei Betlen
7887376bff Update llama.cpp 2023-07-07 19:06:54 -04:00
Andrei Betlen
cc542b4452 Update llama.cpp 2023-07-07 03:04:54 -04:00
Andrei Betlen
98ae4e58a3 Update llama.cpp 2023-07-06 17:57:56 -04:00
Andrei Betlen
b994296c75 Update llama.cpp 2023-07-05 01:00:14 -04:00
Andrei Betlen
c67f786360 Update llama.cpp 2023-06-29 01:08:15 -04:00
Andrei Betlen
952228407e Update llama.cpp 2023-06-26 08:50:38 -04:00
Andrei Betlen
e37798777e Update llama.cpp 2023-06-20 11:25:10 -04:00
Andrei Betlen
44dcb5cf71 Update llama.cpp 2023-06-18 09:37:20 -04:00
Andrei Betlen
60426b23cc Update llama.cpp 2023-06-17 13:37:14 -04:00
Andrei Betlen
d7153abcf8 Update llama.cpp 2023-06-16 23:11:14 -04:00
Andrei Betlen
715f98c591 Update llama.cpp 2023-06-14 21:40:13 -04:00
Andrei Betlen
890ae442b9 Update llama.cpp 2023-06-10 18:10:01 -04:00
Andrei Betlen
6639371407 Update llama.cpp 2023-06-10 12:17:38 -04:00
Andrei Betlen
c0f7e739c9 Update llama.cpp 2023-06-09 12:39:09 -04:00
Andrei Betlen
312f6eb144 Update llama.cpp 2023-06-08 16:46:55 -04:00
Andrei Betlen
69355403c6 Update llama.cpp 2023-06-08 00:15:17 -04:00
Andrei Betlen
bf322861e8 Update llama.cpp 2023-06-07 03:43:33 -04:00
Andrei Betlen
aad4b17f52 Update llama.cpp 2023-06-06 16:23:55 -04:00
Andrei Betlen
7b57420ea9 Update llama.cpp 2023-06-05 18:17:29 -04:00
Andrei Betlen
6d5b049801 Update llama.cpp 2023-06-04 23:30:42 -04:00
Andrei Betlen
5377f9784a Update llama.cpp 2023-05-31 23:24:52 -04:00
Andrei Betlen
30bf8ec557 Update llama.cpp 2023-05-26 03:03:11 -04:00
Andrei Betlen
c41b1ebca7 Update llama.cpp 2023-05-22 23:50:35 -04:00
Andrei Betlen
fafe47114c Update llama.cpp 2023-05-21 17:47:21 -04:00
Andrei Betlen
50e136252a Update llama.cpp 2023-05-17 16:14:12 -04:00
Andrei Betlen
e37a808bc0 Update llama.cpp 2023-05-16 23:33:53 -04:00
Andrei Betlen
214589e462 Update llama.cpp 2023-05-16 17:20:45 -04:00
Andrei Betlen
ceec21f1e9 Update llama.cpp 2023-05-14 22:07:35 -04:00
Andrei Betlen
cdf59768f5 Update llama.cpp 2023-05-14 00:04:22 -04:00
Andrei Betlen
28ee2adec2 Update llama.cpp 2023-05-11 21:15:12 -04:00
Andrei Betlen
35229f5eab Update llama.cpp 2023-05-11 10:05:34 -04:00
Andrei Betlen
f315b82832 Revert changes to llama.cpp and setup.py 2023-05-08 19:53:21 -04:00
Maximilian Winter
515d9bde7e Fixed somethings and activated cublas 2023-05-06 23:40:19 +02:00
Andrei Betlen
d78cec67df Update llama.cpp 2023-05-04 12:20:25 -04:00
Andrei Betlen
1d47cce222 Update llama.cpp 2023-05-03 09:33:30 -04:00
Andrei Betlen
f073ef0571 Update llama.cpp 2023-05-01 15:23:01 -04:00
Andrei Betlen
80184a286c Update llama.cpp 2023-05-01 10:44:28 -04:00
Andrei Betlen
ea0faabae1 Update llama.cpp 2023-04-28 15:32:43 -04:00
Andrei Betlen
9339929f56 Update llama.cpp 2023-04-26 20:00:54 -04:00
Andrei Betlen
cbd26fdcc1 Update llama.cpp 2023-04-25 19:03:41 -04:00
Andrei Betlen
c4c332fc51 Update llama.cpp 2023-04-24 17:42:09 -04:00
Andrei Betlen
280a047dd6 Update llama.cpp 2023-04-24 15:52:24 -04:00
Andrei Betlen
02cf881317 Update llama.cpp 2023-04-24 09:30:10 -04:00
Andrei Betlen
e99caedbbd Update llama.cpp 2023-04-22 19:50:28 -04:00
Andrei Betlen
1eb130a6b2 Update llama.cpp 2023-04-21 17:40:27 -04:00
Andrei Betlen
ba3959eafd Update llama.cpp 2023-04-20 05:15:31 -04:00
Andrei Betlen
3d290623f5 Update llama.cpp 2023-04-20 01:08:15 -04:00
Andrei Betlen
207ebbc8dc Update llama.cpp 2023-04-19 14:02:11 -04:00
Andrei Betlen
b2d44aa633 Update llama.cpp 2023-04-18 02:22:35 -04:00
Andrei Betlen
3f68e95097 Update llama.cpp 2023-04-18 01:29:27 -04:00
Andrei Betlen
887f3b73ac Update llama.cpp 2023-04-15 12:16:05 -04:00
Andrei Betlen
25b646c2fb Update llama.cpp 2023-04-14 23:32:05 -04:00
Andrei Betlen
9c8c2c37dc Update llama.cpp 2023-04-14 10:01:57 -04:00
Andrei Betlen
005c78d26c Update llama.cpp 2023-04-12 14:29:00 -04:00
Andrei Betlen
2a60eb820f Update llama.cpp 2023-04-11 23:53:46 -04:00
Andrei Betlen
9f1e565594 Update llama.cpp 2023-04-11 11:59:03 -04:00
Andrei Betlen
5247e32d9e Update llama.cpp 2023-04-10 12:56:23 -04:00
Andrei Betlen
c3c2623e8b Update llama.cpp 2023-04-09 22:01:33 -04:00
Andrei Betlen
a3f713039f Update llama.cpp 2023-04-08 02:38:42 -04:00
Andrei Betlen
74bf043ddd Update llama.cpp 2023-04-05 16:25:54 -04:00
Andrei Betlen
4530197629 Update llama.cpp 2023-04-03 14:49:07 -04:00
Andrei Betlen
1ed8cd023d Update llama_cpp and add kv_cache api support 2023-04-02 13:33:49 -04:00
Andrei Betlen
3af274cbd4 Update llama.cpp 2023-04-01 13:00:09 -04:00
Andrei Betlen
f5e03805f7 Update llama.cpp 2023-03-31 00:00:43 -04:00
Andrei Betlen
8908f4614c Update llama.cpp 2023-03-28 21:10:23 -04:00
Andrei Betlen
c210635c9b Update llama.cpp 2023-03-27 01:35:51 -04:00
Andrei Betlen
0ea84df91c Update llama.cpp 2023-03-26 14:00:37 -04:00
Andrei Betlen
4525236214 Update llama.cpp 2023-03-25 16:26:03 -04:00
Andrei Betlen
fa92740a10 Update llama.cpp 2023-03-25 12:12:09 -04:00
Andrei Betlen
c784d83131 Update llama.cpp and re-organize low-level api 2023-03-24 14:58:42 -04:00
Andrei Betlen
2c25257c62 Update llama.cpp 2023-03-23 23:00:56 -04:00
Andrei Betlen
02760f8fa7 Update llama.cpp and shared library build process 2023-03-23 17:01:06 -04:00
Andrei Betlen
5bd6efb18a Add llama.cpp to vendor folder 2023-03-23 05:37:26 -04:00