llama.cpp

baalajimaestro/llama.cpp

Fork 0

Commit graph

3674e5ed4e Update model path Andrei Betlen 2023-08-24 01:01:20 -0400
db982a861f Fix Andrei Betlen 2023-08-24 01:01:12 -0400
4ed632c4b3 Remove deprecated params Andrei Betlen 2023-08-24 01:01:05 -0400
cf405f6764 Merge branch 'main' into v0.2-wip Andrei Betlen 2023-08-24 00:30:51 -0400
bbbf0f4fc4 Update llama.cpp Andrei Betlen 2023-08-24 00:17:00 -0400
d644199fe8

Merge pull request #625 from abetlen/dependabot/pip/mkdocs-material-9.2.0 Andrei 2023-08-22 15:53:57 -0400
abca3d81c8

Bump mkdocs-material from 9.1.21 to 9.2.0 dependabot[bot] 2023-08-21 20:53:56 +0000
2a0844b190

Merge pull request #556 from Huge/patch-1 Andrei 2023-08-17 23:21:45 -0400
876f39d751

Merge pull request #564 from Isydmr/main Andrei 2023-08-17 23:21:27 -0400
4cf0461f97

Merge pull request #598 from pradhyumna85/main Andrei 2023-08-17 23:20:43 -0400
8fc3fa9f1c Bump version Andrei Betlen 2023-08-17 23:17:56 -0400
da1ef72c51 Update llama.cpp Andrei Betlen 2023-08-17 23:02:20 -0400
e632c59fa0 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-08-17 20:53:04 -0400
7ac73b8d94

Merge pull request #621 from c0sogi/main Andrei 2023-08-17 20:52:48 -0400
a240aa6b25 Fix typos in llama_grammar c0sogi 2023-08-17 21:00:44 +0900
620cd2fd69 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-08-14 22:41:47 -0400
5788f1f2b2 Remove unnused import Andrei Betlen 2023-08-14 22:41:37 -0400
6dfb98117e

Merge pull request #600 from Vuizur/main Andrei 2023-08-14 22:40:41 -0400
b99e758045

Merge pull request #604 from aliencaocao/main-1 Andrei 2023-08-14 22:40:10 -0400
b345d60987 Update llama.cpp Andrei Betlen 2023-08-14 22:33:30 -0400
91e86e5d71

Merge pull request #610 from abetlen/dependabot/pip/fastapi-0.101.1 Andrei 2023-08-14 22:22:56 -0400
c48b18b364

Merge pull request #611 from abetlen/dependabot/pip/sse-starlette-1.6.5 Andrei 2023-08-14 22:22:51 -0400
07e23f46a5

Merge pull request #612 from abetlen/dependabot/pip/pydantic-settings-2.0.3 Andrei 2023-08-14 22:22:44 -0400
485ad97909

Bump pydantic-settings from 2.0.2 to 2.0.3 dependabot[bot] 2023-08-14 20:40:16 +0000
e91969c888

Bump sse-starlette from 1.6.1 to 1.6.5 dependabot[bot] 2023-08-14 20:38:42 +0000
077f8ed23e

Bump fastapi from 0.101.0 to 0.101.1 dependabot[bot] 2023-08-14 20:36:56 +0000
c471871d0b

make n_gpu_layers=-1 offload all layers Billy Cao 2023-08-13 11:21:28 +0800
d018c7b01d

Add doc string for n_gpu_layers argument Billy Cao 2023-08-12 18:41:47 +0800
17dd7fa8e0 Add py.typed Hannes Krumbiegel 2023-08-11 09:58:48 +0200
d010ea70d2

Fixed Cuda Dockerfile Pradyumna Singh Rathore 2023-08-10 20:41:34 +0530
88184ed217 fix CJK output again MeouSker77 2023-08-09 22:04:35 +0800
66fb0345e8 Move grammar to function call argument Andrei Betlen 2023-08-08 15:08:54 -0400
1e844d3238 fix Andrei Betlen 2023-08-08 15:07:28 -0400
843b7ccd90 Merge branch 'main' into c0sogi/main Andrei Betlen 2023-08-08 14:43:02 -0400
bf0c603c51 Merge branch 'main' into fix-on-m1 Andrei Betlen 2023-08-08 14:38:35 -0400
36041c8bec Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-08-08 14:35:10 -0400
d015bdb4f8 Add mul_mat_q option Andrei Betlen 2023-08-08 14:35:06 -0400
dcc26f7f78

Merge pull request #573 from mzen17/spelling-error-patch Andrei 2023-08-08 14:32:34 -0400
f6a7850e1a Update llama.cpp Andrei Betlen 2023-08-08 14:30:58 -0400
1dd4774ca9

Merge pull request #583 from abetlen/dependabot/pip/mkdocs-1.5.2 Andrei 2023-08-08 14:24:40 -0400
03e575f6a5

Merge pull request #584 from abetlen/dependabot/pip/fastapi-0.101.0 Andrei 2023-08-08 14:24:31 -0400
83f8438c4f

Bump fastapi from 0.100.1 to 0.101.0 dependabot[bot] 2023-08-07 20:10:12 +0000
4cf2fc7d3d

Bump mkdocs from 1.5.1 to 1.5.2 dependabot[bot] 2023-08-07 20:09:55 +0000
0d7d2031a9 prevent memory access error by llama_grammar_free c0sogi 2023-08-07 17:02:33 +0900
b07713cb9f reset grammar for every generation c0sogi 2023-08-07 15:16:25 +0900
418aa83b01 Added grammar based sampling c0sogi 2023-08-07 02:21:37 +0900
097fba25e5

Fixed spelling error "lowe-level API" to "low-level API" Mike Zeng 2023-08-05 02:00:04 -0500
ac188a21f3 Added low level grammar API c0sogi 2023-08-05 14:43:35 +0900
9f499af6b0

Update llama.cpp bretello 2023-08-03 18:23:26 +0200
39978ccaf5

add mul_mat_q parameter bretello 2023-08-03 18:22:52 +0200
a5bc57e279

Update README.md Ihsan Soydemir 2023-08-03 16:49:45 +0200
d4844b93ae

Merge pull request #2 from Isydmr/isydmr/docker-improvements Ihsan Soydemir 2023-08-03 16:42:27 +0200
cdab73536b

Docker improvements Ihsan Soydemir 2023-08-03 16:36:50 +0200
60e85cbe46

Fix dev setup in README.md so that everyone can run it Huge 2023-08-02 12:27:08 +0200
91bf8fac1b

Merge pull request #550 from abetlen/dependabot/pip/uvicorn-0.23.2 Andrei 2023-08-01 17:39:25 -0400
0cc8d8282a

Bump uvicorn from 0.23.1 to 0.23.2 dependabot[bot] 2023-08-01 21:25:18 +0000
5011ef4fc6

Merge pull request #549 from abetlen/dependabot/pip/mkdocs-material-9.1.21 Andrei 2023-08-01 17:24:04 -0400
7fb4f0bda2

Merge pull request #548 from abetlen/dependabot/pip/fastapi-0.100.1 Andrei 2023-08-01 17:23:45 -0400
ecb72cc0a2

Bump mkdocs-material from 9.1.19 to 9.1.21 dependabot[bot] 2023-07-31 20:32:04 +0000
4a2f41a803

Bump fastapi from 0.100.0 to 0.100.1 dependabot[bot] 2023-07-31 20:31:16 +0000
ce57920e60 Suppress llama.cpp output when loading model. Andrei Betlen 2023-07-28 14:45:18 -0400
a9b9f0397c Format Andrei Betlen 2023-07-28 01:53:08 -0400
abc538fcd5 fix: annoying bug where attribute exceptions were droining out file not found exceptions Andrei Betlen 2023-07-28 01:43:00 -0400
d89bf8c072

Merge pull request #536 from Isydmr/patch-2 Andrei 2023-07-28 01:37:23 -0400
3e77eea7ec

Fix OpenBLAS Docker build Ihsan Soydemir 2023-07-27 19:44:15 +0200
ffa81218f6

Merge pull request #531 from abetlen/dependabot/pip/uvicorn-0.23.1 Andrei 2023-07-26 23:46:57 -0400
583d63351a

Bump uvicorn from 0.22.0 to 0.23.1 dependabot[bot] 2023-07-27 03:33:07 +0000
468fccbed7

Merge pull request #532 from abetlen/dependabot/pip/black-23.7.0 Andrei 2023-07-26 23:31:48 -0400
ecdfe4fbd3

Bump black from 23.3.0 to 23.7.0 dependabot[bot] 2023-07-26 19:08:28 +0000
6e6c275c94

Merge pull request #530 from abetlen/dependabot/pip/mkdocs-material-9.1.19 Andrei 2023-07-26 15:07:21 -0400
bfbbc8db14

Bump mkdocs-material from 9.1.18 to 9.1.19 dependabot[bot] 2023-07-26 17:54:39 +0000
7debb505ab

Merge pull request #516 from charles-dyfis-net/poetry-no-versions-in-extras Andrei 2023-07-26 13:53:48 -0400
e665b557fd

Merge pull request #523 from shouyiwang/tensor_split Andrei 2023-07-26 13:53:02 -0400
d3bf7db2db

Merge pull request #525 from Isydmr/patch-1 Andrei 2023-07-25 16:31:02 -0400
0687a3092b

Fix typo in 70B path Ihsan Soydemir 2023-07-25 20:49:44 +0200
426dbfe3f4 Change tensor_split from array to pointer Shouyi Wang 2023-07-25 18:29:59 +1000
078902a6fe Add llama_grammar_accept_token Andrei Betlen 2023-07-24 15:55:26 -0400
bf901773b0 Add llama_sample_grammar Andrei Betlen 2023-07-24 15:42:31 -0400
1b6997d69f Convert constants to python types and allow python types in low-level api Andrei Betlen 2023-07-24 15:42:07 -0400
343480364f Merge branch 'main' into v0.2-wip Andrei Betlen 2023-07-24 15:26:08 -0400
c7c700b0d4 Bump version Andrei Betlen 2023-07-24 14:11:21 -0400
11dd2bf382 Add temporary rms_norm_eps parameter Andrei Betlen 2023-07-24 14:09:24 -0400
8cd64d4ac3 Add rms_eps_norm Andrei Betlen 2023-07-24 13:52:12 -0400
e4431a6ade

Merge pull request #522 from bretello/llama2-70b-support Andrei 2023-07-24 13:48:26 -0400
0f09f10e8c

add support for llama2 70b bretello 2023-07-24 15:51:19 +0200
77c9f496b0 Merge branch 'main' into v0.2-wip Andrei Betlen 2023-07-24 13:19:54 -0400
4aaaec561d Bump version Andrei Betlen 2023-07-24 13:12:38 -0400
401309d11c Revert "Merge pull request #521 from bretello/main" Andrei Betlen 2023-07-24 13:11:10 -0400
07f0f3a386

Merge pull request #521 from bretello/main Andrei 2023-07-24 13:09:28 -0400
d8a3ddbb1c Update llama.cpp Andrei Betlen 2023-07-24 13:08:06 -0400
985d559971 Update llama.cpp Andrei Betlen 2023-07-24 13:04:34 -0400
8be7d67f7e

raise exception when llama_load_model_from_file fails bretello 2023-07-24 14:42:37 +0200
c03fa87956

pyproject.toml: extras list should contain only package list, not versions (#515) Charles Duffy 2023-07-23 13:15:40 -0500
436036aa67 Merge branch 'main' into v0.2-wip Andrei Betlen 2023-07-21 12:42:38 -0400
231123ee1e Update llama.cpp Andrei Betlen 2023-07-21 12:41:59 -0400
b83728ad1e Update llama.cpp Andrei Betlen 2023-07-21 12:33:27 -0400
0538ba1dab Merge branch 'main' into v0.2-wip Andrei Betlen 2023-07-20 19:06:26 -0400
a4fe3fe350 Bump version Andrei Betlen 2023-07-20 18:56:29 -0400
01435da740 Update llama.cpp Andrei Betlen 2023-07-20 18:54:25 -0400
28a111704b Fix compatibility with older python versions Andrei Betlen 2023-07-20 18:52:10 -0400