baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
469 commits 1 branch 0 tags 2.1 MiB
Commit graph

469 commits

This branch
This branch
All branches
Author SHA1 Message Date
Andrei Betlen
e72f58614b Change pointer to lower overhead byref 2023-05-07 20:01:34 -04:00
Andrei Betlen
14da46f16e Added cache size to settins object. 2023-05-07 19:33:17 -04:00
Andrei Betlen
0e94a70de1 Add in-memory longest prefix cache. Closes #158 2023-05-07 19:31:26 -04:00
Andrei Betlen
8dfde63255 Fix return type 2023-05-07 19:30:14 -04:00
Andrei Betlen
2753b85321 Format 2023-05-07 13:19:56 -04:00
Andrei Betlen
4f8cf52a38 Update README 2023-05-07 05:20:04 -04:00
Andrei Betlen
3adc8fb3ae Update README to use cli options for server 2023-05-07 05:10:52 -04:00
Andrei Betlen
627811ea83 Add verbose flag to server 2023-05-07 05:09:10 -04:00
Andrei Betlen
5f43c553d5 Bump version 2023-05-07 03:29:33 -04:00
Andrei Betlen
3fbda71790 Fix mlock_supported and mmap_supported return type 2023-05-07 03:04:22 -04:00
Andrei Betlen
5a3413eee3 Update cpu_count 2023-05-07 03:03:57 -04:00
Andrei Betlen
1a00e452ea Update settings fields and defaults 2023-05-07 02:52:20 -04:00
Andrei Betlen
86753976c4 Revert "llama_cpp server: delete some ignored / unused parameters" 
This reverts commit b47b9549d5.
 2023-05-07 02:02:34 -04:00
Andrei Betlen
c382d8f86a Revert "llama_cpp server: mark model as required" 
This reverts commit e40fcb0575.
 2023-05-07 02:00:22 -04:00
Andrei Betlen
d8fddcce73 Merge branch 'main' of github.com:abetlen/llama_cpp_python into better-server-params-and-fields 2023-05-07 01:54:00 -04:00
Andrei Betlen
397ae97f64 Update README 2023-05-07 01:41:19 -04:00
Andrei Betlen
1c188459c4 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main 2023-05-07 00:41:10 -04:00
Andrei Betlen
7c3743fe5f Update llama.cpp 2023-05-07 00:12:47 -04:00
Andrei
c76e0913bb
Update issue templates 2023-05-06 22:18:31 -04:00
Andrei Betlen
bc853e3742 Fix type for eval_logits in LlamaState object 2023-05-06 21:32:50 -04:00
Andrei
ec617c04c1
Merge pull request #164 from abetlen/dependabot/pip/mkdocstrings-0.21.2 
Bump mkdocstrings from 0.20.0 to 0.21.2
 2023-05-06 21:30:09 -04:00
dependabot[bot]
ae3c639764
Bump mkdocstrings from 0.20.0 to 0.21.2 
Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.20.0 to 0.21.2.
- [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases)
- [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mkdocstrings/mkdocstrings/compare/0.20.0...0.21.2)

---
updated-dependencies:
- dependency-name: mkdocstrings
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-07 00:16:31 +00:00
Andrei
8a692a5838
Merge pull request #161 from abetlen/dependabot/pip/pytest-7.3.1 
Bump pytest from 7.2.2 to 7.3.1
 2023-05-06 20:15:35 -04:00
dependabot[bot]
33d41fb8f3
Bump pytest from 7.2.2 to 7.3.1 
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.2.2 to 7.3.1.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/7.2.2...7.3.1)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-07 00:07:39 +00:00
Andrei
c7becd9363
Merge pull request #162 from abetlen/dependabot/pip/mkdocs-1.4.3 
Bump mkdocs from 1.4.2 to 1.4.3
 2023-05-06 20:06:14 -04:00
Maximilian Winter
515d9bde7e Fixed somethings and activated cublas 2023-05-06 23:40:19 +02:00
dependabot[bot]
2a21b8f69e
Bump mkdocs from 1.4.2 to 1.4.3 
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.4.2 to 1.4.3.
- [Release notes](https://github.com/mkdocs/mkdocs/releases)
- [Commits](https://github.com/mkdocs/mkdocs/compare/1.4.2...1.4.3)

---
updated-dependencies:
- dependency-name: mkdocs
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-06 21:16:08 +00:00
Andrei
d077e641f9
Merge pull request #165 from abetlen/dependabot/pip/mkdocs-material-9.1.9 
Bump mkdocs-material from 9.1.4 to 9.1.9
 2023-05-06 17:14:45 -04:00
dependabot[bot]
fdcab2286c
Bump mkdocs-material from 9.1.4 to 9.1.9 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.4 to 9.1.9.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.4...9.1.9)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-06 21:11:57 +00:00
Andrei
bcc4e631cb
Merge pull request #163 from abetlen/dependabot/pip/black-23.3.0 
Bump black from 23.1.0 to 23.3.0
 2023-05-06 17:10:30 -04:00
Maximilian Winter
aa203a0d65 Added mirostat sampling to the high level API. 2023-05-06 22:47:47 +02:00
Mug
fd80ddf703 Fix a bug with wrong type 2023-05-06 22:22:28 +02:00
Mug
996f63e9e1 Add utf8 to chat example 2023-05-06 15:16:58 +02:00
Mug
3ceb47b597 Fix mirastat requiring c_float 2023-05-06 13:35:50 +02:00
Mug
9797394c81 Wrong logit_bias parsed type 2023-05-06 13:27:52 +02:00
Mug
1895c11033 Rename postfix to suffix to match upstream 2023-05-06 13:18:25 +02:00
dependabot[bot]
c9bb602b26
Bump black from 23.1.0 to 23.3.0 
Bumps [black](https://github.com/psf/black) from 23.1.0 to 23.3.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.1.0...23.3.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-05 23:25:53 +00:00
Andrei
2f2ea00a3d
Merge pull request #160 from th-neu/main 
Create dependabot.yml
 2023-05-05 19:24:53 -04:00
Thomas Neu
79d50a29f4
Create dependabot.yml 2023-05-06 01:02:59 +02:00
Andrei Betlen
980903df93 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main 2023-05-05 15:07:26 -04:00
Andrei Betlen
98bbd1c6a8 Fix eval logits type 2023-05-05 14:23:14 -04:00
Andrei Betlen
b5f3e74627 Add return type annotations for embeddings and logits 2023-05-05 14:22:55 -04:00
Andrei Betlen
3e28e0e50c Fix: runtime type errors 2023-05-05 14:12:26 -04:00
Andrei Betlen
e24c3d7447 Prefer explicit imports 2023-05-05 14:05:31 -04:00
Andrei Betlen
40501435c1 Fix: types 2023-05-05 14:04:12 -04:00
Andrei Betlen
66e28eb548 Fix temperature bug 2023-05-05 14:00:41 -04:00
Andrei Betlen
6702d2abfd Fix candidates type 2023-05-05 14:00:30 -04:00
Andrei Betlen
5e7ddfc3d6 Fix llama_cpp types 2023-05-05 13:54:22 -04:00
Andrei
f712a04f4e
Merge pull request #157 from th-neu/th-neu-readme-windows 
readme windows
 2023-05-05 12:40:45 -04:00
Thomas Neu
22c3056b2a
Update README.md 
added MacOS
 2023-05-05 18:40:00 +02:00