baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
1519 commits 1 branch 0 tags 2.1 MiB
Commit graph

187 commits

Author SHA1 Message Date
Andrei Betlen
5f96621e92 misc: only search tests folder for tests 2024-02-23 03:40:25 -05:00
Andrei Betlen
be23404ed4 Cleanup pyproject 2024-01-18 21:22:19 -05:00
Austin
6bfe98bd80
Integration of Jinja2 Templating (#875) 
* feat: Add support for jinja templating

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>

* fix: Refactor chat formatter and update interface for jinja templates

- Simplify the `llama2_template` in `llama_jinja_format.py` by removing unnecessary line breaks for readability without affecting functionality.
- Update `ChatFormatterInterface` constructor to accept a more generic `Optional[object]` type for the template parameter, enhancing flexibility.
- Introduce a `template` property to `ChatFormatterInterface` for standardized access to the template string.
- Replace `MetaSingleton` metaclass with `Singleton` for the `ChatFormatterFactory` to streamline the singleton implementation.

These changes enhance code readability, maintain usability, and ensure consistency in the chat formatter's design pattern usage.

* Add outline for Jinja2 templating integration documentation

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>

* Add jinja2 as a dependency with version range for Hugging Face transformers compatibility

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>

* Update jinja2 version constraint for mkdocs-material compatibility

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>

* Fix attribute name in AutoChatFormatter

- Changed attribute name from `self._renderer` to `self._environment`

---------

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>
 2024-01-17 09:47:52 -05:00
kddubey
5a8944672f
Fix logits_to_logprobs for 2-D and 3-D logits (#1002) 
* Fix logits_to_logprobs for 2-D and 3-D logits

* Set dtype to single

* Test size
 2023-12-16 18:59:26 -05:00
Andrei Betlen
52320c348c Add python 3.12 classifier 2023-11-06 09:34:07 -05:00
Andrei Betlen
ac853e01e1 Include git directories 2023-09-30 00:01:14 -04:00
Andrei Betlen
9e76613629 Remove git repo exclude 2023-09-29 23:28:59 -04:00
Andrei Betlen
1ed0f3ebe1 Bump scikit-build-core version to one that includes fix for windows cmake. 2023-09-25 14:20:09 -04:00
Andrei Betlen
8d75016549 Install required runtime dlls to package directory on windows 2023-09-16 14:57:49 -04:00
Andrei Betlen
65a2a20050 Enable make fallback for scikit-build-core 2023-09-14 11:43:55 -04:00
Andrei Betlen
255d653ae3 Add documentation and changelog links in pyproject 2023-09-14 04:00:37 -04:00
Andrei Betlen
6cfc54284b Add pyproject extra for scikit-build-core to ensure compatible pathspec version 2023-09-13 16:51:57 -04:00
Devrim
da9df78db0
Add X-Request-ID request header for mirroring custom IDs. (#703) 2023-09-13 16:18:31 -04:00
Andrei Betlen
6e02525971 bugfix: remove git directories from source distribution to avoid build-info.h bug 2023-09-12 20:57:28 -04:00
Andrei Betlen
c59f084005 Add python version classifiers to pyproject.toml 2023-09-12 19:15:44 -04:00
Andrei Betlen
bb4e67e7aa Using dynamic version 2023-09-12 18:56:36 -04:00
Andrei Betlen
e00d182ef4 Bump scikit-build-core 2023-09-12 18:56:22 -04:00
Andrei Betlen
cf9e613420 Update scikit-build-core options 2023-09-12 17:47:17 -04:00
Andrei Betlen
1910793f56 Merge branch 'main' into v0.2-wip 2023-09-12 16:43:32 -04:00
Andrei Betlen
c7901f1141 Bump version 2023-09-12 16:16:40 -04:00
dependabot[bot]
0791487493
Bump mkdocs-material from 9.2.8 to 9.3.1 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.2.8 to 9.3.1.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.2.8...9.3.1)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-12 15:57:09 +00:00
dependabot[bot]
b6c7d0a6a2
Bump black from 23.7.0 to 23.9.1 
Bumps [black](https://github.com/psf/black) from 23.7.0 to 23.9.1.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.7.0...23.9.1)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-12 15:13:01 +00:00
dependabot[bot]
db572db924
Bump httpx from 0.24.1 to 0.25.0 
Bumps [httpx](https://github.com/encode/httpx) from 0.24.1 to 0.25.0.
- [Release notes](https://github.com/encode/httpx/releases)
- [Changelog](https://github.com/encode/httpx/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/httpx/compare/0.24.1...0.25.0)

---
updated-dependencies:
- dependency-name: httpx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-11 20:41:00 +00:00
Andrei Betlen
db4273a75d Bump version 2023-09-09 12:18:32 -04:00
dependabot[bot]
59a084f1ef
Bump mkdocstrings from 0.22.0 to 0.23.0 
Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 0.22.0 to 0.23.0.
- [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases)
- [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/main/CHANGELOG.md)
- [Commits](https://github.com/mkdocstrings/mkdocstrings/compare/0.22.0...0.23.0)

---
updated-dependencies:
- dependency-name: mkdocstrings
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-08 20:41:22 +00:00
dependabot[bot]
66c13082f5
Bump mkdocs-material from 9.2.5 to 9.2.8 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.2.5 to 9.2.8.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.2.5...9.2.8)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-08 19:48:14 +00:00
dependabot[bot]
da6e23afa0
Bump pytest from 7.4.0 to 7.4.2 
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.4.0 to 7.4.2.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/7.4.0...7.4.2)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-08 19:39:06 +00:00
dependabot[bot]
3705a1ab1a
Bump diskcache from 5.6.1 to 5.6.3 
Bumps [diskcache](https://github.com/grantjenks/python-diskcache) from 5.6.1 to 5.6.3.
- [Commits](https://github.com/grantjenks/python-diskcache/compare/v5.6.1...v5.6.3)

---
updated-dependencies:
- dependency-name: diskcache
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-04 21:07:18 +00:00
Andrei Betlen
bf08d1b2bb Bump version 2023-08-29 18:09:13 -04:00
dependabot[bot]
20f4a5789d
Bump mkdocs-material from 9.2.0 to 9.2.5 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.2.0 to 9.2.5.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.2.0...9.2.5)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-28 20:27:22 +00:00
Andrei Betlen
4cd3e6be0c Bump version 2023-08-28 11:17:01 -04:00
Andrei Betlen
3d083f32a6 Bump version 2023-08-27 13:03:09 -04:00
Andrei Betlen
9ab49bc1d4 Bump version 2023-08-26 23:38:00 -04:00
Andrei Betlen
ac47d55577 Merge branch 'main' into v0.2-wip 2023-08-25 15:45:22 -04:00
Andrei Betlen
3f8bc417d7 Bump version 2023-08-25 15:18:15 -04:00
Andrei
915bbeacc5
Merge pull request #633 from abetlen/gguf 
GGUF (Breaking Change to Model Files)
 2023-08-25 15:13:12 -04:00
Andrei Betlen
c8a7637978 Ignore vendor directory for tests 2023-08-25 14:35:27 -04:00
Andrei Betlen
cf405f6764 Merge branch 'main' into v0.2-wip 2023-08-24 00:30:51 -04:00
dependabot[bot]
abca3d81c8
Bump mkdocs-material from 9.1.21 to 9.2.0 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.21 to 9.2.0.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.21...9.2.0)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-21 20:53:56 +00:00
Andrei Betlen
8fc3fa9f1c Bump version 2023-08-17 23:17:56 -04:00
dependabot[bot]
4cf2fc7d3d
Bump mkdocs from 1.5.1 to 1.5.2 
Bumps [mkdocs](https://github.com/mkdocs/mkdocs) from 1.5.1 to 1.5.2.
- [Release notes](https://github.com/mkdocs/mkdocs/releases)
- [Commits](https://github.com/mkdocs/mkdocs/compare/1.5.1...1.5.2)

---
updated-dependencies:
- dependency-name: mkdocs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-07 20:09:55 +00:00
dependabot[bot]
0cc8d8282a
Bump uvicorn from 0.23.1 to 0.23.2 
Bumps [uvicorn](https://github.com/encode/uvicorn) from 0.23.1 to 0.23.2.
- [Release notes](https://github.com/encode/uvicorn/releases)
- [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/uvicorn/compare/0.23.1...0.23.2)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-01 21:25:18 +00:00
dependabot[bot]
ecb72cc0a2
Bump mkdocs-material from 9.1.19 to 9.1.21 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.19 to 9.1.21.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.19...9.1.21)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-31 20:32:04 +00:00
dependabot[bot]
583d63351a
Bump uvicorn from 0.22.0 to 0.23.1 
Bumps [uvicorn](https://github.com/encode/uvicorn) from 0.22.0 to 0.23.1.
- [Release notes](https://github.com/encode/uvicorn/releases)
- [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/uvicorn/compare/0.22.0...0.23.1)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-27 03:33:07 +00:00
dependabot[bot]
ecdfe4fbd3
Bump black from 23.3.0 to 23.7.0 
Bumps [black](https://github.com/psf/black) from 23.3.0 to 23.7.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.3.0...23.7.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-26 19:08:28 +00:00
dependabot[bot]
bfbbc8db14
Bump mkdocs-material from 9.1.18 to 9.1.19 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.18 to 9.1.19.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.18...9.1.19)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-26 17:54:39 +00:00
Andrei
7debb505ab
Merge pull request #516 from charles-dyfis-net/poetry-no-versions-in-extras 
pyproject.toml: extras list should contain only package list, not versions
 2023-07-26 13:53:48 -04:00
Andrei Betlen
343480364f Merge branch 'main' into v0.2-wip 2023-07-24 15:26:08 -04:00
Andrei Betlen
c7c700b0d4 Bump version 2023-07-24 14:11:21 -04:00
Andrei Betlen
77c9f496b0 Merge branch 'main' into v0.2-wip 2023-07-24 13:19:54 -04:00