Commit graph

659 commits

Author SHA1 Message Date
Ian Scrivener
94f63a66b9
Create macos_install.md
add MacOS Metal markdown install instructions
2023-06-13 09:49:19 +10:00
Andrei
ad4479e609
Merge pull request #359 from matthoffner/main
Document metal support
2023-06-10 19:31:40 -04:00
Matt Hoffner
4eb245afd8
Update README.md 2023-06-10 15:59:26 -07:00
Andrei Betlen
74fbaae157 Bump version 2023-06-10 18:19:48 -04:00
Andrei Betlen
6e302c6ee8 Update makefile and gitignore 2023-06-10 18:17:34 -04:00
Andrei Betlen
c1eaef329a Add resource destination to cmake 2023-06-10 18:11:48 -04:00
Andrei Betlen
890ae442b9 Update llama.cpp 2023-06-10 18:10:01 -04:00
Andrei Betlen
bf2bfec615 Update changelog 2023-06-10 12:22:39 -04:00
Andrei Betlen
21acd7901f Re-enable cache 2023-06-10 12:22:31 -04:00
Andrei Betlen
6639371407 Update llama.cpp 2023-06-10 12:17:38 -04:00
Andrei Betlen
6b764cab80 Bump version 2023-06-09 23:25:38 -04:00
Andrei Betlen
e3542b6627 Revert "Merge pull request #350 from abetlen/migrate-to-scikit-build-core"
This reverts commit fb2c5f7fd9, reversing
changes made to 202ed4464b.
2023-06-09 23:23:16 -04:00
Andrei Betlen
3c6e1b6c42 Update to smoketest 2023-06-09 19:08:15 -04:00
Andrei Betlen
d4aed351e3 Run on workflow_dispatch 2023-06-09 17:08:42 -04:00
Andrei Betlen
2fdd873125 Add gihub action to test published pypi version of package 2023-06-09 16:52:40 -04:00
Andrei Betlen
a553552868 Add project urls to pyproject 2023-06-09 16:52:17 -04:00
Andrei Betlen
c0f7e739c9 Update llama.cpp 2023-06-09 12:39:09 -04:00
Andrei Betlen
dd7c7bf80b Bump version 2023-06-09 11:52:07 -04:00
Andrei Betlen
0da655b3be Temporarily disable cache until save state bug is fixed. 2023-06-09 11:10:24 -04:00
Andrei Betlen
be0403da98 Add missing poetry sections to pyproject.toml 2023-06-09 11:09:32 -04:00
Andrei Betlen
f2a54ecb4c Update CHANGELOG 2023-06-09 11:01:42 -04:00
Andrei Betlen
556c7edf47 Truncate max_tokens if it exceeds context length 2023-06-09 10:57:36 -04:00
Andrei
fb2c5f7fd9
Merge pull request #350 from abetlen/migrate-to-scikit-build-core
Migrate to scikit-build-core
2023-06-09 03:00:01 -04:00
Andrei Betlen
b025a859ae Add full path to shared library installation path 2023-06-08 22:11:01 -04:00
Andrei Betlen
146ca2c59f Add missing httpx 2023-06-08 22:03:24 -04:00
Andrei Betlen
1d6bdf8db6 Update server dependencies 2023-06-08 21:59:58 -04:00
Andrei Betlen
43854e6a83 Update server dependencies 2023-06-08 21:55:42 -04:00
Andrei Betlen
c12138f7bd Update changelog 2023-06-08 21:53:38 -04:00
Andrei Betlen
7345456779 Migrate to scikit-build-core 2023-06-08 21:49:42 -04:00
Andrei Betlen
202ed4464b Update gitignore 2023-06-08 20:33:30 -04:00
Andrei Betlen
312f6eb144 Update llama.cpp 2023-06-08 16:46:55 -04:00
Andrei Betlen
0c42168508 Fix cache implementation breaking changes 2023-06-08 13:19:23 -04:00
Andrei Betlen
90874c01cd Bump version 2023-06-08 03:26:49 -04:00
Andrei Betlen
e169a960f6 Ensure make clean removes all shared library files 2023-06-08 00:40:04 -04:00
Andrei Betlen
607d217caa Allow both .so and .dylib extensions for macos 2023-06-08 00:27:19 -04:00
Andrei Betlen
c9e79c6681 Add metal build flags 2023-06-08 00:22:39 -04:00
Andrei Betlen
69355403c6 Update llama.cpp 2023-06-08 00:15:17 -04:00
Andrei Betlen
bf322861e8 Update llama.cpp 2023-06-07 03:43:33 -04:00
Andrei Betlen
fe4ae72ad2 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main 2023-06-07 03:43:18 -04:00
Andrei Betlen
cf6a9d6d8e Add framework and archive destinations to cmake for macos and windows. 2023-06-07 03:42:55 -04:00
Andrei
0f0b447fa4
Merge pull request #289 from Maximilian-Winter/main
Diskcache implementation for llama state.
2023-06-06 17:03:03 -04:00
Andrei Betlen
0e156ffd66 Fix changelog format 2023-06-06 17:01:10 -04:00
Andrei
d508573fb4
Merge pull request #328 from spirilis/mirostat
Added mirostat support for completions, chat completions API
2023-06-06 16:58:23 -04:00
Andrei Betlen
aad4b17f52 Update llama.cpp 2023-06-06 16:23:55 -04:00
Andrei Betlen
8b4968ea67 Fix resize issue. Closes #330 2023-06-06 11:37:57 -04:00
Eric B
9b1c9e902c Added mirostat support for completions, chat completions API 2023-06-05 22:37:11 -04:00
Andrei
cc8858a413
Merge pull request #324 from abetlen/dependabot/pip/typing-extensions-4.6.3
Bump typing-extensions from 4.6.2 to 4.6.3
2023-06-05 19:47:30 -04:00
dependabot[bot]
5702d30a83
Bump typing-extensions from 4.6.2 to 4.6.3
Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.6.2 to 4.6.3.
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
- [Commits](https://github.com/python/typing_extensions/compare/4.6.2...4.6.3)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-05 23:46:45 +00:00
Andrei
2f42d6b513
Merge pull request #322 from abetlen/dependabot/pip/scikit-build-0.17.6
Bump scikit-build from 0.17.5 to 0.17.6
2023-06-05 19:45:16 -04:00
dependabot[bot]
fa7285c51f
Bump scikit-build from 0.17.5 to 0.17.6
Bumps [scikit-build](https://github.com/scikit-build/scikit-build) from 0.17.5 to 0.17.6.
- [Release notes](https://github.com/scikit-build/scikit-build/releases)
- [Changelog](https://github.com/scikit-build/scikit-build/blob/main/CHANGES.rst)
- [Commits](https://github.com/scikit-build/scikit-build/compare/0.17.5...0.17.6)

---
updated-dependencies:
- dependency-name: scikit-build
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-05 23:30:17 +00:00