earonesty
|
58a6e42cc0
|
Update app.py (#705)
|
2023-09-13 23:01:34 -04:00 |
|
Andrei Betlen
|
f4090a0bb2
|
Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.
|
2023-09-13 23:00:43 -04:00 |
|
Andrei Betlen
|
c999325e8e
|
Fix boolean cli flags
|
2023-09-13 22:56:10 -04:00 |
|
Andrei Betlen
|
83764c5aee
|
Update CHANGELOG
|
2023-09-13 21:58:53 -04:00 |
|
Andrei Betlen
|
4daf77e546
|
Format
|
2023-09-13 21:23:23 -04:00 |
|
Andrei Betlen
|
2920c4bf7e
|
Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)
|
2023-09-13 21:23:13 -04:00 |
|
Andrei Betlen
|
6a20293fc2
|
Reorder init params to match llama.cpp order
|
2023-09-13 21:20:26 -04:00 |
|
Andrei Betlen
|
c8f9b8a734
|
Explicitly make all init params other than model_path into keyword only params
|
2023-09-13 21:19:47 -04:00 |
|
Andrei Betlen
|
a68f9e2791
|
Add kwargs to init to catch extra params
|
2023-09-13 21:19:02 -04:00 |
|
Andrei Betlen
|
9e345a47a2
|
remove print
|
2023-09-13 21:12:27 -04:00 |
|
Andrei Betlen
|
517f9ed80b
|
Convert missed llama.cpp constants into standard python types
|
2023-09-13 21:11:52 -04:00 |
|
Andrei Betlen
|
c4c440ba2d
|
Fix tensor_split cli option
|
2023-09-13 20:00:42 -04:00 |
|
Andrei Betlen
|
203ede4ba2
|
Bump version
|
2023-09-13 18:07:08 -04:00 |
|
Andrei Betlen
|
759405c84b
|
Fix issue with Literal and Optional cli arguments not working. Closes #702
|
2023-09-13 18:06:12 -04:00 |
|
Andrei Betlen
|
6cfc54284b
|
Add pyproject extra for scikit-build-core to ensure compatible pathspec version
|
2023-09-13 16:51:57 -04:00 |
|
Andrei Betlen
|
cacfd562ba
|
Update llama.cpp
|
2023-09-13 16:51:00 -04:00 |
|
Devrim
|
da9df78db0
|
Add X-Request-ID request header for mirroring custom IDs. (#703)
|
2023-09-13 16:18:31 -04:00 |
|
Andrei Betlen
|
1372e4f60e
|
Update CHANGELOG
|
2023-09-13 02:50:27 -04:00 |
|
Andrei Betlen
|
8e13520796
|
Bump version
|
2023-09-13 01:47:58 -04:00 |
|
Andrei Betlen
|
ec1132008e
|
fix: only ignore c extension files installed in-source, avoids removing ggml-metal.metal from sdist
|
2023-09-13 01:46:29 -04:00 |
|
Andrei Betlen
|
8ddf63b9c7
|
Remove reference to FORCE_CMAKE from docs
|
2023-09-12 23:56:10 -04:00 |
|
Andrei Betlen
|
109123c4f0
|
docs: Use pymdownx.snippets for easier docs management
|
2023-09-12 22:28:58 -04:00 |
|
Andrei Betlen
|
2787663a25
|
Bump version
|
2023-09-12 21:00:01 -04:00 |
|
Andrei Betlen
|
38cd2ac624
|
Update CHANGELOG
|
2023-09-12 20:59:54 -04:00 |
|
Andrei Betlen
|
6e02525971
|
bugfix: remove git directories from source distribution to avoid build-info.h bug
|
2023-09-12 20:57:28 -04:00 |
|
Andrei Betlen
|
c59f084005
|
Add python version classifiers to pyproject.toml
|
2023-09-12 19:15:44 -04:00 |
|
Andrei
|
3feeafed1a
|
Merge pull request #499 from abetlen/v0.2-wip
llama-cpp-python v0.2.0
|
2023-09-12 19:04:18 -04:00 |
|
Andrei Betlen
|
bcef9ab2d9
|
Update title
|
2023-09-12 19:02:30 -04:00 |
|
Andrei Betlen
|
89ae347585
|
Remove references to force_cmake
|
2023-09-12 19:02:20 -04:00 |
|
Andrei Betlen
|
1dd3f473c0
|
Remove references to FORCE_CMAKE
|
2023-09-12 19:01:16 -04:00 |
|
Andrei Betlen
|
6e89775759
|
Bump version
|
2023-09-12 18:57:01 -04:00 |
|
Andrei Betlen
|
bb4e67e7aa
|
Using dynamic version
|
2023-09-12 18:56:36 -04:00 |
|
Andrei Betlen
|
e00d182ef4
|
Bump scikit-build-core
|
2023-09-12 18:56:22 -04:00 |
|
Andrei Betlen
|
fe743b4945
|
Revert python 3.12 tests
|
2023-09-12 18:43:43 -04:00 |
|
Andrei Betlen
|
6bddf620e1
|
Add python 3.12 to tests
|
2023-09-12 18:41:29 -04:00 |
|
Andrei Betlen
|
e3387e4655
|
Add explanatory comment
|
2023-09-12 18:41:00 -04:00 |
|
Andrei Betlen
|
e65a823dc8
|
Update flags
|
2023-09-12 18:37:32 -04:00 |
|
Andrei Betlen
|
4cb0e35b64
|
string options
|
2023-09-12 18:35:34 -04:00 |
|
Andrei Betlen
|
2c3df160fb
|
Reorder
|
2023-09-12 18:29:18 -04:00 |
|
Andrei Betlen
|
d123129e63
|
fix
|
2023-09-12 18:25:31 -04:00 |
|
Andrei Betlen
|
dadfd96745
|
Use compiler to determine best optimizations for platform
|
2023-09-12 18:21:49 -04:00 |
|
Andrei Betlen
|
4c0787b408
|
Disable acceleration in macos tests only
|
2023-09-12 18:05:44 -04:00 |
|
Andrei Betlen
|
d24383eaef
|
Disable acceleration on macos
|
2023-09-12 17:58:47 -04:00 |
|
Andrei Betlen
|
cf9e613420
|
Update scikit-build-core options
|
2023-09-12 17:47:17 -04:00 |
|
Andrei Betlen
|
04a6bbe30e
|
Revert test changes
|
2023-09-12 17:46:58 -04:00 |
|
Andrei Betlen
|
9547a351ee
|
Try arm64 python
|
2023-09-12 17:35:07 -04:00 |
|
Andrei Betlen
|
fa2f1fdf60
|
Enable accelerations and set python architecture
|
2023-09-12 17:28:36 -04:00 |
|
Andrei Betlen
|
010a50168c
|
Add tune
|
2023-09-12 17:20:57 -04:00 |
|
Andrei Betlen
|
f93fb30f5c
|
Set native arch flags for macos
|
2023-09-12 17:15:07 -04:00 |
|
Andrei Betlen
|
685a929c6a
|
typo
|
2023-09-12 17:03:19 -04:00 |
|