nullname
|
d634efcdd9
|
feat: adding rpc_servers parameter to Llama class (#1477)
* passthru rpc_servers params
wip
* enable llama rpc by default
* convert string to byte
* add rpc package
* Revert "enable llama rpc by default"
This reverts commit 832c6dd56c979514cec5df224bf2d2014dccd790.
* update readme
* Only set rpc_servers when provided
* Add rpc servers to server options
---------
Co-authored-by: Andrei Betlen <abetlen@gmail.com>
|
2024-06-04 10:38:21 -04:00 |
|
Andrei Betlen
|
2907c26906
|
misc: Update debug build to keep all debug symbols for easier gdb debugging
|
2024-05-28 22:52:28 -04:00 |
|
Andrei Betlen
|
7f59856fa6
|
fix: Enable CUDA backend for llava. Closes #1324
|
2024-05-10 10:18:47 -04:00 |
|
Andrei Betlen
|
f57b01ac9b
|
ci: add debug build to dev makefile
|
2024-02-21 11:04:30 -05:00 |
|
Andrei Betlen
|
36b843228f
|
misc: fix makefile build commands
|
2024-02-14 03:47:40 -05:00 |
|
Andrei Betlen
|
011cd84ded
|
Update llama.cpp
|
2024-01-30 09:48:09 -05:00 |
|
Andrei Betlen
|
9f7852acfa
|
misc: Add vulkan target
|
2024-01-29 10:39:23 -05:00 |
|
Andrei Betlen
|
e21c3c7a91
|
Update makefile
|
2024-01-19 08:47:56 -05:00 |
|
Andrei Betlen
|
95d54808a5
|
Upgrade pip for editable installs
|
2023-09-14 02:01:45 -04:00 |
|
Andrei Betlen
|
1dd3f473c0
|
Remove references to FORCE_CMAKE
|
2023-09-12 19:01:16 -04:00 |
|
Andrei Betlen
|
6cb77a20c6
|
Migrate to scikit-build-core. Closes #489
|
2023-07-18 18:52:29 -04:00 |
|
Andrei Betlen
|
ca11673061
|
Add universal docker image
|
2023-07-07 03:38:51 -04:00 |
|
Andrei Betlen
|
98ae4e58a3
|
Update llama.cpp
|
2023-07-06 17:57:56 -04:00 |
|
Andrei Betlen
|
6e302c6ee8
|
Update makefile and gitignore
|
2023-06-10 18:17:34 -04:00 |
|
Andrei Betlen
|
e3542b6627
|
Revert "Merge pull request #350 from abetlen/migrate-to-scikit-build-core"
This reverts commit fb2c5f7fd9, reversing
changes made to 202ed4464b.
|
2023-06-09 23:23:16 -04:00 |
|
Andrei Betlen
|
7345456779
|
Migrate to scikit-build-core
|
2023-06-08 21:49:42 -04:00 |
|
Andrei Betlen
|
e169a960f6
|
Ensure make clean removes all shared library files
|
2023-06-08 00:40:04 -04:00 |
|
Andrei Betlen
|
c9e79c6681
|
Add metal build flags
|
2023-06-08 00:22:39 -04:00 |
|
Andrei Betlen
|
00ea3af51b
|
Add makefile
|
2023-05-26 17:56:20 -04:00 |
|