Commit graph

19 commits

Author SHA1 Message Date
nullname
d634efcdd9
feat: adding rpc_servers parameter to Llama class (#1477)
* passthru rpc_servers params

wip

* enable llama rpc by default

* convert string to byte

* add rpc package

* Revert "enable llama rpc by default"

This reverts commit 832c6dd56c979514cec5df224bf2d2014dccd790.

* update readme

* Only set rpc_servers when provided

* Add rpc servers to server options

---------

Co-authored-by: Andrei Betlen <abetlen@gmail.com>
2024-06-04 10:38:21 -04:00
Andrei Betlen
2907c26906 misc: Update debug build to keep all debug symbols for easier gdb debugging 2024-05-28 22:52:28 -04:00
Andrei Betlen
7f59856fa6 fix: Enable CUDA backend for llava. Closes #1324 2024-05-10 10:18:47 -04:00
Andrei Betlen
f57b01ac9b ci: add debug build to dev makefile 2024-02-21 11:04:30 -05:00
Andrei Betlen
36b843228f misc: fix makefile build commands 2024-02-14 03:47:40 -05:00
Andrei Betlen
011cd84ded Update llama.cpp 2024-01-30 09:48:09 -05:00
Andrei Betlen
9f7852acfa misc: Add vulkan target 2024-01-29 10:39:23 -05:00
Andrei Betlen
e21c3c7a91 Update makefile 2024-01-19 08:47:56 -05:00
Andrei Betlen
95d54808a5 Upgrade pip for editable installs 2023-09-14 02:01:45 -04:00
Andrei Betlen
1dd3f473c0 Remove references to FORCE_CMAKE 2023-09-12 19:01:16 -04:00
Andrei Betlen
6cb77a20c6 Migrate to scikit-build-core. Closes #489 2023-07-18 18:52:29 -04:00
Andrei Betlen
ca11673061 Add universal docker image 2023-07-07 03:38:51 -04:00
Andrei Betlen
98ae4e58a3 Update llama.cpp 2023-07-06 17:57:56 -04:00
Andrei Betlen
6e302c6ee8 Update makefile and gitignore 2023-06-10 18:17:34 -04:00
Andrei Betlen
e3542b6627 Revert "Merge pull request #350 from abetlen/migrate-to-scikit-build-core"
This reverts commit fb2c5f7fd9, reversing
changes made to 202ed4464b.
2023-06-09 23:23:16 -04:00
Andrei Betlen
7345456779 Migrate to scikit-build-core 2023-06-08 21:49:42 -04:00
Andrei Betlen
e169a960f6 Ensure make clean removes all shared library files 2023-06-08 00:40:04 -04:00
Andrei Betlen
c9e79c6681 Add metal build flags 2023-06-08 00:22:39 -04:00
Andrei Betlen
00ea3af51b Add makefile 2023-05-26 17:56:20 -04:00