Daniel Hiltgen
|
1b249748ab
|
Add multiple CPU variants for Intel Mac
This also refines the build process for the ext_server build.
|
2024-01-17 15:08:54 -08:00 |
|
Bruce MacDonald
|
a897e833b8
|
do not cache prompt (#2018)
- prompt cache causes inferance to hang after some time
|
2024-01-16 13:48:05 -05:00 |
|
Daniel Hiltgen
|
2ecb247276
|
Fix intel mac build
Make sure we're building an x86 ext_server lib when cross-compiling
|
2024-01-13 14:46:34 -08:00 |
|
Daniel Hiltgen
|
39928a42e8
|
Always dynamically load the llm server library
This switches darwin to dynamic loading, and refactors the code now that no
static linking of the library is used on any platform
|
2024-01-11 08:42:47 -08:00 |
|