717f7229eb
* Do not shift context for sliding window models * truncate prompt > 2/3 tokens * only target gemma2 |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
httplib.h | ||
json.hpp | ||
server.cpp | ||
utils.hpp |
717f7229eb
* Do not shift context for sliding window models * truncate prompt > 2/3 tokens * only target gemma2 |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
httplib.h | ||
json.hpp | ||
server.cpp | ||
utils.hpp |