baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Merge pull request #265 from dmahurin/fix-from-bytes-byteorder

Browse source 
fix "from_bytes() missing required argument 'byteorder'"
This commit is contained in:
Andrei 2023-05-26 12:53:06 -04:00 committed by GitHub
commit 2adf6f3f9a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
examples/low_level_api/low_level_api_chat_cpp.py
View file

@ -496,7 +496,7 @@ n_keep = {self.params.n_keep}
# Contains multi-byte UTF8
for num, pattern in [(2, 192), (3, 224), (4, 240)]:
# Bitwise AND check
if pattern & int.from_bytes(cur_char) == pattern:
if pattern & int.from_bytes(cur_char, 'little') == pattern:
self.multibyte_fix = [cur_char] + ([None] * (num-1))
# Stop incomplete bytes from passing