6 commits

Author	SHA1	Message	Date
Andrei Betlen	2cc499512c	Black formatting	2023-03-24 14:35:41 -04:00
Andrei Betlen	e24c581b5a	Implement prompt batch processing as in main.cpp	2023-03-24 14:33:38 -04:00
Andrei Betlen	a28cb92d8f	Remove model_name param	2023-03-24 04:04:29 -04:00
Andrei Betlen	eec9256a42	Bugfix: avoid decoding partial utf-8 characters	2023-03-23 16:25:13 -04:00
Andrei Betlen	e63ea4dbbc	Add support for logprobs	2023-03-23 15:51:05 -04:00
Andrei Betlen	79b304c9d4	Initial commit	2023-03-23 05:33:06 -04:00