Fix: default repeat_penalty

This commit is contained in:
Andrei Betlen 2023-05-08 18:49:11 -04:00
parent a3cc7bf5b2
commit 82d138fe54

View file

@ -146,7 +146,7 @@ top_k_field = Field(
)
repeat_penalty_field = Field(
default=0.0,
default=1.1,
ge=0.0,
description="A penalty applied to each token that is already generated. This helps prevent the model from repeating itself.\n\n"
+ "Repeat penalty is a hyperparameter used to penalize the repetition of token sequences during text generation. It helps prevent the model from generating repetitive or monotonous text. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient.",