examples: use punkt_tab instead of punkt (#6907)

This was causing an error since we depend on punkt_tab.
This commit is contained in:
Mahesh Sathiamoorthy 2024-09-22 07:25:28 +05:30 committed by GitHub
parent dbba73469d
commit ad935f45ac
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -9,7 +9,7 @@ import nltk
warnings.filterwarnings( warnings.filterwarnings(
"ignore", category=FutureWarning, module="transformers.tokenization_utils_base" "ignore", category=FutureWarning, module="transformers.tokenization_utils_base"
) )
nltk.download("punkt", quiet=True) nltk.download("punkt_tab", quiet=True)
def getArticleText(url): def getArticleText(url):