Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Object/NLP/Text Tokenizer/Special Token/
OOV token
Search

OOV token

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2025 Aug 9 23:16
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2025 Aug 9 23:16
Refs
Refs

Out-Of-Vocabulary

non-seen from training dataset
 
 
 
 
 
 
 
 
 

Recommendations

Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Object/NLP/Text Tokenizer/Special Token/
OOV token