Texonom
/
Engineering
/
Data Engineering
/
Artificial Intelligence
/
AI Object
/
NLP
/
Text Tokenizer
/
Subword Tokenizer
/
BPE
/
BPE Dropout
Search
BPE Dropout
Creator
Creator
Seonglae Cho
Created
Created
2024 Mar 10 13:36
Editor
Editor
Seonglae Cho
Edited
Edited
2024 Mar 18 8:12
Refs
Refs
바이트 쌍의 병합을 무작위로 생략함으로써, 모델이 더 다양한 서브워드 분할에 노출되도록 하는 technique
Recommendations
Texonom
/
Engineering
/
Data Engineering
/
Artificial Intelligence
/
AI Object
/
NLP
/
Text Tokenizer
/
Subword Tokenizer
/
BPE
/
BPE Dropout
