Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Text embedding/Positional Embedding/Relative Positional Encoding/
Axial position encoding
Search

Axial position encoding

Creator
Creator
Seonglae Cho
Created
Created
2024 Mar 2 6:27
Editor
Editor
Seonglae Cho
Edited
Edited
2024 Mar 2 7:6
Refs
Refs
이미지같은 큰 차원에 유용
 
 
 
 
 
 
github.com
https://github.com/google/trax/blob/4d99ad4965bab1deba227539758d59f0df0fef48/trax/layers/research/position_encodings.py#L29
 
 

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Text embedding/Positional Embedding/Relative Positional Encoding/
Axial position encoding
Copyright Seonglae Cho