Self-attention enables the encoder to weigh the importance of each word and capture both short and long-range dependencies.
Encoder Self-Attention
Creator
Creator
Seonglae ChoCreated
Created
2023 Mar 5 23:49Editor
Editor
Seonglae ChoEdited
Edited
2023 Oct 6 7:27Refs
Refs
Self-Attention 