Attention Output

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Aug 21 16:39
Editor
Edited
Edited
2024 Jul 7 16:6

최종 값 (Context Vector), Attention Value

Query, Keys, Value할 때 value와 다르고 헷갈리니까 Attention output이라고 하자
Each word is also represented by a value which contains the information of that word. As a result, each context word is now represented by an attention-based attention value of all the words in the sentence.
 
 
 
 
 
 
 

 

Recommendations