Attention Key

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Oct 6 7:49
Editor
Edited
Edited
2024 Feb 23 6:8
Refs
Refs
The keys represent the words in the input sentence. The key vectors help the model understand how each word relates to the context word.
각 단어가 쿼리에 해당하는 단어와 얼마나 연관있는 지를 비교하기 위한 벡터
 
 
 
 
 
 
 
 

Recommendations