Attention Mechanism abstraction

Creator
Creator
Alan JoAlan Jo
Created
Created
2023 Oct 6 7:48
Editor
Editor
Alan JoAlan Jo
Edited
Edited
2023 Oct 6 8:0
Refs
Refs
Imagine yourself in a library. You have a specific question (query). Books on the shelves have titles on their spines (keys) that suggest their content. You compare your question to these titles to decide how relevant each book is, and how much attention to give each book. Then, you get the information (value) from the relevant books to answer your question.
 
 
 
 
 
 
 
 
 

Recommendations