Attention Score

Creator

Created

2023 Aug 21 16:39

Editor

Edited

2024 Nov 18 22:46

Refs

Scaled dot product attention is most usual which are in Transformer architecture paper

Attention = \Sigma <K, Q>

Attention Score functions

/////////