Attention Matrix QKKey, Query Vector Similarity Attention Key Attention QueryAttention Score functionsDot-Product AttentionBahdanau AttentionMultiplicative AttentionAdditive Attention