Attention MatrixKey, Query Vector Similarity Attention Key Attention QueryAttention Score functionsDot-Product AttentionBahdanau AttentionMultiplicative AttentionAdditive Attention