Explicit Multimodality alignment

Explicit alignment with similarity metric

Dynamic Time Warpling

• CCA based DTW (linear)

• DCCA based DTW (non-linear)

Graphical models

• generative graphical models

• factored HMM

• dynamic Bayesian Network

• hierarchical HMM

[multimodal] (3) Alignment, (4) Fusion

Multimodal Learning, Multimodal Representations

https://seunghan96.github.io/mult/study-(multi)Multimodal-Learning-(3)-Alignment/