Sentence-Level Multimodal and Language-Agnostic Representations
Limitation
Optimized for short sentences, with difficulties in processing long sentences. (Focuses on local relationships rather than global sentence relationships) Need to develop a new embedding space that better reflects the discrete characteristics of text.