Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/Machine Learning/Representation Learning/Text embedding/Contextual embedding/
Measures of Contextuality
Search

Measures of Contextuality

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Jul 10 8:15
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2023 Aug 29 8:32
Refs
Refs

self similarity

각기 다른 문장에서 사용되는 동일 단어의 유사
 

intra-sentence similarity

한 문장 내 단어들의 유사도
 

maximum explainable variance

static embedding으로 표현가능한 정도
 
 
 
Contextual Embedding - How Contextual are Contextualized Word Representations?
오늘 살펴볼 논문은 How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings 라는 논문이다. 이름이 무척 긴데, 사실 이
Contextual Embedding - How Contextual are Contextualized Word Representations?
https://velog.io/@stapers/Contextual-Embedding-How-Contextual-are-Contextualized-Word-Representations
Contextual Embedding - How Contextual are Contextualized Word Representations?
 
 

Table of Contents
self similarityintra-sentence similaritymaximum explainable variance

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/Machine Learning/Representation Learning/Text embedding/Contextual embedding/
Measures of Contextuality
Copyright Seonglae Cho