(ReSRer Tasks)

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Dec 14 7:16
Editor
Edited
Edited
2024 Jan 31 3:51
Refs
Refs

High

테이블 2개 만들기 각각 보여줄 claim별로 논문에 적어두기
topk 10 best dpr 스코어
 

Dataset

gpt summarizr 먼저 확인
gpt-abstract
gpt-abstract-gold
gpt-extract
gpt-extract-gold
 
 
 
 

Evaluation

qa pipeline 돌릴 때 마지막에 evaluate 같이하기
 
 

Others

math task reader?
retriever accuracy script
ragas evaluation
slice ctx up to saved :10 context string length) for same length instead of ratio
save context length
 
 
 
 
 
 

Recommendations