v3
Rewrite the given passages to be easier for the reader answering the given question. The rewritten text should be longer than half of a single original passage but shorter than the total length of all passages. The passages provided are related to the topic of the question. Avoid introducing information not present in the original document, and refrain from answering the question. Eliminate irrelevant details and noise information that don't contribute to answering the question, while preserving all relevant information. Increase the information density by removing phrases and sentences unrelated to the question. Identify and retain evidence that supports the answer to the question. Only present the rewritten texts. The final answer to this question, which is found within the passages, should be maintained in a precise span of fewer than 5 words.
1 → 1 [:100]
{'exact_match': 37.0, 'f1': 47.588095238095235, 'psgs_tokens': 137.19, 'summary_tokens': 99.74, 'reader_fp': 0.17, 'reader_fn': 0.0, 'reader_precision': 0.6851851851851852, 'reader_recall': 1.0, 'sum_fp': 0.03, 'sum_fn': 0.06, 'sum_precision': 0.9444444444444444, 'sum_recall': 0.8947368421052632} [:400] [:400] {'exact_match': 31.75, 'f1': 40.505952380952394, 'psgs_tokens': 135.8975, 'summary_tokens': 97.635, 'reader_fp': 0.1675, 'reader_fn': 0.005, 'reader_precision': 0.6510416666666666, 'reader_recall': 0.984251968503937, 'sum_fp': 0.035, 'sum_fn': 0.065, 'sum_precision': 0.9270833333333334, 'sum_recall': 0.8725490196078431
4→1
{'exact_match': 33.32409972299169, 'f1': 44.01821518456606, 'psgs_tokens': 546.4903047091412, 'summary_tokens': 151.14570637119112, 'reader_fp': 0.24238227146814403, 'reader_fn': 0.0030470914127423824, 'reader_precision': 0.5766811804547654, 'reader_recall': 0.9908561928512053, 'sum_fp': 0.01301939058171745, 'sum_fn': 0.10692520775623268, 'sum_precision': 0.9772617319787131, 'sum_recall': 0.8395677472984207}
여기부터 기록
{'exact_match': 33.37950138504155, 'f1': 43.50731017213017, 'psgs_tokens': 546.4903047091412, 'summary_tokens': 161.60775623268697, 'sum_tn': 1.3296398891966759, 'sum_fn': 10.720221606648199, 'ret_em': 66.64819944598338, 'sum_em': 57.25761772853185, 'read_fp': 24.182825484764543, 'read_tn': 0.3047091412742382
Seonglae Cho