The Reversal Curse

Creator

Creator

Seonglae Cho

Created

Created

2024 Jan 14 11:36

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Mar 30 17:48

Refs

Refs

Fundamental limitation of Causal LM

Failed to generalize A→B then ⇒ B → A

Reverse Training to Nurse the Reversal Curse

모든 단어를 두 번 사용하고, 훈련 문자열을 역방향으로 뒤집되, 특정 부분 문자열 like entir을 그대로 유지하여 훈련 (

Reverse Training to Nurse the Reversal Curse

HTML conversions sometimes display errors due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on.

Reverse Training to Nurse the Reversal Curse

https://arxiv.org/html/2403.13799v1

https://arxiv.org/pdf/2309.12288.pdf

Recommendations

////////