Seonglae ChoFundamental limitation of Causal LM
Failed to generalize A→B then ⇒ B → A
Reverse Training to Nurse the Reversal Curse
모든 단어를 두 번 사용하고, 훈련 문자열을 역방향으로 뒤집되, 특정 부분 문자열 like entir을 그대로 유지하여 훈련 (Meta FAIR )
Reverse Training to Nurse the Reversal Curse
HTML conversions sometimes display errors due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on.
https://arxiv.org/html/2403.13799v1
arxiv.org
https://arxiv.org/pdf/2309.12288.pdf