AI Arithmetic Reasoning

Creator

Creator

Seonglae Cho

Created

Created

2024 Sep 29 23:29

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Dec 1 2:2

Refs

Refs

Attention tracks relationships between numbers, pattern matching, while MLP performs calculations

aclanthology.org

https://aclanthology.org/2023.emnlp-main.435.pdf

Limitation

패턴매칭이라 진정한 논리적이나 수학적 추론이 아니라 같은 문제라도 수치에 따라 정답률 다름

질문에 불필요한 정보가 추가될 때, LLM은 이 정보를 무시하지 못하고 성능이 크게 감소한다

https://arxiv.org/pdf/2410.05229

arithmetic is important for world modeling

Arithmetic is an underrated world-modeling technology — LessWrong

Of all the cognitive tools our ancestors left us, what’s best? Society seems to think pretty highly of arithmetic. It’s one of the first things we le…

Arithmetic is an underrated world-modeling technology — LessWrong

https://www.lesswrong.com/posts/r2LojHBs3kriafZWi/arithmetic-is-an-underrated-world-modeling-technology

Arithmetic is an underrated world-modeling technology — LessWrong

number_cookbook

GraphPKU • Updated 2024 Nov 27 11:37

https://arxiv.org/pdf/2411.03766

Recommendations

////////