Seonglae ChoSimilar to the minimum limits based on the uncertainty principle's tradeoff or the ecosystem's carrying capacity limits due to biological reproduction, AI, despite its initial exponential growth, is likely to have intelligence limits since its implementation occurs in physical reality. Since both human neuron communication and semiconductor vector operations are affected by physical distance in terms of computation speed, if there are intelligence limits based on physical laws, it's likely to manifest as a tradeoff between the quantity of knowledge and quality of reasoning. While we don't know how far above current human-level intelligence this physically-imposed limit might be, unlike transformer scaling laws, the complexity of structure can also increase exponentially, so whether this limit is just above us or far away remains unknown.
Is there an appropriate way to predict this limit and calculate the intelligence that could be reached within this limit?
Physical laws may impose constraints on the development of intelligence
The Beginning of Infinity
The Beginning of Infinity: Explanations that Transform the World is a popular science book by the physicist David Deutsch first published in 2011.
https://en.wikipedia.org/wiki/The_Beginning_of_Infinity
Superintelligence: Paths, Dangers, Strategies
Superintelligence: Paths, Dangers, Strategies is a 2014 book by the philosopher Nick Bostrom. It explores how superintelligence could be created and what its features and motivations might be. It argues that superintelligence, if created, would be difficult to control, and that it could take over the world in order to accomplish its goals. The book also presents strategies to help make superintelligences whose goals benefit humanity. It was particularly influential for raising concerns about existential risk from artificial intelligence.
https://en.wikipedia.org/wiki/Superintelligence:_Paths,_Dangers,_Strategies
