Seonglae ChoCentral goal of machine learning (Interpolation + Extrapolation)
To predict un-seen data and model’s generalization ability is model’s capability to adapt properly to new data.
Bias-Variance Trade-off to minimize complexity and variance to improve model generalization.
Model Generalization Notion
AI Generalization Methods
LLM Generality is a Timeline Crux — LessWrong
Short Summary LLMs may be fundamentally incapable of fully general reasoning, and if so, short timelines are less plausible. …
https://www.lesswrong.com/posts/k38sJNLk7YbJA72ST/llm-generality-is-a-timeline-crux
