Overfitting

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2021 May 31 5:45
Editor
Edited
Edited
2024 Nov 14 11:19
Refs

Predicts training dataset > test, High
Variance
(Spurious correlation)

데이터를 Generalization 하려기 보다 개별 sample을 기억하도록 학습되는 것
Models that are bigger or have more capacity are more likely to overfit. In other words, large number of parameters can cause overfitting since it allows for more accurate fitting to the training data, resulting in higher variance of the model. However If data is general enough, overfitting is okay like
Deep double descent
.
Resolve Overfitting
notion image
 
 
 
 

Recommendations