Shifting factor
Amount by which the average of our predictions differs from the true mean. It captures he inherent error even with infinite training data.
- Bias indicates the prediction in the absence of any other features in the record.
- Bias can arise from intrinsic factors, not just from a lack of data.
- High bias in the decision-making process indicates that the model has not sufficiently learned complex patterns.
- This is rather caused by the family of models fundamentally being unable to approximate the ground truth, not by the data itself.
Inductive Bias, Extrinsic Bias, and Intrinsic Bias do not need to be classified separately since most factors can be considered to fall into multiple categories simultaneously.
Bias Notion