MAE
Improved representations since images have heavy spatial redundancy (Image Locality). Therefore, learning to recover a missing patch from neighboring patches is helpful for high-level understanding.

arxiv.org
https://arxiv.org/pdf/2208.00173
arxiv.org
https://arxiv.org/pdf/2111.06377

Seonglae Cho