Building and using an image pyramid - GeoServer 2.18.x User Manual
GeoServer can efficiently deal with large TIFF with overviews, as long as the TIFF is below the 2GB size limit. Once the image size goes beyond such limit it's time to start considering an image pyramid instead.
https://docs.geoserver.org/stable/en/user/tutorials/imagepyramid/imagepyramid.html
