Store the position information lost during pooling (or not), then restore (or random) values to those positions