Find the best Vector Space that represents data effectively
More well behaved representation from optimization perspective. Therefore, we must minimize the information (residual) that is lost when reducing dimensions.
Observed dimensionality datasets typically don't contain all possible cases (meaningless data is excluded). Therefore, in such cases, the dimensionality of the dataset can be effectively reduced
Dimension Reductions
Dimension Reduction Notion