Fails when data consists of multiple separate clustersDirections of greatest variance may not be most informative