K-FAC

K-FAC uses the Kronecker product of two bases as approximate eigenvector bases for the full Hessian, while EK-FAC corrects eigenvalues by calculating the variance of components obtained by projecting actual pseudo-gradients onto these bases. This is called Eigenvalue Correction and enables hundreds of times faster computation compared to traditional iterative linear system solvers.