Seonglae Cho- kernel → feature
- mirror → gradient
- Legendre → function ↔ gradient
and
- kernel → representation geometry
- preconditioning → optimization geometry
- Hessian → local metric
A gradient method that uses a different geometry instead of Euclidean distance for updates
Dual space update like Preconditioning
Dual space update is a "coordinate transformation-based update method" used in Mirror Descent
Mirror descent
In mathematics, mirror descent is an iterative optimization algorithm for finding a local minimum of a differentiable function.
https://en.wikipedia.org/wiki/Mirror_descent