It's not about changing coordinates, but rather changing 'what to use as coordinates'
- kernel → feature
- mirror → gradient
- Legendre → function ↔ gradient
and
- kernel → representation geometry
- preconditioning → optimization geometry
- Hessian → local metric
Legendre duality is a "well-behaved special case" of convex conjugate

Seonglae Cho