Mirror Descent

Creator

Creator

Seonglae Cho

Created

Created

2026 Mar 20 17:5

Editor

Editor

Seonglae Cho

Edited

Edited

2026 Mar 20 17:16

Refs

Refs

Bregman divergence

A gradient method that uses a different geometry instead of Euclidean distance for updates

Dual space update like
Preconditioning

Dual space update is a "coordinate transformation-based update method" used in Mirror Descent

In mathematics, mirror descent is an iterative optimization algorithm for finding a local minimum of a differentiable function.

https://en.wikipedia.org/wiki/Mirror_descent

Recommendations

///////