PolarGrad (Polar Gradient methods; Lau et al., 2025) is a class of matrix-gradient optimizers based on the concept of gradient-anisotropy preconditioning in optimization. It has close relation to Muon ...
Abstract: The dynamics of many systems are most naturally expressed in terms of a state-dependent mass matrix, the most prominent example being rigid body dynamics. However, model predictive control ...