🛰️ Daily AI Frontier
‹ back to 2026-08-08

Muon on the Stiefel Manifold Admits an Exact Closed-Form Update

arXiv math.OC Optimization Algorithms Mikhail Solonko, Molozhavenko Alexander, Maxim Rakhuba 2026-08-06

TL;DR - An arXiv preprint showing that the Muon matrix-aware optimizer's update on the Stiefel manifold (matrices with orthonormal columns) has an exact closed-form solution, yielding a new algorithm called Skewon. It matters because prior Stiefel extensions of Muon relied on heuristic, approximate, or iterative updates with uneven efficiency.

  • Derives an exact closed-form solution for the Stiefel Muon update, replacing approximate/iterative schemes used in existing extensions.
  • Introduces Skewon, a practical algorithm for orthogonality-constrained optimization with an efficient implementation built on that closed form.
  • Establishes first-order convergence guarantees for Skewon in the smooth non-convex setting.
  • Targets a constraint set (orthonormal columns) that is common in machine learning and scientific computing; abstract reports no empirical benchmarks, so speed/quality gains are unquantified here.

view merged work →