Dounan Du
Understanding the Muon Optimizer
An intuitive derivation of Muon through gradient descent, RMS-to-RMS operator norms, singular values, and Newton–Schulz iteration.
Posts
Dounan Du
Why I Think Laboratory Research Can Be Accelerated
Why laboratory memory, knowledge transfer, interdisciplinary complexity, automation overhead, and disconnected infrastructure slow experimental research.