Featured

X Square Robot releases DMuon optimizer, improving embodied model distributed training efficiency by about 30%

X Square Robot has released the DMuon optimizer, a distributed adaptation of the Muon optimizer that improves embodied model distributed training efficiency by about 30%, reducing per-step training time from 2.2 times that of AdamW to 1.02 times. The improvements include Owner-centric execution and communication optimization, automatic selection of compute kernels based on matrix shape, and balanced workload distribution across Owners. DMuon is fully open source and compatible with Muon usage, requiring only 3 lines of code to introduce into training.

This page provides a summary and source link only.