Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs

Published in arXiv 2025, 2025

A systems and modeling recipe for training a 718-billion-parameter mixture-of-experts language model on Ascend NPUs.