EP
Expert Parallelism Tools
Field Notes on Scaling MoE Expert Parallelism with DeepEP
Documenting the journey of scaling expert parallelism to achieve high-throughput pretraining.
https://nousresearch.com/moe-scaling-field-notes/
Expert Parallelism
Creator
Creator
Seonglae ChoCreated
Created
2025 Mar 3 17:23Editor
Editor
Seonglae ChoEdited
Edited
2026 Feb 4 14:24Refs
Refs
MoE MoE Implementation