Bibliography (3):
https://www.microsoft.com/en-us/research/blog/deepspeed-advancing-moe-inference-and-training-to-power-next-generation-ai-scale/
‘end-to-end’ directory
https://github.com/microsoft/DeepSpeed