Bibliography (3):

  1. https://www.microsoft.com/en-us/research/blog/deepspeed-advancing-moe-inference-and-training-to-power-next-generation-ai-scale/

  2. ‘end-to-end’ directory

  3. https://github.com/microsoft/DeepSpeed