Bibliography (6):

1. https://github.com/tensorflow/mesh

2. Attention Is All You Need

3. https://cacm.acm.org/research/a-domain-specific-architecture-for-deep-neural-networks/

4. Wikipedia Bibliography:

   1. Deep learning § Deep neural networks  :

      https://en.wikipedia.org/wiki/Deep_learning#Deep_neural_networks

   2. https://en.wikipedia.org/wiki/SPMD  :

      https://en.wikipedia.org/wiki/SPMD

   3. https://en.wikipedia.org/wiki/Collective_operation#All-reduce  :

      https://en.wikipedia.org/wiki/Collective_operation#All-reduce