Bibliography (8):

  1. ImageNet Large Scale Visual Recognition Challenge

  2. Attention Is All You Need

  3. https://github.com/Alibaba-MIIL/Solving_ImageNet

  4. Vision Transformer: An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale

  5. Knowledge distillation: A good teacher is patient and consistent