Bibliography (5):
Vision Transformer: An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale
ImageNet Large Scale Visual Recognition Challenge
Interpret Vision Transformers as ConvNets with Dynamic Convolutions
Wikipedia Bibliography:
Softmax function
Rectifier (neural networks)