Bibliography (5):

  1. Attention Is All You Need

  2. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

  3. Long Range Arena (LRA): A Benchmark for Efficient Transformers

  4. https://github.com/mlpen/Nystromformer