Bibliography (8):

  1. Longformer: The Long-Document Transformer

  2. BigBird: Transformers for Longer Sequences

  3. WaveNet: A Generative Model for Raw Audio

  4. Attention Is All You Need

  5. Long Range Arena (LRA): A Benchmark for Efficient Transformers