Bibliography (4):

  1. Attention Is All You Need

  2. Long Range Arena (LRA): A Benchmark for Efficient Transformers

  3. S4: Efficiently Modeling Long Sequences with Structured State Spaces

  4. Wikipedia Bibliography:

    1. Prior probability