Bibliography (5):

  1. Attention Is All You Need

  2. Reformer: The Efficient Transformer

  3. A Deep Dive into the Reformer

  4. The Reformer—Pushing the Limits of Language Modeling

  5. https://blog.eleuther.ai/rotary-embeddings/