Bibliography (4):

1. Attention Is All You Need

2. A Deep Dive into the Reformer

3. The Reformer—Pushing the Limits of Language Modeling

4. https://blog.eleuther.ai/rotary-embeddings/