Bibliography (5):
Attention Is All You Need
Reformer: The Efficient Transformer
A Deep Dive into the Reformer
The Reformer—Pushing the Limits of Language Modeling
https://blog.eleuther.ai/rotary-embeddings/