Bibliography (7):
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Attention Is All You Need
Long Range Arena (LRA): A Benchmark for Efficient Transformers
https://github.com/mlpen/YOSO
Wikipedia Bibliography:
https://en.wikipedia.org/wiki/Bernoulli_sampling :
https://en.wikipedia.org/wiki/Bernoulli_sampling
Locality-sensitive hashing
Softmax function