“‘Compressed Transformers’ Tag”,2019-12-30 (dynamic evaluation (NN), RNN, recurrent Transformers, compression; backlinks)⁠:

Bibliography for tag ai/nn/transformer/attention/compression, most recent first: 3 related tags, 19 annotations, & 4 links (parent).

• See Also
• Links
  • “Cached Transformers: Improving Transformers With Differentiable Memory Cache”, Zhang et al 2023
  • “In-Context Autoencoder for Context Compression in a Large Language Model”, Ge et al 2023
  • “Learning to Compress Prompts With Gist Tokens”, Mu et al 2023
  • “Token Turing Machines”, Ryoo et al 2022
  • “MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition”, Wu et al 2022
  • “ABC: Attention With Bounded-Memory Control”, Peng et al 2021
  • “Memorizing Transformers”, Wu et al 2021
  • “Recursively Summarizing Books With Human Feedback”, Wu et al 2021
  • “∞-Former: Infinite Memory Transformer”, Martins et al 2021
  • “Perceiver IO: A General Architecture for Structured Inputs & Outputs”, Jaegle et al 2021
  • “TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?”, Ryoo et al 2021
  • “Not All Memories Are Created Equal: Learning to Forget by Expiring”, Sukhbaatar et al 2021
  • “Perceiver: General Perception With Iterative Attention”, Jaegle et al 2021
  • “Learning to Summarize Long Texts With Memory Compression and Transfer”, Park et al 2020
  • “Memory Transformer”, Burtsev et al 2020
  • “Compressive Transformers for Long-Range Sequence Modeling”, Rae et al 2019
  • “Set Transformer: A Framework for Attention-Based Permutation-Invariant Neural Networks”, Lee et al 2018
  • “Generating Wikipedia by Summarizing Long Sequences”, Liu et al 2018
  • “Phonotactic Reconstruction of Encrypted VoIP Conversations: Hookt on Fon-Iks”, White et al 2011
• Miscellaneous
• Bibliography

Backlinks: