See Also

Link Bibliography

1. https://arxiv.org/abs/2301.07088#bytedance: “MUG: Vision Learners Meet Web Image-Text Pairs”⁠, Bingchen Zhao, Quan Cui, Hao Wu, Osamu Yoshie, Cheng Yang:

   link-bibliography

2. https://arxiv.org/abs/2301.01296#microsoft: “TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models”⁠, Sucheng Ren, Fangyun Wei, Zheng Zhang, Han Hu:

   link-bibliography

3. https://arxiv.org/abs/2301.00704#google: “Muse: Text-To-Image Generation via Masked Generative Transformers”⁠, Huiwen Chang, Han Zhang, Jarred Barber, A. J. Maschinot, Jose Lezama, Lu Jiang, Ming-Hsuan Yang, Kevin Murphy:

   link-bibliography

4. https://arxiv.org/abs/2212.05199: “MAGVIT: Masked Generative Video Transformer”⁠, Lijun Yu, Yong Cheng, Kihyuk Sohn, José Lezama, Han Zhang, Huiwen Chang, Alexander G. Hauptmann, Ming-Hsuan Yang:

   link-bibliography

5. https://openreview.net/forum?id=wmGlMhaBe0: “MaskDistill: A Unified View of Masked Image Modeling”⁠, Anonymous:

   link-bibliography

6. https://arxiv.org/abs/2211.07636#baai: “EVA: Exploring the Limits of Masked Visual Representation Learning at Scale”⁠, Yuxin Fang, Wen Wang, Binhui Xie, Quan Sun, Ledell Wu, Xinggang Wang, Tiejun Huang, Xinlong Wang, Yue Cao:

   link-bibliography

7. https://arxiv.org/abs/2211.07292: “Paella: Fast Text-Conditional Discrete Denoising on Vector-Quantized Latent Spaces”⁠, Dominic Rampas, Pablo Pernias, Elea Zhong, Marc Aubreville:

   link-bibliography

8. https://arxiv.org/abs/2209.14156: “TVLT: Textless Vision-Language Transformer”⁠, Zineng Tang, Jaemin Cho, Yixin Nie, Mohit Bansal:

   link-bibliography

9. https://arxiv.org/abs/2207.13532#bytedance: “CMAE: Contrastive Masked Autoencoders Are Stronger Vision Learners”⁠, Zhicheng Huang, Xiaojie Jin, Chengze Lu, Qibin Hou, Ming-Ming Cheng, Dongmei Fu, Xiaohui Shen, Jiashi Feng:

   link-bibliography

10. https://arxiv.org/abs/2207.06991: “PIXEL: Language Modelling With Pixels”⁠, Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, Desmond Elliott:

    link-bibliography

11. https://arxiv.org/abs/2207.06405#facebook: “Masked Autoencoders That Listen”⁠, Po-Yao, Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer:

    link-bibliography

12. https://arxiv.org/abs/2206.08356#facebook: “OmniMAE: Single Model Masked Pretraining on Images and Videos”⁠, Rohit Girdhar, Alaaeldin El-Nouby, Mannat Singh, Kalyan Vasudev Alwala, Arm, Joulin, Ishan Misra:

    link-bibliography

13. https://arxiv.org/abs/2205.14204#google: “M3AE: Multimodal Masked Autoencoders Learn Transferable Representations”⁠, Xinyang Geng, Hao Liu, Lisa Lee, Dale Schuurams, Sergey Levine, Pieter Abbeel:

    link-bibliography

14. https://arxiv.org/abs/2205.09113#facebook: “Masked Autoencoders As Spatiotemporal Learners”⁠, Christoph Feichtenhofer, Haoqi Fan, Yanghao Li, Kaiming He:

    link-bibliography

15. https://arxiv.org/abs/2204.14217#baai: “CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers”⁠, Ming Ding, Wendi Zheng, Wenyi Hong, Jie Tang:

    link-bibliography

16. https://arxiv.org/abs/2111.06377#facebook: “MAE: Masked Autoencoders Are Scalable Vision Learners”⁠, Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross Girshick:

    link-bibliography