CLIP: Connecting Text and Images: We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the ‘zero-shot’ capabilities of GPT-2 and GPT-3
https://github.com/klauscc/VindLU
Vision Transformer: An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Dense-Captioning Events in Videos
Attention Is All You Need
ConvNeXt: A ConvNet for the 2020s