CLIP: Connecting Text and Images: We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the ‘zero-shot’ capabilities of GPT-2 and GPT-3
Unsupervised Cross-lingual Representation Learning at Scale
Contrastive Representation Learning: A Framework and Review
ImageNet Large Scale Visual Recognition Challenge
Microsoft COCO: Common Objects in Context
https://github.com/FlagAI-Open/FlagAI
Wikipedia Bibliography:
OpenAI