“RuCLIP—New Models and Experiments: a Technical Report”, Alex Shonenkov, Andrey Kuznetsov, Denis Dimitrov, Tatyana Shavrina, Daniil Chesakov, Anastasia Maltseva, Alena Fenogenova, Igor Pavlov, Anton Emelyanov, Sergey Markov, Daria Bakshandaeva, Vera Shybaeva, Andrey Chertok2022-02-22 (, ; similar)⁠:

In the report, we propose 6 new implementations of ruCLIP model trained on our 240M pairs.

The accuracy results are compared with the original CLIP model with Ru-En translation (OPUS-MT) on 16 datasets from different domains.

Our best implementations outperform CLIP + OPUS-MT solution on most of the datasets in few-show and zero-shot tasks.

In the report, we briefly describe the implementations and concentrate on the conducted experiments. Inference execution time comparison is also presented in the report.

View PDF:

RuCLIP—New Models and Experiments: a Technical Report