Code and Data: Install

View on and Install via GitHub (coming soon).

Repo Structure Overview

.
├── README.md
├── Figure_1_Modality_Gap/
├── Figure_2_Cone_Effect/
├── Figure_3_Contrastive_Learning/
├── Table_1_Implications_CLIP_Zero_Shot/
├── Table_2_Implications_CLIP_Fairness/
├── util/

We organize the code in the orders of the figures as presented in the paper. As the folder name indicated, the Figure_1_Modality_Gap folder provides the code for reproducing Figure 1.

Citation

@Article{
  ModalityGap2022,
  title     = {Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning},
  author    = {Weixin Liang and
               Yuhui Zhang and
               Yongchan Kwon and
               Serena Yeung and
               James Zou},
  journal   = {arXiv preprint arXiv:2203.02053},
  url       = {https://arxiv.org/abs/2203.02053},
  year      = {2022}
}