Code and Data: Install
View on and Install via GitHub (coming soon).Repo Structure Overview
.
├── README.md
├── Figure_1_Modality_Gap/
├── Figure_2_Cone_Effect/
├── Figure_3_Contrastive_Learning/
├── Table_1_Implications_CLIP_Zero_Shot/
├── Table_2_Implications_CLIP_Fairness/
├── util/
We organize the code in the orders of the figures as presented in the paper. As the folder name indicated, the Figure_1_Modality_Gap folder provides the code for reproducing Figure 1.
Citation
@Article{
ModalityGap2022,
title = {Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning},
author = {Weixin Liang and
Yuhui Zhang and
Yongchan Kwon and
Serena Yeung and
James Zou},
journal = {arXiv preprint arXiv:2203.02053},
url = {https://arxiv.org/abs/2203.02053},
year = {2022}
}