Skip to content

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning

Notifications You must be signed in to change notification settings

ypwang61/negCLIPLoss_NormSim

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning

[ Paper ]

This is an official code of negCLIPLoss & NormSim, which is a simple but efficient data selection method for CLIP model. This paper replaces the original VAS paper.

If you found this repository, our paper useful, please consider citing:

@article{wang2024cliploss,
  title={CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning},
  author={Wang, Yiping and Chen, Yifang and Yan, Wendan and Fang, Alex and Zhou, Wenjing and Jamieson, Kevin and Du, Simon Shaolei},
  journal={arXiv preprint arXiv:2405.19547},
  year={2024}
}

Details

The main function is baselines/vas2: load_uids_with_cs_new. Will clean the code and add details soon.

Acknowlegements

We thank the authors of DataComp for open sourcing their codes.

About

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published