Abstract: To be added. (Under construction)
- Link to download the MS COCO validation set (2017): https://cocodataset.org/#download
- Run the
zero_shot_evaluation.ipynbfile. It will construct the ColorFoil benchmark from the MS COCO dataset and perform the zero-shot evaluation of CLIP, ViLT, and BridgeTower models.