Official Pytorch Implementation
For all the methods described in the paper, is it required to have:
- Anaconda
- CLIP
Specific requirements for each method are described in its section. To install CLIP please run the following commands:
conda install --yes -c pytorch pytorch=1.7.1 torchvision cudatoolkit=<CUDA_VERSION>
pip install ftfy regex tqdm gdown
pip install git+https://github.com/openai/CLIP.git
Dataset Curation.
We create an MSCOCO and WiT Kor 5BE2 ean-Image-English Pair dataset.
Training.
python3 train.py
- Cifar10
| Model | Acc. |
|---|---|
| KoCLIP(kor) | 15% |
| Ours(kor) | 80% |
| CLIP(eng) | 95% |
http://pred.ga/AI_Tech/FinalProject/GPU2.mp4 (High-quality video)
Demo.
