pytorch-lightning-transformers Medium article

Setup

$ git clone https://github.com/sobamchan/pytorch-lightning-transformers.git
$ cd pytorch-lightning-transformers
$ pipenv install
$ pipenv shell

CUDA_VISIBLE_DEVICES=0,1 python csqa.py --gpus 2

$ python mrpc.py

This will load pre-trained BERT and fine-tune it with putting classification layer on top on MRPC task (paraphrase identification).

Name		Name	Last commit message	Last commit date
Latest commit History 20 Commits
.flake8		.flake8
.gitignore		.gitignore
Pipfile		Pipfile
Pipfile.lock		Pipfile.lock
README.md		README.md
csqa.py		csqa.py
mrpc.py		mrpc.py