Jaekeol Choi, Euna Jung, Jangwon Suh, Wonjong Rhee. Improving Bi-encoder Document Ranking Models with Two Rankers and Multi-teacher Distillation. SIGIR 2021 (short)
Paper at: https://arxiv.org/abs/2103.06523
We used Robust04 and Clueweb09b ( This can be easily modified for MS-MARCO dataset. )
./run_single.sh
./run_trmd.sh