Open
Description
As reported in #153985, two issues blocked pin upgrade log:
- vision_maskrcnn graph breaks is increased from 18 to 20 which blocked TorchVision pin upgrade.
- benchmark timeout: There is a 3.5 hour timeout limit. We spent 1.5 hour for setting up environment (including 0.5 hour for installing fbgemm). Then, detectron2_fasterrcnn_r_101_fpn, detectron2_fasterrcnn_r_101_c4, detectron2_fasterrcnn_r_101_dc5, detectron2_fasterrcnn_r_50_dc5 each took around 20 mins, leading to the timeout finally.
#154255 bumped the expected graph breaks to unblock and increased #shards for timeout. But we still need investigation on the increased #graph breaks.
cc @chauhang @penguinwu @voznesenskym @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @amjames