To run:
python3 codet5_scored_partials.py --gpu_id 0 --num_gpu 1 --model_name codet5 --split val --difficulties introductory
codet5_scored_partials.py L381 generates the programs
codet5_scored_partials.py L382 runs them against the test cases
8000