I group here all problems we encounter related to re-running submissions. Click on the relevant issues for more information.
Auto-migration
When a phase allow the advanced option "Auto migrate to this phase", the behavior is a bit problematic: it runs all successful submissions of the previous phase in the new phase. I think we want to run only leaderboard submissions.
Also, it seems that deleting the new submissions created by the migrations delete the original submissions (linked to the point above).
Rerun whole phase runs child submissions too
@lbeziaud noticed that re-running submissions in a multi-tasks competition creates independant submissions for all children task:
When rerunning a unique submission (with the button in the action column), the behavior is as expected. The issue only concerns the "rerun all submissions per phase" button. It might be related to:
Deleting a re-run submission also delete the original submission
I think this is not the expected behavior. We should be able to remove the new submissions withtout removing the original submissions that got re-run.
Re-run submission on deleted task
@ihsaan-ullah reported that if you re-run submissions after deleting the task, the submissions get stuck in "Submitting":
Re-creation of submissions when using the re-run functionality
EDIT: we chose to ignore this point and to continue counting the re-runs as new submissions.
@dtuantran noted that using re-run creates new submissions:
I think that what he wanted to point out is that the number of submissions of the competition (and then of the platform) is also increased, not reflecting the number of submissions made by participants.
- Do not count re-runs in the submissions count
I group here all problems we encounter related to re-running submissions. Click on the relevant issues for more information.
Auto-migration
When a phase allow the advanced option "Auto migrate to this phase", the behavior is a bit problematic: it runs all successful submissions of the previous phase in the new phase. I think we want to run only leaderboard submissions.
Also, it seems that deleting the new submissions created by the migrations delete the original submissions (linked to the point above).
Solved by: Auto-migrate leaderboard submissions #1341. The problem of deletion is solved by: Delete rerun submission deletes original submission #1311
Rerun whole phase runs child submissions too
@lbeziaud noticed that re-running submissions in a multi-tasks competition creates independant submissions for all children task:
When rerunning a unique submission (with the button in the action column), the behavior is as expected. The issue only concerns the "rerun all submissions per phase" button. It might be related to:
Rerun submission automatically run against all tasks #604
Fix the behavior of "re-run all" functionality
Solved by: Rerun phase submissions #1323
Deleting a re-run submission also delete the original submission
I think this is not the expected behavior. We should be able to remove the new submissions withtout removing the original submissions that got re-run.
Solved by: Delete rerun submission deletes original submission #1311
Re-run submission on deleted task
@ihsaan-ullah reported that if you re-run submissions after deleting the task, the submissions get stuck in "Submitting":
Rerun submission after deleting a task #1179
Show warning when deleting a task
Solved by: Rerun submission when a task used is deleted #1301
Produce error when this happens (error message + avoid creating the new submission)
Solved by: Rerun submission when a task used is deleted #1301
Re-creation of submissions when using the re-run functionality
EDIT: we chose to ignore this point and to continue counting the re-runs as new submissions.
@dtuantran noted that using re-run creates new submissions:
I think that what he wanted to point out is that the number of submissions of the competition (and then of the platform) is also increased, not reflecting the number of submissions made by participants.