> Which submission will be used for the final evaluation?

Which submission will be used for the final evaluation?

Posted by: DXY0808 @ Aug. 19, 2019, 8:27 a.m.

---

Dear DXY0808,

According to the home page of this challenge:
"This is a 2-phase challenge; we are presently running the first phase (feed-back phase). The final blind testing will start August 20. The LAST SUBMISSION of the participants ranked better than baseline2 in the feed-back phase will be submitted automatically to the final phase to determine the winners. This submission will be tested on five new datasets. "

Good luck!

Best,
The AutoDL challenges organizers

Posted by: Zhengying @ Aug. 19, 2019, 12:46 p.m.

---

Thanks for your answer. My last submission in "ALL Datasets" and "Dataset 1" is different. In this case, which one will be used?

Posted by: DXY0808 @ Aug. 19, 2019, 1:06 p.m.

---

What concerns the evaluation is always the tab "All datasets". Other tabs are only for test and experimental purpose.

Posted by: Zhengying @ Aug. 19, 2019, 1:08 p.m.

---

Can I use a different submission? I'm not allowed to submit a new submission as it shows that I run out of Execution Time, but I still have 3 submissions left today.

Posted by: DXY0808 @ Aug. 19, 2019, 1:14 p.m.

---

Please indicate the submission ID of the submission you wish to use for final evaluation. We'll discuss among the organizers on whether this is allowed. Even the result could be negative but you can indicate the submission ID just in case.

Posted by: Zhengying @ Aug. 19, 2019, 1:25 p.m.

---

I wish to use 4900. Many thanks for your help!

Posted by: DXY0808 @ Aug. 19, 2019, 1:31 p.m.

---

Hi, it seems there is some problem with my submission "5116", where the computation time is "9:50:15". Would it not be terminated after 20 mins? Due to this problem, my last submission on all datasets (ID: 5343) can not be evaluated on all five datasets.

Posted by: DXY0808 @ Aug. 19, 2019, 6:09 p.m.

---

If possible, I hope to use my final submission (ID= 5348) for the final evaluation. Thanks

Posted by: DXY0808 @ Aug. 19, 2019, 6:20 p.m.

---

You can decide which one to use after the end of feedback phase in several hours. :)

Posted by: Zhengying @ Aug. 19, 2019, 8:21 p.m.