Dear challenge organizers,

I noticed the challenge has been extended to Aug 30th. However, it seems there are several issues with the docker submission in the forum for quite a while, but we have not received any response yet. Our team has also submitted a docker but it seems it takes forever to process a docker. If the challenge is still active, it would be great if the issues in forum (and other docker submission issues) can be resolved asap so that participants can evaluate their performance on leaderboard.

Another question regarding the evaluation, I noticed the final ranking will be computed based on the performances on the hidden testing set (leaderboard) and an external dataset. However, I have the concern if this evaluation is fair, as the results on hidden testing set can be seen by participants. This hidden "testing" set essentially becomes a validation set and it is not very fair to use it for final evaluation.

Thanks in advance Sincerely, PeachPear