Hi organizers, I recently joined this competition. It was very close to the checkpoint time when I entered, so I submitted the official demo (resnet plus ridge regression) to check the result. My submission (id: #27901) finally got a score of ~7%. It is a bit confusing to me cause when I looked at the leaderboard, most of the values there were over 20%. It would be great if the official could announce the approximate score of this baseline for the contestants’ reference. I’m just wondering if there’s something wrong with my submission or if the scoring criteria could be further clarified. Thank you in advance.
You may not have submitted the pre-trained model “pytorch_model.bin” with the notebook to the platform. Otherwise you should get a score of 27.377% with this quickstarter.
1 Like
Thanks for reaching out!