OOS scoring runs completing successfully but showing no score ("-") in DataCrunch 2 across two consecutive rounds

[b-ionut-r]

Hey everyone

This is my first competition on DataCrunch 2 so apologies if I’m missing something obvious, but I’ve been seeing something weird with my OOS scores and wanted to ask.

I have two OOS runs that completed successfully but both show “-” in the score column:

• One from around a week ago (Round 12, run #72998)
• One from yesterday Sunday (Round 13, run #74063)

Both show Status: Success and ran for ~20 minutes, so it seems like they executed fine. But no score ever appeared. Meanwhile I can see other people on the leaderboard with scores, so I’m not sure what’s going on on my end.

Is this normal timing-wise — like the score only populates after Crunch DAO releases the ground truth? Or is there something I should have done differently with my submission selection?

Thanks in advance, any help appreciated!

[enzo]

Hello b-ionut-r,

First of all, welcome on Crunch!

As stated in the competition’s overview, it takes 5 weeks for the Out-of-Sample scores to be resolved.

The resolved runs are only there to help you validate your code; they will never be rewarded.

[b-ionut-r]

I see. I must’ve missed that bit. Thanks for the quick response!