How to select final submission for out-of-sample scoring?

Also how many final submission will be allowed for the out-of-sample scoring? Thanks.

Just one, we will release the parameters selection soon!

@enzo Any updates on this? How do we select the submission that goes on for OOS testing?

It will be released this week.

@newbee @fun-robert Out-of-Sample Submission Selection - ADIA Lab Market Prediction Competition

Please allow the selection of two or three submissions for the final round of the competition.

Given the temporality of the dataset, only one submission/idea may not give the best results.

If each account could pick two or three submissions, their success in the completion would be less based on chance and more based on their ideas.

1 Like

I totally support the suggestion to submit two solutions for OOS. It is a pretty common practice in many competitions

Hi @selected-ilia and @bigfish:

Multi-submission would be equivalent to assessing an average of predictions
No, it wouldn’t :slight_smile: Multi-submission is equivalent to assessing the prediction with the maximum OOS score, which is impossible to create as one submission of ensembles. So it is not a question of computational cost, rather of evaluating not one, but two ideas independently.

@selected-ilia Please answer in the tread itself and not report the answers here.