How to select final submission for out-of-sample scoring?

[resonant-poincare]

Hi @selected-ilia and @bigfish:

Increasing the number of selected submissions for the OOS scoring to two or three

Hey there, bigfish! It seems that you’re interested in assessing an average of predictions from a group of models. Multi-submission would be equivalent to this, BUT with the advantage of more computational cost. As people had to build complex models with the computational cost limitation in mind, it would be unfair to modify this so late into the competition. Please explore different ensemble techniques that are compatible with the computational resources provided.