AI/ML for 5G-Energy Consumption Modelling by ITU AI/ML in 5G Challenge
I'm thinking about point 3 from previous post, that the users who did not make a submission selection, should not assesment\present in leaderboard or should assessed by maximum score.
Many other participants who made submission selection had better scores in their other hundreds submissions. Therefore, the leaderboard should be scored on the minimum score basis from all submissions to ensure fairness and accurate representation of performance.
In this case participants from point 3 would be in equal conditions with the others ..... otherwise they got the advantage over others.
This is indirectly confirmed by the fact that some of the participants’ submissions were made 2 months ago. Therefore, maybe the best submissions were selected among all the results for these users, and according to the rules, the participant must himself determine 2 variants.
Thanks for this complete explanation. Reproducibility of the result is indeed a separate big problem (for example, Catboost on the GPU, or other libraries when processing features, not to mention versioning :))).
Consider mandatory model selection in future competitions to bring it closer to real-world development conditions.
When you have to choose in any case which version to deploy based on a holdout sample (like 50% public in a competition) and then your model face the new data (like other 50% private in a competition).
Anyway, lets the best model wins!
Thanks.
Practice Mode is extremely useful in Geometry Dash. It allows players to place checkpoints and practice difficult sections without restarting the entire level.