Hello hosts and Zindi team, Thank you for this great challenge!
To plan my submissions correctly: Is the final ranking based on the average MAE of all 7 evaluated weeks (Week 48 to Week 2), or is it the score of only the last submission, or something else?
This will help everyone focus on the right strategy. Thank you!
HI THERE
Based on the rules, the final ranking is not an average of all the weekly public scores.
The score we see each week is just the "Public Leaderboard." There is also a hidden "Private Leaderboard" (with the other 70% of the test data).
At the very end of the competition, you will select your 2 best submissions. Zindi will test only those 2 submissions against the hidden private data, and your best score of the two will become your final rank.
So, your final score comes from your single best submission, which is only calculated at the end.
You have gotten Yisak all wrong. This is a real time forecasting challenge.
This is the rule from Zindi:
I stand to be corrected but from what I read, only two weeks, Week 1 (29 December 2025–3 January 2026) and Week 2 (5–10 January 2026), will be used for the final leaderboard. As for the 70% 30% split, I am sure it will be conducted to create the public leaderboard and the private leaderboard. The question is "Will it be on the final two weeks or the average of all the weeks?" I think waiting for @Zindi is the best option to clarify everything.
Good Luck!
Hello @CodeJoe, as you clearly stated. What matters most at the end is the ability of your model to accurately forecast 2 weeks into the future. During the comp, you will be able to update your model as more data becomes available. However for the last week of comp you will forecast the first 2 weeks of January and the competition will close. Hence, your score is not an average of all the weeks but just the scored obtained on the first 2 weeks of January.
Thank you @AJoel