RMB CPI Nowcasting Challenge
'%3e%3cpath fill='%23001489' d='M0 0v6h9V0z'/%3e%3cpath fill='%23e03c31' d='M0 0v3h9V0z'/%3e%3cg stroke='%23fff' stroke-width='2'%3e%3cpath id='d' d='m0 0 4.5 3L0 6m4.5-3H9'/%3e%3cuse xlink:href='%23b' stroke='%23ffb81c' clip-path='url(%23c)'/%3e%3c/g%3e%3cuse xlink:href='%23d' fill='none' stroke='%23007749' stroke-width='1.2'/%3e%3c/g%3e%3c/svg%3e)
Helping South Africa
$17 000 USD
Completed (over 2 years ago)
Forecast
1277 joined
21 active
Start
Sep 01, 23
Close
Dec 12, 23
Reveal
Dec 14, 23
Leaderboard
Help · 3 Dec 2023, 09:45 · 9
Hello Zindi Team,
my submissions are being scored very strangely. I have:
September: 64.06244549 (public) 63.83522056 (private)
October: 0.525259398 (public) 0.490421064 (private)
November: 0.637503142 (public) 64.2800284 (private)
How do you calculate these scores?
Fret not, the present private score is based on the second month's private scores.
If you selected a second month submission, you would have been number 2 based on the scores you provided in this discussion.
But according to these instructions:
the third month submission must be selected.
Yes, you are right.
The third month needs to be selected but here is the case whereby others have only one submission for the third month.
What happens in their case is that the second month submission gets selected by default.
For others, there are two available submissions for the 3rd month so they go ahead and select those two leading to the appearance of a poor lb score.
... But the appearance of a poor lb score is only temporary pending release of the third month's values.
yeah ihar we all selected the 3rd month's submission. but i have seen ur discussion that u ask to submit 2 different submissions from two different models for 1 month and i suspect that u have selected 2 solutions of november both scoring above 63 RMSE. but many of us didn't have 2 different solutions for 1 month so we just leaved our november's submission as selected and the other one our December's submission. we did(at least i did that) because it is mandatory to select 2 submissions and i have one for this month. since they are evaluating it using last months evaluation our last month's submission have a higher ranking and thus the leaderboard. when the real private score is revealed we will see our real rank.
OK, thank you for the explanation.
i agree with this,Those values are only applicable till the release of the actual Nov values..Then your score of 64 or smthing,will change to the actual 0.4,0.5,0.6,0.7,0.8,0.9..it has once happened to me,so just wait for the release.
Hello, sorry for not alerting you.
I did not receive the November RMB In house solution so the November public leaderboard is 0s meaning your score probably will be strangely off.
As long as you are confident of you values in your submission files you should be safe.
Final leaderboard to be revealed on 14/15 December.
Now the hard work on our side starts making sure all rules were complied with and finding the most interesting solutions.
Hello, thank you to clarify this to me.