African Credit Scoring Challenge
'/%3e%3c/defs%3e%3cpath fill='%23fff' d='M-120-80h240V80h-240z'/%3e%3cpath d='M-120-80h240v48h-240z'/%3e%3cpath fill='%23060' d='M-120 32h240v48h-240z'/%3e%3cg id='b'%3e%3cuse xlink:href='%23a' stroke='%23000'/%3e%3cuse xlink:href='%23a' fill='%23fff'/%3e%3c/g%3e%3cuse xlink:href='%23b' transform='scale(-1 1)'/%3e%3cpath fill='%23b00' d='M-120-24v48h101c3 8 13 24 19 24s16-16 19-24h101v-48H19C16-32 6-48 0-48s-16 16-19 24z'/%3e%3cpath id='c' d='M19 24c3-8 5-16 5-24s-2-16-5-24c-3 8-5 16-5 24s2 16 5 24'/%3e%3cuse xlink:href='%23c' transform='scale(-1 1)'/%3e%3cg fill='%23fff'%3e%3cellipse rx='4' ry='6'/%3e%3cpath id='d' d='M1 5.85s4 8 4 21-4 21-4 21z'/%3e%3cuse xlink:href='%23d' transform='scale(-1)'/%3e%3cuse xlink:href='%23d' transform='scale(-1 1)'/%3e%3cuse xlink:href='%23d' transform='scale(1 -1)'/%3e%3c/g%3e%3c/svg%3e){kind=small}
I wanted to wait for the first challenge under the new feature to close and observe the results. Once the competition ended, I could immediately see the private scores for all my submissions within the 15-minute window. This gave me the chance to unselect and select the best submissions, - the leaderboard did change after these 15 minutes as people selected their best private score subs. (For me however, I didn’t bother adjusting my submissions because my initial selections were already the best I had, though admittedly, they weren’t great. 😅)
Now, I’m curious: was this the intended behavior? The ability to see private scores and select/unselect submissions during this window or did I miss something from your discussion New Feature: Final 15-Minute Submission Window Explained - Zindi? @Amy_Bray / @Zindi, if this wasn’t intended, it might be a bug that needs to be relooked and corrected, but if it was intentional, I feel it could be unfair, especially for participants in different time zones. And worse, I honestly don’t see how there’s any final evaluation to be done if we can already see the private scores during these 15 minutes and unselect the worst subs and select the best performing as per the private leaderboard performance. This opens up alot of luck in winning Zindi competitions and might discourage hardwork.
That said, congratulations to all the winners! I didn’t perform very well in this one, but I’m looking forward to learn from the top solutions and hack a better score in a future competition 😊
ohh noo, we missed the party :(
Too bad if you could select other better ones.
We shouldn't be able to see the private leaderboard scores and table. Instead of implementing this method, automatically select everyone's best private score.
Yes seen it elsewhere.. Maybe it's direction zindi is taking
I noticed that too but i didn't change any of my submissions (although I had better ones) , this was unfair and it needs to be looked into
Why didn't you change? Did you give it a trial and then platform could not allow?
Yes it didnt allow....maybe bwcause i had to unselect one of the other two....but anyway I was sure it was a bug, since it doesn't make sense (as @private_1x stated they could have just taken best private two for everyone.
I think there is a bug here, I did not select two submissions for the final assessment, and strangely what appeared on the leaderboard was my submission with the best private score, while on the public score, the submission was not the submission with my best public score.
Strange indeed! More reason to relook leaderboard @Amy_Bray? @AJoel?
Yes, even the submission that appears on the private leaderboard is my 4th best public score submission
Well ... I'm upset because I could have won 1st place. I didn't realize that the private scores would appear during 15-min, or rather, I couldn't believe it.
Personally, I find this unfair, especially for the people who needed to wake up in the night to attend this 15-min window. Maybe it would be different if this window would have last 1 day, but anyway, I think it makes the submission selection pointless ! There is a reason why this doesn't exist on any other Data Science competition website.
Suggestion : why don't you just select the best private scores for everyone, instead of giving the chance to a few to have a considerable advantage.
In my situation, it gives a very bitter feeling and cost me 2500$. It was my first competition here, and I won't keep a great memory of it 😅
I guess you've been competing elsewhere before now 🤔
Hi Julius, thank you for raising this! We are looking in to it.
Did not know this was possible. Its definitely unfair because I cant remember seeing it in the rules. Yet again, it could be a bug in which case Zindi should use selections outside this 15min window for the final leaderboard.
Yea. Let see how Amy & team handles this. Carifications on how new feature ould work for this and future competitions would really help