African Credit Scoring Challenge
Helping Africa
$5 000 USD
Completed (~1 year ago)
1959 joined
1022 active
Start
Nov 29, 24
Close
Jan 12, 25
Reveal
Jan 13, 25
'%3e%3cpath id='a' fill='%23FF0' d='M0 0v6h4' transform='rotate(18)'/%3e%3cuse xlink:href='%23a' transform='scale(-1 1)'/%3e%3c/g%3e%3cg id='c' transform='rotate(72)'%3e%3cuse xlink:href='%23b'/%3e%3cuse xlink:href='%23b' transform='rotate(72)'/%3e%3c/g%3e%3cuse xlink:href='%23c' transform='scale(-1 1)'/%3e%3c/svg%3e){kind=small}
How does private leaderboard submission work?
Help · 28 Dec 2024, 22:09 · 3
Sorry I'm a 1st timer here.
It says in the rule: "Before the end of the challenge you need to choose 2 submissions to be judged on for the private leaderboard. If you do not make a selection your 2 best public leaderboard submissions will be used to score on the private leaderboard."
But as I know the submission file is a csv with only prediction result of public test set. How can it be used to judge the private test set? Shouldn't we submit a notebook instead?
The public leaderboard is only 30% of what you have submitted, private is the whole thing
Yeah I get it. I'm only confused about how the private submission process works.
According to the rule (or at least how I understand it), upon deadline they will automatically choose our 2 best public submissions (30%) to evaluate the private test set (the whole thing). But since we only submit a csv file with prediction of public (30%) test set, how exactly can they do that?
Instead of csv file, should we submit the notebook with code so that they can run it with the full test set? Like some kaggle competitions
Or will we be given access to the private set to run it in our local environment (and a small extra time to submit the result)? I'm not sure about this, rule says private set is only available after challenge closed
Oh just read your reply again and now I got it lol. Thank you