Primary competition visual

Sustainable Development Goals (SDGs): Text Classification Challenge

Helping Africa
$1 000 USD
Challenge completed almost 7 years ago
Natural Language Processing
Classification
412 joined
50 active
Starti
Sep 05, 18
Closei
Nov 12, 18
Reveali
Nov 13, 18
Leaderboard Ranking
Help · 13 Nov 2018, 07:37 · 4

Hi,

I think scores have been updated by itself,

I mean, I haven't done any submission in last two days, but the scores are updated along with other participants.

Can somebody please, help me to understand this.

Thank You,

Anshu

Discussion 4 answers

I think they did run the models on the entire dataset(public and private leaderboard)

I’m not too sure though

13 Nov 2018, 07:42
Upvotes 0

IMO, We need to share the code first, so that they run on whole dataset.

Lets see what they(@zindi) have to say.

I think what they do is that they take 80% of the test data that we submit, and do the hamming loss scoring on that 80%. The final score is the hamming loss of the entire submission file we uploaded. So they won't need our code, as they have held back 20% of our submitted values which are included for the final leaderboard

13 Nov 2018, 14:40
Upvotes 0

I see, Thank You @allank.