AI4D Africa’s Anglophone Research Lab Tanzania Tourism Classification Challenge
Helping Tanzania, United Republic of
$1 000 USD
Challenge completed over 3 years ago
Classification
506 joined
180 active
Start
Jun 01, 22
Close
Jul 01, 22
Reveal
Jul 01, 22
Submission Leaderboard Scoring
Help · 9 Jun 2022, 14:20 · 2
I think there might be an issue with the scoring formula used on the leaderboard.
For example, I randomly changed the name of the columns from ['High Cost', 'Higher Cost', 'Highest Cost', 'Low Cost', 'Lower Cost', 'Normal Cost'] to ['High Cost', 'Higher Cost', 'Lower Cost', 'Normal Cost', 'Low Cost', 'Highest Cost'], and I got the same log loss score on the leaderboard for both submissions.
Should this be? I'm just wondering
There might be a problem in this case I did this and I got different score.
If it's the same log loss you meant to say, then yes, irrespective of how you arrange the columns you should get the same score.
However if you meant different scores on the leaderboard after shuffling the columns, then there is an issue with calculating the logloss score from @Zindi