Primary competition visual

Radiant Earth Spot the Crop Hackathon by #ZindiWeekendz

Helping South Africa
$300 USD
Challenge completed over 4 years ago
Classification
Earth Observation
81 joined
21 active
Starti
Jul 02, 21
Closei
Jul 04, 21
Reveali
Jul 04, 21
Submission evaluation wrong crop order
Notebooks · 3 Jul 2021, 22:01 · 3

Hey,

A few people already posted about the SampleSubmission.csv file having additional field_ids that are not in the test data but required in the submission.

I also noticed that the column order of the crops in the SampleSubmission.csv file is different from the order in the Tutorial notebook, which likely explains why scores are so bad for everybody. I adjusted the relevant part in the notebook code (see below) to reorder the columns as they are in the SampleSubmission.csv file. It did give me a way better score which is now close to the score I was expecting based on my testing. I'm hoping this can help everyone until the issues get fixed by the organisers.

Code changes:

pred_df = pred_df.rename(columns={

7:'Crop_ID_1',

2:'Crop_ID_2',

0:'Crop_ID_3',

1:'Crop_ID_4',

8:'Crop_ID_5',

5:'Crop_ID_6',

4:'Crop_ID_7',

6:'Crop_ID_8',

3:'Crop_ID_9'

})

Discussion 3 answers
User avatar
DoubleAgent
Carnegie mellon university africa

Thanks for this observation, greatly appreciated.

4 Jul 2021, 05:06
Upvotes 0
User avatar
Philipps-university marburg

Thanks a lot @Just4Fun. This problem took me 3-4 days (looking for errors in my code...). When I adjust the order of the columns according to your post, I get the "real" cross entropy score.

@Zindi: This issue should really be fixed, otherwise competitors that did not take part in the Hackathon will not get the right scoring results!

10 Aug 2021, 08:54
Upvotes 0

Wow! @Just4Fun you are my hero!!! Thank you very much! I was looking for bug in my code for 3 days!

10 Aug 2021, 18:09
Upvotes 0