Primary competition visual

Radiant Earth Spot the Crop Challenge

Helping South Africa
$8 800USD
Challenge completed ~4 years ago
Classification
Earth Observation
548 joined
101 active
Starti
Jul 05, 21
Closei
Oct 03, 21
Reveali
Oct 03, 21
User avatar
AkashPB
Column Format for submission
Notebooks Ā· 19 Aug 2021, 06:10 Ā· 7

Hi @Zindi,

Do we still need to follow the crop order while performing submission as mentioned in the discussion - https://zindi.africa/hackathons/radiant-earth-spot-the-crop-hackathon/discussions/6728 or shall we follow the crop order mentioned in the radiant hub's github - https://github.com/radiantearth/mlhub-tutorials/blob/main/notebooks/South%20Africa%20Crop%20Types%20Competition/Radiant_Earth_Spot_the_Crop_Baseline_Model-S2.ipynb ??

The reason for asking is, the crop-order mentioned in the hackathon discussion is giving values that correspond to our cross-validation log loss while the order mentioned in the notebook is giving values that are way off as compared to submitting just the samplesubmission file of the hackathon. Kindly look into this and confirm.

Thanks!

Discussion 7 answers
User avatar
ZINDI

Please use the order of the sample submission csv provided.

19 Aug 2021, 10:34
Upvotes 0
User avatar
AkashPB

we are obviously using the order of sample submission only but my query is this -

Do we need to use this format(as mentioned in the discussion link mentioned above) -

pred_df = pred_df.rename(columns={

7:'Crop_ID_1',

2:'Crop_ID_2',

0:'Crop_ID_3',

1:'Crop_ID_4',

8:'Crop_ID_5',

5:'Crop_ID_6',

4:'Crop_ID_7',

6:'Crop_ID_8',

3:'Crop_ID_9'

})

or this format as mentioned in the notebook -

pred_df = pd.DataFrame(y_competition_prob) pred_df = pred_df.rename(columns={ 0:'Crop_ID_1', 1:'Crop_ID_2', 2:'Crop_ID_3', 3:'Crop_ID_4', 4:'Crop_ID_5', 5:'Crop_ID_6', 6:'Crop_ID_7', 7:'Crop_ID_8', 8:'Crop_ID_9' }) pred_df['field_id']=data_test_grouped['field_id'] pred_df = pred_df[['field_id', 'Crop_ID_1', 'Crop_ID_2', 'Crop_ID_3', 'Crop_ID_4', 'Crop_ID_5', 'Crop_ID_6', 'Crop_ID_7', 'Crop_ID_8', 'Crop_ID_9']]

Both of them are giving different answers and the scores which you see on leaderboard are mostly from following the format mentioned in the discussion link - https://zindi.africa/hackathons/radiant-earth-spot-the-crop-hackathon/discussions/6728

User avatar
MICADEE
LAHASCOM

Yes. These two different orderings actually gave two different scores on LB respectively. One is far better than the other one. @Zindi We truly need a clarification here as regards this issue on ground.

Thanks in anticipation.

User avatar
Lone_Wolf
University of ghana

HI @ZINDI

can we please get an update on this?

User avatar
ZINDI

Hi all,

Please follow what is on the data page

  • 0 - No Data
  • 1 - Lucerne/Medics
  • 2 - Planted pastures (perennial)
  • 3 - Fallow
  • 4 - Wine grapes
  • 5 - Weeds
  • 6 - Small grain grazing
  • 7 - Wheat
  • 8 - Canola
  • 9 - Rooibos
User avatar
AkashPB

If possible @ZINDI reset the leaderboard. because most of us followed the format mentioned in the discussion link stated above and this data page format was rarely followed by anyone.

User avatar
MICADEE
LAHASCOM

Okay. Thanks @Zindi