Primary competition visual

CGIAR Eyes on the Ground Challenge

Helping Africa
$10 000 USD
Completed (over 2 years ago)
Prediction
871 joined
137 active
Starti
Jul 21, 23
Closei
Nov 03, 23
Reveali
Nov 03, 23
Allowed for use "type of damage" column in test set during training?
Help · 28 Oct 2023, 03:30 · 4

We can label samples in test set to zeros if type of damage is non DR. And using them for training. Is this allowed?

Discussion 4 answers
User avatar
Nayal_17

According to the officials: "You are not allowed to use feature "type of damage" at all in your solution. We recommend dropping the column when you read the file in. During code review, if a solution uses "type of damage" the team/user will be disqualified."

So we can't use damage type in any way.

28 Oct 2023, 03:33
Upvotes 0

I think easily to reach 7.x, 8.x if use type of damage for training. How to competition host check this issue? How to host select user to submit code verify?

From the rules section:

If you are in the top 10 at the time the leaderboard closes, we will email you to request your code. On receipt of email, you will have 48 hours to respond and submit your code following the Reproducibility of submitted code guidelines detailed below. Failure to respond will result in disqualification.

And from "Reproducibility of submitted code" in the same section:

If your submitted code does not reproduce your score on the leaderboard, we reserve the right to adjust your rank to the score generated by the code you submitted.
If your code does not run you will be dropped from the top 10. Please make sure your code runs before submitting your solution.

In the official message from amyflorida626 there is no clarification about test/train data, maybe we could ping the organizers to get an answer!

@amyflorida626

UPD

I wrote a message, hopefully the organizers reply soon!

28 Oct 2023, 14:24
Upvotes 0