Hello Zindians

A few clarifications on this challenge:

Tie breaker.

The private leaderboard will be used in the final rankings.

If two solutions earn identical scores on the leaderboard, the tiebreaker will be the date and time in which the submission was made (the earlier solution will win).

Perfect score

Note that there is a 20:80 split between the public and private test sets. So one can have a perfect score in the public leaderboard and a terrible score in the private or vice versa.

Zindi maintains a public leaderboard and a private leaderboard for each competition. The Public Leaderboard includes approximately 20% of the test dataset. While the competition is open, the Public Leaderboard will rank the submitted solutions by the accuracy score they achieve. Upon close of the competition, the Private Leaderboard, which covers the other 80% of the test dataset, will be made public and will constitute the final ranking for the competition.

Predictions

Note that the expected output from your models is probabilities. You should not post-process the probabilities by setting thresholds, rounding off or changing the probabilities in any way.

If the error metric requires probabilities to be submitted, do not set thresholds (or round your probabilities) to improve your place on the leaderboard. In order to ensure that the client receives the best solution Zindi will need the raw probabilities. This will allow the clients to set thresholds to their own needs.

Resource restriction

Use only the free colab GPU resources or an equivalent GPU with same specifications as the NVIDIA Tesla K80

To make this challenge accessible to all, there are restrictions on run time. You are allowed a maximum of 7 hours’ train time and 2 hours’ inference time on the whole test set, with a maximum 1 minute inference per image.

We encourage you to use Google Colab which allows you access to a NVIDIA Tesla K80. If you choose to use a different GPU, it may not exceed the specs of an NVIDIA Tesla K80.