How can we verify our code to submit to Zindi because the get score is scoring only on the public test data?

Hi Zindi,

We would like to raise a concern regarding the recently revealed results and request a re-evaluation to ensure that all our submissions were properly considered.

It seems that some of our more recent submissions were not included in the final private leaderboard evaluation. Over the past several days, we submitted conservative solutions that we are confident would be feasible. However, the final leaderboard only reflects the solution we submitted over a month ago, which is notably worse than our recent submissions.

Could you please re-check the submissions we made during the last four days of the competition (from 26th September to 30th September)? To ensure the fairness of the competition, we need confirmation that all our solutions were evaluated.

Additionally, we noticed that several teams, including ours, saw their rankings drop dramatically in the private leaderboard compared to the public leaderboard. We suspect that the private leaderboard evaluation may have been limited to the first 300 submissions, which includes infeasible submissions from earlier public leaderboard rounds. If this is the case, it may not align with the competition rules, as only feasible submissions should count towards the 300 limit. Given this, it’s essential that all submissions, especially those submitted more recently, be evaluated as they are critical to determining the final solution quality.

Thank you for your attention to this matter. @nicolapiovesan, @ZINDI, @meganomaly, maybe you can also opensource the private data to us and let us see the result.

Best regards