I want to raise a broader concern about the state of recent Zindi competitions.
This year, several competitions have had serious leakage issues. In some cases, the issues are not minor they completely compromise the leaderboard and allow participants to score extremely well without building a meaningful machine learning solution.
A recent example is this issue that was raised on 10 June 2026 in this competition
The concern was very serious. The dataset appeared to have been sorted by the target before splitting into train and test, while preserving row order. This means the hidden test labels could effectively be inferred from the row index. As explained in the original post, someone could get a perfect leaderboard score by using the test row order alone, without training any model.
That completely breaks the competition.
The bigger problem is that today is 23 June 2026, almost two weeks later, and there has still been no clear communication from the organizers. No update. No decision. No acknowledgement of what will happen to the leaderboard. Just silence.
This is not acceptable.
Participants spend real time, compute, and effort on these competitions. Some people spend days or weeks building models, writing pipelines, tuning solutions, and sharing ideas. When a leakage issue is raised, especially one that can produce a perfect score, it should be treated as urgent.
At minimum, competitors deserve:
Leakage can happen. Dataset mistakes can happen. But silence after a critical issue is raised destroys trust.
Zindi has been an important platform for many African data scientists and ML practitioners, myself included. That is exactly why this is frustrating. The platform should protect the integrity of competitions and respect the time of participants.
I hope Zindi and the competition organizers take this seriously, respond clearly, and improve how these issues are handled going forward.
Exactly. There are tons of people who clearly use latitude and longitude and get AUC=1 and F1=1. We stay honest and fold the data not to use coordinates and we probably will not advance to the next stage:)
💯
@Koleshjr
I share your concern. What I find difficult to understand is the recurring lack of communication whenever a clear data leakage issue is raised in some competitions.
Dataset leakage is one of the most critical issues in any machine learning challenge because it can completely undermine the validity of the leaderboard and the work of participants who are investing significant time and resources into building legitimate solutions.
Mistakes can happen, but when credible concerns are raised, participants deserve timely acknowledgement, investigation updates, and clear communication about any actions being taken. Prolonged silence only creates uncertainty and raises questions about the dataset review process and competition oversight.
At this point, I think many participants would simply appreciate an official response from Zindi or the competition organizers outlining their findings and the next steps. Transparency is essential for maintaining trust in the platform and the competitions hosted on it.
MICADEE
@AJoel @meganomaly
Hi everyone,
Thank you for raising this, and thank you especially to those who have explained the concern clearly and constructively.
You are right to expect timely communication from us when a potential data leakage issue is raised. We should have acknowledged this sooner, and we apologise for the silence. Participants are investing real time and effort into this challenge, and it is our responsibility to protect the integrity of the competition and keep you informed when serious concerns are raised.
We have been investigating the issue and have been waiting on additional data to determine the right corrective action. That data has now been provided.
We are currently working through the update and expect to make changes to the challenge within the next 2 days. When we do, we will also provide a clear explanation of what has changed and how this affects the leaderboard, submissions, and competition process going forward.
We understand the frustration here. Leakage can happen, but communication should not stop while the issue is being investigated. We take this seriously and will aim to communicate more proactively in situations like this going forward.
Thank you for your patience and for holding us accountable.
Appreciate the response, was equally concerned on this matter and really disturbed with current perfect scores. Its an issue of safeguarding credibility and integrity of this competitions and challenges. The Kaggle of Mama Africa, really appreciate
cosigned