As we knew, the old data is flawed and the current leaderboard does not reflect new situtation. Maybe the organizers should delete old leaderboard and only show new submission after Sep 18?
@tungtung Well said. I just wish @zindi can make things easier for everyone. Because i am stuck and fed up. Seeing your model scores improving gradually on leaderboard is the source of inspiration for any participant on any platform. So i still don't understand why this is different.
We are not resetting the leaderboard, as there is nothing preventing anyone from making the same flawed submissions after the reset. As always on Zindi, all submissions using disallowed data will be disqualified during code review.
We invite everyone who made submissions using the data leak to message us privately (zindi at zindi dot africa) to request that we remove those specific submissions from the leaderboard if they are interested in the leaderboard being a true reflection of current standings.
We recognise that this is not an ideal situation, but it is the best outcome given the circumstances. We appreciate your patience, understanding and support, and reassure you all that the best submission will win regardless of current leaderboard standings!
Yeah, they really should reset it.
I stopped making any more submission because it's meaningless with the current standing.
keep in mind that the top 10% are required to share their code, so basically anyone that used unallowed dataset will be disqualified.
@tungtung Well said. I just wish @zindi can make things easier for everyone. Because i am stuck and fed up. Seeing your model scores improving gradually on leaderboard is the source of inspiration for any participant on any platform. So i still don't understand why this is different.
I don't know what has become of @zindi lately. This is very frustrating for participants.
@ZINDI @Zindi
Hi everyone,
We are not resetting the leaderboard, as there is nothing preventing anyone from making the same flawed submissions after the reset. As always on Zindi, all submissions using disallowed data will be disqualified during code review.
We invite everyone who made submissions using the data leak to message us privately (zindi at zindi dot africa) to request that we remove those specific submissions from the leaderboard if they are interested in the leaderboard being a true reflection of current standings.
We recognise that this is not an ideal situation, but it is the best outcome given the circumstances. We appreciate your patience, understanding and support, and reassure you all that the best submission will win regardless of current leaderboard standings!