Primary competition visual

Microsoft Learn Location Mention Recognition Challenge

$5 000 USD
Challenge completed ~1 year ago
Natural Language Processing
Generative AI
1219 joined
365 active
Starti
May 16, 24
Closei
Oct 13, 24
Reveali
Oct 13, 24
User avatar
tungtung
Can the organizers refresh leaderboard?
Platform · 21 Sep 2024, 15:38 · 6

As we knew, the old data is flawed and the current leaderboard does not reflect new situtation. Maybe the organizers should delete old leaderboard and only show new submission after Sep 18?

Discussion 6 answers
User avatar
Muhamed_Tuo
Inveniam

Yeah, they really should reset it.

I stopped making any more submission because it's meaningless with the current standing.

21 Sep 2024, 16:19
Upvotes 1
User avatar
Moujoudix

keep in mind that the top 10% are required to share their code, so basically anyone that used unallowed dataset will be disqualified.

21 Sep 2024, 16:27
Upvotes 1
User avatar
MICADEE
LAHASCOM

@tungtung Well said. I just wish @zindi can make things easier for everyone. Because i am stuck and fed up. Seeing your model scores improving gradually on leaderboard is the source of inspiration for any participant on any platform. So i still don't understand why this is different.

22 Sep 2024, 01:10
Upvotes 2

I don't know what has become of @zindi lately. This is very frustrating for participants.

User avatar
Koleshjr
Multimedia university of kenya
24 Sep 2024, 11:33
Upvotes 0
User avatar
ZINDI

Hi everyone,

We are not resetting the leaderboard, as there is nothing preventing anyone from making the same flawed submissions after the reset. As always on Zindi, all submissions using disallowed data will be disqualified during code review.

We invite everyone who made submissions using the data leak to message us privately (zindi at zindi dot africa) to request that we remove those specific submissions from the leaderboard if they are interested in the leaderboard being a true reflection of current standings.

We recognise that this is not an ideal situation, but it is the best outcome given the circumstances. We appreciate your patience, understanding and support, and reassure you all that the best submission will win regardless of current leaderboard standings!

24 Sep 2024, 14:46
Upvotes 2