Primary competition visual

Kenya Clinical Reasoning Challenge

Helping Kenya
$10 000 USD
Completed (8 months ago)
Prediction
Natural Language Processing
SLM
1664 joined
440 active
Starti
Apr 03, 25
Closei
Jun 29, 25
Reveali
Jun 30, 25
User avatar
Knowledge_Seeker101
Freelance
Community Idea: On Metrics
Platform · 2 Jul 2025, 20:39 · 4

Hey Zindians! 👋 I’ve been thinking about how we can make our competitions even more impactful and aligned with real-world needs. One idea that came to mind is this: 💡 What if Zindi involved the community in selecting the evaluation metric before the actual competition starts? Here’s how it could work: 🔹 A “placebo” challenge is launched with just the problem statement and a sample dataset. 🔹 Zindians propose custom evaluation metrics along with baseline models or justifications for why their metric makes sense. 🔹 The most optimal, fair, and client-aligned metric is then selected — and used in the real competition. This would: ✅ Engage the community beyond just competing ✅ Promote fairness and innovation in how solutions are scored ✅ Ensure better alignment with what the client actually values It could even come with small rewards for the best metric proposals. What do you think, fellow Zindians? @Zindi

Discussion 4 answers
User avatar
yehoshua

Great 😃

2 Jul 2025, 20:43
Upvotes 1
User avatar
Davisy

I real do like the idea and I support it.

3 Jul 2025, 06:01
Upvotes 2
User avatar
meganomaly
Zindi

Hey @Knowledge_Seeker101 I love this suggestion, thank you for sharing it! We agree that getting the community involved in shaping evaluation metrics could drive fairness, innovation, and real-world impact. We’ll see if we can test out this approach in a future challenge and gather feedback from the community on how it works in practice. Stay tuned!

4 Jul 2025, 13:00
Upvotes 2
User avatar
Knowledge_Seeker101
Freelance

That's great 👍 thank you for the consideration