Hey Zindians! 👋 I’ve been thinking about how we can make our competitions even more impactful and aligned with real-world needs. One idea that came to mind is this: 💡 What if Zindi involved the community in selecting the evaluation metric before the actual competition starts? Here’s how it could work: 🔹 A “placebo” challenge is launched with just the problem statement and a sample dataset. 🔹 Zindians propose custom evaluation metrics along with baseline models or justifications for why their metric makes sense. 🔹 The most optimal, fair, and client-aligned metric is then selected — and used in the real competition. This would: ✅ Engage the community beyond just competing ✅ Promote fairness and innovation in how solutions are scored ✅ Ensure better alignment with what the client actually values It could even come with small rewards for the best metric proposals. What do you think, fellow Zindians? @Zindi
Great 😃
I real do like the idea and I support it.
Hey @Knowledge_Seeker101 I love this suggestion, thank you for sharing it! We agree that getting the community involved in shaping evaluation metrics could drive fairness, innovation, and real-world impact. We’ll see if we can test out this approach in a future challenge and gather feedback from the community on how it works in practice. Stay tuned!
That's great 👍 thank you for the consideration