Primary competition visual

agriBORA Commodity Price Forecasting Challenge

Helping Kenya
€8 250 EUR
18 days left
Data analysis
GIS
Time-series
Forecasting
Nowcasting
604 joined
199 active
Starti
Nov 14, 25
Closei
Dec 27, 25
Reveali
Jan 13, 26
User avatar
keystats
Mount Kenya University
Confused About Zindi Scoring — Are We Missing Something? 🤯
Help · 19 Nov 2025, 09:44 · 4

Hi everyone, am I the only one feeling confused about how this competition actually works? 😅

Let me break down my confusion:

We're currently in week 47 (Nov 17-22) and we're supposed to predict weeks 48 and 49. But here's the thing - those weeks haven't even happened yet! The actual prices for week 48 will only be known on Dec 2nd, and for week 49 on Dec 9th.

So my big question is: what is Zindi using RIGHT NOW to calculate our leaderboard scores? Like, if nobody has the real prices for weeks 48-49 yet, how are we getting MAE and RMSE scores?

And about the submissions - the template shows weeks 48 through 52 plus weeks 1-2. But the rules say we only predict 2 weeks at a time. So should I be:

- Submitting predictions for ALL those weeks every time?

- Or just the 2 weeks we're actually forecasting and put zeros for the rest?

Right now I'm only predicting weeks 48-49 and leaving the others as zero, but I'm not sure if that's correct.

Also, I'm wondering how some geniuses are already scoring 0.9's on the leaderboard! ✨🎉🎊 how is that even possible when we're predicting future prices that don't exist yet? make me wonder is there something am missing?

And this is what worries me - sometimes when the LB score looks bad we dismiss an approach, but then later find out it was actually the best one. By then it's impossible to retrace our steps because we've moved on to other methods.

My training MAE is like 0.11 but my leaderboard MAE is 1.65 - that's a huge difference! Makes me wonder what data is actually being used for scoring and if I'm completely misunderstanding something.

Can anyone shed some light on this?

Discussion 4 answers
User avatar
Koleshjr
Multimedia university of kenya

I think with the rolling leaderboard it means atm we are being evaluated on dummy data. So whatever score you are seeing on the leaderboard is not meaningful. Meaningful scores will start rolling once week 48 and 49 are over. So right now you are just wasting subs in my opinion

19 Nov 2025, 11:11
Upvotes 2
User avatar
keystats
Mount Kenya University

Thanks @Koleshjr for the enlightment. It now makes total sense

User avatar
Freelance

It is possible. Unfortunately the provided AgriBORA data has prices up to week 41, and we don't have any data for weeks 42-45.

User avatar
keystats
Mount Kenya University

Somehow its possible if what truly matters are predictions for week 1 and 2 .... https://zindi.africa/competitions/agribora-commodity-price-forecasting-challenge/discussions/29366 .....For the missing weeks, you can use linear interpolation up to week 46, or any other imputation method you're comfortable with to fill these gaps.

However, what will truly matter are predictions for weeks 46-49. You should rely heavily on your local RMSE and MAE scores - if your model consistently gives you low error scores each time you add new data, you can be confident that your model is performing well.

When you eventually incorporate week 52 data to predict weeks 1 and 2, you can be hopeful for a good final score if your model has maintained strong performance throughout the rolling updates.