Primary competition visual

Farm to Feed Shopping Basket Recommendation Challenge

Helping Kenya
€8 250 EUR
Completed (~1 month ago)
Machine Learning
Prediction
Feature Engineering
740 joined
266 active
Starti
Dec 02, 25
Closei
Jan 19, 26
Reveali
Jan 20, 26
User avatar
Yisakberhanu
wachemo university
Is anyone else seeing a disconnect between CV and LB?
23 Dec 2025, 07:19 · 4

Hi everyone,

I wanted to start a discussion about CV vs. LB correlation. Currently, I'm finding it hard to trust my local validation because the scores are much higher than what I see on the leaderboard.

My situation:

  • Local CV (Week 1): ~0.956
  • Public LB: Fluctuating between 0.88 and 0.91

The Quantity target seems to be behaving relatively well/consistently, so I'm trying to figure out if this drop is purely due to the Price target or unseen shifts in the test set.

How is the correlation looking for you guys? Is anyone managing to get a CV that actually tracks the LB movement?

Discussion 4 answers
User avatar
Chafei07

You could try training once on the full training data.

24 Dec 2025, 15:31
Upvotes 0
User avatar
Yisakberhanu
wachemo university

yeh but not worked in may case

@ Retro Bowl I’ve been seeing something similar. My local CV looks very strong (mid‑0.95 range) but the LB is consistently lower, usually around 0.89–0.90. From what I can tell, the Quantity target is fairly stable across folds and leaderboard, but the Price target seems to be where the discrepancy comes in.

19 Jan 2026, 08:06
Upvotes 0

I find it fascinating how the insights from this challenge can reshape local agriculture. By tailoring shopping basket recommendations, we could significantly reduce food waste and improve nutrition. Excited to see where this leads!

30 Jan 2026, 03:33
Upvotes 0