Hi everyone,
I wanted to start a discussion about CV vs. LB correlation. Currently, I'm finding it hard to trust my local validation because the scores are much higher than what I see on the leaderboard.
My situation:
The Quantity target seems to be behaving relatively well/consistently, so I'm trying to figure out if this drop is purely due to the Price target or unseen shifts in the test set.
How is the correlation looking for you guys? Is anyone managing to get a CV that actually tracks the LB movement?
You could try training once on the full training data.
yeh but not worked in may case
@ Retro Bowl I’ve been seeing something similar. My local CV looks very strong (mid‑0.95 range) but the LB is consistently lower, usually around 0.89–0.90. From what I can tell, the Quantity target is fairly stable across folds and leaderboard, but the Price target seems to be where the discrepancy comes in.
I find it fascinating how the insights from this challenge can reshape local agriculture. By tailoring shopping basket recommendations, we could significantly reduce food waste and improve nutrition. Excited to see where this leads!