How r y'all finding the LB - CV correlation. I can not trust my best submission (90.6) because it seems to be based on chance. My better CV submissions are terrible (around 88)
Hi there, thanks for confirming that most of the top public scores have worse CV scores (<0.88). Yes, it’s an absolute dilemma whether to choose the best public leaderboard score or the best CV score. In your case, since you have two submissions, you could consider choosing one based on each.
Hi there, thanks for confirming that most of the top public scores have worse CV scores (<0.88). Yes, it’s an absolute dilemma whether to choose the best public leaderboard score or the best CV score. In your case, since you have two submissions, you could consider choosing one based on each.
May I ask what CV score you achieved with your best submission, and what your overall best CV score is?