Primary competition visual

African Credit Scoring Challenge

Helping Africa
$5 000 USD
Completed (~1 year ago)
1959 joined
1022 active
Starti
Nov 29, 24
Closei
Jan 12, 25
Reveali
Jan 13, 25
User avatar
josh_amayo
Oval
CV vs LB
Data · 3 Jan 2025, 16:03 · 7

Are people still having disparity between LB and CV? My CV has gone up to 0.91 but lb score still plateau-ing at 0.68. Seen many people break the 0.7 mark so curious how people got over this disparity

Discussion 7 answers
User avatar
preciousgift
Data Science Nigeria

Experiencing the same here.

3 Jan 2025, 17:38
Upvotes 1
User avatar
BanterGent96
Wits University

2 theories:

1. Some of the people who have lb scores over 0.7 just have models that are highly overfit and their private scores will be lower

2. They genuinely have better models and found a clever way to account for the differences between the distributions of Train.csv and Test.csv as well as the imbalance in the data

3 Jan 2025, 18:08
Upvotes 2
User avatar
josh_amayo
Oval

Quite the conundrum, whether to trust the model with better Cv scores or lb scores

User avatar
Mohamed_Elnageeb
University of khartoum

you h've got two submissions 😉

User avatar
josh_amayo
Oval

Haha true, will just submit the best of both and hope for the best

User avatar
Ebiendele
Federal university of technology akure

The best advice is to trust your approach because the shake up is going to be crazy once the comp is over

User avatar
GIrum
Adama Science and Technology University

it is just Good cross validation method solves a lil bit of this problem. for me my CV is 0.82 and LB is 0.72, it correlates well i guess

5 Jan 2025, 13:47
Upvotes 0