Primary competition visual

Expresso Churn Prediction Challenge

Helping Senegal
$1 000 USD
Completed (over 4 years ago)
Classification
Prediction
1378 joined
437 active
Starti
Aug 27, 21
Closei
Nov 28, 21
Reveali
Nov 28, 21
User avatar
University of lagos
0.0+ score on leaderboard
Help · 19 Oct 2021, 19:25 · 9

My first and second submissions gave a roc_auc of 0.0+ score on leaderboard using lgbm

But while training and cross validation on Google Colab I recorded a training roc_auc socre of 0.9+ and CV roc_score score of 0.9+

Can someone please help me out?

Discussion 9 answers
User avatar
Aaron_Simumba
Entrepreneurs financial centre

Make sure your submission file contains probabilities between 0 and 1 inclusive.

19 Oct 2021, 19:44
Upvotes 0
User avatar
University of lagos

i made use of predict_proba but still same result on leaderboard

User avatar
Aaron_Simumba
Entrepreneurs financial centre

Are you getting any errors while working or it's simply the score that is not showing properly?

User avatar
University of lagos

It is simply the scores that is not showing up properly

User avatar
flamethrower

Hello, do you run predict_proba[:, 1] or this one [:,0] for your submission?

User avatar
University of lagos

I ran only predict_proba(test)

User avatar
flamethrower

Ok, predict proba gives an array of shape no of rows X 2 columns. The 1st column represents probability of 0, 2nd probability of 1(which in our case is probability of Churn needed for an AUC metric).

Run predict_proba(test)[:, 1] and see if it fixes your situation

User avatar
University of lagos

Thank you so much,

It fixed it

User avatar
flamethrower

Cheers!