Mobile Money and Financial Inclusion in Tanzania Challenge
Cash and prizes worth $2,250 USD
Who is most likely to use mobile money? And who is most likely to use other financial services?
26 March–30 June 2019 23:59
462 data scientists enrolled, 163 on the leaderboard
CV vs Leaderboard
published 4 May 2019, 20:43

There is a huge gub between my CV and the leaderboard score , is there any one encountering this problem ?

edited 17 minutes later

Yes, I have the same problem getting 0.75 CV

I tried different approaches in order to reduce this gap but I think the test set is different from the train set

By the way, when I summed the logloss error for the predicted columns independently* my CV score was similar to the LB score. I am not sure if it's a coincidence or may be Zindi is miscalculating the error.

*sum(logloss(predicted_probability_class_i, 1 if class_i else0 ))

replying to rinnqd
edited less than a minute later

I tested the same idea and i get the same score like the lb

How to check the CV

Hi everyone. Thank you for flagging this potential issue. We are looking into it now. We will keep you updated.

No traction on this yet, I hope this issue is sorted out early enough.

Morning everyone, thank you for your patience. We have identified the issue and it should be resolved in a week.

is this solved ? looks like no