How does the evaluation happen on the private leader board? My position went from 133 to 199 which is drastic, the score also changed. Understanding this will help me improve my future performance.
The private Leaderboard reflects your model evaluation over the whole test set. So, I'll say that your model has been overffitting the public Leaderboard (which is half of the test set).
For upcoming competitions, trust more your CV than your LB score.
Thank you all for the advise. I'm very new to data science and I had not applied cross validation, I' had only focused on getting better scores on the public leaderboard.
Yes, also focus on cross validation in other projects outside competitions as well. Building a robust model not overfitted to any one set but can generalize to new data is the main target.
'/%3e%3c/defs%3e%3cpath fill='%23fff' d='M-120-80h240V80h-240z'/%3e%3cpath d='M-120-80h240v48h-240z'/%3e%3cpath fill='%23060' d='M-120 32h240v48h-240z'/%3e%3cg id='b'%3e%3cuse xlink:href='%23a' stroke='%23000'/%3e%3cuse xlink:href='%23a' fill='%23fff'/%3e%3c/g%3e%3cuse xlink:href='%23b' transform='scale(-1 1)'/%3e%3cpath fill='%23b00' d='M-120-24v48h101c3 8 13 24 19 24s16-16 19-24h101v-48H19C16-32 6-48 0-48s-16 16-19 24z'/%3e%3cpath id='c' d='M19 24c3-8 5-16 5-24s-2-16-5-24c-3 8-5 16-5 24s2 16 5 24'/%3e%3cuse xlink:href='%23c' transform='scale(-1 1)'/%3e%3cg fill='%23fff'%3e%3cellipse rx='4' ry='6'/%3e%3cpath id='d' d='M1 5.85s4 8 4 21-4 21-4 21z'/%3e%3cuse xlink:href='%23d' transform='scale(-1)'/%3e%3cuse xlink:href='%23d' transform='scale(-1 1)'/%3e%3cuse xlink:href='%23d' transform='scale(1 -1)'/%3e%3c/g%3e%3c/svg%3e)
Was your local CV going higher & what cross validation system did you apply?
The private Leaderboard reflects your model evaluation over the whole test set. So, I'll say that your model has been overffitting the public Leaderboard (which is half of the test set).
For upcoming competitions, trust more your CV than your LB score.
Thank you all for the advise. I'm very new to data science and I had not applied cross validation, I' had only focused on getting better scores on the public leaderboard.
Yes, also focus on cross validation in other projects outside competitions as well. Building a robust model not overfitted to any one set but can generalize to new data is the main target.