How does the evaluation happen on the private leader board? My position went from 133 to 199 which is drastic, the score also changed. Understanding this will help me improve my future performance.
Was your local CV going higher & what cross validation system did you apply?
The private Leaderboard reflects your model evaluation over the whole test set. So, I'll say that your model has been overffitting the public Leaderboard (which is half of the test set).
For upcoming competitions, trust more your CV than your LB score.
Thank you all for the advise. I'm very new to data science and I had not applied cross validation, I' had only focused on getting better scores on the public leaderboard.
Yes, also focus on cross validation in other projects outside competitions as well. Building a robust model not overfitted to any one set but can generalize to new data is the main target.