As much as ensembling helps, it really does not push someone to be creative in their FE process. If you spent time in Feature Engineering in this competition plus a GOOD CROSS VALIDATION SCHEME well you could have easily had a good model that ends up in the top positions. So to anyone reading this, ensembling works yes but try to push yourself to the limits in your FE process and you will see the magic. Good features that i got were,
Package_all, combine all packages into one feature
Tour_arrangement plus all the other categorical features and more
Funny thing one single model would have been on the 2nd place yes 2nd place. Too bad i never chose that due to the no correlation with the public lb but yes it can be done. Hope this helps
It would really helpful if you could share your notebook , this way we get to learn the feature engineering techniques you have used
I will after zindi has approved the solution
Thanks
Congratulations Koleshjr for the great work. I'm eagely waiting to see how you extracted the most relevant features for improved accuracy.
Thank you :)