These competition i have come to realise much later that count encoding of the categorical columns led to a very improved score if you had not done it, try and see the improvement