SVM,KNN,RandomForest, Grid Search Takes too much time on Colab, any help
Help · 14 Sep 2020, 14:48 · 14

i have been trying to tune the parameters for svc, knn and random forest on google colab, it like am just wasting my time

Discussion 14 answers

Change the knn to Decision Tree. KNN takes longer period to train on such dataset.

14 Sep 2020, 14:50
Upvotes 0
User avatar
MICADEE
LAHASCOM

Did you on your GPU on colab? And forget about knn bcos it will take a while day to run.

14 Sep 2020, 14:54
Upvotes 0

yes GPU enabled on colab, can you suggest some models for me

User avatar
MICADEE
LAHASCOM

Use Lightgbm..... It's more faster.

User avatar
Ladoke akintola university of technology

Use the boosting family .. catboost,lightgbm or xgboost

yeah, i have tried that, it worked well, i want to improve the score, any tip

Try ensemble techniques, crossvalidation techniques, stacking etc.

focus on models from different families of algorithm to build the ensembles. add a little bit randomness to the models and use a mode or mean probability score

User avatar
Ladoke akintola university of technology

You don't need stacking, ensembling yet ,just focus on features engineering, feature selecting.. after all those you will see great change when you use stacking and the likes

Thanks, i will try that out

Alright, Thanks i will try it out

use random search to get good parameters. then, fine tune the values using a smaller set of values . Alternatively, you can use bayesian search, its very fast and accurate!

14 Sep 2020, 15:25
Upvotes 0