Does anyone knows why under the same circumstances ,FastAI is better than pure pytorch ?!!
fastai does all the tricks required to make training of image type problems fast as well as some other tricks to improve performance.
you can implement the same tricks in your pytorch pipeline and it will be just as fast/good as fastai is built on top of pytorch.
i already do one cyclic schedular and the same transforms but still fastai much better in loss results
do you recommend other tricks?
I noticed also that besides the one cycle schedular, fastai also uses other tricks such as discriminative learning rates. This is very obvious when using the fine_tune method. Perhpas that contributes to fastai getting better results.
This is also my observation.
Yes. You should.
fastai does all the tricks required to make training of image type problems fast as well as some other tricks to improve performance.
you can implement the same tricks in your pytorch pipeline and it will be just as fast/good as fastai is built on top of pytorch.
i already do one cyclic schedular and the same transforms but still fastai much better in loss results
do you recommend other tricks?
I noticed also that besides the one cycle schedular, fastai also uses other tricks such as discriminative learning rates. This is very obvious when using the fine_tune method. Perhpas that contributes to fastai getting better results.
This is also my observation.
Yes. You should.
Yes. You should.