Hello !
I started using PyTorch to take part in more data science competitions and I was able to gather some tricks to make it run faster. I thought it may be of interest here : https://www.thekerneltrip.com/deep-learning/optimize-pytorch-code/ (depending on the approaches you chose, but most of the tricks will apply here)
Have a nice read :)