Hi all. I have been having this error. kindly help out.
CUDA out of memory. Tried to allocate 150.00 MiB (GPU 0; 14.76 GiB total capacity; 13.52 GiB already allocated; 149.75 MiB free; 13.58 GiB reserved in total by PyTorch)
It seems that your GPU memory is already containing an old model. You are probably running 2 notebook in parallel, so you have to close all the notebooks before loading this model.
It is also possible that you have loaded 2 big models in the same notebook which the the GPU memory can't handle. Try to restart your notebook in this case and run your model again.
It seems that your GPU memory is already containing an old model. You are probably running 2 notebook in parallel, so you have to close all the notebooks before loading this model.
It is also possible that you have loaded 2 big models in the same notebook which the the GPU memory can't handle. Try to restart your notebook in this case and run your model again.
If neither of these 2 scenarios is correct, you might need to reduce your sequence length/batch size or use a smaller model.