Well as you can see, if you try to do any form of inferencing, it brings out this error. After a day of debugging and tears😭, I realized the bug is from unsloth. I think it is about time we changed the pipeline (One reason I don't like dealing with LLM fine-tuning😔).
Please if you know a way around it, it will really help!
I am getting the same error. Don't really know what changed. Would doing installs from a requirements.txt work?
Rather than doing installs with the default code?
I tried using a previous version (the one I used before). It still gave that error.
Gettting the exact same error. I tried installing previous three versions, but no luck.
Yes, I have sent the complaint to unsloth. Let's wait for their reply. But in the meantime, we have to change the pipeline
Bug should now be fixed.
Thank God! 🔥🔥
Hello Joseph! Do you mean it should be fixed without any edits? because I am having the same bug
Just Cross check with official unsloth colab notebook, just a minor change.