Hi Everyone, hi @Krishna_Priya, @Mohammed_NASRI, @seif_aber, @mithilsalunkhe, @Eloff,
Could you please explain how you solved this problem? Does it have anything to do with the torch version?
peft==0.2.0
torch==1.13.1
CUDA 113
--------------------------------------------------------------------------- TypeError Traceback (most recent call last) /tmp/ipykernel_24/2986680819.py in <module> 4 ----> 5 model = WhisperForConditionalGeneration.from_pretrained(model_whisp, load_in_8bit=True,torch_dtype=torch.float16, device_map="auto") 6 7 # model.hf_device_map - this should be {" ": 0} /opt/conda/lib/python3.7/site-packages/transformers/modeling_utils.py in from_pretrained(cls, pretrained_model_name_or_path, *model_args, **kwargs) 2697 # Dispatch model with hooks on all devices if necessary 2698 if device_map is not None: -> 2699 dispatch_model(model, device_map=device_map, offload_dir=offload_folder, offload_index=offload_index) 2700 2701 if output_loading_info: TypeError: dispatch_model() got an unexpected keyword argument 'offload_index'