please after performing this concatenation i encountered Null values in my target column. how do I handle this?
Bear with me, but I don't think you are meant to concatenate the datasets.
You can work with the train and test dataset separately but I want to perform Feature Eng on the dataset together, reasons why I concatenated.
Try using df = pd.concat([train, test]).reset_index(drop = True)
Yeah use this:
train['source']='train'
test['source']='test'
data = pd.concat([train, test],ignore_index=True) print (train.shape, test.shape, data.shape)
Bear with me, but I don't think you are meant to concatenate the datasets.
You can work with the train and test dataset separately but I want to perform Feature Eng on the dataset together, reasons why I concatenated.
Try using df = pd.concat([train, test]).reset_index(drop = True)
Yeah use this:
train['source']='train'
test['source']='test'
data = pd.concat([train, test],ignore_index=True) print (train.shape, test.shape, data.shape)