import pandas as pd df = pd.read_csv("submission_9.csv") df2 = pd.read_csv("ref_south_africa_crops_competition_v1_test_labels/_common/sample_submission.csv") df.index = df["Field ID"] df2.index = df2["Field ID"] print(df.head()) df.columns = [i for i in range(len(df.columns))] df = df[[0, 8, 3, 1, 2, 9, 6, 5, 7, 4]] print(df.index, df2.index) print(df.index.shape, df2.index.shape) print(set(df.index) - set(df2.index)) df = df.reindex(df2.index) df = df.iloc[:, 1:] df.to_csv("sample_reorganised_9.csv", index=True)

I fix this error like this. You need to reindex your df to be in the same order as their sample submission. In this example my columns start with field_id and then are in the original label order