@zindi team - can you please look into the submission error issue? (URGENT)
Platform ·13 May 2023, 08:31·12
No one is able to submit solutions in the past 2 days. Even the submission files that were accepted before are not being accepted now. This is resulting in a loss of competition time.
Hi @Krishna_Priya, we've been working to resolve this and you should be able to make submissions now. Please let us know if you're still facing any issue.
Upon checking now, if I submit a new solution or a previously accepted submission, both of them result in:
Missing entries for IDs ID_86ad3ef21e469217f28a749c990c81fd, ID_5409734bcc4a0f053e73f405d0f135da, ID_b10dc4e959b6596d31866e5094ef500a, ID_da2de9aa4bc9ce53ad11a7d72648c03d, and ID_2d17ccb05b51361cc5390e4ef9551519
but the problem is that these IDs are neither in train, dev, and test.
the ids in train dev and test look like this with a "-" in the names: ID_92d2b94e-3e31-40be-b479-50062e90d1e4
Missing entries for IDs ID_65464009-0d02-4060-97e6-bf99264ccc38, ID_f221bcc4-e2fe-4ffd-93ae-4da3d3c7026a, ID_36b49ec8-1a0f-4936-b284-40bdd9b52695, ID_31ee6185-f757-4936-80df-2132dc319a13, and ID_835ba985-928b-4f2a-a314-5e443ffdb0a1
the ID pattern is correct now, but these IDs are not a part of train, test or dev. Neither are these ID part of previously accepted solutions. thus resubmitting the previously accepted solutions also give the same error.
Even after appending these 5 IDs manually to the submission csv , some other random IDs appear as missing. It seems that IDs expected in the submission file and the ID (total count: 8291) in the train, dev and test are not the same.
Upon further inspection, I found that test metadata has been updated in the data section, and that is why the IDs are missing in the previous submissions. I am able to submit with the new test metadata IDs.
Even when I download the new data (SampleSubmission_1.csv, dev_metadata.csv and test_metadata.csv) the identifiers of SampleSubmission_1.csv are neither in dev_metadata.cs nor in test_metadata.csv
I appended the dev_metadata.csv to test_metadata.csv to create a new submission file and used it for submission. the IDs in sample submission might not be correct.
Hi @Krishna_Priya, we've been working to resolve this and you should be able to make submissions now. Please let us know if you're still facing any issue.
Hi @Nelly43,
Upon checking now, if I submit a new solution or a previously accepted submission, both of them result in:
Missing entries for IDs ID_86ad3ef21e469217f28a749c990c81fd, ID_5409734bcc4a0f053e73f405d0f135da, ID_b10dc4e959b6596d31866e5094ef500a, ID_da2de9aa4bc9ce53ad11a7d72648c03d, and ID_2d17ccb05b51361cc5390e4ef9551519
but the problem is that these IDs are neither in train, dev, and test.
the ids in train dev and test look like this with a "-" in the names: ID_92d2b94e-3e31-40be-b479-50062e90d1e4
and above missing IDs are something else.
Please give it a try now
Now, it shows
Missing entries for IDs ID_65464009-0d02-4060-97e6-bf99264ccc38, ID_f221bcc4-e2fe-4ffd-93ae-4da3d3c7026a, ID_36b49ec8-1a0f-4936-b284-40bdd9b52695, ID_31ee6185-f757-4936-80df-2132dc319a13, and ID_835ba985-928b-4f2a-a314-5e443ffdb0a1
the ID pattern is correct now, but these IDs are not a part of train, test or dev. Neither are these ID part of previously accepted solutions. thus resubmitting the previously accepted solutions also give the same error.
Even after appending these 5 IDs manually to the submission csv , some other random IDs appear as missing. It seems that IDs expected in the submission file and the ID (total count: 8291) in the train, dev and test are not the same.
Hi @Nelly43,
Upon further inspection, I found that test metadata has been updated in the data section, and that is why the IDs are missing in the previous submissions. I am able to submit with the new test metadata IDs.
Thank you
Hi @Krishna_Priya,
I wasn't around for a while, so did they upload the test audios as well or not yet?
@siwar_NASRI, no the test audios have not been uploaded yet. I think it will be uploaded according to the schedule.
Hi @Krishna_Priya and @siwar_NASRI
Even when I download the new data (SampleSubmission_1.csv, dev_metadata.csv and test_metadata.csv) the identifiers of SampleSubmission_1.csv are neither in dev_metadata.cs nor in test_metadata.csv
I don't know why
@Krishna_Priya Can you explain in more detail how you solved the problem?
hi @Monsia,
I appended the dev_metadata.csv to test_metadata.csv to create a new submission file and used it for submission. the IDs in sample submission might not be correct.
Thanks!