Primary competition visual

Intron AfriSpeech-200 Automatic Speech Recognition Challenge

$5 000 USD
Challenge completed over 2 years ago
Automatic Speech Recognition
430 joined
41 active
Starti
Feb 17, 23
Closei
May 28, 23
Reveali
May 28, 23
User avatar
Krishna_Priya
@zindi team - can you please look into the submission error issue? (URGENT)
Platform · 13 May 2023, 08:31 · 12

No one is able to submit solutions in the past 2 days. Even the submission files that were accepted before are not being accepted now. This is resulting in a loss of competition time.

Discussion 12 answers
User avatar
Nelly43
Zindi

Hi @Krishna_Priya, we've been working to resolve this and you should be able to make submissions now. Please let us know if you're still facing any issue.

13 May 2023, 11:41
Upvotes 0
User avatar
Krishna_Priya

Hi @Nelly43,

Upon checking now, if I submit a new solution or a previously accepted submission, both of them result in:

Missing entries for IDs ID_86ad3ef21e469217f28a749c990c81fd, ID_5409734bcc4a0f053e73f405d0f135da, ID_b10dc4e959b6596d31866e5094ef500a, ID_da2de9aa4bc9ce53ad11a7d72648c03d, and ID_2d17ccb05b51361cc5390e4ef9551519

but the problem is that these IDs are neither in train, dev, and test.

the ids in train dev and test look like this with a "-" in the names: ID_92d2b94e-3e31-40be-b479-50062e90d1e4

and above missing IDs are something else.

User avatar
Nelly43
Zindi

Please give it a try now

User avatar
Krishna_Priya

Now, it shows

Missing entries for IDs ID_65464009-0d02-4060-97e6-bf99264ccc38, ID_f221bcc4-e2fe-4ffd-93ae-4da3d3c7026a, ID_36b49ec8-1a0f-4936-b284-40bdd9b52695, ID_31ee6185-f757-4936-80df-2132dc319a13, and ID_835ba985-928b-4f2a-a314-5e443ffdb0a1

the ID pattern is correct now, but these IDs are not a part of train, test or dev. Neither are these ID part of previously accepted solutions. thus resubmitting the previously accepted solutions also give the same error.

User avatar
Krishna_Priya

Even after appending these 5 IDs manually to the submission csv , some other random IDs appear as missing. It seems that IDs expected in the submission file and the ID (total count: 8291) in the train, dev and test are not the same.

User avatar
Krishna_Priya

Hi @Nelly43,

Upon further inspection, I found that test metadata has been updated in the data section, and that is why the IDs are missing in the previous submissions. I am able to submit with the new test metadata IDs.

Thank you

User avatar
Siwar_NASRI

Hi @Krishna_Priya,

I wasn't around for a while, so did they upload the test audios as well or not yet?

User avatar
Krishna_Priya

@siwar_NASRI, no the test audios have not been uploaded yet. I think it will be uploaded according to the schedule.

Hi @Krishna_Priya and @siwar_NASRI

Even when I download the new data (SampleSubmission_1.csv, dev_metadata.csv and test_metadata.csv) the identifiers of SampleSubmission_1.csv are neither in dev_metadata.cs nor in test_metadata.csv

I don't know why

@Krishna_Priya Can you explain in more detail how you solved the problem?

User avatar
Krishna_Priya

hi @Monsia,

I appended the dev_metadata.csv to test_metadata.csv to create a new submission file and used it for submission. the IDs in sample submission might not be correct.