Primary competition visual

Uber Nairobi Ambulance Perambulation Challenge

Helping Kenya
$6 000 USD
Completed (~5 years ago)
Prediction
1091 joined
330 active
Starti
Sep 17, 20
Closei
Jan 24, 21
Reveali
Jan 24, 21
Is there a bug in the scoring of the submission file?
Notebooks · 28 Dec 2020, 18:24 · 5

My assumption is that the order of the rows don't matter. However, I noticed that I get 2 completely differnet scores when the rows are sorted differently with the same generated submission file .

Anyone experiencing same or can @Zindi clarify if row arrangement matters by checking the arrangement in the scoring file. Happy to get your feedback.

Discussion 5 answers

perhaps the date is not checked?

30 Dec 2020, 12:33
Upvotes 0

Maybe. I guess Zindi needs to review and revert

Hello @Zindi.... Still expecting a response

10 Jan 2021, 09:44
Upvotes 0

This competition uses an external metric we set up outside the normal Zindi metric system, and it looks like the scoring function assumes the dataframe is ordered by date as in the submission file. Normally we can ignore row order because we're matching rows on an ID, here the idea is to look for the last specified location before a crash happens. I'll double-check and then get the team to put out a notice. My suggestion for now is to follow the ordering from the sample submission.

12 Jan 2021, 09:56
Upvotes 0

Thanks for the response. This will help me make progress with the development.