My assumption is that the order of the rows don't matter. However, I noticed that I get 2 completely differnet scores when the rows are sorted differently with the same generated submission file .
Anyone experiencing same or can @Zindi clarify if row arrangement matters by checking the arrangement in the scoring file. Happy to get your feedback.
perhaps the date is not checked?
Maybe. I guess Zindi needs to review and revert
This competition uses an external metric we set up outside the normal Zindi metric system, and it looks like the scoring function assumes the dataframe is ordered by date as in the submission file. Normally we can ignore row order because we're matching rows on an ID, here the idea is to look for the last specified location before a crash happens. I'll double-check and then get the team to put out a notice. My suggestion for now is to follow the ordering from the sample submission.
Thanks for the response. This will help me make progress with the development.