I've seen that we may select our top 2 submissions for scoring on the private leaderboard. If a team is participating in both tracks (Phi-2 and Falcon), does this mean that we should select the top submission for each track?
What is possible to do is to select your 2 best Falcon OR 2 best Phi-2 models and if those are selected in the top 10 then you can send in your other model too.
For example. Select your 2 best Falcon models, if you are in the top 10 and need to submit your code, then submit your Falcon code and your Phi-2 code with the associated scores.
The review team will take your Falcon and Phi-2 solutions into account.
Amy, the performance between the two models (Falcon and best Phi-2) may not be easy to compare. It would be better if the can open another profile to submit both Falcon and Phi-2.
zeroppl is this is not possible, please include the results for both the model in your paper. We will take this into account
'/%3e%3c/defs%3e%3cpath fill='%23fff' d='M-120-80h240V80h-240z'/%3e%3cpath d='M-120-80h240v48h-240z'/%3e%3cpath fill='%23060' d='M-120 32h240v48h-240z'/%3e%3cg id='b'%3e%3cuse xlink:href='%23a' stroke='%23000'/%3e%3cuse xlink:href='%23a' fill='%23fff'/%3e%3c/g%3e%3cuse xlink:href='%23b' transform='scale(-1 1)'/%3e%3cpath fill='%23b00' d='M-120-24v48h101c3 8 13 24 19 24s16-16 19-24h101v-48H19C16-32 6-48 0-48s-16 16-19 24z'/%3e%3cpath id='c' d='M19 24c3-8 5-16 5-24s-2-16-5-24c-3 8-5 16-5 24s2 16 5 24'/%3e%3cuse xlink:href='%23c' transform='scale(-1 1)'/%3e%3cg fill='%23fff'%3e%3cellipse rx='4' ry='6'/%3e%3cpath id='d' d='M1 5.85s4 8 4 21-4 21-4 21z'/%3e%3cuse xlink:href='%23d' transform='scale(-1)'/%3e%3cuse xlink:href='%23d' transform='scale(-1 1)'/%3e%3cuse xlink:href='%23d' transform='scale(1 -1)'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Hi, Amy? Can we do 4 submissions in this case? Or they should create another account? Thanks
After discussing with Zindi, I would like to ask you to create 2 profiles. One for each model.
The system is set to 2 submission selections.
What is possible to do is to select your 2 best Falcon OR 2 best Phi-2 models and if those are selected in the top 10 then you can send in your other model too.
For example. Select your 2 best Falcon models, if you are in the top 10 and need to submit your code, then submit your Falcon code and your Phi-2 code with the associated scores.
The review team will take your Falcon and Phi-2 solutions into account.
Amy, the performance between the two models (Falcon and best Phi-2) may not be easy to compare. It would be better if the can open another profile to submit both Falcon and Phi-2. zeroppl is this is not possible, please include the results for both the model in your paper. We will take this into account