Indaba Grand Challenge: Curing Leishmaniasis by Deep Learning Indaba
Helping Africa
3000 Zindi Points
Completed (~5 years ago)
Reinforcement Learning
341 joined
24 active
Start
Jun 29, 20
Close
May 31, 21
Reveal
May 31, 21
reproducibility of the code
Help · 1 Mar 2021, 06:49 · 5
Hi everyone,
In the evaluation criteria, it was said the code should reproduce the same score as the evaluation process. It was said also that the evaluation workflow uses a different protocol from the starter Notebook. How can we then reproduce the same results if the evaluation code is not available. Also, what if I didn't use Pyrosetta for the docking? I have found the documentation very difficult to follow.
Hi hothman,
good for pointing this out. In the intro video on youtube, marcin explained, that the scoring/evaluation function addapts dynamically to the already submitted solutions. They will learn more and more about compounds that work and compounds that fail and will emigrate that into the evaluation score, as far as I understood.
Greetings Philipp
Thank you, Philipp
it's not however clear what must we reproduce exactly: the process that leads to identifying the submitted lead or the score returned by the evaluation process.
Regards
Houcem
Hi hothman,
you are welcome.
Yes, you are right. To me this issue should be clarified by the competition owner. Because there is a mismatch between the zindi statuts and the indaba grand challenge description of the contest. There is a lot of variety between the solutions/scores and often a already submitted solution scores different in a certain range.
However, the ultimate goal is to come up with a new(existing) molecules to help curing leishmaniasis. So maybe even if there is a high probability to violate the rules of zindi, in terms of reproducibility, we should continue delivering our solutions.
Greetings Philipp
Thanks, Philipp,
That's really a nice way to put it. It's a great reminder of why we are doing this :)
Houcem
Hi Houcem,
thank you for your kind words. I really appreciate them.
Greetings Philipp