I would like to propose some changes for new competitions.
- Automl: I don't see any reasons why we should not use it. Para turning is a part of the DS journey. Reproducibility is already in the requirements. In case of hardware limitation, we could also restrict the training time.
- Probablity thresholds: it is very weird to that thresholds are not allowed. I understand that you don't want participants overfit the LB then just allow 2 lower-and-upper thresholds.
- Submissions limitation: Very surprised that in one competition we could submit 100 (or 50) times per day. It should be max 10.
Disclaimer: Our team read the rule carefully and did not use automl and did not put any thresholds.