Smart Energy Supply Scheduling for Green Telecom Challenge by ITU
18 000 CHF
Completed (over 1 year ago)
Prediction
833 joined
158 active
Start
Aug 06, 24
Close
Sep 30, 24
Reveal
Oct 03, 24
feasibility of solution on private LB
Help · 3 Sep 2024, 01:05 · 3
When we submit a solution we get feedback if it's feasible or not.
Is this only for the data on the public LB or also for the data on the private LB?
I'm a bit concerned that some unpredictable bad weather day on the private LB may ruin all submissions.
Yes we need to know. And especially we don't know how private / public LB split is performed. Because it seems that the public leaderboard is built on 4 first days (because on the 0.57 ratio between local CV and LB score and 4/7 = 0.57). If this is the case the LB is then misleading since the SOC constraint can be broken on he last 3 days. @Zindi @meganomaly
I took a submission that was previously accepted and disabled all power sources for the last two days. This modified submission also got accepted with the same score. I conclude that no checking for feasibility on the private LB is reported.
Obviously it would be better to know if a submission is feasible. On the other hand if we got this feedback it would lead to candidates probing the private LB. I.e. you would submit riskier and riskier strategies and basically learn what is the lowest power you can still use to pass.
Thanks @tfriedel. Though it is risky for us, it is in the spirit of the competition because, in real time we won't know beforehand what will transpire afterwards. Again if the actual LB takes into account all the 7 days, It could have been easier to overfit as well.