Primary competition visual

Lacuna Solar Survey Challenge

Helping Madagascar
$5 000 USD
Completed (12 months ago)
Computer Vision
Prediction
729 joined
247 active
Starti
Feb 14, 25
Closei
Mar 23, 25
Reveali
Mar 24, 25
True evaluation metric for Lacuna Solar Survey Challenge ?
Platform · 15 Mar 2025, 00:07 · 5

Dear @AJoel , could you please confirm that the evaluation script for this challenge is indeed using MAE .

I have just made some experiment on my best submission which makes me believe that the metric used for this challenge is RMSE .

Looking forward to hearing your answer on this .

@zindi

Discussion 5 answers
User avatar
nymfree

interesting

15 Mar 2025, 06:59
Upvotes 0
User avatar
Muhamed_Tuo
Inveniam

Hey @PUBG, do you mind elaborating on the experiment you did to come to this conclusion ?

15 Mar 2025, 13:53
Upvotes 0

I have clipped my target values to 100 and this has significantly increases my LB score by 0.6 ~ .

User avatar
AJoel
Zindi

Hi @PUBG

The evaluation metric for the Lacuna Solar Challenge is MAE.

17 Mar 2025, 08:31
Upvotes 1