Primary competition visual

Lacuna Solar Survey Challenge

Helping Madagascar
$5 000 USD
Completed (~1 year ago)
Computer Vision
Prediction
730 joined
247 active
Starti
Feb 14, 25
Closei
Mar 23, 25
Reveali
Mar 24, 25
True evaluation metric for Lacuna Solar Survey Challenge ?
Platform · 15 Mar 2025, 00:07 · 5

Dear @AJoel , could you please confirm that the evaluation script for this challenge is indeed using MAE .

I have just made some experiment on my best submission which makes me believe that the metric used for this challenge is RMSE .

Looking forward to hearing your answer on this .

@zindi

Discussion 5 answers
User avatar
nymfree

interesting

15 Mar 2025, 06:59
Upvotes 0
User avatar
Muhamed_Tuo
Inveniam

Hey @PUBG, do you mind elaborating on the experiment you did to come to this conclusion ?

15 Mar 2025, 13:53
Upvotes 0

I have clipped my target values to 100 and this has significantly increases my LB score by 0.6 ~ .

User avatar
AJoel
Zindi

Hi @PUBG

The evaluation metric for the Lacuna Solar Challenge is MAE.

17 Mar 2025, 08:31
Upvotes 1