💊 Hot Topic: Validation MASE Score ?

USAID's Intelligent Forecasting Challenge: Model Future Contraceptive Use

Helping Côte d'Ivoire

$25 000 USD

Completed (over 5 years ago)

Skills you will learn

Prediction

516 joined

120 active

Info Data Chat Leaderboard

Start

Jul 27, 20

Aug 30, 20

Reveal

Aug 30, 20

asingleneuron

Validation MASE Score ?

Help · 2 Sep 2020, 14:06 · 6

Hi All,

Really impressed after seeing the low RMSE score by the top teams on the leaderboard. I am very much curious to know the MASE Score of the validation period? If it is possible for you to share please do that.

Thanks

Discussion 6 answers

nooby

2 Sep 2020, 14:11 (edited 2 minutes later)

Upvotes 0

nooby

0.88 (denominator using all train), 1.01 (denominator using train remove last three data), how about you?

2 Sep 2020, 14:16 (edited 1 minute later)

Upvotes 0

asingleneuron

Mine 1.13 (denominator using train remove last three data). I can relate bcz your's model RMSE is lower compare to mine. Thank you @nooby for sharing. Good luck for the competition.

replied to nooby2 Sep 2020, 14:52

Upvotes 0

adilism

Is this the score after dropping all-zero series?

replied to nooby2 Sep 2020, 21:32

Upvotes 0

nooby

No, all zero series are still there.

If the denominator of MASE is zero, the MASE will be zero. I refer to the FAQ on the main competition site.

replied to adilism3 Sep 2020, 04:24

Upvotes 0

adilism