Primary competition visual

INEGI UN-GGIM Human Settlement Detection Challenge by ITU

Helping Mexico
1 000 CHF
Completed (over 1 year ago)
Classification
208 joined
84 active
Starti
Sep 02, 24
Closei
Sep 28, 24
Reveali
Oct 10, 24
Top-scoring approach for detecting human settlements using S5 model and spectral indices
Connect Ā· 15 Nov 2024, 18:28 Ā· 2

Thanks to the organizers. I have endless hours of fun understanding this problem. I am glad to share my approach.

**Detecting Human Settlements**

The competition details can be reviewed here: [INEGI-GCIM Human Settlement Detection Challenge](https://zindi.africa/competitions/inegi-gcim-human-settlement-detection-challenge).

Using the code provided in my GitHub repository (https://github.com/joaquinsalas/zindi), I achieved the following scores:

- **Public leaderboard**: 0.8628

- **Private leaderboard**: 0.8662

These scores compare well with the top of the leaderboard.

---

**Approach**

The solution implements the **Simplified Structured State Space Sequencing (S5)** model, as described by [Smith et al.](https://arxiv.org/abs/2208.04933). The S5 model extends the Structured State Space (S4) ideas of [Gu et al.](https://arxiv.org/abs/2111.00396), which use multi-input, multi-output state space models. S4 itself expands on linear time-invariant dynamical systems (LTI), governed by equations like:

\[

\dot{x}(t) = A x(t) + B u(t), \quad y(t) = C x(t) + D u(t)

\]

Gu et al. condition \(A\) with a low-rank correction, allowing diagonalization, and both papers provide source code.

Additionally, my solution improved based on a suggestion by [Koleshjr](https://zindi.africa/competitions/inegi-gcim-human-settlement-detection-challenge/discussions/23313), who recommended incorporating spectral indices into the model.

---

**Key Insights**

- Use the **S5** model for structured state space learning.

- Balance classes by undersampling the majority class.

- Include spectral indices alongside the image spectral bands for better feature representation.

---

**Instructions**

To replicate my results:

1. Install the S5 model provided by i404788 on GitHub: [S5 PyTorch](https://github.com/i404788/s5-pytorch).

2. The repository includes:

- Code for training the model: `settlements_s5_c17c.py`

- Code for preparing a submission to Zindi: `settlements_s5_c17_zindi.py`

- The best model weights (too large for GitHub; feel free to ask, and I’ll be happy to share).

- The best submission file: `best_s5_model_submission.csv`.

Feel free to ask questions or share feedback. Happy modeling!

Discussion 2 answers
User avatar
nymfree

amazing. been trying to apply structured state spaces to some problems. will study your code. thanks for

15 Nov 2024, 18:31
Upvotes 0
User avatar
Lone_Wolf
University of ghana

Congratulations

15 Nov 2024, 18:55
Upvotes 0