EarthNet2021 Challenge - Leaderboard
Main (IID)
Rank | Model Name | Group Name | MAD | OLS | EMD | SSIM | EarthNetScore |
---|---|---|---|---|---|---|---|
1 | Earthformer | Earthformer-Team | 0.2749 | 0.3619 | 0.2701 | 0.6350 | 0.3425 |
2 | Diaconu ConvLSTM | TUM | 0.2638 | 0.3513 | 0.2623 | 0.5565 | 0.3266 |
3 | SGConvLSTM | ETH Zurich | 0.2589 | 0.3456 | 0.2533 | 0.5292 | 0.3176 |
4 | SGEDConvLSTM | ETH Zurich | 0.2580 | 0.3440 | 0.2532 | 0.5237 | 0.3164 |
5 | Channel-U-Net Baseline | EN-Team | 0.2482 | 0.3381 | 0.2336 | 0.3973 | 0.2902 |
6 | Arcon Baseline | EN-Team | 0.2414 | 0.3216 | 0.2258 | 0.3863 | 0.2803 |
7 | Persistence Baseline | EN-Team | 0.2315 | 0.3239 | 0.2099 | 0.3265 | 0.2625 |
8 | |||||||
9 |
Robustness (OOD)
Rank | Model Name | Group Name | MAD | OLS | EMD | SSIM | EarthNetScore |
---|---|---|---|---|---|---|---|
1 | Earthformer | Earthformer-Team | 0.2533 | 0.3581 | 0.2732 | 0.5270 | 0.3252 |
2 | Diaconu ConvLSTM | TUM | 0.2541 | 0.3522 | 0.2660 | 0.5125 | 0.3204 |
3 | SGConvLSTM | ETH Zurich | 0.2512 | 0.3481 | 0.2597 | 0.4977 | 0.3146 |
4 | SGEDConvLSTM | ETH Zurich | 0.2497 | 0.3450 | 0.2587 | 0.4887 | 0.3121 |
5 | Channel-U-Net Baseline | EN-Team | 0.2402 | 0.3390 | 0.2371 | 0.3721 | 0.2854 |
6 | Arcon Baseline | EN-Team | 0.2314 | 0.3088 | 0.2177 | 0.3432 | 0.2655 |
7 | Persistence Baseline | EN-Team | 0.2248 | 0.3236 | 0.2123 | 0.3112 | 0.2587 |
8 | |||||||
9 |
Extreme Summer
Rank | Model Name | Group Name | MAD | OLS | EMD | SSIM | EarthNetScore |
---|---|---|---|---|---|---|---|
1 | SGConvLSTM | ETH Zurich | 0.2366 | 0.3199 | 0.2279 | 0.3497 | 0.2740 |
2 | SGEDConvLSTM | ETH Zurich | 0.2304 | 0.3164 | 0.2186 | 0.2993 | 0.2595 |
3 | Channel-U-Net Baseline | EN-Team | 0.2286 | 0.2973 | 0.2065 | 0.2306 | 0.2364 |
4 | Arcon Baseline | EN-Team | 0.2243 | 0.2753 | 0.1975 | 0.2084 | 0.2215 |
5 | Diaconu ConvLSTM | TUM | 0.2137 | 0.2906 | 0.1879 | 0.1904 | 0.2140 |
6 | Persistence Baseline | EN-Team | 0.2158 | 0.2806 | 0.1614 | 0.1605 | 0.1939 |
7 | |||||||
8 | |||||||
9 |
Seasonal Cycle
Rank | Model Name | Group Name | MAD | OLS | EMD | SSIM | EarthNetScore |
---|---|---|---|---|---|---|---|
1 | Persistence Baseline | EN-Team | 0.2329 | 0.3848 | 0.2034 | 0.3184 | 0.2676 |
2 | Diaconu ConvLSTM | TUM | 0.2146 | 0.3778 | 0.2003 | 0.1685 | 0.2193 |
3 | SGConvLSTM | ETH Zurich | 0.2207 | 0.3756 | 0.1723 | 0.1817 | 0.2162 |
4 | Channel-U-Net Baseline | EN-Team | 0.2169 | 0.3811 | 0.1903 | 0.1255 | 0.1955 |
5 | SGEDConvLSTM | ETH Zurich | 0.2056 | 0.3585 | 0.1543 | 0.1218 | 0.1790 |
6 | Arcon Baseline | EN-Team | 0.2014 | 0.3788 | 0.1787 | 0.0834 | 0.1587 |
7 | |||||||
8 | |||||||
9 |