Leaderboard

Method Date Bellingham Bloomington Innsbruck San Francisco East Tyrol Overall
IoU Acc. IoU Acc. IoU Acc. IoU Acc. IoU Acc. IoU Acc.
Inria1 ? 3-Jan-17 52.91 95.14 46.08 94.95 58.12 95.16 57.84 86.05 59.03 96.40 55.82 93.54
Inria2 ? 3-Jan-17 56.11 95.37 50.40 95.27 61.03 95.37 61.38 87.00 62.51 96.61 59.31 93.93
TeraDeep ? 5-May-17 58.08 95.88 53.38 95.61 59.47 95.26 64.34 88.71 62.00 96.57 60.95 94.41
RMIT? 16-July-17 57.30 95.97 51.78 95.60 60.70 95.69 66.71 89.23 59.73 96.59 61.73 94.62
Raisa Energy? 8-Sep-17 64.46 96.04 56.63 95.38 66.99 95.97 67.74 87.48 69.21 96.92 65.94 94.36
DukeAMLL? 6-Nov-17 66.90 96.69 58.48 96.15 69.92 96.37 75.54 91.87 72.34 97.42 70.91 95.70
NUS? 13-Nov-17 65.36 96.34 58.50 95.95 68.45 96.21 71.17 90.08 71.58 97.32 68.36 95.18
Onera 1? 14-Nov-17 63.42 96.11 62.74 96.20 63.77 95.44 66.53 89.18 65.90 96.76 65.04 94.74
Onera 2? 14-Nov-17 68.92 96.94 68.12 97.00 71.87 96.72 71.17 89.74 74.75 97.78 71.02 95.63
NUS? 22-Nov-17 70.74 97.00 66.06 96.74 73.17 96.75 73.57 91.19 76.06 97.81 72.45 95.90
DukeAMLL? 29-Nov-17 67.14 96.64 65.43 96.73 72.27 96.66 75.72 91.80 74.67 97.70 72.55 95.91
Raisa Energy? 30-Nov-17 68.73 96.79 60.83 96.23 70.07 96.31 70.64 89.52 74.76 97.64 69.57 95.30
NUS? 11-Dec-17 66.93 96.54 61.42 96.34 71.06 96.47 74.34 91.47 73.21 97.51 70.99 95.67
NUS? 15-Dec-17 70.73 97.06 64.87 96.69 73.64 96.86 73.04 91.19 76.36 97.88 72.18 95.94
DukeAMLL? 15-Dec-17 68.75 96.89 59.17 96.27 71.82 96.66 69.28 89.90 75.83 97.85 69.15 95.51
Koki Takahashi? 22-Dec-17 69.71 96.89 67.10 96.49 78.41 97.47 79.79 93.29 80.15 98.26 76.42 96.48
Tao Hu? 2-Jan-18 65.92 96.78 62.05 96.54 72.37 96.91 69.78 90.35 70.21 97.46 68.72 95.61
ENPC – Singh? 4-Jan-18 63.34 95.90 63.20 96.16 76.08 97.18 74.91 91.67 77.58 98.01 72.07 95.78
ENPC – Singh2? 4-Jan-18 64.28 96.00 65.84 96.52 77.11 97.31 75.86 92.01 78.68 98.12 73.30 95.99
ENPC – Singh3? 5-Jan-18 63.58 95.91 63.94 96.22 76.28 97.21 75.48 91.83 77.69 98.03 72.50 95.84
Tao Hu2? 21-Jan-18 68.62 96.81 66.06 96.82 76.43 97.24 74.68 91.58 77.92 98.05 73.41 96.10
Ohleyer – ENS? 21-Jan-18 57.72 95.78 57.84 96.06 63.81 95.38 40.00 81.23 67.25 96.92 52.42 93.07
Tao Hu3? 23-Jan-18 70.73 97.10 69.75 97.15 76.58 97.26 76.10 91.80 78.63 98.11 74.95 96.29
Xiang Li? 6-Feb-18 67.08 96.65 61.86 96.37 70.20 96.44 74.90 91.61 71.90 97.47 71.03 95.71
Xiang Li2? 7-Feb-18 67.32 96.67 62.28 96.43 70.51 96.47 74.76 91.57 72.38 97.53 71.16 95.73
Tao Hu4? 8-Feb-18 70.73 97.09 69.98 97.22 76.74 97.29 76.73 92.34 79.09 98.17 75.33 96.42
Kang Zhao? 23-Feb-18 56.11 95.37 50.40 95.27 61.03 95.37 61.38 87.00 62.51 96.62 59.31 93.93
Vladimir Iglovikov? 27-Feb-18 72.24 97.13 72.10 97.28 74.57 96.85 72.40 90.60 78.33 98.01 73.41 95.97
Alexander Buslaev? 4-Mar-18 72.38 97.16 76.89 97.76 76.68 97.21 78.67 92.81 79.85 98.21 77.39 96.63
Alexander Buslaev2? 8-Mar-18 72.89 97.27 78.21 97.93 77.98 97.42 79.71 93.29 80.47 98.28 78.39 96.84
Romanian Academy? 8-Mar-18 68.46 96.72 65.58 96.50 71.16 96.37 65.07 85.58 73.92 97.57 67.45 94.55
Ales Zhuk? 9-Mar-18 43.12 91.74 25.92 83.43 46.29 90.71 65.93 87.47 40.03 90.80 47.46 88.83
Mi Zhang? 10-Mar-18 55.58 93.66 56.43 94.24 70.38 96.09 72.60 90.11 71.84 97.13 66.92 94.25
Vladimir Iglovikov2? 12-Mar-18 71.85 97.02 59.06 94.77 78.50 97.44 79.77 93.12 81.13 98.31 75.28 96.13
Ales Zhuk2? 28-Mar-18 53.91 94.66 51.18 94.69 57.92 94.20 72.07 90.53 56.31 95.01 62.11 93.82
Ales Zhuk3? 28-Mar-18 47.97 94.54 43.79 94.56 56.02 94.80 62.81 87.99 56.30 95.79 56.28 93.54
CC Yen? 04-Apr-18 21.00 87.92 12.37 86.74 22.33 87.61 22.62 71.85 20.17 89.13 20.36 84.65
CS of GZU? 9-Apr-18 68.97 96.95 49.60 95.44 66.87 96.21 58.30 86.66 73.45 97.68 61.91 94.59
Ales Zhuk4? 9-Apr-18 61.29 96.14 47.28 95.10 63.64 95.79 68.82 89.61 67.56 97.06 64.09 94.74
Ales Zhuk5? 9-Apr-18 47.97 94.54 43.79 94.56 56.02 94.80 62.81 87.99 56.30 95.79 56.28 93.54
Mafuyanscuec? 17-Apr-18 60.32 96.10 47.19 95.26 64.87 96.00 59.70 87.45 61.00 96.64 59.18 94.29
CS3 of GZU? 17-Apr-18 69.94 96.92 61.03 96.33 69.92 96.43 68.71 89.63 74.55 97.70 68.81 95.40
Selim Seferbekov? 17-Apr-18 73.11 97.23 78.80 97.95 77.32 97.26 78.61 92.71 80.64 98.25 77.92 96.68
Chandra Kiran? 17-Apr-18 62.14 95.98 58.91 95.84 64.15 95.63 67.11 88.41 64.99 96.79 64.64 94.53
Jimmy Ju? 23-Apr-18 71.59 97.14 57.57 96.06 70.39 96.53 70.41 90.21 76.97 97.94 69.74 95.58
Mi Zhang2? 27-Apr-18 66.74 96.77 64.34 96.70 72.60 96.77 68.54 89.90 71.02 97.36 68.73 95.50
Selim Seferbekov2? 29-Apr-18 73.66 97.30 79.96 98.05 78.36 97.41 79.33 92.85 79.04 98.07 78.45 96.74
Mafuyanscuec2? 1-May-18 66.29 96.63 58.59 96.14 67.33 96.11 69.90 90.04 71.20 97.41 67.71 95.27
Ali Aliev? 6-May-18 73.30 97.19 77.18 97.77 77.31 97.23 78.48 92.58 76.88 97.80 77.22 96.51
Pavel Yakubovskiy? 10-May-18 72.80 97.22 78.49 97.89 77.47 97.29 79.69 93.15 80.38 98.25 78.31 96.76
Onur Tasar? 7-June-18 72.32 97.17 72.38 97.30 76.32 97.08 77.06 92.08 78.27 97.97 75.85 96.32
Q Liu? 20-June-18 57.80 95.83 38.30 94.44 61.23 95.41 62.28 87.20 62.94 96.61 58.66 93.90
Ghassemi Sina? 25-June-18 69.47 96.74 75.17 97.58 75.90 97.05 72.76 91.20 76.89 97.93 73.63 96.10
Ali Aliev? 27-June-18 73.59 97.22 75.13 97.59 77.62 97.28 76.90 92.00 81.08 98.29 76.83 96.48
Xiang Li? 29-June-18 65.50 96.39 66.63 96.85 72.59 96.73 76.14 91.96 71.86 97.48 72.36 95.88
Sina Ghassemi? 05-July-18 69.13 96.92 70.30 97.17 72.51 96.76 72.76 91.20 75.31 97.83 72.21 95.97
Huan Qi? 27-July-18 61.47 95.79 54.11 95.36 65.01 95.51 65.11 87.11 66.75 96.78 63.41 94.11
Sina Ghassemi2? 27-July-18 69.70 96.99 66.70 96.72 72.16 96.68 65.85 88.91 73.91 97.68 68.50 95.40
Sina Ghassemi3? 30-July-18 68.17 96.83 67.97 96.93 73.07 96.78 66.78 89.21 75.42 97.84 69.20 95.52
Bodhiswatta-ICTLab? 02-August-18 62.44 96.03 48.20 95.21 59.83 95.24 73.19 90.98 60.35 96.10 64.82 94.71
Sina Ghassemi4? 02-August-18 66.46 96.51 70.27 97.16 72.49 96.76 69.61 89.02 75.29 97.82 70.36 95.46
Alexey Bokhovkin? 05-August-18 71.10 97.02 76.30 97.64 75.19 96.97 78.21 92.61 78.14 98.03 76.49 96.45
Alexey Bokhovkin2? 08-August-18 70.15 96.98 74.26 97.51 73.69 96.81 77.59 92.53 76.18 97.87 75.34 96.34
Bodhiswatta-ICTLab2? 15-August-18 66.14 96.53 50.30 95.33 64.50 95.60 71.05 90.11 63.94 96.46 65.83 94.80
ZhenguoYuan? 19-August-18 70.33 97.01 59.27 96.17 74.78 97.03 60.31 87.09 77.81 98.03 66.05 95.07
ZhenguoYuanMS? 21-August-18 64.36 96.40 52.99 95.60 68.14 96.20 62.97 87.49 71.13 97.37 63.74 94.61
ZhenguoYuanVGG? 21-August-18 68.11 96.77 60.41 96.20 72.33 96.65 67.72 88.50 73.22 97.52 68.25 95.13
Fuzail Palnak? 27-August-18 59.76 95.55 61.44 96.35 72.78 96.83 70.19 90.16 73.66 97.70 68.33 95.32
Sina Ghassemi? 14-September-18 66.47 96.52 70.30 97.17 72.51 96.76 69.64 89.04 75.31 97.83 70.39 95.46
Sina Ghassemi? 17-September-18 69.13 96.92 70.30 97.17 72.51 96.76 69.64 89.04 75.31 97.83 70.76 95.54
Shen Shen? 17-September-18 65.04 96.36 53.61 95.51 65.11 95.61 72.10 90.23 68.68 97.03 67.27 94.95
Simon? 18-September-18 63.71 96.34 55.65 95.79 67.77 96.05 66.28 88.70 70.41 97.20 65.35 94.82
Maria Papadomanolaki? 18-September-18 67.20 96.60 60.39 96.23 71.89 96.63 71.59 90.30 75.41 97.76 70.08 95.50
Song Zichen? 20-September-18 69.85 97.00 68.38 97.00 73.60 96.86 73.76 91.17 75.96 97.86 72.78 95.98
Zhang Bin? 23-September-18 70.29 96.98 65.29 96.36 74.49 96.99 73.30 91.22 75.55 97.84 72.21 95.88
Zhang Bin2? 25-September-18 71.68 97.18 71.48 97.32 75.39 97.15 75.91 92.14 77.03 97.99 74.80 96.36
Shen Shen? 26-September-18 70.13 96.92 55.35 95.40 71.41 96.54 69.69 89.72 76.33 97.82 68.88 95.28
Song Zichen? 27-September-18 70.77 97.11 71.83 97.36 75.20 97.07 75.37 91.83 78.44 98.10 74.64 96.29
Bodhiswatta-ICTLab? 28-September-18 67.66 96.66 66.42 96.61 69.38 96.33 74.41 91.52 69.73 97.28 71.02 95.68
Fuzail Palnak? 17-October-18 64.73 96.60 63.27 96.58 72.66 96.88 67.81 89.64 72.92 97.66 68.20 95.47
Maria Papadomanolaki? 18-October-18 64.69 96.47 59.19 96.20 67.59 96.18 75.63 91.83 70.68 97.30 70.18 95.60
Maria Papadomanolaki? 18-October-18 64.88 96.49 53.22 95.70 66.30 96.07 73.85 91.37 68.67 97.19 68.16 95.36
Zhang Bin? 22-October-18 72.21 97.26 74.15 97.55 76.92 97.29 78.69 93.00 79.08 98.14 76.99 96.65
Bodhiswatta Chatterjee? 27-November-18 73.50 97.29 79.38 98.02 78.09 97.35 79.76 93.14 80.99 98.29 78.73 96.82
Adrian Boguszewski? 29-November-18 67.67 96.11 72.70 97.07 73.42 96.50 72.79 89.80 77.96 97.88 72.73 95.47
Koki Takahashi (Waseda University)? 12-January-19 74.15 97.44 75.55 97.72 78.62 97.43 80.65 93.63 80.80 98.31 78.80 96.91
Bodhiswatta Chatterjee [10]
– ICTLab, Concordia Univ., Montreal?
06-February-19 73.74 97.35 80.66 98.15 79.13 97.52 81.41 93.89 81.36 98.35 79.88 97.05
Bodhiswatta Chatterjee [12]
– ICTLab, Concordia Univ., Montreal?
06-February-19 74.63 97.47 80.80 98.18 79.50 97.58 81.85 94.08 81.71 98.39 80.32 97.14
WenChao Kang [6] ? 24 April 19 71.03 97.07 62.13 96.45 75.45 97.11 74.54 91.53 77.31 97.99 72.95 96.03
Fuzail Palnak – Sinhgad [3] ? 09 June 19 73.48 97.32 74.16 97.52 78.29 97.44 77.48 92.48 80.42 98.27 76.98 96.61
Jhansi, Pallavi, Zoheb – fellowship.ai? 11 June 19 66.07 96.45 67.26 96.85 68.89 96.11 72.08 90.83 71.52 97.32 70.01 95.51
Aleksandar Milosavljevic – University of Nis,
Faculty of Electronic Engineering
26 June 19 73.90 97.35 72.97 97.39 77.31 97.32 76.46 92.01 80.41 98.23 76.27 96.46
Yue Liao
HiPAG
15 July 2019 71.60 97.20 70.28 97.24 74.77 96.99 76.94 92.32 77.56 97.99 75.10 96.35
Yuting Zhu [19]
Shantou University
03 September 2019 69.59 96.97 66.51 96.82 75.25 97.07 73.27 91.10 78.39 98.08 72.83 96.01
Can Altinigne [34]
EPFL
06 September 2019 71.25 97.17 71.86 97.33 75.81 97.19 76.99 92.34 78.52 98.10 75.55 96.43
Yuting Zhu [25]
Shantou University
17 September 2019 70.14 96.91 69.31 97.06 74.98 96.99 74.55 91.52 78.71 98.09 73.83 96.12
Yuting Zhu [26]
Shantou University
18 September 2019 71.16 97.04 68.37 96.97 75.32 97.02 75.52 91.84 79.01 98.11 74.39 96.20
Yuting Zhu [28]
Shantou University
23 September 2019 71.08 97.05 70.51 97.11 75.57 97.06 75.39 91.66 79.04 98.12 74.63 96.20
Zhaohong Xu
Jilin University
21 October 2019 69.33 96.91 64.03 96.31 75.41 97.05 71.32 90.16 77.83 98.02 71.48 95.69
Yue Liao [11]
Wuhan University
25 November 2019 71.74 97.22 70.55 97.27 75.44 97.11 77.26 92.47 78.54 98.10 75.52 96.43
Zhaohong Xu [2]
Jilin University
11 January 2020 70.58 96.94 72.60 97.33 76.42 97.16 75.74 91.68 79.42 98.16 75.17 96.25
Bhupinder Singh
anon
13 January 2020 70.72 97.03 69.70 97.12 74.98 97.01 74.39 91.35 78.40 98.06 73.87 96.12
Ales Zhuk [8]
BSU
10 February 2020 66.06 96.53 64.72 96.62 68.51 96.21 74.18 91.36 70.76 97.33 70.51 95.61
chenjun [3] 12 February 2020 72.73 97.33 77.19 97.87 77.94 97.44 79.50 93.20 79.80 98.24 78.08 96.82
Ulrich Kastlunger
University of Innsbruck
20 February 2020 72.88 97.35 70.91 97.28 76.48 97.21 77.46 92.66 78.97 98.14 76.02 96.53
Ales Zhuk [12]
BSU
26 March 2020 69.32 96.93 74.30 97.53 73.65 96.85 76.48 92.09 75.96 97.86 74.71 96.25
Bohao Huang [5]
Duke University AMLL
27 April 2020 72.78 97.32 74.66 97.62 77.54 97.36 79.45 93.31 80.44 98.29 77.73 96.78
Nicolas Girard [2] – Inria ?
Unet-ResNet101 + Frame field learning
22 June 2020 69.75 96.77 72.04 97.13 74.64 96.83 74.55 91.14 77.40 97.92 73.91 95.96
Yue Liao [20]
Wuhan University
25 July 2020 72.25 97.25 72.49 97.41 75.21 97.07 77.70 92.54 78.06 98.04 75.94 96.46
Yuting Zhu [60]
Shantou University
24 August 2020 73.12 97.22 75.58 97.64 77.66 97.31 79.81 93.26 80.61 98.25 78.08 96.73
Eugene Khvedchenya [19]
ods.ai
03 September 2020 74.61 97.44 81.52 98.25 80.20 97.66 82.81 94.43 82.63 98.47 81.06 97.25
Alireza Abedin
The University of Adelaide
21 October 2020 64.75 96.46 63.60 96.49 70.56 96.45 69.61 89.30 71.32 97.43 68.55 95.23
Heng-Qing Huang [10]
GuangXi University
22 September 2020 73.46 97.33 79.69 98.06 78.81 97.48 80.47 93.51 81.11 98.34 79.22 96.94
Mateusz Gomulski 23 September 2020 71.39 97.11 71.83 97.34 74.89 96.99 74.98 91.72 77.85 98.01 74.42 96.23
Alireza Abedin [4]
The University of Adelaide
27 October 2020 72.05 97.22 73.86 97.51 76.27 97.19 77.45 92.58 78.46 98.09 76.18 96.52
Guanzhou Chen, CVEO Team [2]
Wuhan University
04 December 2020 70.27 96.94 68.89 97.04 72.15 96.71 75.79 91.88 76.30 97.89 73.62 96.09
Shang Xiaoheng
Beihang University
17 January 2021 63.40 96.00 57.34 95.77 63.98 94.97 66.73 88.36 67.42 96.65 64.72 94.35
Cheng Liao [33]
SWJTU
31 January 2021 71.43 97.19 78.49 97.98 78.10 97.42 80.48 93.69 81.09 98.34 78.67 96.92
Dengyupeng [~60]
Ucas-aircas
25 February 2021 74.09 97.43 79.22 98.03 78.89 97.53 81.56 94.03 81.02 98.34 79.73 97.07
Dengyupeng [~60]
Ucas-aircas
26 February 2021 73.89 97.43 80.67 98.17 79.20 97.56 81.72 94.07 81.68 98.40 80.10 97.13
Cheng Liao [36]
SWJTU
05 March 2021 71.96 97.21 79.52 98.09 78.43 97.50 81.11 93.88 80.28 98.27 79.11 96.99
Yang Liu
CDNU
12 March 2021 71.61 97.05 75.27 97.56 74.82 96.92 76.65 91.86 78.61 98.06 75.73 96.29
HuQian
CUG
17 May 2021 62.90 96.19 62.23 96.42 68.12 96.20 75.48 91.69 70.37 97.32 70.27 95.56
Advanced Institute [8] 02 August 2021 75.34 97.58 82.67 98.40 80.83 97.77 83.80 94.77 82.95 98.51 81.91 97.41
Lei Ding [14]
University of Trento
06 November 2021 73.85 97.41 73.22 97.48 79.49 97.61 80.09 93.51 79.26 98.14 78.15 96.83

The classification samples (?) correspond to this piece of input color image.
For the sake of fairness, numbers between brackets [] indicate the number of submissions.

Comments are closed.