Login

Forgot password? Request a new one here!

Page navigation

How to join BRATS 2015: Brain Tumor Image Segmentation Challenge

Register below, select BRATS2015 as the research unit

How to join BRATS 2015 if you are already registered (e.g. in BRATS2012, BRATS2013, BRATS2014 or other Research Unit): Navigate to MyVSD, scroll to "Group Membership" apply for a new Membership by selecting BRATS2015
More information can be found at MICCAI-BRATS 2015

Acknowledgements

Brain tumor image data used in this article were obtained from the MICCAI 2013 Challenge on Multimodal Brain Tumor Segmentation. The challenge database contain fully anonymized images from the Cancer Imaging Archive.

Citation

The outcome of the BRATS2012 and BRATS2013 challenges has been summarized in the following publication. Authors using the BRATS dataset are kindly requested to cite this work:

  • Menze et al., The Multimodal Brain TumorImage Segmentation Benchmark (BRATS), IEEE Trans. Med. Imaging, 2015.Get the citation as BibTex
  • Kistler et. al, The virtual skeleton database: an open access repository for biomedical research and collaboration. JMIR, 2013. (BibTex)

Registration

You have to use your institutional email address for the registration.

Download

Please register to receive an email with your login link and activate your account.

BRATS 2015 Testing Data

You need to log in to download the testing data!

BRATS 2015 Training Data incl. Ground Truth

You need to log in to download the training ground truth data!

Evaluation

Ground Truth images

All images are stored as signed 16-bit integers, but only positive values are used. The manual segmentations (Truth) of the patient images have the following four different labels:

  1 for necrosis
  2 for edema
  3 for non-enhancing tumor
  4 for enhancing tumor
  0 for everything else
    

IMPORTANT

here are 3 requirements for the successfull upload and validation of your segmentation:

  1. Use the MHA filetype to store your segmentations (not mhd) [use short or ushort if you experience any upload problems]
  2. Keep the same labels as the provided truth.mha (see above)
  3. Name your segmentations according to this template: VSD.your_description.###.mha

    replace the ### with the ID of the corresponding Flair MR images. This allows the system to relate your segmentation to the correct training truth. Download an example list for the training data and testing data.

Example 1
    Filename: VSD.Brain.XX.O.MR_Flair.40819.mha
   The VSD-Id would be 40819
    Filename of your segmentation: VSD.Seg_HG_001.40819.mha
    
Example 2
    Filename: VSD.Brain.XX.O.MR_Flair.35529.mha
   The VSD-Id would be 35529
    Filename of your segmentation: VSD.Seg_LG_011.35529.mha
    

Evaluation details

The evaluation is done for 3 different tumor sub-compartements:

  • Region 1: complete tumor (labels 1+2+3+4 for patient data, labesl 1+2 for synthetic data)
  • Region 2: Tumor core (labels 1+3+4 for patient data, label 2 for synthetic data)
  • Region 3: Enhancing tumor (label 4 for patient data, n.a. for synthetic data)

Evaluation Results: Testing

Position Covered Cases Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 36 / 110 0.77 (15) 0.64 (10) 0.67 (1) 0.74 (24) 0.84 (4) 0.64 (6) 0.86 (13) 0.59 (15) 0.77 (3) 1.02 (1) 9.17 5.33 3.67
2 110 / 110 0.84 (4) 0.73 (1) 0.62 (10) 0.79 (16) 0.75 (28) 0.57 (19) 0.93 (4) 0.78 (3) 0.73 (8) 1.00 (5) 5.17 6.50 6.67
3 53 / 110 0.83 (5) 0.72 (3) 0.60 (11) 0.80 (14) 0.76 (24) 0.67 (3) 0.90 (6) 0.75 (6) 0.62 (20) 1.00 (9) 6.00 6.50 6.33
4 110 / 110 0.85 (1) 0.72 (4) 0.63 (8) 0.82 (11) 0.77 (19) 0.62 (9) 0.91 (5) 0.73 (8) 0.68 (13) 1.00 (4) 3.83 6.50 9.67
5 110 / 110 0.84 (2) 0.65 (8) 0.62 (9) 0.87 (7) 0.88 (2) 0.62 (10) 0.84 (24) 0.57 (18) 0.67 (14) 1.00 (3) 6.33 6.17 11.67
6 49 / 110 0.84 (3) 0.73 (2) 0.54 (20) 0.89 (2) 0.84 (5) 0.62 (11) 0.82 (27) 0.69 (9) 0.51 (37) 1.00 (14) 8.00 6.50 13.17
7 109 / 110 0.79 (12) 0.63 (17) 0.58 (16) 0.74 (23) 0.71 (33) 0.54 (23) 0.90 (7) 0.62 (12) 0.68 (11) 1.01 (2) 7.67 11.00 9.50
8 110 / 110 0.77 (19) 0.68 (7) 0.59 (12) 0.69 (34) 0.65 (40) 0.56 (20) 0.93 (3) 0.79 (2) 0.71 (10) 1.00 (18) 12.67 10.33 7.83
9 53 / 110 0.80 (10) 0.69 (6) 0.59 (13) 0.76 (21) 0.71 (34) 0.66 (4) 0.88 (9) 0.74 (7) 0.58 (24) 1.00 (15) 9.50 9.67 12.17
10 53 / 110 0.81 (7) 0.63 (14) 0.58 (17) 0.88 (5) 0.90 (1) 0.66 (5) 0.79 (34) 0.54 (27) 0.59 (22) 1.00 (6) 9.00 9.00 13.67
11 110 / 110 0.80 (9) 0.62 (19) 0.56 (19) 0.89 (3) 0.86 (3) 0.69 (1) 0.76 (36) 0.55 (25) 0.52 (35) 1.00 (7) 9.50 9.50 16.50
12 37 / 110 0.74 (30) 0.63 (15) 0.67 (2) 0.69 (35) 0.80 (10) 0.63 (8) 0.86 (16) 0.59 (14) 0.77 (4) 0.99 (38) 20.17 12.00 4.67
13 110 / 110 0.79 (11) 0.62 (18) 0.52 (23) 0.82 (9) 0.80 (12) 0.64 (7) 0.80 (31) 0.56 (20) 0.49 (39) 1.00 (10) 10.50 10.67 16.33
14 53 / 110 0.82 (6) 0.71 (5) 0.33 (42) 0.79 (17) 0.76 (26) 0.26 (43) 0.88 (8) 0.80 (1) 0.67 (15) 1.00 (12) 7.50 9.83 20.83
15 36 / 110 0.76 (23) 0.60 (23) 0.65 (3) 0.72 (30) 0.81 (9) 0.61 (13) 0.85 (20) 0.55 (23) 0.77 (2) 0.99 (33) 18.00 14.50 6.00
16 38 / 110 0.76 (21) 0.60 (20) 0.64 (5) 0.73 (27) 0.80 (11) 0.61 (12) 0.85 (23) 0.56 (21) 0.73 (7) 1.00 (32) 17.50 15.00 6.67
17 110 / 110 0.81 (8) 0.56 (33) 0.57 (18) 0.89 (1) 0.82 (6) 0.55 (22) 0.76 (38) 0.50 (37) 0.67 (16) 1.00 (8) 9.50 16.17 14.33
18 53 / 110 0.78 (14) 0.63 (16) 0.53 (21) 0.87 (8) 0.76 (21) 0.60 (15) 0.74 (41) 0.59 (16) 0.55 (28) 1.00 (13) 13.00 11.50 16.17
19 109 / 110 0.77 (18) 0.63 (13) 0.49 (31) 0.82 (10) 0.68 (36) 0.49 (31) 0.76 (37) 0.65 (10) 0.63 (19) 1.00 (11) 13.00 13.00 15.17
20 110 / 110 0.75 (25) 0.60 (21) 0.59 (14) 0.74 (25) 0.81 (8) 0.59 (16) 0.84 (25) 0.54 (26) 0.64 (18) 1.00 (23) 16.67 12.17 13.17
21 110 / 110 0.68 (38) 0.64 (9) 0.59 (15) 0.56 (45) 0.60 (43) 0.56 (21) 0.96 (1) 0.78 (4) 0.68 (12) 0.99 (43) 21.50 13.00 9.00
22 38 / 110 0.74 (31) 0.60 (22) 0.64 (4) 0.69 (33) 0.79 (15) 0.60 (14) 0.85 (18) 0.56 (22) 0.75 (6) 0.99 (40) 20.67 16.33 6.83
23 37 / 110 0.75 (26) 0.57 (29) 0.63 (7) 0.70 (31) 0.79 (16) 0.58 (17) 0.85 (19) 0.53 (30) 0.75 (5) 0.99 (37) 19.17 19.33 8.33
24 57 / 110 0.76 (22) 0.59 (26) 0.51 (25) 0.74 (22) 0.72 (32) 0.51 (27) 0.85 (22) 0.58 (17) 0.54 (31) 1.00 (19) 14.50 17.50 15.17
25 53 / 110 0.75 (28) 0.63 (12) 0.47 (33) 0.79 (18) 0.70 (35) 0.50 (28) 0.76 (39) 0.65 (11) 0.58 (25) 1.00 (27) 19.00 13.00 17.50
26 37 / 110 0.72 (36) 0.58 (27) 0.64 (6) 0.66 (38) 0.76 (23) 0.58 (18) 0.86 (17) 0.55 (24) 0.78 (1) 0.99 (42) 22.50 19.50 7.50
27 110 / 110 0.78 (13) 0.59 (24) 0.45 (39) 0.74 (26) 0.81 (7) 0.46 (34) 0.86 (12) 0.52 (32) 0.52 (36) 1.00 (17) 11.67 13.00 26.17
28 53 / 110 0.76 (24) 0.64 (11) 0.50 (27) 0.77 (20) 0.80 (14) 0.67 (2) 0.81 (29) 0.56 (19) 0.44 (42) 1.00 (29) 17.33 15.67 18.33
29 110 / 110 0.67 (40) 0.57 (30) 0.52 (24) 0.88 (6) 0.80 (13) 0.50 (29) 0.58 (45) 0.49 (40) 0.60 (21) 1.00 (25) 19.67 16.67 16.67
30 53 / 110 0.77 (16) 0.59 (25) 0.49 (29) 0.80 (15) 0.78 (17) 0.51 (26) 0.79 (33) 0.51 (36) 0.53 (34) 1.00 (22) 14.67 21.50 20.50
31 63 / 110 0.77 (20) 0.56 (35) 0.50 (28) 0.78 (19) 0.77 (20) 0.46 (35) 0.79 (32) 0.50 (38) 0.59 (23) 1.00 (28) 16.83 21.33 18.83
32 53 / 110 0.74 (32) 0.55 (39) 0.49 (30) 0.72 (28) 0.73 (31) 0.44 (39) 0.82 (28) 0.51 (35) 0.65 (17) 1.00 (30) 20.00 22.17 16.83
33 110 / 110 0.74 (29) 0.54 (40) 0.51 (26) 0.82 (12) 0.78 (18) 0.52 (25) 0.76 (40) 0.49 (39) 0.58 (26) 1.00 (26) 18.17 23.50 18.67
34 110 / 110 0.58 (45) 0.55 (38) 0.52 (22) 0.46 (46) 0.59 (44) 0.45 (37) 0.94 (2) 0.61 (13) 0.71 (9) 0.99 (48) 23.83 22.50 15.17
35 53 / 110 0.77 (17) 0.57 (28) 0.46 (37) 0.81 (13) 0.74 (29) 0.53 (24) 0.78 (35) 0.51 (34) 0.49 (38) 1.00 (16) 13.83 23.83 24.17
36 52 / 110 0.73 (33) 0.56 (31) 0.47 (35) 0.69 (32) 0.76 (22) 0.45 (38) 0.85 (21) 0.53 (28) 0.53 (33) 1.00 (31) 19.83 18.33 24.50
37 52 / 110 0.71 (37) 0.56 (32) 0.47 (34) 0.66 (39) 0.76 (25) 0.46 (36) 0.86 (11) 0.53 (31) 0.54 (32) 0.99 (36) 20.83 19.83 23.67
38 52 / 110 0.72 (35) 0.55 (36) 0.46 (38) 0.68 (37) 0.73 (30) 0.42 (41) 0.86 (14) 0.53 (29) 0.55 (29) 0.99 (35) 20.50 21.50 25.17
39 52 / 110 0.72 (34) 0.55 (37) 0.47 (36) 0.69 (36) 0.75 (27) 0.43 (40) 0.86 (15) 0.52 (33) 0.54 (30) 0.99 (34) 20.17 22.17 25.50
40 108 / 110 0.68 (39) 0.51 (41) 0.48 (32) 0.65 (40) 0.68 (38) 0.49 (30) 0.80 (30) 0.48 (41) 0.57 (27) 0.99 (41) 25.33 24.00 20.83
41 53 / 110 0.75 (27) 0.56 (34) 0.00 (49) 0.89 (4) 0.47 (45) 0.00 (49) 0.68 (43) 0.78 (5) 0.00 (49) 1.00 (21) 16.17 22.00 32.67
42 110 / 110 0.65 (42) 0.43 (45) 0.44 (40) 0.72 (29) 0.68 (37) 0.48 (32) 0.65 (44) 0.38 (46) 0.48 (40) 0.99 (44) 26.83 27.50 20.83
43 16 / 110 0.66 (41) 0.44 (43) 0.05 (46) 0.64 (43) 0.63 (41) 0.04 (47) 0.87 (10) 0.44 (42) 0.06 (46) 1.00 (24) 20.00 25.33 31.67
44 53 / 110 0.63 (44) 0.45 (42) 0.43 (41) 0.64 (42) 0.62 (42) 0.47 (33) 0.71 (42) 0.42 (45) 0.45 (41) 0.99 (46) 29.33 28.50 22.83
45 1 / 110 0.00 (50) 0.00 (50) 0.00 (49) 0.00 (50) 0.00 (50) 0.00 (49) 0.00 (50) 0.00 (50) 0.00 (49) 0.99 (45) 32.83 25.83 26.00
46 21 / 110 0.64 (43) 0.44 (44) 0.14 (45) 0.62 (44) 0.66 (39) 0.17 (44) 0.83 (26) 0.43 (43) 0.15 (45) 0.99 (39) 25.67 28.50 30.67
47 4 / 110 0.42 (47) 0.24 (47) 0.14 (44) 0.43 (47) 0.27 (48) 0.11 (46) 0.42 (48) 0.28 (47) 0.21 (44) 1.00 (20) 27.33 27.83 31.00
48 15 / 110 0.54 (46) 0.36 (46) 0.28 (43) 0.64 (41) 0.44 (46) 0.31 (42) 0.56 (46) 0.42 (44) 0.29 (43) 0.99 (47) 30.33 30.83 25.33
49 110 / 110 0.36 (48) 0.14 (48) 0.03 (47) 0.31 (48) 0.29 (47) 0.14 (45) 0.50 (47) 0.11 (48) 0.03 (47) 0.98 (49) 32.33 31.50 30.67
50 106 / 110 0.25 (49) 0.02 (49) 0.01 (48) 0.21 (49) 0.13 (49) 0.04 (48) 0.41 (49) 0.01 (49) 0.01 (48) 0.98 (50) 33.17 32.33 31.00

Evaluation Results: Training

Position Covered Cases Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 1 / 274 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 (1) 1.00 1.00 1.00
2 1 / 274 0.93 (2) 0.93 (3) 0.94 (2) 1.00 (2) 1.00 (2) 1.00 (2) 0.87 (12) 0.87 (6) 0.88 (5) 1.00 (2) 3.33 2.50 2.17
3 1 / 274 0.92 (4) 0.84 (5) 0.89 (3) 0.86 (15) 0.84 (9) 0.86 (4) 0.98 (2) 0.83 (9) 0.93 (2) 1.00 (7) 5.00 4.67 2.33
4 1 / 274 0.91 (5) 0.94 (2) 0.81 (6) 0.86 (16) 0.93 (4) 0.74 (11) 0.95 (4) 0.96 (2) 0.90 (3) 1.00 (9) 6.00 2.33 6.67
5 274 / 274 0.92 (3) 0.83 (6) 0.76 (8) 0.92 (7) 0.81 (12) 0.78 (7) 0.92 (8) 0.86 (7) 0.75 (10) 1.00 (4) 4.00 5.33 8.33
6 14 / 274 0.89 (7) 0.89 (4) 0.81 (7) 0.83 (21) 0.90 (5) 0.74 (12) 0.95 (5) 0.88 (5) 0.90 (4) 1.00 (13) 8.00 3.67 7.33
7 3 / 274 0.87 (12) 0.81 (7) 0.83 (4) 0.95 (4) 0.93 (3) 0.87 (3) 0.80 (22) 0.73 (17) 0.81 (8) 1.00 (12) 8.67 7.50 4.50
8 23 / 274 0.88 (9) 0.77 (9) 0.72 (12) 0.92 (6) 0.87 (7) 0.71 (14) 0.85 (17) 0.73 (18) 0.79 (9) 1.00 (5) 6.50 7.50 7.17
9 21 / 274 0.88 (10) 0.75 (12) 0.68 (15) 0.91 (8) 0.84 (11) 0.66 (18) 0.86 (16) 0.72 (19) 0.75 (12) 1.00 (3) 6.50 8.67 8.50
10 274 / 274 0.90 (6) 0.75 (11) 0.73 (11) 0.90 (10) 0.86 (8) 0.75 (9) 0.90 (9) 0.72 (20) 0.74 (14) 1.00 (6) 5.50 8.00 10.50
11 186 / 274 0.88 (8) 0.77 (8) 0.68 (14) 0.90 (11) 0.84 (10) 0.68 (17) 0.89 (10) 0.76 (13) 0.75 (13) 1.00 (8) 6.50 7.67 11.83
12 274 / 274 0.84 (15) 0.77 (10) 0.73 (10) 0.77 (27) 0.66 (23) 0.69 (15) 0.95 (6) 0.95 (4) 0.82 (7) 1.00 (15) 10.83 9.00 6.83
13 274 / 274 0.87 (13) 0.73 (14) 0.68 (13) 0.89 (13) 0.74 (17) 0.72 (13) 0.86 (15) 0.77 (12) 0.70 (18) 1.00 (11) 9.00 9.83 9.00
14 19 / 274 0.83 (17) 0.75 (13) 0.82 (5) 0.96 (3) 0.73 (18) 0.82 (5) 0.74 (26) 0.80 (11) 0.83 (6) 1.00 (23) 11.83 11.50 5.50
15 24 / 274 0.78 (24) 0.70 (17) 0.61 (18) 0.67 (29) 0.65 (24) 0.62 (22) 0.96 (3) 0.84 (8) 0.65 (19) 1.00 (25) 13.83 10.33 11.00
16 6 / 274 0.82 (18) 0.65 (21) 0.63 (17) 0.82 (22) 0.78 (14) 0.76 (8) 0.83 (18) 0.66 (25) 0.55 (24) 1.00 (20) 13.33 12.00 10.00
17 30 / 274 0.85 (14) 0.70 (15) 0.56 (23) 0.91 (9) 0.72 (20) 0.63 (19) 0.81 (20) 0.76 (15) 0.53 (25) 1.00 (10) 9.17 12.17 16.67
18 11 / 274 0.80 (20) 0.62 (23) 0.73 (9) 0.78 (25) 0.58 (26) 0.74 (10) 0.87 (13) 0.74 (16) 0.75 (11) 0.99 (27) 14.50 15.50 8.00
19 162 / 274 0.80 (23) 0.69 (18) 0.60 (19) 0.77 (26) 0.76 (15) 0.62 (20) 0.86 (14) 0.68 (21) 0.72 (16) 1.00 (21) 14.33 11.33 13.17
20 20 / 274 0.74 (28) 0.70 (16) 0.63 (16) 0.85 (17) 0.90 (6) 0.79 (6) 0.74 (27) 0.65 (26) 0.58 (23) 1.00 (26) 16.67 11.50 10.67
21 274 / 274 0.84 (16) 0.67 (19) 0.55 (25) 0.90 (12) 0.76 (16) 0.59 (23) 0.82 (19) 0.68 (22) 0.61 (21) 1.00 (14) 10.50 12.83 16.50
22 267 / 274 0.80 (21) 0.66 (20) 0.58 (20) 0.84 (20) 0.71 (21) 0.53 (27) 0.79 (23) 0.66 (24) 0.74 (15) 1.00 (18) 14.00 14.50 13.00
23 3 / 274 0.88 (11) 0.51 (28) 0.29 (29) 0.85 (18) 0.40 (29) 0.29 (29) 0.92 (7) 0.96 (3) 0.30 (29) 1.00 (16) 9.00 15.17 18.17
24 274 / 274 0.80 (22) 0.60 (24) 0.57 (22) 0.87 (14) 0.79 (13) 0.59 (25) 0.77 (25) 0.53 (30) 0.60 (22) 1.00 (19) 13.67 15.33 13.83
25 24 / 274 0.75 (27) 0.60 (27) 0.48 (26) 0.93 (5) 0.63 (25) 0.53 (26) 0.65 (30) 0.65 (27) 0.48 (26) 1.00 (17) 13.50 16.33 15.17
26 273 / 274 0.77 (25) 0.60 (26) 0.57 (21) 0.81 (24) 0.73 (19) 0.52 (28) 0.77 (24) 0.56 (29) 0.71 (17) 1.00 (22) 16.17 16.33 13.50
27 111 / 274 0.81 (19) 0.63 (22) 0.48 (27) 0.85 (19) 0.70 (22) 0.68 (16) 0.81 (21) 0.63 (28) 0.40 (28) 1.00 (24) 14.17 16.33 16.17
28 252 / 274 0.75 (26) 0.60 (25) 0.56 (24) 0.71 (28) 0.56 (27) 0.59 (24) 0.88 (11) 0.81 (10) 0.64 (20) 0.98 (31) 16.33 15.83 16.00
29 68 / 274 0.62 (30) 0.50 (29) 0.46 (28) 0.64 (31) 0.48 (28) 0.62 (21) 0.68 (29) 0.66 (23) 0.44 (27) 0.99 (29) 20.17 18.33 17.83
30 274 / 274 0.66 (29) 0.36 (30) 0.00 (31) 0.67 (30) 0.26 (30) 0.00 (31) 0.70 (28) 0.76 (14) 0.00 (31) 0.99 (28) 19.50 17.67 20.83
31 1 / 274 0.51 (31) 0.16 (31) 0.08 (30) 0.81 (23) 0.12 (31) 0.09 (30) 0.38 (31) 0.22 (31) 0.08 (30) 0.99 (30) 19.50 20.33 18.83