Information about the evaluation are now available. Scroll down to read the instructions. For now, you can download the challenge set consisting of 59 liver segmentations.
The provided liver segmentations are part of the training data from the "VISCERAL Organ Segmentation and Landmark Detection Challenge" at the IEEE International Symposium on Biomedical Imaging (ISBI) in May 1st, 2014 in Beijing, China. For more information on the ongoing VISCERAL Anatomy Benchmark series, please visit www.visceral.eu (which should also be acknowledged by citation, footnote, or other suitable means in any publication using any part of its dataset).Please reference the Virtual Skeleton Database in your work as:
Shape2014Research Unit during registration.
MyVSD/Settings/Group Membershipand apply to the Shape2014 group
Please register to receive, after approval, an email with your login link and activate your account
59 liver segmentations are available:
You need to log in to download the challenge data!
All participants obtain a set of training data as binary images, which they use to build a model of the liver. The participants are free in the choice of registration and modeling algorithm. In order to make an evaluation possible, the final model needs to be a parametric, Gaussian model (which comprises e.g. many linear models, such as.the standard PCA models). The evaluation of the model quality is performed once the model is uploaded on the virtual skeleton database.
The model will be evaluated according to the following criteria:
We compute for each of our evaluation criteria:
ranking of the participant according to their performance (e.g. if there are 10 participants, the best performing algorithm gets 1 point and the worst performing algorithm gets 10 point). The final ranking will be the avarage of the individual rankings.
The model has to be provided in statismo format, which is described here: statismo format documentA first version of the validation procedure can be found on github: validation code repo
Name your model according to this template: VSD.your_description.26857.h5
This allows the system to identify your model to be part of the challenge.
The description shall not include any spaces or dots.