Insight Journal (ISSN 2327-770X) - Implementing the Automatic Generation of 3D Statistical Shape Models with ITK

Implementing the Automatic Generation of 3D Statistical Shape Models with ITK

Heimann T., Oguz I., Wolf I., Styner M., Meinzer H.

University of North Carolina at Chapel Hill

Please use this identifier to cite or link to this publication: http://hdl.handle.net/1926/224

Published in The Insight Journal - 2006 MICCAI Open Science Workshop.

Submitted by Ipek Oguz on 07-19-2006.

Statistical Shape Models are a popular method for segmenting three-dimensional medical images. To
obtain the required landmark correspondences, various automatic approaches have been proposed. In
this work, we present an improved version of minimizing the description length (MDL) of the model. To
initialize the algorithm, we describe a method to distribute landmarks on the training shapes using a conformal
parameterization function. Then, we introduce a novel procedure to modify landmark positions
locally without disturbing established correspondences. We employ a gradient descent optimization to
minimize the MDL cost function, speeding up automatic model building by several orders of magnitude
when compared to the original MDL approach. The necessary gradient information is estimated from
a singular value decomposition, a more accurate technique to calculate the PCA than the commonly
used eigendecomposition of the covariance matrix. In this work, we first present a basic version where
spatial locations are used in the MDL cost function; next, we introduce an extended version where any
combination of features can be used as a metric. As an example application, we present results based on
local curvature measurements. Finally, we present results for synthetic and real-world datasets demonstrating
the efficiency of our procedures and give details about the implementation using the Insight
Toolkit (ITK).

Data

5 Files (3Mb)

data.tar.gz (74Kb)
IJ06-Correspondence.pdf (411Kb) [view paper]
MICCAI06_Correspondence.ppt (3Mb) [view slideshow]
code.tar.gz (45Kb)
itkCorrespondences.zip (104Kb)

Code

Automatic Testing Results by Insight-Journal Dashboard on Fri Dec 30 09:00:26 2011 for revision #12

expertise: 5 sensitivity: 5

This project had trouble building: 6 errors, 1 warnings
Click here for more details.

Go here to access the main testing dashboard.

Automatic Testing Results by Insight-Journal Dashboard on Mon Nov 20 22:43:14 2006 for revision #11

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Sun Nov 19 21:43:55 2006 for revision #10

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Thu Oct 12 13:59:22 2006 for revision #9

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Fri Aug 25 11:52:16 2006 for revision #8

expertise: 5 sensitivity: 4.7

Automatic Testing Results by Insight-Journal Dashboard on Fri Aug 18 15:14:18 2006 for revision #7

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Fri Jul 21 17:50:32 2006 for revision #6

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Wed Jul 19 19:23:17 2006 for revision #5

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Wed Jul 19 15:15:00 2006 for revision #4

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Wed Jul 19 14:49:20 2006 for revision #3

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Wed Jul 19 13:31:47 2006 for revision #2

expertise: 5 sensitivity: 5

Automatic Testing Results by Insight-Journal Dashboard on Mon Jul 10 22:17:29 2006 for revision #1

expertise: 5 sensitivity: 5

Reviews

Good tool for correspondence problem. by Ekaterina Syrkina on 12-12-2006 for revision #11

expertise: 3 sensitivity: 5

Summary:
With this work authors present flexible software for establishing correspondence between shape boundaries over a given training set. This is the main step in statistical shape model building. Application is restricted to the objects with spherical topology. Framework for the model building itself (after establishing correspondence) is not provided, but this is the minor step in the problem.

Hypothesis:
Not applicable

Evidence:
As far as I know, presented work is the first open source for this particular problem. Default settings has been proven by appropriate for the MDL approach measurements to give the best results (see authors' IPMI paper), but it also possible to change some parts of the algorithm such as cost function, initial parametrisation, landmark positions, use of features and other fine tunings (up to now I've tried only default settings).

Open Science:
Source code is available, but there is only one example data set (cuboids).

Reproducibility:
I've downloaded and compiled the code without any problems.

Running. The following statement from the paper is not correct in the current implementation: "A main() function is provided along with these classes as a ready to use tool. The only parameters to this tool are an input list file, a landmark file, and a model radius." There is 4th parameter in the last version and I get segmentation fault without it (while there is the check of the number of input parameters in main.cc, I do not get the expected message: "Usage: " << argv[0] << " MeshListFile LandmarkFile ModelRadius OutputLandmarkFile"). Would be nice to see more detailed description when running the program (e.g. with "-h"). Also I get warnings with no sense for me: "Couldn't convert pixel type".

Comment for Linux users: data are provided with Windows line breaks, you have to use something like dos2unix to avoid problems. It would be nice to have data for both Linux and Windows platforms.

Use of Open Source Software:
ITK, cmake

Open Source Contributions:
Source code is provided, main classes are described, but more clear and up to date instructions how to use it are neccesary.

Classes for mesh writers in different formats are available for output (STL, ASCII). Default output format is *.meta.

Small text correction: it seems that number of vertices for cuboids given in the Table 2 (that is 486) is not correct (I've found only 386 for cuboids data)

Code Quality:
Code is enough commented

Applicability to other problems:
Can be applied for any problem where statistical shape modeling for triangulated meshes is needed. It is not restricted only to medical applications.

Suggestions for future work:
Thought the most difficult part of building statistical shape model is given, construction of the model itself (with PCA) and framework to analyse the model (e.g. calculation of measures, such as specificity and generalisation ability) would make the application more complete. Also, visualisation part is not covered and no hints to visualise data and get 3d images from the paper are given. Default output mesh format also requires some comments.

Requests for additional information from authors:
Up to date parameters to run the program

Additional Comments:
Very nice and useful job! Thanks!

Shape model generation by Jim Miller on 08-30-2006 for revision #8

expertise: 3 sensitivity: 4.3

Summary:
This paper describes (and provides) methods for generating statistical shape models. A minimum description length landmark generation method is implemented. Additional features can also be used to control the selection of landmarks.

Automated generation of statistical shape models in important. While specifying shape models manually in 2D is not too taxing, the problem becomes very burdonsome for 3D objects. The methods provided here will increase the use of statistical shape models in ITK.

Hypothesis:
Non Applicable

Evidence:

Open Science:
Paper provides source code and data.

Reproducibility:
The software built without issue for me.

Use of Open Source Software:
Provides an ITK framework for constructing shape models.

Open Source Contributions:
Source code provided. While in an ITK framework, many of object inherit from itkObject. Does it make sense for some of the algorithms to be implemented as filters?

This paper only covers the construction of the statistical shape model, not its application.

Code Quality:
See the above note.

Applicability to other problems:
Statistical shape models are an important component of medical image analysis. They are not utilized more because of the difficulty in specifying the models in 3D.

Suggestions for future work:

Requests for additional information from authors:

This paper only covers the construction of the statistical shape model, not its application. Is there another paper on the application or do the authors use existing ITK methods to fit a statistical shape model to an image?

Additional Comments:

Comment by Ipek Oguz: Pointer to application paper

We have submitted another paper (also in ISC/NA-MIC Workshop on Open Science at MICCAI 2006), describing how we use the shape models computed in this work. The described statistical shape analysis framework is also open source.

Framework for the Statistical Shape Analysis of Brain Structures using SPHARM-PDM, by M.Styner et al.

Thanks for your review,

Useful Software. A more general framework design needed. by Ghassan Hamarneh on 08-30-2006 for revision #8

expertise: 4 sensitivity: 4.7

Summary:

The authors present a pipeline for establishing 3D shape correspondence. The implementation is based on concepts from earlier work [2-7], including MDL, shape index and curvedness local features, and establishing correspondence on the unit sphere.

Hypothesis:

The importance of statistical shape analysis in clinical applications.

The need for open source code and software for establishing 3D shape correspondence statistical model building.

The authorâs submission provides a means to perform 3D statistical shape analysis.

Evidence:

The authors describe and provide code and sample data for creating statistical shape models. The authors made particular choices regarding how these models are created (e.g. MDL-based, specific local features, specific shape representation).

Open Science:

See next section.

Reproducibility:

ITK classes, code and data are provided. See below.

I downloaded all the files including the source code, but did not build the code. The authors provide an application (see main.cpp), a single data set of cuboids, and an example of command line argument.

The authors write: âA detailed overview of how the example application works is useful to demonstrate how the various classes work together. Initially, an instanceâ¦.â. This paragraph is useful for understanding the framework. It would have been helpful to refer the reader to specific lines from the main.cpp file.

The authors write that the framework is flexible enough allowing the use of other local shape features. However, details describing which classes, source code, or virtual functions (?) need to be implemented or modified to accomplish this. I was expecting to find something like:

ssmCalculator->SetLocalFeatures( ShapeIndexAndCurvedness);

In this way the framework may be used to compare the correspondence results and statistical model created when different local features are used.

Use of Open Source Software:

The authors make use of CMAKE and ITK coding style. Experience or advice related to open source are not given.

Open Source Contributions:

The authors provide the source code (and sample data). Users familiar with CMAKE should be able to build the provided application. CMakeLists.txt is provided.

Code Quality:

Main.cpp hardly has any comments. Other random files checked do not have any comments at all.

Applicability to other problems:

Code can be applied to general shape correspondence problems in non-medical applications, for example for shape modelling, geometry processing, and computer graphics.

Suggestions for future work:

I think that it would be valuable to provide a class
itk::SpatialObjectToSpatialObjectRegistrationMethod
where this work would be an instantiation of.

Perhaps ImageToImage, SpatialObjectToSpatialObject, ImageToSpatialObject, and SpatialObjectToImage should all inherit from a higher level ObjectToObjectRegistrationMethod.

It would be valuable to be able to specify the different components of the shape correspondence (or the SpatialObjectToSpatialObject â¦) framework in a manner similar to the current image registration framework of ITK. In the image registration framework the user can set the transform, similarity metric, optimization, interpolation etc. It seems to me it is natural to have a similar framework for shape âregistrationâ, where the following can be set: contours vs surfaces, shape representation, correspondence/mapping representation, local features, cost functions, optimization strategy, etc. This will require a substantial investment in designing such a framework, similar to what has been undertaken for the image registration framework (perhaps even learning from that experience to provide improvements). Such a new framework will be more welcoming for other researchers and developers to create other modules (e.g. a new local feature or cost function). The current submission under review could be thought of as a single instantiation of such a general shape correspondence pipeline. The current submission does have some aspects of this general pipeline.
A tutorial similar to the: âHello Worldâ Registration (section 8.2 in the ITK guide, edition 2, ITK2.4) would be beneficial.

The MDL approach ties the correspondence problem with building the statistical shape model. It might be beneficial in some cases to examine different statistical analyses or model building approaches assuming an already established correspondence.

Requests for additional information from authors:

It is hard to read the text in the flowchart of Figure 4 in the PDF submission. A higher resolution figure would be good.

Can the framework be applied in 2D to match contours (not surfaces) of shapes?

It appears that the software or code used to produce the images and coloring in Figure 2 is not provided. How can these figures be generated?

Additional Comments:

Comment by Ipek Oguz: How to use different local features

Thanks for your detailed review and your useful suggestions for future work. We will submit a new version of the paper integrating some of your suggestions, after the reviewing period is over.

In the meantime, I would like to clarify your question about how to use our software for other local metrics. You do not need to make any changes to the code at all; the local metrics we use are not hard-coded anywhere in the source. They are simply provided as input data. Therefore, whichever arbitrary local features you wish to use, you simply need to provide the values for those features for each mesh in the corresponding feature files (.txt) described in the paper. We decided this method would have been more useful than providing the user with the choice over only a handful of pre-defined local features. This also allows separating the computation of the features from the actual correspondence work.

Add a new review

Quick Comments

Resources


Download All
Github

Statistics more


Global rating:
Review rating:	[review]
Code rating:
Views:	29916
Downloads:	3906
Paper Quality:

Information more


Paper Id:	111
Categories:	Data, Programming, Programming
Keywords:	Correspondence, Statistical Shape Analysis
Toolkits:	ITK, CMake
Revision:
Export citation:
Status:	Open for public review

Share

Linked Publications more


A Gradient Descent Trust Region Optimizer by Brooks R.
Implementation of graph-based interactive 3D vessel segmentation filter by Pellow D., Freiman M., Joskowicz L.
N4ITK: Nick's N3 ITK Implementation For MRI Bias Field Correction by Tustison N., Gee J.
Noise simulation by Lehmann G.
Anisotropic Fast Marching in ITK by Mirebeau J.
Computing Bone Morphometric Feature Maps from 3-Dimensional Images by Vimort J., McCormick M., Paniagua B.
Tubular Geodesics using Oriented Flux: An ITK Implementation by Benmansour F., Turetken E., Fua P.
Parallel algorithms for erosion and dilation of label images. by Beare R., Jackway P.
Statismo - A framework for PCA based statistical models by Lüthi M., Blanc R., Albrecht T., Gass T., Goksel O., Büchler P., Kistler M., Bousleiman H., Reyes M., Cattin P., Vetter T.
Primal/Dual Mesh with Application to Triangular/Simplex Mesh and Delaunay/Voronoi by Irshad H., Rigaud S., Gouaillard A.

View license

Loading license...

Send a message to the author