Abstract
Purpose
Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested.
Methods
Simple thresholds and statistical methods are unable to adequately segment the various elements of the GBM, such as local contrast enhancement, necrosis, and edema. Most voxel-based methods cannot achieve satisfactory results in larger data sets, and the methods based on generative or discriminative models have intrinsic limitations during application, such as small sample set learning and transfer. A new method was developed to overcome these challenges. Multimodal MR images are segmented into superpixels using algorithms to alleviate the sampling issue and to improve the sample representativeness. Next, features were extracted from the superpixels using multi-level Gabor wavelet filters. Based on the features, a support vector machine (SVM) model and an affinity metric model for tumors were trained to overcome the limitations of previous generative models. Based on the output of the SVM and spatial affinity models, conditional random fields theory was applied to segment the tumor in a maximum a posteriori fashion given the smoothness prior defined by our affinity model. Finally, labeling noise was removed using “structural knowledge” such as the symmetrical and continuous characteristics of the tumor in spatial domain.
Results
The system was evaluated with 20 GBM cases and the BraTS challenge data set. Dice coefficients were computed, and the results were highly consistent with those reported by Zikic et al. (MICCAI 2012, Lecture notes in computer science. vol 7512, pp 369–376, 2012).
Conclusion
A brain tumor segmentation method using model-aware affinity demonstrates comparable performance with other state-of-the art algorithms.
Similar content being viewed by others
References
Liu J, Udupa JK, Odhner D, Hackney D, Moonis G (2005) A system for brain tumor volume estimation via MR imaging and fuzzy connectedness. Comput Med Imaging Graphics 29(1):21–34
Sled JG, Zijdenbos AP, Evans AC (1998) A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans Med Imaging 17(1):87–97
Belaroussi B, Milles J, Carme S, Zhu YM, Benoit-Cattin H (2006) Intensity non-uniformity correction in MRI: existing methods and their validation. Med Image Anal 10(2):234
Madabhushi A, Udupa JK (2005) Interplay between intensity standardization and inhomogeneity correction in MR image processing. IEEE Trans Med Imaging 24(5):561–576
Patel MR, Tse V (2004) Diagnosis and staging of brain tumors. Semin Roentgenol 39(3):347–360
Prastawa M, Bullitt E, Ho S, Gerig G (2004) A brain tumor segmentation framework based on outlier detection. Med Image Anal 8(3):275–283
Phillips W, Velthuizen R, Phuphanich S, Hall L, Clarke L, Silbiger M (1995) Application of fuzzy c-means segmentation technique for tissue differentiation in MR images of a hemorrhagic glioblastoma multiforme. Magn Reson Imaging 13(2):277–290
Clark MC, Hall LO, Goldgof DB, Velthuizen R, Murtagh FR, Silbiger MS (1998) Automatic tumor segmentation using knowledge-based techniques. IEEE Trans Med Imaging 17(2):187–201
Fletcher-Heath LM, Hall LO, Goldgof DB, Murtagh FR (2001) Automatic segmentation of non-enhancing brain tumors in magnetic resonance images. Artif Intell Med 21(1–3):43–63
Warfield SK, Kaus M, Jolesz FA, Kikinis R (2000) Adaptive, template moderated, spatially varying statistical classification. Med Image Anal 4(1):43–55
Kaus MR, Warfield SK, Nabavi A, Black PM, Jolesz FA, Kikinis R (2001) Automated segmentation of MR images of Brain Tumors1. Radiology 218(2):586–591
Prastawa M, Bullitt E, Moon N, Van Leemput K, Gerig G (2003) Automatic brain tumor segmentation by subject specific modification of atlas priors. Acad Radiol 10(12):1341–1348
Wells W III, Grimson WEL, Kikinis R, Jolesz FA (1996) Adaptive segmentation of MRI data. IEEE Trans Med Imaging 15(4):429–442
Guillemaud R, Brady M (1997) Estimating the bias field of MR images. IEEE Trans Med Imaging 16(3):238–251
Corso JJ, Sharon E, Dube S, El-Saden S, Sinha U, Yuille A (2008) Efficient multilevel brain tumor segmentation with integrated bayesian model classification. IEEE Trans Med Imaging 27(5):629–640
Zhou J, Chan K, Chong V, Krishnan S (2006) Extraction of brain tumor from MR images using one-class support vector machine. In: 27th annual international conference of the engineering in medicine and biology society, 2005. IEEE-EMBS 2005. pp 6411–6414
Xuan X, Liao Q (2008) Automated MRI brain rumor segmentation based on feature extraction. Comput Eng 9:070
Corso J, Yuille A, Sicotte N, Toga A (2007) Detection and segmentation of pathological structures by the extended graph-shifts algorithm. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI. pp 985–993
Schapire RE, Freund Y, Bartlett P, Lee WS (1998) Boosting the margin: a new explanation for the effectiveness of voting methods. Ann Stat 26(5):1651–1686
Dettling M (2004) BagBoosting for tumor classification with gene expression data. Bioinformatics 20(18):3583–3593
Breiman L (2001) Random forests. Mach Learn 45(1):5–32
Zikic D, Glocker B, Konukoglu E, Criminisi A, Demiralp C, Shotton J, Thomas O, Das T, Jena R, Price S (2012) Decision forests for tissue-specific segmentation of high-grade gliomas in multi-channel MR. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI. Lecture notes in computer science, vol 7512. pp 369–376
Liu H, Motoda H, Yu L (2004) A selective sampling approach to active feature selection. Artif Intell 159(1):49–74
Fernández A, García S, Herrera F (2011) Addressing the classification with imbalanced data: open problems and new challenges on class distribution. In: Hybrid artificial intelligent systems. Lecture notes in computer science, vol 6678. pp 1–10
Li SZ (1995) Markov random field modeling in computer vision. Springer, New York
Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 20(1):45–57
Lee CH, Schmidt M, Murtha A, Bistritz A, Sander J, Greiner R (2005) Segmenting brain tumors with conditional random fields and support vector machines. In: Computer vision for biomedical, image applications. Lecture notes in computer science, vol 3765. pp 469–478
Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181
Xu C, Corso JJ (2002) Evaluation of super-voxel methods for early video processing. In: IEEE conference on computer vision and pattern recognition (CVPR) 2012, pp 1202–1209
Bauer S, Nolte L-P, Reyes M (2011) Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2011. Springer, pp 354–361
Platt J (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Class 10(3):61–74
Ren X, Malik J (2003) Learning a classification model for segmentation. In: Proceedings of the ninth IEEE international conference on computer vision, 2003. pp 10–17
Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8):837–842
Lee TS (1996) Image representation using 2D Gabor wavelets. IEEE Trans Pattern Anal Mach Intell 18(10):959–971
Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239
Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124–1137
Kolmogorov V, Zabin R (2004) What energy functions can be minimized via graph cuts? IEEE Trans Pattern Anal Mach Intell 26(2):147–159
Zabih RD, Veksler O, Boykov Y (2004) System and method for fast approximate energy minimization via graph cuts. U. S. Patent 6,744, 923 [p]. 1 June 2004
Delong A, Osokin A, Isack HN, Boykov Y (2012) Fast approximate energy minimization with label costs. Int J Comput Vis 96(1):1–27
Singh SK, Hawkins C, Clarke ID, Squire JA, Bayani J, Hide T, Henkelman RM, Cusimano MD, Dirks PB (2004) Identification of human brain tumour initiating cells. Nature 432(7015):396–401
Zikic D, Glocker B, Konukoglu E, Shotton J, Criminisi A, Ye DH, Demiralp C, Thomas OM, Das T, Jena R, Price SJ (2012) Context-sensitive classification forests for segmentation of brain tumor tissues. In: Proceedings of MICCAI-BRATS (2012)
Acknowledgments
This work was partially supported by the Chinese National Science Foundation (61273241) and the NSF CAREER grant IIS-0845282. Conflict of Interest The authors have declared that no conflict of interest exists.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wu, W., Chen, A.Y.C., Zhao, L. et al. Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. Int J CARS 9, 241–253 (2014). https://doi.org/10.1007/s11548-013-0922-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-013-0922-7