Abstract
Purpose
Clinical workflows and user interfaces of image-based computer-aided diagnosis (CAD) for interstitial lung diseases in high-resolution computed tomography are introduced and discussed.
Methods
Three use cases are implemented to assist students, radiologists, and physicians in the diagnosis workup of interstitial lung diseases.
Results
In a first step, the proposed system shows a three-dimensional map of categorized lung tissue patterns with quantification of the diseases based on texture analysis of the lung parenchyma. Then, based on the proportions of abnormal and normal lung tissue as well as clinical data of the patients, retrieval of similar cases is enabled using a multimodal distance aggregating content-based image retrieval (CBIR) and text-based information search. The global system leads to a hybrid detection-CBIR-based CAD, where detection-based and CBIR-based CAD show to be complementary both on the user’s side and on the algorithmic side.
Conclusions
The proposed approach is in accordance with the classical workflow of clinicians searching for similar cases in textbooks and personal collections. The developed system enables objective and customizable inter-case similarity assessment, and the performance measures obtained with a leave-one-patient-out cross-validation (LOPO CV) are representative of a clinical usage of the system.
Similar content being viewed by others
References
Abe H, MacMahon H, Engelmann R, Li Q, Shiraishi J, Katsuragawa S, Aoyama M, Ishida T, Ashizawa K, Metz CE, Doi K (2003) Computer-aided diagnosis in chest radiography: results of large-scale observer tests at the 1996–2001 RSNA scientific assemblies. RadioGraphics 23(1): 255–265
Aisen A, Broderick L, Winer-Muram H, Brodley C, Kak A, Pavlopoulou C, Dy J, Shyu C, Marchiori A (2003) Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology 228(1): 265–270
Caritá EC, Seraphim E, Honda MO, Mazzoncini de Azevedo-Marques P (2008) Implementation and evaluation of a medical image management system with content-based retrieval support. Radiol Brasileira 41(5): 331–336
Depeursinge A, Müller H (2010) Fusion techniques for combining textual and visual information retrieval. In: ImageCLEF, The springer international series on information retrieval, vol. 32. Springer, Berlin Heidelberg, pp 95–114
Depeursinge A, Racoceanu D, Iavindrasana J, Cohen G, Platon A, Poletti PA, Müller H (2010) Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography. Artif Intell Med 50(1): 13–21
Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti PA, Müller H (2010) 3D case-based retrieval for interstitial lung diseases. In: MCBR-CDS 2009: Medical content-based retrieval for clinical decision support, lecture notes in computer science (LNCS). Springer, pp 39–48
Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti PA, Müller H Building a reference multimedia database for interstitial lung diseases. Comput Med Imaging Graph (to appear)
Depeursinge A, Zrimec T, Busayarat S, Müller H (2011) 3D lung image retrieval using localized features In: Medical imaging 2011: computer-aided diagnosis, vol. 7963. SPIE, p 79632E
Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31(4–5): 198–211
Duncan JS, Ayache N (2000) Medical image analysis: progress over two decades and the challenges ahead. IEEE Trans Pattern Anal Mach Intell 22(1): 85–106
Engle RL (1992) Attempts to use computers as diagnostic aids in medical decision making: a thirty-year experience. Perspect Biol Med 35(2): 207–219
Friedman C, Elstein A, Wolf F, Murphy G, Franz T, Heckerling P, Fine P, Miller T, Abraham V (1999) Enhancement of clinician’s diagnostic reasoning by computer-based consultation. J Am Med Assoc 282(19): 1851–1856
Gallo L, De Pietro G, Coronato A, Marra I (2008) Toward a natural interface to virtual medical imaging environments. In: AVI ’08: Proceedings of the working conference on advanced visual interfaces, Association for Computing Machinery. New York, pp 429–432
Hoffman EA, Reinhardt JM, Sonka M, Simon BA, Guo J, Saba O, Chon D, Samrah S, Shikata H, Tschirren J, Palagyi K, Beck KC, McLennan G (2003) Characterization of the interstitial lung disease via density-based and texture-based analysis of computed tomography images of lung structure and function. Acad Radiol 10(10): 1104–1118
Kelly K, Dean J, Lee SJ, Comulada W (2010) Breast cancer detection: radiologists’ performance using mammography with and without automated whole-breast ultrasound. Eur Radiol 20: 2557–2564
Keysers D, Dahmen J, Ney H, Wein BB, Lehmann TM (2003) A statistical framework for model-based image retrieval in medical applications. J Electron Imaging 12(1): 59–68
King TE (2010) Approach to the adult with interstitial lung disease: clinical evaluation. In: Denise S. Basow (edn). UpToDate, Waltham, MA
Kruger RP, Thompson WB, Turner AF (1974) Computer diagnosis of pneumoconiosis. IEEE Transact Syst Man Cybern SMC-4(1): 40–49
Lemaire JB, Schaefer JP, Martin LA, Faris P, Ainslie MD, Hull RD (1999) Effectiveness of the quick medical reference as a diagnostic tool. Can Med Assoc J 161(6): 725–728
Liu CT, Tai PL, Chen AYJ, Peng CH, Wang JS (2000) A content-based medical teaching file assistant for CT lung image retrieval. In: Proceedings of the IEEE international conference on electronics, circuits, systems. Jouneih-Kaslik, Lebanon, pp 361–365
Mazoue JG (1990) Diagnosis without doctors. J Med Philos 15(6): 559–579
Meyers P, Nice C, Becker H, Nettleton W, Sweeney J, Meckstroth GR (1964) Automated computer analysis of radiographic images. Radiology 83: 1029–1034
Miller RA (1994) Medical diagnostic decision support systems-past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc 1(1): 8–27
Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medicine-clinical benefits and future directions. Int J Med Inform 73(1): 1–23
Müller H, Rosset A, Garcia A, Vallée JP, Geissbuhler A (2005) Benefits from content-based visual data access in radiology. RadioGraphics 25(3): 849–858
Nishikawa RM (2007) Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 31(4–5): 224–235
Oliveira MC, Cirne W, de Azevedo Marques PM (2007) Towards applying content-based image retrieval in the clinical routine. Future Gener Comput Syst 23(3): 466–474
Rosset A, Spadola L, Ratib O (2004) OsiriX: an open-source software for navigating in multidimensional DICOM images. J Digit Imaging 17(3): 205–216
Salgado R, Mulkens T, Bellinck P, Termote JL (2003) Volume rendering in clinical practice. a pictorial review. J Belge de Radiologie 86(4): 215–220
Sasso G, Marsiglia HR, Pigatto F, Basilicata A, Gargiulo M, Abate AF, Nappi M, Pulley J, Sasso FS (2005) A visual query-by-example image database from chest CT images: potential role as a decision and educational support tool for radiologists. J Digit Imaging 18(1): 78–84
Schroeder W, Martin K, Lorensen B (2006) The visualization toolkit—an object oriented approach to 3D graphics. 3rd edn. Kitware, Inc, Clifton park
Shyu CR, Brodley CE, Kak AC, Kosaka A, Aisen AM, Broderick LS (1999) ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comput Vis Imag Underst 75(1/2): 111–132
Simel D, Drummond R (2008) The rational clinical examination: evidence-based clinical diagnosis. McGraw-Hill, NY
Sluimer IC, van Waes PF, Viergever MA, van Ginneken B (2003) Computer-aided diagnosis in high resolution CT of the lungs. Med Phys 30(12): 3081–3090
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12): 1349–1380
Tao Y, Zhou XS, Bi J, Jerebkoa A, Wolf M, Salganicoff M, Krishnana A (2009) An adaptive knowledge-driven medical image search engine for interactive diffuse parenchymal lung disease quantification. In: Medical imaging 2009: computer-aided diagnosis, vol 7260. SPIE, p 726007
Uchiyama Y, Katsuragawa S, Abe H, Shiraishi J, Li F, Li Q, Zhang CT, Suzuki K, Doi K (2003) Quantitative computerized analysis of diffuse lung disease in high-resolution computed tomography. Med Phys 30(9): 2440–2454
Vomweg TW (2008) Computer-aided diagnosis: clinical applications in the breast. In: Image processing in radiology, medical radiology. Berlin Heidelberg, Springer, pp 355–374
Warner H, Bouhaddou O (1994) Innovation review: iliad-a medical diagnostic support program. Top Heal Inf Manag 14(4): 51–58
Webb WR, Müller NL, Naidich DP (2001) High-Resolution CT of the lung. Lippincott Williams & Wilkins, Philadelphia
Welter P, Deserno TM, Fischer B, Wein BB, Ott B, Günther RW (2009) Integration of CBIR in radiological routine in accordance with IHE. In: Medical imaging 2009: Advanced PACS-based imaging informatics and therapeutic applications, vol 7264. SPIE, p 726404
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Depeursinge, A., Vargas, A., Gaillard, F. et al. Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows. Int J CARS 7, 97–110 (2012). https://doi.org/10.1007/s11548-011-0618-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-011-0618-9