Abstract
Motivation
Fiber optic endoscopy is essential for minimally invasive surgery, but endoscopic images are very challenging for computer vision algorithms, since they contain many effects like tissue deformations, specular reflections, smoke, variable illumination and field of view. We developed a method to extract features from endoscopic images usable for scene analysis and classification. These features could be used with data from other sensors for workflow analysis and recognition.
Materials and methods
Evolutionary reinforcement learning that automatically computes good features, making it possible to classify endoscopic images into their respective surgical phases. It is especially designed to abstract the relevant information from the highly noisy images automatically.
Results
Automatic feature extraction was used to classify images from endoscopic cholecystectomies into their respective surgical phases. These automatically computed features perform better than some classical features from computer vision. The automated feature extraction process enables reasonable classification rates for complex and difficult images where no good features are known.
Conclusion
We developed an automatic method that extracts features from images for use in classification. The method was applied to endoscopic images yielding promising results and demonstrating its feasibility under demanding conditions.
Similar content being viewed by others
References
Ahmadi S-A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2006) Recovery of surgical workflow without explicit models. In: Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 420-428
Banzhaf W, Nordin P, Keller RE, Francone FD (1998) Genetic programming: an introduction. Morgan Kaufmann Publishers Inc., San Francisco
Burges CJC (1998) A tutorial on support vector machines for pattern recognition. In: Zeitschrift Data Mining and Knowledge Discovery, pp 121–167
Ghosh P, Mitchell M (2006) Segmentation of medical images using a genetic algorithm. In: Proceedings of the 8th annual conference on Genetic and evolutionary computation, ACM Press, New York, pp 1171–1178
Iakovidis DK, Maroulis DE, Karkanis SA, Brokos A (2005) A comparative study of texture features for the discrimination of gastric polyps in endoscopic video. In: Proceedings of the 18th IEEE symposium on computer-based medical systems, IEEE, pp 575–580
Karkanis SA, Iakovidis DK, Maroulis DE, Karras DA, Tzivras M (2003) Computer-aided tumor detection in endoscopic video using color wavelet features. In: IEEE transactions on information technology in biomedicine, vol. 7, IEEE, pp 141–152
Koza JR (1990) Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems. Stanford University Computer Science Department. Technical report
Lo BP, Darzi A, Yang G-Z (2003) Episode classification for the analysis of tissue/instrument interaction with multiple visual cues. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 230–237
Majewski P, Jedruch W (2005) Endoscopy images classification with kernel based learning algorithms. In: Innovations in Applied Artificial Intelligence, pp 400–405
Nandi RJ, Nandi AK, Rangayyan RM, Scutt D (2006) Classification of breast masses in mammograms using genetic programming and feature selection. In: J Med Biol Eng Comput. Springer, Berlin, pp 683–694
Ohnuma K, Masamune K, Yoshimitsu K, Sadahiro T, Vain J, Fukui Y, Miyawaki F (2006) Timed-automata-based model for laparoscopic surgery and intraoperative motion recognition of a surgeon as interface connecting the surgical scenario and real operating room. In: Computer Assisted Radiology and Surgery, pp 442–445
Szymanski JJ, Brumby SP, Pope P, Eads D, Esch-Mosher D, Galassi M, Harvey NR, Mcculloch HD, Perkins SJ, Porter R, Theiler J, Young AC, Bloch JJ, David N (2002) Feature extraction from multiple data sources using genetic programming. In: Proceedings of SPIE, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery VIII, vol. 4725, pp 338–345
Schölkopf B, Smola AJ, Williamson RC, Bartlett PL (2000) A new support vector algorithms. In: Neural computation. The MIT Press, Cambridge, vol. 12, pp 1207–1245
Wang P, Krishnan SM, Kugean C, Tjoa MP (2001) Classification of endoscopic images based on texture and neural network. In: Proceedings of Engineering in Medicine and Biology Society, vol. 4, IEEE, pp 3691–3695
Zhang M, Ciesielski VB, Andreae P (2003) A domain independent window approach to multiclass object detection using genetic programming. In: EURASIP J Appl Signal Process, vol. 8. Hindawi Publishing Corporation, pp 841–859
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Klank, U., Padoy, N., Feussner, H. et al. Automatic feature generation in endoscopic images. Int J CARS 3, 331–339 (2008). https://doi.org/10.1007/s11548-008-0223-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-008-0223-8