Abstract
Heavy smoke development represents an important challenge for operating physicians during laparoscopic procedures and can potentially affect the success of an intervention due to reduced visibility and orientation. Reliable and accurate recognition of smoke is therefore a prerequisite for the use of downstream systems such as automated smoke evacuation systems. Current approaches distinguish between non-smoked and smoked frames but often ignore the temporal context inherent in endoscopic video data. In this work, we therefore present a method that utilizes the pixel-wise displacement from randomly sampled images to the preceding frames determined using the optical flow algorithm by providing the transformed magnitude of the displacement as an additional input to the network. Further, we incorporate the temporal context at evaluation time by applying an exponential moving average on the estimated class probabilities of the model output to obtain more stable and robust results over time. We evaluate our method on two convolutional-based and one state-of-the-art transformer architecture and show improvements in the classification results over a baseline approach, regardless of the network used.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Darzi A, Mackay S.Recent advances in minimal access surgery. BrMedJ. 2002;324(7328):31–4.
Leibetseder A, Primus MJ, Petscharnig S, Schoeffmann K. Image-based smoke detection in laparoscopic videos. Comput Assist Robot Endosc Clin Image Based Proced. Springer, 2017:70–87.
Leibetseder A, Primus MJ, Petscharnig S, Schoeffmann K. Real-time image-based smoke detection in endoscopic videos. Proc ACM Multimedia. 2017:296–304.
Reiter W. Improving endoscopic smoke detection with semi-supervised noisy student models. Biomed Engineering. Vol. 6. (1). De Gruyter, 2020:20200026.
Reiter W. Co-occurrence balanced time series classification for the semi-supervised recognition of surgical smoke. Int J Comput Assist Radiol Surg. 2021;16(11):2021–7.
Wang H, Wang K, Yan T, Zhou H, Cao E, Lu Y et al. Endoscopic image classification algorithm based on poolformer. Front Neurosci. 2023;17.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. Proc IEEE. 2016:770–8.
Liu Z, Hu H, Lin Y et al. Swin transformer v2: scaling up capacity and resolution. Proc IEEE. IEEE, 2022:12009–19.
Farnebäck G. Two-frame motion estimation based on polynomial expansion. Image Anal SCIA. Springer, 2003:363–70.
Paszke A et al. PyTorch: an imperative style, high-performance deep learning library. Adv Neural Inf Process Syst. Vol. 32. MIT Press, 2019.
Bradski G. The OpenCV library. J Softw Tools. 2000;120:122–5.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Rueckert, T., Rieder, M., Feussner, H., Wilhelm, D., Rueckert, D., Palm, C. (2024). Smoke Classification in Laparoscopic Cholecystectomy Videos Incorporating Spatio-temporal Information. In: Maier, A., Deserno, T.M., Handels, H., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2024. BVM 2024. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-44037-4_78
Download citation
DOI: https://doi.org/10.1007/978-3-658-44037-4_78
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-44036-7
Online ISBN: 978-3-658-44037-4
eBook Packages: Computer Science and Engineering (German Language)