Abstract
In healthcare, thousands of safety incidents occur every year, but learning from these incidents is not effectively aggregated. Analysing incident reports using AI could uncover critical insights to prevent harm by identifying recurring patterns and contributing factors. To aggregate and extract valuable information, natural language processing (NLP) and machine learning techniques can be employed to summarise and mine unstructured data, potentially surfacing systemic issues and priority areas for improvement. This paper presents I-SIRch:CS, a framework designed to facilitate the aggregation and analysis of safety incident reports while ensuring traceability throughout the process. The framework integrates concept annotation using the Safety Intelligence Research (SIRch) taxonomy with clustering, summarisation, and analysis capabilities. Utilising a dataset of 188 anonymised maternity investigation reports annotated with 27 SIRch human factors concepts, I-SIRch:CS groups the annotated sentences into clusters using sentence embeddings and k-means clustering, maintaining traceability via file and sentence IDs. Summaries are generated for each cluster using offline state-of-the-art abstractive summarisation models (BART, DistilBART, T5), which are evaluated and compared using metrics assessing summary quality attributes. The generated summaries are linked back to the original file and sentence IDs, ensuring traceability and allowing for verification of the summarised information. Results demonstrate BART’s strengths in creating informative and concise summaries.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2019)
Huang, K., Altosaar, J., Ranganath, R.: ClinicalBERT: modeling clinical notes and predicting hospital readmission. ArXiv arXiv:abs/1904.05342 (2019)
Lee, J., et al.: BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36(4), 1234–1240 (2019)
Lewis, M., et al.: BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Annual Meeting of the Association for Computational Linguistics (2019)
Luo, Z., Ji, Y., Gupta, A., Li, Z., Frisch, A., He, D.: Towards accurate and clinically meaningful summarization of electronic health record notes: A guided approach. In: 2023 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), pp. 1–5 (2023)
Patil, S.S., Moorthy, V.: Extraction of unstructured electronic healthcare records using natural language processing. In: 2023 International Conference on Networking and Communications (ICNWC), pp. 1–6 (2023)
Radford, A., Narasimhan, K.: Improving Language Understanding by Generative Pre-Training (2018)
Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(1) (Jan 2020)
Sanh, V., Debut, L., Chaumond, J., Wolf, T.: DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv arXiv:abs/1910.01108 (2019)
Singh, M.K., Cosma, G., Waterson, P., Back, J., Jun, G.T.: I-SIRch: AI-powered concept annotation tool for equitable extraction and analysis of safety insights from maternity investigations. Under Review (2023). Preprint available: https://github.com/gcosma/I-SIRchpapers
Tsai, H.Y., Huang, H.H., Chang, C.J., Tsai, J.S., Chen, H.H.: Patient history summarization on outpatient conversation. In: 2022 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), pp. 364–370 (2022)
Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., Zhou, M.: Minilm: deep self-attention distillation for task-agnostic compression of pre-trained transformers. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. NIPS’20, Curran Associates Inc., Red Hook, NY, USA (2020)
Zelina, P., Halámková, J., Nováček, V.: Extraction, labeling, clustering, and semantic mapping of segments from clinical notes. IEEE Trans. Nanobiosci. 22(4), 781–788 (2023)
Zhu, Y., Yang, X., Wu, Y., Zhang, W.: Leveraging summary guidance on medical report summarization. IEEE J. Biomed. Health Inform. 27(10), 5066–5075 (2023)
Acknowledgments
This report is independent research funded by NHSX and The Health Foundation and it is managed by the National Institute for Health Research (AI_HI200006). The views expressed in this publication are those of the author(s) and not necessarily those of the NHSX, The Health Foundation, National Institute for Health Research, or the Department of Health and Social Care.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Cosma, G., Singh, M.K., Waterson, P., Jun, G.T., Back, J. (2024). Intelligent Multi-document Summarisation for Extracting Insights on Racial Inequalities from Maternity Incident Investigation Reports. In: Xie, X., Styles, I., Powathil, G., Ceccarelli, M. (eds) Artificial Intelligence in Healthcare. AIiH 2024. Lecture Notes in Computer Science, vol 14976. Springer, Cham. https://doi.org/10.1007/978-3-031-67285-9_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-67285-9_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-67284-2
Online ISBN: 978-3-031-67285-9
eBook Packages: Computer ScienceComputer Science (R0)