Abstract
Clinical Decision Support (CDS) systems assist doctors to make clinical decisions by searching for medical literature based on patients’ medical records. Past studies showed that correctly predicting patient’s diagnosis can significantly increase the performance of such clinical retrieval systems. However, our studies showed that there are still a large portion of relevant documents ranked very low due to term mismatch problem. Different to other retrieval tasks, queries issued to this clinical retrieval system have already been expanded with the most informative terms for disease prediction. It is therefore a great challenge for traditional Pseudo Relevance Feedback (PRF) methods to incorporate new informative terms from top K pseudo relevant documents. Consequently, we explore in this paper word embedding for obtaining further improvements because the word vectors were all trained on much larger collections and they can identify words that are used in similar contexts. Our study utilized test collections from the CDS track in TREC 2015, trained on 2014 data. Experiment results show that word embedding can significantly improve retrieval performance, and term mismatch problem can be largely resolved, particularly for the low ranked relevant documents. However, for highly ranked documents with less term mismatching problem, word emending’s improvement can also be replaced by a traditional language model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Roberts, K., et al.: Overview of the TREC 2016 clinical decision support track. In: TREC (2016)
Limsopatham, N., et al.: Modelling the usefulness of document collections for query expansion in patient search. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM (2015)
Zhang, D., He, D.: Enhancing clinical decision support systems with public knowledge bases. Data Inf. Manag. 1, 49–60 (2017)
Zhang, D., et al.: Wikipedia-based automatic diagnosis prediction in clinical decision support systems. In: iConference 2017 Proceedings (2017)
Zhou, G., et al.: Learning continuous word embedding with metadata for question retrieval in community question answering. In: ACL, vol. 1 (2015)
Ganguly, D., et al.: Word embedding based generalized language model for information retrieval. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM (2015)
Carpineto, C., Romano, G.: A survey of automatic query expansion in information retrieval. ACM Comput. Surv. (CSUR) 44(1) (2012)
Choi, S., Choi, J.: SNUMedinfo at TREC CDS track 2014: medical case-based retrieval task. Seoul National Univ (Republic of Korea) (2014)
Balaneshin-kordan, S., Kotov, A., Xisto, R.: WSU-IR at TREC 2015 clinical decision support track: joint weighting of explicit and latent medical query concepts from diverse sources. In: Proceedings of the 2015 Text Retrieval Conference (2015)
Gurulingappa, H., et al.: Semi-supervised information retrieval system for clinical decision support. In: TREC (2016)
Mitra, B., et al.: A dual embedding space model for document ranking. arXiv preprint arXiv:1602.01137 (2016)
Lv, Y., Zhai, C.X.: A comparative study of methods for estimating query language models with pseudo feedback. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management. ACM (2009)
Pyysalo, S., Ginter, F., Moen, H., Salakoski, T., Ananiadou, S.: Distributional semantics resources for biomedical text processing (2013)
Balaneshin-Kordan, S., Kotov, A., Xisto, R.: WSU-IR at TREC 2015 clinical decision support track: joint weighting of explicit and latent medical query concepts from diverse sources. Wayne State University, Detroit, US (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Zhang, D., He, D. (2018). Can Word Embedding Help Term Mismatch Problem? – A Result Analysis on Clinical Retrieval Tasks. In: Chowdhury, G., McLeod, J., Gillet, V., Willett, P. (eds) Transforming Digital Worlds. iConference 2018. Lecture Notes in Computer Science(), vol 10766. Springer, Cham. https://doi.org/10.1007/978-3-319-78105-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-319-78105-1_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78104-4
Online ISBN: 978-3-319-78105-1
eBook Packages: Computer ScienceComputer Science (R0)