Abstract
In this paper, we present an overview of the NLPCC 2023 shared task, named Chinese Medical Instructional Video (CMIVQA), which includes three sub-tracks: temporal answer grounding in a single video, video corpus retrieval, and temporal answer grounding in video corpus. The CMIVQA datasets containing the videos, audios, and corresponding subtitles are made public, and the corresponding labels are manually annotated by medical experts. Details of the shared task, datasets, evaluation metrics, and final results will be provided in order. We hope this shared task can provide more insights into the first-aid, medical emergency, or medical education.
This work is supported by the National Natural Science Fund of China (62221002, 62171183), the Hunan Provincial Natural Science Foundation of China (2022JJ20017), and in part by the CAAI-Huawei MindSpore Open Fund. This work will also be used on MindSpore.
B. Li and Y. Weng—These authors contribute this work equally.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Song, Q., Sun, B., Li, S.: Multimodal sparse transformer network for audio-visual speech recognition. IEEE Trans. Neural Networks Learn. Syst., 1–11 (2022)
Buch, S., Eyzaguirre, C., Gaidon, A., Wu, J., Fei-Fei, L., Niebles, J.C.: Revisiting the" video" in video-language understanding. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2917–2927 (2022)
Li, B., et al.: More but correct: Generating diversified and entity-revised medical response. arXiv preprint arXiv:2108.01266 (2021)
Li, B., Weng, Y., Xia, F., Sun, B., Li, S.: VPAI_Lab at MedVidQA 2022: a two-stage cross-modal fusion method for medical instructional video classification. In: Proceedings of the 21st Workshop on Biomedical Language Processing, pp. 212–219, Dublin, Ireland, May 2022. Association for Computational Linguistics
Jabeen, S., Li, X., Amin, M.S., Bourahla, O., Li, S., Jabbar, A.: A review on methods and applications in multimodal deep learning. ACM Trans. Multimed. Comput. Commun. Appl. 19(2s), 1–41 (2023)
Rogers, A., Gardner, M., Augenstein, I.: QA dataset explosion: a taxonomy of NLP resources for question answering and reading comprehension. ACM Comput. Surv. 55(10), 1–45 (2023)
Yang, A., Miech, A., Sivic, J., Laptev, I., Schmid, C.: Just ask: learning to answer questions from millions of narrated videos. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1686–1697 (2021)
Gupta, D., Attal, K., Demner-Fushman, D.: A dataset for medical instructional video classification and question answering. Sci. Data 10(1), 158 (2023)
Gupta, D., Demner-Fushman, D.: Overview of the medvidqa 2022 shared task on medical video question-answering. In: Proceedings of the 21st Workshop on Biomedical Language Processing, pp. 264–274 (2022)
Li, B., Weng, Y., Sun, B., Li, S.: Towards visual-prompt temporal answering grounding in medical instructional video. arXiv preprint arXiv:2203.06667 (2022)
Weng, Y., Li, B.: Visual answer localization with cross-modal mutual knowledge transfer. In: ICASSP 2023–2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5 (2023)
Neo, S.-Y., Ran, Y., Goh, H.-K., Zheng, Y., Chua, T.-S., Li, J.: The use of topic evolution to help users browse and find answers in news video corpus. In: Proceedings of the 15th ACM International Conference on Multimedia, pp. 198–207 (2007)
Li, B., Weng, Y., Sun, B., Li, S.: Learning to locate visual answer in video corpus using question. In ICASSP 2023–2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5 (2023)
He, P., Gao, J., Chen, W.: Debertav 3: improving deberta using electra-style pre-training with gradient-disentangled embedding sharing. arXiv preprint arXiv:2111.09543 (2021)
Lijun, W., et al.: R-drop: regularized dropout for neural networks. Adv. Neural. Inf. Process. Syst. 34, 10890–10905 (2021)
Brown, T., et al.: Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 33, 1877–1901 (2020)
Liu, Y., et al.: Roberta: a robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)
Gupta, H., Jin, K.H., Nguyen, H.Q., McCann, M.T., Unser, M.: CNN-based projected gradient descent for consistent ct image reconstruction. IEEE Trans. Med. Imaging 37(6), 1440–1453 (2018)
He, P., Liu, X., Gao, J., Chen, W.: Deberta: decoding-enhanced bert with disentangled attention. arXiv preprint arXiv:2006.03654 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, B. et al. (2023). Overview of the NLPCC 2023 Shared Task: Chinese Medical Instructional Video Question Answering. In: Liu, F., Duan, N., Xu, Q., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2023. Lecture Notes in Computer Science(), vol 14304. Springer, Cham. https://doi.org/10.1007/978-3-031-44699-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-44699-3_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44698-6
Online ISBN: 978-3-031-44699-3
eBook Packages: Computer ScienceComputer Science (R0)