[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3633637.3633711acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

Multi-perspective Text Matching Algorithm Based on Multi-granularity Feature Convolution

Published: 28 February 2024 Publication History

Abstract

The core of Chinese text matching task lies in mining the deep semantic information inside the text, exploring the semantic similarities and differences between different texts, and then analyzing the semantic similarity between two texts to be matched. To address the problems of single text granularity feature, insufficient capture of potential semantic information at multiple granularities and weak interactive matching of coding features in Chinese text matching, we propose a multi-perspective text matching model based on multi-granularity features convolution (MpmMfc). The model first extracts characters, words and associated phrases by multi-pattern partitioning and performs initial encoding, then uses a two-way gate loop control unit to initially extract the contextual semantic information in the encoding. Then a multi-grain size high-dimensional encoding matrix is constructed and convolutional neural network is used to capture the granularity features to improve the characterization of multi-granularity semantic information. Finally, the multi-granularity convolutional matrices of two texts are cross-cosine matched by multi-perspective matching patterns to enhance the interaction strength of multi-granularity feature information. The results achieved in the experiments of LCQMC, a spoken expression class dataset, and BQ, a financial class dataset, are better than the currently available non-BERT type text matching models.

References

[1]
Fan Y, Pang L, Hou J P, Matchzoo: A toolkit for deep text matching[J]. arXiv preprint arXiv:1707.07270, 2017.
[2]
Yao YJ, A Review of Intelligent Q&A Systems Based on Deep Learning[J]. Computer System Applications. 2023, 32(04), 1-15.
[3]
Li K, Research on information retrieval technology based on deep learning[D]. University of Electronic Science and Technology, 2021.
[4]
Shen Y, He X, Gao J, A Latent Semantic Model with Convolutional-pooling Structure for Information Retrieval[C]. Proceedings of the 23rd ACM International Conference on Information and Knowledge Management. ACM, 2014: 101-110.
[5]
Hu B, Lu Z, Li H, Convolutional Neural Network Architectures for Matching Natural Language Sentences[C]. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS). ACM, 2014: 2042-2050.
[6]
Wan S, Lan Y, Guo J, A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations[C]. Proceedings of the AAAI Conference on Artificial Intelligence. AAAI, 2016: 2835-2841.
[7]
Mueller J, Thyagarajan A. Siamese Recurrent Architectures for Learning Sentence Similarity[C]. Proceedings of the AAAI Conference on Artificial Intelligence. AAAI, 2016: 2786-2792.
[8]
Nie Y, Bansal M. Shortcut-stacked Sentence Encoders for Multi-domain inference[C]. Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP (RepEval). ACL, 2017: 41-45.
[9]
Zhang X, Lu W, Pan Y, Empirical Study on Tangent Loss Function for Classification with Deep Neural Networks[J]. Computers & Electrical Engineering. 2021, 90(1): 107000.
[10]
Wang S, Liang D, Song J, DABERT: Dual Attention Enhanced BERT for Semantic Matching[C]. Proceedings of the 29th International Conference on Computational Linguistics (COLING). ACL, 2022: 1645-1654.
[11]
Jiang W, Lu J, Liang T, BERTBooster: A Knowledge Enhancement Method Jointing Incremental Training and Gradient Optimization[J]. International Journal of Intelligent Systems (IJIS). 2022, 37(11): 9390-9403.
[12]
Zhang X, Lu W, Zhang G, Chinese Sentence Semantic Matching Based on Multi-granularity Fusion Model[C]. Advances in Knowledge Discovery and Data Mining: 24th Pacific-Asia Conference (PAKDD). Springer, 2020: 246-257.
[13]
Lu W, Zhao P, Li Y, Chinese Sentence Semantic Matching Based on Multi-level Relevance Extraction and Aggregation for Intelligent Human–robot Interaction[J]. Applied Soft Computing. 2022, 131(1): 109795.
[14]
Liu P, Qiu X, Chen J, Deep Fusion Lstms for Text Semantic Matching[C]. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. ACL, 2016: 1034-1043.
[15]
Chen L, Lan Y, Pang L, RI-match: Integrating Both Representations and Interactions for Deep Semantic Matching[C]. Information Retrieval Technology: 14th Asia Information Retrieval Societies Conference (AIRS). Springer, 2018: 90-102.
[16]
Ranasinghe T, Orǎsan C, Mitkov R. Semantic Textual Similarity with Siamese Neural Networks[C]. Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP). ACL, 2019: 1004-1011.
[17]
Shi H, Wang C, Sakai T. A Siamese CNN Architecture for Learning Chinese Sentence Similarity[C]. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop (AACL/IJCNLP). ACL, 2020: 24-29.
[18]
Lu W, Yu R, Wang S, Sentence Semantic Matching Based on 3D CNN for Human–robot Language Interaction[J]. ACM Transactions on Internet Technology (TOIT). ACM, 2021, 21(4): 1-24.
[19]
Yu R, Lu W, Li Y, Sentence Semantic Matching with Hierarchical CNN Based on Dimension-Augmented Representation[C]. 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 2021: 1-8.
[20]
Yu R, Lu W, Lu H, Sentence Pair Modeling Based on Semantic Feature Map for Human Interaction with IoT Devices[J]. International Journal of Machine Learning and Cybernetics (JMLC). 2021, 12(11): 3081-3099.
[21]
Zhang X, Lei F, Yu S. Self-attention Based Text Matching Model with Generative Pre-training[C]. 2021 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech). IEEE, 2021: 84-91.
[22]
Ye W, Liu Y, Zou L, Fast Semantic Matching Via Flexible Contextualized Interaction[C]. Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (WSDM). ACM, 2022: 1275-1283.
[23]
Zhao P, Lu W, Li Y, Chinese Semantic Matching with Multi-granularity Alignment and Feature Fusion[C], 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 2021: 1-8.
[24]
Zhao P, Lu W, Wang S, Multi-granularity Interaction Model Based on Pinyins and Radicals for Chinese Semantic Matching[J]. World Wide Web. 2022, 25(4): 1703-1723.
[25]
Xu C, Xu J, Dong Z, Semantic Sentence Matching via Interacting Syntax Graphs[C]. Proceedings of the 29th International Conference on Computational Linguistics (ICCL). ACL, 2022: 938-949.
[26]
He T, Huang W, Qiao Y, Text-attentional Convolutional Neural Network for Scene Text Detection[J]. IEEE transactions on image processing. 2016, 25(6): 2529-2541
[27]
Lai Y, Feng Y, Yu X, Lattice Cnns for Matching Based Chinese Question Answering[C]. Proceedings of the AAAI Conference on Artificial Intelligence. AAAI, 2019, 33(01): 6634-6641.
[28]
Wang Z, Hamza W, Florian R. Bilateral Multi-perspective Matching for Natural Language Sentences[C]. Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI). 2017: 4144-4150.
[29]
Chen Q, Zhu X, Ling Z, Enhanced LSTM for Natural Language Inference[C]. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. ACL, 2017: 1657-1668.
[30]
Zhang X, Lu W, Pan Y, Empirical Study on Tangent Loss Function for Classification with Deep Neural Networks[J]. Computers & Electrical Engineering, 2021, 90(1): 107000.
[31]
Chen L, Zhao Y, Lyu B, Neural Graph Matching Networks for Chinese Short Text Matching[C]. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACL, 2020: 6152-6158.
[32]
Lu Z, Xia H, Hong W. Multi-granularity Feature Fusion Algorithm for Short Chinese Texts Based on Hierarchical Attention Networks[C]. Proceedings of the 2022 5th International Conference on Algorithms, Computing and Artificial Intelligence (ICCIA). ACM, 2022: 1-5.
[33]
Zuo Y, Peng X, Lu W, Chinese Sentence Matching with Multiple Alignments and Feature Augmentation[C]. 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, 2022: 1-8.

Index Terms

  1. Multi-perspective Text Matching Algorithm Based on Multi-granularity Feature Convolution

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '23: Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition
    October 2023
    589 pages
    ISBN:9798400707988
    DOI:10.1145/3633637
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 February 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Feature Interaction
    2. Multi-granularity Feature Convolution
    3. Multi-perspective Matching
    4. Text Matching

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • the Guilin Science and Technology Development Program
    • the Development Foundation of the 54th Research Institute of China Electronics Technology Group Corporation
    • the National Natural Science Foundation of China
    • the Development Foundation of the 7th Research Institute of China Electronics Technology Group Corporation
    • the Natural Science Foundation of Guangxi
    • the Innovation Project of GUET Graduate Education
    • the Guangxi Key Research and Development Program

    Conference

    ICCPR 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 21
      Total Downloads
    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 11 Dec 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media