[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3331184.3331276acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

Multi-Level Matching Networks for Text Matching

Published: 18 July 2019 Publication History

Abstract

Text matching aims to establish the matching relationship between two texts. It is an important operation in some information retrieval related tasks such as question duplicate detection, question answering, and dialog systems. Bidirectional long short term memory (BiLSTM) coupled with attention mechanism has achieved state-of-the-art performance in text matching. A major limitation of existing works is that only high level contextualized word representations are utilized to obtain word level matching results without considering other levels of word representations, thus resulting in incorrect matching decisions for cases where two words with different meanings are very close in high level contextualized word representation space. Therefore, instead of making decisions utilizing single level word representations, a multi-level matching network (MMN) is proposed in this paper for text matching, which utilizes multiple levels of word representations to obtain multiple word level matching results for final text level matching decision. Experimental results on two widely used benchmarks, SNLI and Scaitail, show that the proposed MMN achieves the state-of-the-art performance.

References

[1]
Samuel R Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. 2015. A large annotated corpus for learning natural language inference. In EMNLP. 632--642.
[2]
Qian Chen, Xiaodan Zhu, Zhenhua Ling, Si Wei, Hui Jiang, and Diana Inkpen. 2017. Enhanced LSTM for Natural Language Inference. In ACL, Vol. 1. 1657--1668.
[3]
Alexis Conneau, Douwe Kiela, Holger Schwenk, Loic Barrault, and Antoine Bordes. 2017. Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. In EMNLP. 670--680.
[4]
Jingjing Gong, Xipeng Qiu, Xinchi Chen, Dong Liang, and Xuanjing Huang. 2018. Convolutional Interaction Network for Natural Language Inference. In EMNLP. 1576--1585.
[5]
Yichen Gong, Heng Luo, and Jian Zhang. 2017. Natural language inference over interaction space. ICLR .
[6]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
[7]
Tushar Khot, Ashish Sabharwal, and Peter Clark. 2018. SciTail: A textual entailment dataset from science question answering. In AAAI .
[8]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR .
[9]
Ankur P Parikh, Oscar T"ackström, Dipanjan Das, and Jakob Uszkoreit. 2016. A Decomposable Attention Model for Natural Language Inference. In EMNLP. 2249--2255.
[10]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In EMNLP. 1532--1543.
[11]
Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018a. Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference. In EMNLP .
[12]
Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018b. Hermitian Co-Attention Networks for Text Matching in Asymmetrical Domains. In IJCAI .
[13]
Nam Khanh Tran and Claudia Niedereée. 2018. Multihop Attention Networks for Question Answer Matching. In SIGIR. 325--334.
[14]
Zhiguo Wang, Wael Hamza, and Radu Florian. 2017. Bilateral multi-perspective matching for natural language sentences. In IJCAI. 4144--4150.
[15]
Liu Yang, Minghui Qiu, Chen Qu, Jiafeng Guo, Yongfeng Zhang, W Bruce Croft, Jun Huang, and Haiqing Chen. 2018. Response ranking with deep matching networks and external knowledge in information-seeking conversation systems. In SIGIR. 245--254.
[16]
Wei Emma Zhang, Quan Z Sheng, Zhejun Tang, and Wenjie Ruan. 2018. Related or Duplicate: Distinguishing Similar CQA Questions via Convolutional Neural Networks. In SIGIR. 1153--1156.

Cited By

View all
  • (2024)The Generative Generic-Field Design Method Based on Design Cognition and Knowledge ReasoningSustainability10.3390/su1622984116:22(9841)Online publication date: 12-Nov-2024
  • (2024)MATER: Bi-level matching-aggregation model for time-aware expert recommendationExpert Systems with Applications10.1016/j.eswa.2023.121576237(121576)Online publication date: Mar-2024
  • (2022)Webpage retrieval based on query by example for think tank constructionInformation Processing & Management10.1016/j.ipm.2021.10276759:1(102767)Online publication date: Jan-2022
  • Show More Cited By

Index Terms

  1. Multi-Level Matching Networks for Text Matching

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval
    July 2019
    1512 pages
    ISBN:9781450361729
    DOI:10.1145/3331184
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. attention
    2. multi-level matching network
    3. text matching

    Qualifiers

    • Short-paper

    Funding Sources

    • VCRS scholarship
    • EU Horizon 2020 Research and Innovation Programme
    • UK EPSRC

    Conference

    SIGIR '19
    Sponsor:

    Acceptance Rates

    SIGIR'19 Paper Acceptance Rate 84 of 426 submissions, 20%;
    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 21 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Generative Generic-Field Design Method Based on Design Cognition and Knowledge ReasoningSustainability10.3390/su1622984116:22(9841)Online publication date: 12-Nov-2024
    • (2024)MATER: Bi-level matching-aggregation model for time-aware expert recommendationExpert Systems with Applications10.1016/j.eswa.2023.121576237(121576)Online publication date: Mar-2024
    • (2022)Webpage retrieval based on query by example for think tank constructionInformation Processing & Management10.1016/j.ipm.2021.10276759:1(102767)Online publication date: Jan-2022
    • (2022)A lightweight semantic‐enhanced interactive network for efficient short‐text matchingJournal of the Association for Information Science and Technology10.1002/asi.2473174:2(283-300)Online publication date: 16-Dec-2022
    • (2021)Attention-Based Multi-level Network for Text Matching with Feature FusionProceedings of the 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence10.1145/3508546.3508632(1-7)Online publication date: 22-Dec-2021
    • (2021)Learning Fine-Grained Fact-Article Correspondence in Legal CasesIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2021.313099229(3694-3706)Online publication date: 26-Nov-2021
    • (2020)FILLET - Platform for Intelligent Nutrition2020 IEEE/ACS 17th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA50499.2020.9316490(1-8)Online publication date: Nov-2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media