[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3308558.3313587acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Multi-Domain Gated CNN for Review Helpfulness Prediction

Published: 13 May 2019 Publication History

Abstract

Consumers today face too many reviews to read when shopping online. Presenting the most helpful reviews, instead of all, to them will greatly ease purchase decision making. Most of the existing studies on review helpfulness prediction focused on domains with rich labels, not suitable for domains with insufficient labels. In response, we explore a multi-domain approach that learns domain relationships to help the task by transferring knowledge from data-rich domains to data-deficient domains. To better model domain differences, our approach gates multi-granularity embeddings in a Neural Network (NN) based transfer learning framework to reflect the domain-variant importance of words. Extensive experiments empirically demonstrate that our model outperforms the state-of-the-art baselines and NN-based methods without gating on this task. Our approach facilitates more effective knowledge transfer between domains, especially when the target domain dataset is small. Meanwhile, the domain relationship and domain-specific embedding gating are insightful and interpretable.

References

[1]
Andreas Argyriou, Theodoros Evgeniou, and Massimiliano Pontil. 2007. Multi-task feature learning. In NIPS. 41-48.
[2]
Miguel Ballesteros, Chris Dyer, and Noah A Smith. 2015. Improved transition-based parsing by modeling characters instead of words with LSTMs. arXiv:1508.00657 (2015).
[3]
John Blitzer, Ryan McDonald, and Fernando Pereira. 2006. Domain adaptation with structural correspondence learning. In EMNLP. 120-128.
[4]
Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching Word Vectors with Subword Information. CoRR abs/1607.04606(2016). http://arxiv.org/abs/1607.04606
[5]
Qing Cao, Wenjing Duan, and Qiwei Gan. 2011. Exploring determinants of voting for the “helpfulness” of online user reviews: A text mining approach. Decision Support Systems 50, 2 (2011).
[6]
Cen Chen, Yinfei Yang, Jun Zhou, Forrest Sheng Bao, and Xiaolong Li. 2018. Cross-Domain Review Helpfulness Prediction Based on Convolutional Neural Networks with Auxiliary Domain Discriminators. In NAACL.
[7]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv:1412.3555 (2014).
[8]
Cristian Danescu-Niculescu-Mizil, Gueorgi Kossinets, Jon Kleinberg, and Lillian Lee. 2009. How Opinions Are Received by Online Communities: A Case Study on Amazon.Com Helpfulness Votes. In WWW. 141-150.
[9]
Hal Daume III. 2007. Frustratingly Easy Domain Adaptation. In ACL. 256-263.
[10]
Bhuwan Dhingra, Hanxiao Liu, Zhilin Yang, William W Cohen, and Ruslan Salakhutdinov. 2016. Gated-attention readers for text comprehension. arXiv:1606.01549 (2016).
[11]
Xin Huang, Yuxin Peng, and Mingkuan Yuan. 2017. Cross-modal Common Representation Learning by Hybrid Transfer Network. CoRR abs/1706.00153(2017).
[12]
Xin Huang, Yuxin Peng, and Mingkuan Yuan. 2017. MHTN: Modal-adversarial Hybrid Transfer Network for Cross-modal Retrieval. CoRR abs/1708.04308(2017).
[13]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. EMNLP, 1746-1751.
[14]
Yoon Kim, Yacine Jernite, David Sontag, and Alexander M Rush. 2016. Character-Aware Neural Language Models. In AAAI. 41-49.
[15]
Zheng Li, Ying Wei, Yu Zhang, and Qiang Yang. 2018. Hierarchical Attention Transfer Network for Cross-Domain Sentiment Classification. In AAAI.
[16]
Bing Liu. 2012. Sentiment analysis and opinion mining. Synthesis lectures on human language technologies 5, 1(2012), 1-167.
[17]
Haijing Liu, Yang Gao, Pin Lv, Mengxue Li, Shiqiang Geng, Minglan Li, and Hao Wang. 2017. Using Argument-based Features to Predict and Analyse Review Helpfulness. In EMNLP. Copenhagen, Denmark, 1358-1363.
[18]
Pengfei Liu, Xipeng Qiu, and Xuanjing Huang. 2017. Adversarial Multi-task Learning for Text Classification. In ACL. 1-10.
[19]
Lionel Martin and Pearl Pu. 2014. Prediction of Helpful Reviews Using Emotions Extraction. In AAAI. 1551-1557.
[20]
J McAuley and J Leskovec. 2013. Hidden factors and hidden topics: understanding rating dimensions with review text. In RecSys. 165-172.
[21]
Lili Mou, Zhao Meng, Rui Yan, Ge Li, Yan Xu, Lu Zhang, and Zhi Jin. 2016. How Transferable are Neural Networks in NLP Applications?. In EMNLP. 479-489.
[22]
Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. Transactions on knowledge and data engineering 22, 10(2010), 1345-1359.
[23]
Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In EMNLP.
[24]
D.E. Rumelhart, G.E. Hintont, and R.J. Williams. 1986. Learning representations by back-propagating errors. Nature 323(1986).
[25]
Min Joon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2016. Bidirectional Attention Flow for Machine Comprehension. CoRR abs/1611.01603(2016). http://arxiv.org/abs/1611.01603
[26]
Chuanqi Tan, Furu Wei, Qingyu Zhou, Nan Yang, Bowen Du, Weifeng Lv, and Ming Zhou. 2018. Context-Aware Answer Sentence Selection With Hierarchical Gated Recurrent Neural Networks. TASLP 26, 3 (2018), 540-549.
[27]
Duyu Tang, Bing Qin, and Ting Liu. 2015. Document modeling with gated recurrent neural network for sentiment classification. In EMNLP. 1422-1432.
[28]
Chang Wang and Sridhar Mahadevan. 2008. Manifold alignment using procrustes analysis. In ICML. 1120-1127.
[29]
Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, and Ming Zhou. 2017. Gated Self-Matching Networks for Reading Comprehension and Question Answering. In ACL. 189-198.
[30]
Yinfei Yang, Cen Chen, and Forrest Sheng Bao. 2016. Aspect-Based Helpfulness Prediction for Online Product Reviews. In ICTAI.
[31]
Yinfei Yang, Yaowei Yan, Minghui Qiu, and Forrest Bao. 2015. Semantic Analysis and Helpfulness Prediction of Text for Online Product Reviews. In ACL-IJCNLP. 38-44.
[32]
Zhilin Yang, Ruslan Salakhutdinov, and William W Cohen. 2017. Transfer learning for sequence tagging with hierarchical recurrent networks. In ICLR.
[33]
Wenpeng Yin, Katharina Kann, Mo Yu, and Hinrich Schütze. 2017. Comparative Study of CNN and RNN for Natural Language Processing. CoRR abs/1702.01923(2017). arXiv:1702.01923http://arxiv.org/abs/1702.01923
[34]
Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks?. In NIPS. 3320-3328.
[35]
Jianfei Yu and Jing Jiang. 2016. Learning Sentence Embeddings with Auxiliary Tasks for Cross-Domain Sentiment Classification. In EMNLP. 236-246.
[36]
Yu Zhang and Qiang Yang. 2017. A survey on multi-task learning. arXiv:1707.08114 (2017).
[37]
Yu Zhang and Dit-Yan Yeung. 2010. A convex formulation for learning task relationships in multi-task learning. In UAI.

Cited By

View all
  • (2023)Understanding of Customer Decision-Making Behaviors Depending on Online ReviewsApplied Sciences10.3390/app1306394913:6(3949)Online publication date: 20-Mar-2023
  • (2023)Predicting the Helpfulness of Online Customer Reviews2023 International Conference on Information Technology (ICIT)10.1109/ICIT58056.2023.10225838(686-689)Online publication date: 9-Aug-2023
  • (2023)A Review Helpfulness Modeling Mechanism for Online E-commerce: Multi-Channel CNN End‑to‑End ApproachApplied Artificial Intelligence10.1080/08839514.2023.216622637:1Online publication date: 12-Jan-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '19: The World Wide Web Conference
May 2019
3620 pages
ISBN:9781450366748
DOI:10.1145/3308558
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • IW3C2: International World Wide Web Conference Committee

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Review helpfulness prediction
  2. transfer learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '19
WWW '19: The Web Conference
May 13 - 17, 2019
CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)2
Reflects downloads up to 31 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Understanding of Customer Decision-Making Behaviors Depending on Online ReviewsApplied Sciences10.3390/app1306394913:6(3949)Online publication date: 20-Mar-2023
  • (2023)Predicting the Helpfulness of Online Customer Reviews2023 International Conference on Information Technology (ICIT)10.1109/ICIT58056.2023.10225838(686-689)Online publication date: 9-Aug-2023
  • (2023)A Review Helpfulness Modeling Mechanism for Online E-commerce: Multi-Channel CNN End‑to‑End ApproachApplied Artificial Intelligence10.1080/08839514.2023.216622637:1Online publication date: 12-Jan-2023
  • (2023)D-HRSPTelematics and Informatics10.1016/j.tele.2023.10200182:COnline publication date: 1-Aug-2023
  • (2023)DMFNExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.120344228:COnline publication date: 15-Oct-2023
  • (2023)Utilizing a feature-aware external memory network for helpfulness prediction in e-commerce reviewsApplied Soft Computing10.1016/j.asoc.2023.110923148(110923)Online publication date: Nov-2023
  • (2023)Assessing the helpfulness of hotel reviews for information overload: a multi-view spatial feature approachInformation Technology & Tourism10.1007/s40558-023-00280-x26:1(59-87)Online publication date: 14-Dec-2023
  • (2022)Credit Bank Default Prediction Based on Machine Learning ApproachesProceedings of the 2022 International Conference on Bigdata Blockchain and Economy Management (ICBBEM 2022)10.2991/978-94-6463-030-5_85(859-867)Online publication date: 20-Dec-2022
  • (2022)Toward Personalized Answer Generation in E-Commerce via Multi-perspective Preference ModelingACM Transactions on Information Systems10.1145/350778240:4(1-28)Online publication date: 9-Mar-2022
  • (2022)Helpfulness Prediction for VR Application Reviews: Exploring Topic Signals for Causal Inference2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00014(17-21)Online publication date: Oct-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media