[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3289600.3290977acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Gated Attentive-Autoencoder for Content-Aware Recommendation

Published: 30 January 2019 Publication History

Abstract

The rapid growth of Internet services and mobile devices provides an excellent opportunity to satisfy the strong demand for the personalized item or product recommendation. However, with the tremendous increase of users and items, personalized recommender systems still face several challenging problems: (1) the hardness of exploiting sparse implicit feedback; (2) the difficulty of combining heterogeneous data. To cope with these challenges, we propose a gated attentive-autoencoder (GATE) model, which is capable of learning fused hidden representations of items' contents and binary ratings, through a neural gating structure. Based on the fused representations, our model exploits neighboring relations between items to help infer users' preferences. In particular, a word-level and a neighbor-level attention module are integrated with the autoencoder. The word-level attention learns the item hidden representations from items' word sequences, while favoring informative words by assigning larger attention weights. The neighbor-level attention learns the hidden representation of an item's neighborhood by considering its neighbors in a weighted manner. We extensively evaluate our model with several state-of-the-art methods and different validation metrics on four real-world datasets. The experimental results not only demonstrate the effectiveness of our model on top-N recommendation but also provide interpretable results attributed to the attention modules.

References

[1]
Immanuel Bayer, Xiangnan He, Bhargav Kanagal, and Steffen Rendle. 2017. A Generic Coordinate Descent Framework for Learning from Implicit Feedback. In WWW. ACM, 1341--1350.
[2]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural Attentional Rating Regression with Review-level Explanations. In WWW. ACM, 1583--1592.
[3]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat- Seng Chua. 2017. Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In SIGIR. ACM, 335--344.
[4]
Tianqi Chen, Weinan Zhang, Qiuxia Lu, Kailong Chen, Zhao Zheng, and Yong Yu. 2012. SVDFeature: a toolkit for feature-based collaborative filtering. Journal of Machine Learning Research 13 (2012), 3619--3622.
[5]
Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In EMNLP. ACL, 1724--1734.
[6]
Yuyun Gong and Qi Zhang. 2016. Hashtag Recommendation Using Attention- Based Convolutional Neural Network. In IJCAI. IJCAI/AAAI Press, 2782--2788.
[7]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction. In IJCAI. ijcai.org, 1725--1731.
[8]
F. Maxwell Harper and Joseph A. Konstan. 2016. The MovieLens Datasets: History and Context. TiiS 5, 4 (2016), 19:1--19:19.
[9]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW. ACM, 507--517.
[10]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In WWW. ACM, 173--182.
[11]
Xiangnan He, Hanwang Zhang, Min-Yen Kan, and Tat-Seng Chua. 2016. Fast Matrix Factorization for Online Recommendation with Implicit Feedback. In SIGIR. ACM, 549--558.
[12]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation 9, 8 (1997), 1735--1780.
[13]
Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge J. Belongie, and Deborah Estrin. 2017. Collaborative Metric Learning. In WWW. ACM, 193--201.
[14]
Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In ICDM. IEEE Computer Society, 263--272.
[15]
Dong Hyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional Matrix Factorization for Document Context-Aware Recommendation. In RecSys. ACM, 233--240.
[16]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980 (2014).
[17]
Quoc V. Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In ICML (JMLR Workshop and Conference Proceedings), Vol. 32. JMLR.org, 1188--1196.
[18]
Sheng Li, Jaya Kawale, and Yun Fu. 2015. Deep Collaborative Filtering via Marginalized Denoising Auto-encoder. In CIKM. ACM, 811--820.
[19]
Xiaopeng Li and James She. 2017. Collaborative Variational Autoencoder for Recommender Systems. In KDD. ACM, 305--314.
[20]
Jianxun Lian, Xiaohuan Zhou, Fuzheng Zhang, Zhongxia Chen, Xing Xie, and Guangzhong Sun. 2018. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems. In KDD. ACM, 1754--1763.
[21]
Dawen Liang, Laurent Charlin, James McInerney, and David M. Blei. 2016. Modeling User Exposure in Recommendation. In WWW. ACM, 951--961.
[22]
Zhouhan Lin, Minwei Feng, Cícero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A Structured Self-attentive Sentence Embedding. CoRR abs/1703.03130 (2017).
[23]
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. In EMNLP. The Association for Computational Linguistics, 1412--1421.
[24]
Chen Ma, Yingxue Zhang, Qinglong Wang, and Xue Liu. 2018. Point-of-Interest Recommendation: Exploiting Self-Attentive Autoencoders with Neighbor-Aware Influence. In CIKM. ACM, 697--706.
[25]
Julian J. McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: understanding rating dimensions with review text. In RecSys. ACM, 165--172.
[26]
Rong Pan, Yunhong Zhou, Bin Cao, Nathan Nan Liu, Rajan M. Lukose, Martin Scholz, and Qiang Yang. 2008. One-Class Collaborative Filtering. In ICDM. IEEE Computer Society, 502--511.
[27]
Wenjie Pei, Jie Yang, Zhu Sun, Jie Zhang, Alessandro Bozzon, and David M. J. Tax. 2017. Interacting Attention-gated Recurrent Networks for Recommendation. In CIKM. ACM, 1459--1468.
[28]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In UAI. AUAI Press, 452--461.
[29]
Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey E. Hinton. 2007. Restricted Boltzmann machines for collaborative filtering. In ICML (ACM International Conference Proceeding Series), Vol. 227. ACM, 791--798.
[30]
Badrul Munir Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In WWW. ACM, 285--295.
[31]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. AutoRec: Autoencoders Meet Collaborative Filtering. In WWW (Companion Volume). ACM, 111--112.
[32]
Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction. In RecSys. ACM, 297--305.
[33]
Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018. Multi-Pointer Co-Attention Networks for Recommendation. In KDD. ACM, 2309--2318.
[34]
Aäron van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In NIPS. 2643--2651.
[35]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In NIPS. 6000--6010.
[36]
Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles. In KDD. ACM, 448--456.
[37]
HaoWang, NaiyanWang, and Dit-Yan Yeung. 2015. Collaborative Deep Learning for Recommender Systems. In KDD. ACM, 1235--1244.
[38]
Xuejian Wang, Lantao Yu, Kan Ren, Guanyu Tao, Weinan Zhang, Yong Yu, and Jun Wang. 2017. Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors' Demonstration. In KDD. ACM, 2051--2059.
[39]
Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester. 2016. Collaborative Denoising Auto-Encoders for Top-N Recommender Systems. In WSDM. ACM, 153--162.
[40]
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron C. Courville, Ruslan Salakhutdinov, Richard S. Zemel, and Yoshua Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In ICML (JMLR Workshop and Conference Proceedings), Vol. 37. JMLR.org, 2048--2057.
[41]
Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017. Deep Matrix Factorization Models for Recommender Systems. In IJCAI. ijcai.org, 3203--3209.
[42]
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hierarchical Attention Networks for Document Classification. In HLT-NAACL. The Association for Computational Linguistics, 1480--1489.
[43]
Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, and Jiebo Luo. 2016. Image Captioning with Semantic Attention. In CVPR. IEEE Computer Society, 4651--4659.
[44]
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, andWei-Ying Ma. 2016. Collaborative Knowledge Base Embedding for Recommender Systems. In KDD. ACM, 353--362.
[45]
Yongfeng Zhang, Qingyao Ai, Xu Chen, and W. Bruce Croft. 2017. Joint Representation Learning for Top-N Recommendation with Heterogeneous Information Sources. In CIKM. ACM, 1449--1458.
[46]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation. In WSDM. ACM, 425--434.

Cited By

View all
  • (2024)Enhancing Vulnerability Prioritization in Cloud Computing Using Multi-View Representation LearningJournal of Management Information Systems10.1080/07421222.2024.237638441:3(708-743)Online publication date: 4-Sep-2024
  • (2024)Personalized EDM Subject Generation via Co-factored User-Subject EmbeddingAdvances in Knowledge Discovery and Data Mining10.1007/978-981-97-2253-2_5(55-67)Online publication date: 25-Apr-2024
  • (2023)Memory Network-Based Interpreter of User Preferences in Content-Aware Recommender SystemsACM Transactions on Intelligent Systems and Technology10.1145/362523914:6(1-28)Online publication date: 14-Nov-2023
  • Show More Cited By

Index Terms

  1. Gated Attentive-Autoencoder for Content-Aware Recommendation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WSDM '19: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining
    January 2019
    874 pages
    ISBN:9781450359405
    DOI:10.1145/3289600
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 30 January 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. attention mechanism
    2. autoencoders
    3. content-aware recommendation

    Qualifiers

    • Research-article

    Conference

    WSDM '19

    Acceptance Rates

    WSDM '19 Paper Acceptance Rate 84 of 511 submissions, 16%;
    Overall Acceptance Rate 498 of 2,863 submissions, 17%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)38
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 10 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enhancing Vulnerability Prioritization in Cloud Computing Using Multi-View Representation LearningJournal of Management Information Systems10.1080/07421222.2024.237638441:3(708-743)Online publication date: 4-Sep-2024
    • (2024)Personalized EDM Subject Generation via Co-factored User-Subject EmbeddingAdvances in Knowledge Discovery and Data Mining10.1007/978-981-97-2253-2_5(55-67)Online publication date: 25-Apr-2024
    • (2023)Memory Network-Based Interpreter of User Preferences in Content-Aware Recommender SystemsACM Transactions on Intelligent Systems and Technology10.1145/362523914:6(1-28)Online publication date: 14-Nov-2023
    • (2023)Discrete Listwise Content-aware RecommendationACM Transactions on Knowledge Discovery from Data10.1145/360933418:1(1-20)Online publication date: 10-Aug-2023
    • (2023)Asymmetrical Attention Networks Fused Autoencoder for Debiased RecommendationACM Transactions on Intelligent Systems and Technology10.1145/359649814:6(1-24)Online publication date: 14-Nov-2023
    • (2023)Graph-Augmented Co-Attention Model for Socio-Sequential RecommendationIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMC.2023.324230853:7(4039-4051)Online publication date: Jul-2023
    • (2023)Attentive Adversarial Collaborative FilteringIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMC.2023.324108353:7(4064-4076)Online publication date: Jul-2023
    • (2023)Meta Auxiliary Learning for Top-K RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.322315535:10(10857-10870)Online publication date: 1-Oct-2023
    • (2023)To Cluster or Not to Cluster: The Impact of Clustering on the Performance of Aspect-Based Collaborative FilteringIEEE Access10.1109/ACCESS.2023.327026011(41979-41994)Online publication date: 2023
    • (2023)Multi-Aspect enhanced Graph Neural Networks for recommendationNeural Networks10.1016/j.neunet.2022.10.001157(90-102)Online publication date: Jan-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media