Abstract
Sequential recommendation aims to recommend the next item for a user to interact with by analyzing the user’s historical interaction sequences. Recent studies have utilized attribute information to enhance the performance of recommendation systems. However, these studies can not fully consider the impact of different attributes on item representations. To alleviate this problem, we propose Item Attributes Fusion based on Contrastive Learning for Sequential Recommendation (IAFCL). Specifically, we design an attribute fusion module, which assigns specific weights to various attributes through a constructed item-attribute bipartite graph. Subsequently, it performs a weighted summation of all attributes and their item embeddings to enrich the item representation. In addition, we propose a hybrid loss function that includes contrastive loss function. In constructing the contrastive loss function, we employ a new combined data augmentation strategy to enrich the diversity of contrast samples, thus enabling the model to learn more differentiated representations. Experimental results on three public datasets show that IAFCL outperforms benchmark models.
Similar content being viewed by others
Data availability
Amazon Beauty, Sports and Toys: Availability at http://jmcauley.ucsd.edu/data/amazon/.
References
Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web, pp. 811–820 (2010)
He, R., McAuley, J.: Fusing similarity models with markov chains for sparse sequential recommendation. In: 2016 IEEE 16th International Conference on Data Mining (ICDM), pp. 191–200 (2016). IEEE
Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 565–573 (2018)
Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)
Kang, W.-C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206 (2018). IEEE
Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., Jiang, P.: Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 1441–1450 (2019)
Zhang, T., Zhao, P., Liu, Y., Sheng, V.S., Xu, J., Wang, D., Liu, G., Zhou, X., : Feature-level deeper self-attention network for sequential recommendation. In: IJCAI, pp. 4320–4326 (2019)
Zhou, K., Wang, H., Zhao, W.X., Zhu, Y., Wang, S., Zhang, F., Wang, Z., Wen, J.-R.: S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 1893–1902 (2020)
Liu, C., Li, X., Cai, G., Dong, Z., Zhu, H., Shang, L.: Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 4249–4256 (2021)
Liu, H., Deng, Z., Wang, L., Peng, J., Feng, S.: Distribution-based learnable filters with side information for sequential recommendation. In: Proceedings of the 17th ACM Conference on Recommender Systems, pp. 78–88 (2023)
Yuan, F., He, X., Jiang, H., Guo, G., Xiong, J., Xu, Z., Xiong, Y.: Future data helps training: modeling future contexts for session-based recommendation. In: Proceedings of The Web Conference 2020, pp. 303–313 (2020)
Yuan, F., Karatzoglou, A., Arapakis, I., Jose, J.M., He, X.: A simple convolutional generative network for next item recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 582–590 (2019)
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)
Hidasi, B., Karatzoglou, A.: Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management, pp. 843–852 (2018)
Quadrana, M., Karatzoglou, A., Hidasi, B., Cremonesi, P.: Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 130–137 (2017)
Tan, L., Xu, J., Gong, D., Liu, F.: Recurrent attentive neural networks for sequential recommendation. In: Proceedings of the 2023 International Conference on Communication Network and Machine Learning, pp. 356–360 (2023)
Chang, J., Gao, C., Zheng, Y., Hui, Y., Niu, Y., Song, Y., Jin, D., Li, Y.: Sequential recommendation with graph neural networks. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 378–387 (2021)
Chen, H., Yeh, C.-C.M., Wang, F., Yang, H.: Graph neural transport networks with non-local attentions for recommender systems. In: Proceedings of the ACM Web Conference 2022, pp. 1955–1964 (2022)
Wang, Z., Wei, W., Cong, G., Li, X.-L., Mao, X.-L., Qiu, M.: Global context enhanced graph neural networks for session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 169–178 (2020)
Huang, Z., Sun, Z., Liu, J., Ye, Y.: Group-aware graph neural networks for sequential recommendation. Inf. Sci. 670, 120623 (2024)
Zhang, M., Wu, S., Yu, X., Liu, Q., Wang, L.: Dynamic graph neural networks for sequential recommendation. IEEE Trans. Knowl. Data Eng. 35(5), 4741–4753 (2022)
Wu, L., Li, S., Hsieh, C.-J., Sharpnack, J.: Sse-pt: sequential recommendation via personalized transformer. In: Proceedings of the 14th ACM Conference on Recommender Systems, pp. 328–337 (2020)
Yang, Y., Huang, C., Xia, L., Liang, Y., Yu, Y., Li, C.: Multi-behavior hypergraph-enhanced transformer for sequential recommendation. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 2263–2274 (2022)
Zhou, K., Yu, H., Zhao, W.X., Wen, J.-R.: Filter-enhanced mlp is all you need for sequential recommendation. In: Proceedings of the ACM Web Conference 2022, pp. 2388–2399 (2022)
Xie, X., Sun, F., Liu, Z., Wu, S., Gao, J., Zhang, J., Ding, B., Cui, B.: Contrastive learning for sequential recommendation. In: 2022 IEEE 38th International Conference on Data Engineering (ICDE), pp. 1259–1273 (2022). IEEE
Liu, Z., Chen, Y., Li, J., Yu, P., McAuley, J., Xiong, C.: Contrastive self-supervised sequential recommendation with robust augmentation. arxiv 2021. arXiv preprint arXiv:2108.06479
Chen, Y., Liu, Z., Li, J., McAuley, J., Xiong, C.: Intent contrastive learning for sequential recommendation. In: Proceedings of the ACM Web Conference 2022, pp. 2172–2182 (2022)
Zhang, Y., Yin, G., Dong, Y., Zhang, L.: Contrastive learning with frequency domain for sequential recommendation. Appl. Soft Comput. 144, 110481 (2023)
Qiu, R., Huang, Z., Yin, H.: Memory augmented multi-instance contrastive predictive coding for sequential recommendation. In: 2021 IEEE International Conference on Data Mining (ICDM), pp. 519–528 (2021). IEEE
Pasricha, R., McAuley, J.: Translation-based factorization machines for sequential recommendation. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 63–71 (2018)
He, X., Chua, T.-S.: Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 355–364 (2017)
Acknowledgements
Thanks to Professor Qin Jiwei for her help and support during the research process.
Funding
This work was supported by the Science Fund for Outstanding Youth of Xinjiang Uygur Autonomous Region under Grant No. 2021D01E14.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Ethical approval
Not applicable as this study did not involve human participants.
Additional information
Communicated by Bing-kun Bao.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
zhang, D., Qin, J., Ma, J. et al. Item attributes fusion based on contrastive learning for sequential recommendation. Multimedia Systems 30, 291 (2024). https://doi.org/10.1007/s00530-024-01486-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00530-024-01486-7