[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

perCLTV: A General System for Personalized Customer Lifetime Value Prediction in Online Games

Published: 09 January 2023 Publication History

Abstract

Online games make up the largest segment of the booming global game market in terms of revenue as well as players. Unlike games that sell games at one time for profit, online games make money from in-game purchases by a large number of engaged players. Therefore, Customer Lifetime Value (CLTV) is particularly vital for game companies to improve marketing decisions and increase game revenues. Nowadays, as virtual game worlds are becoming increasingly innovative, complex, and diverse, the CLTV of massive players is highly personalized. That is, different players may have very different patterns of CLTV, especially on churn and payment. However, current solutions are inadequate in terms of personalization and thus limit predictive performance. First, most methods just attempt to address either task of CLTV, i.e., churn or payment, and only consider the personalization from one of them. Second, the correlation between churn and payment has not received enough attention and its personalization has not been fully explored yet. Last, most solutions around this line are conducted based on historical data where the evaluation is not convincing enough without real-world tests. To tackle these problems, we propose a general system to predict personalized customer lifetime value in online games, named perCLTV. To be specific, we revisit the personalized CLTV prediction problem from the two sub-tasks of churn prediction and payment prediction in a sequential gated multi-task learning fashion. On this basis, we develop a generalized framework to model CLTV across games in distinct genres by heterogeneous player behavior data, including individual behavior sequential data and social behavior graph data. Comprehensive experiments on three real-world datasets validate the effectiveness and rationality of perCLTV, which significantly outperforms other baseline methods. Our work has been implemented and deployed in many online games released from NetEase Games. Online A/B testing in production shows that perCLTV achieves a prominent improvement in two precision marketing applications of popup recommendation and churn intervention.

References

[1]
Eman AboElHamd, Hamed M. Shamma, and Mohamed Saleh. 2019. Dynamic programming models for maximizing customer lifetime value: An overview. In Proceedings of SAI Intelligent Systems Conference. Springer, 419–445.
[2]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the International Conference on Learning Representations (ICLR’15).
[3]
Shaojie Bai, J. Zico Kolter, and Vladlen Koltun. 2018. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271. Retrieved from https://arxiv.org/abs/1803.01271.
[4]
Valerio Bonometti, Charles Ringer, Mark Hall, Alex R. Wade, and Anders Drachen. 2019. Modelling early user-game interactions for joint estimation of survival time and churn probability. In Proceedings of the IEEE Conference on Games (CoG’19). IEEE, 1–8.
[5]
Paolo Burelli. 2019. Predicting customer lifetime value in free-to-play games. In Data Anal. Appli. Gam. Entertain. Auerbach Publications, 79–107. https://www.taylorfrancis.com/chapters/edit/10.1201/9780429286490-5/predicting-customer-lifetime-value-free-play-games-paolo-burelli.
[6]
Hongyun Cai, Vincent W. Zheng, and Kevin Chen-Chuan Chang. 2018. A comprehensive survey of graph embedding: Problems, techniques, and applications. IEEE Trans. Knowl. Data Eng. 30, 9 (2018), 1616–1637.
[7]
Benjamin Paul Chamberlain, Angelo Cardoso, C. H. Bryan Liu, Roberto Pagliari, and Marc Peter Deisenroth. 2017. Customer lifetime value prediction using embeddings. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1753–1762.
[8]
Pei Pei Chen, Anna Guitart, Ana Fernández del Río, and Africa Periánez. 2018. Customer lifetime value in video games using deep learning and parametric models. In Proceedings of the IEEE International Conference on Big Data (Big Data’18). IEEE, 2134–2140.
[9]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining. 785–794.
[10]
Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. 2018. A survey on network embedding. IEEE Trans. Knowl. Data Eng. 31, 5 (2018), 833–852.
[11]
Myriam Davidovici-Nora. 2013. Innovation in business models in the video game industry: Free-to-play or the gaming experience as a service. Computer Games J. 2, 3 (2013), 22–51.
[12]
Anders Drachen, Mari Pastor, Aron Liu, Dylan Jack Fontaine, Yuan Chang, Julian Runge, Rafet Sifa, and Diego Klabjan. 2018. To be or not to be... social: Incorporating simple social features in mobile game customer lifetime value predictions. In Proceedings of the Australasian Computer Science Week Multiconference. 1–10.
[13]
Peter S. Fader, Bruce G. S. Hardie, and Ka Lok Lee. 2005. RFM and CLV: Using iso-value curves for customer base analysis. J. Market. Res. 42, 4 (2005), 415–430.
[14]
Peter S. Fader, Bruce G. S. Hardie, and Ka Lok Lee. 2005. “Counting your customers” the easy way: An alternative to the pareto/NBD model. Market. Sci. 24, 2 (2005), 275–284.
[15]
Clive W. J. Granger. 1969. Investigating causal relations by econometric models and cross-spectral methods. Econometrica (1969), 424–438.
[16]
Lin Gui, Leng Jia, Jiyun Zhou, Ruifeng Xu, and Yulan He. 2022. Multi-task learning with mutual learning for joint sentiment classification and topic detection. IEEE Trans. Knowl. Data Eng. 34, 4 (2022), 1915–1527. https://ieeexplore.ieee.org/document/9112648.
[17]
Riccardo Guidotti, Giulio Rossetti, Luca Pappalardo, Fosca Giannotti, and Dino Pedreschi. 2018. Personalized market basket prediction with temporal annotated recurring sequences. IEEE Trans. Knowl. Data Eng. 31, 11 (2018), 2151–2163.
[18]
Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, and Qing He. 2020. A survey on knowledge graph-based recommender systems. IEEE Trans. Knowl. Data Eng. (2020), 1–1. https://ieeexplore.ieee.org/document/9216015.
[19]
Juho Hamari, Kati Alha, Simo Järvelä, J. Matias Kivikangas, Jonna Koivisto, and Janne Paavilainen. 2017. Why do players buy in-game content? An empirical study on concrete purchase motivations. Comput. Hum. Behav. 68 (2017), 538–546. https://www.sciencedirect.com/science/article/abs/pii/S0747563216307865.
[20]
Jinquan Hang, Zheng Dong, Hongke Zhao, Xin Song, Peng Wang, and Hengshu Zhu. 2022. Outside in: Market-aware heterogeneous graph neural network for employee turnover prediction. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining. 353–362.
[21]
Liang Hu, Longbing Cao, Jian Cao, Zhiping Gu, Guandong Xu, and Dingyu Yang. 2016. Learning informative priors from heterogeneous domains to improve recommendation in cold-start user domains. ACM Trans. Inf. Syst. 35, 2 (2016), 1–37.
[22]
Tomoharu Iwata, Kazumi Saito, and Takeshi Yamada. 2008. Recommendation method for improving customer lifetime value. IEEE Trans. Knowl. Data Eng. 20, 9 (2008), 1254–1263.
[23]
Hemlata Jain, Ajay Khunteta, and Sumit Srivastava. 2020. Telecom churn prediction and used techniques, datasets and performance measures: A review. Telecommun. Syst. 76, 4 (2020), 613–630. https://link.springer.com/article/10.1007/s11235-020-00727-0.
[24]
How Jing and Alexander J. Smola. 2017. Neural survival recommender. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. 515–524.
[26]
Mohammad Safari Kahreh, Mohammad Tive, Asghar Babania, and Mostafa Hesan. 2014. Analyzing the applications of customer lifetime value (CLV) based on benefit segmentation for the banking sector. Proc. Soc. Behav. Sci. 109 (2014), 590–594. https://www.sciencedirect.com/science/article/pii/S1877042813051434.
[27]
Komal Kapoor, Mingxuan Sun, Jaideep Srivastava, and Tao Ye. 2014. A hazard based approach to user return time prediction. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1719–1728.
[28]
Ali Khodadadi, Seyedabbas Hosseini, Ehsan Pajouheshgar, Farnam Mansouri, and Hamid R. Rabiee. 2022. ChOracle: A unified statistical framework for churn prediction. IEEE Trans. Knowl. Data Eng. 34, 4 (2022), 1656–1666.
[29]
Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations (ICLR’17).
[30]
Eunjo Lee, Yoonjae Jang, Du-Mim Yoon, JiHoon Jeon, Seong-il Yang, Sang-Kwang Lee, Dae-Wook Kim, Pei Pei Chen, Anna Guitart, Paul Bertens, et al. 2018. Game data mining competition on churn prediction and survival analysis using commercial game log data. IEEE Trans. Games 11, 3 (2018), 215–226.
[31]
Eunjo Lee, Boram Kim, Sungwook Kang, Byungsoo Kang, Yoonjae Jang, and Huy Kang Kim. 2018. Profit optimizing churn prediction for long-term loyal customers in online games. IEEE Trans. Games 12, 1 (2018), 41–53.
[32]
Hui Li, Yanlin Wang, Ziyu Lyu, and Jieming Shi. 2022. Multi-task learning for recommendation over heterogeneous information network. IEEE Trans. Knowl. Data Eng. 34, 2 (2022), 789–802. https://ieeexplore.ieee.org/document/9051843
[33]
Shiyang Li, Xiaoyong Jin, Yao Xuan, Xiyou Zhou, Wenhu Chen, Yu-Xiang Wang, and Xifeng Yan. 2019. Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. Adv. Neur. Inf. Process. Syst. 32 (2019), 5243–5253.
[34]
Zhi Li, Hongke Zhao, Qi Liu, Zhenya Huang, Tao Mei, and Enhong Chen. 2018. Learning from history and present: Next-item recommendation via discriminatively exploiting user behaviors. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1734–1743.
[35]
Min Lin, Qiang Chen, and Shuicheng Yan. 2014. Network in network. In Proceedings of the International Conference on Learning Representations (ICLR’14).
[36]
Michal Lukasik, Kalina Bontcheva, Trevor Cohn, Arkaitz Zubiaga, Maria Liakata, and Rob Procter. 2019. Gaussian processes for rumour stance classification in social media. ACM Trans. Inf. Syst. 37, 2 (2019), 1–24.
[37]
Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1412–1421.
[38]
Will Luton. 2013. Free-to-play: Making Money from Games You Give Away. New Riders.
[39]
África Periáñez, Alain Saas, Anna Guitart, and Colin Magne. 2016. Churn prediction in mobile social games: Towards a complete assessment using survival ensembles. In Proceedings of the IEEE International Conference on Data Science and Advanced Analytics (DSAA’16). IEEE, 564–573.
[40]
Julian Runge, Peng Gao, Florent Garcin, and Boi Faltings. 2014. Churn prediction for high-value players in casual social games. In Proceedings of the IEEE Conference on Computational Intelligence and Games. IEEE, 1–8.
[41]
David C. Schmittlein, Donald G. Morrison, and Richard Colombo. 1987. Counting your customers: Who-are they and what will they do next?Manage. Sci. 33, 1 (1987), 1–24.
[42]
Eric Benjamin Seufert. 2013. Freemium Economics: Leveraging Analytics and User Segmentation to Drive Revenue. Elsevier.
[43]
Rafet Sifa, Fabian Hadiji, Julian Runge, Anders Drachen, Kristian Kersting, and Christian Bauckhage. 2015. Predicting purchase decisions in mobile free-to-play games. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 11. 79–85.
[44]
Rafet Sifa, Julian Runge, Christian Bauckhage, and Daniel Klapper. 2018. Customer lifetime value prediction in non-contractual freemium settings: Chasing high-value users using deep neural networks and SMOTE. In Proceedings of the 51st Hawaii International Conference on System Sciences.
[45]
Jianrong Tao, Linxia Gong, Changjie Fan, Longbiao Chen, Dezhi Ye, and Sha Zhao. 2019. GMTL: A GART based multi-task learning model for multi-social-temporal prediction in online games. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2841–2849.
[46]
Jianrong Tao, Jianshi Lin, Shize Zhang, Sha Zhao, Runze Wu, Changjie Fan, and Peng Cui. 2019. Mvan: Multi-view attention networks for real money trading detection in online games. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2536–2546.
[47]
Yegor Tkachenko. 2015. Autonomous CRM control via CLV approximation with deep reinforcement learning in discrete and continuous action space. arXiv:1504.01840. Retrieved from https://arxiv.org/abs/1504.01840.
[48]
Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Dengxin Dai, and Luc Van Gool. 2022. Revisiting multi-task learning in the deep learning era. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 7 (2022), 3614–3633. https://ieeexplore.ieee.org/document/9336293
[49]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.
[50]
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2017. Graph attention networks. In Proceedings of the 6th International Conference on Learning Representations (ICLR’17).
[51]
Wei Wang and Longbing Cao. 2021. Interactive sequential basket recommendation by learning basket couplings and positive/negative feedback. ACM Trans. Inf. Syst. 39, 3 (2021), 1–26.
[52]
Than Than Win and Khin Sundee Bo. 2020. Predicting customer class using customer lifetime value with random forest algorithm. In Proceedings of the International Conference on Advanced Information Technologies (ICAIT’20). IEEE, 236–241.
[53]
Hanting Xie, Sam Devlin, Daniel Kudenko, and Peter Cowling. 2015. Predicting player disengagement and first purchase with event-frequency based data representation. In Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG’15). IEEE, 230–237.
[54]
Jiarong Xu, Yifan Luo, Jianrong Tao, Changjie Fan, Zhou Zhao, and Jiangang Lu. 2020. NGUARD+ An attention-based game bot detection framework via player behavior sequences. ACM Trans. Knowl. Discov. Data 14, 6 (2020), 1–24.
[55]
Yanan Xu, Yanmin Zhu, and Jiadi Yu. 2021. Modeling multiple coexisting category-level intentions for next item recommendation. ACM Trans. Inf. Syst. 39, 3 (2021), 1–24.
[56]
Su Yan and Xiaojun Wan. 2015. Deep dependency substructure-based learning for multidocument summarization. ACM Trans. Inf. Syst. 34, 1 (2015), 1–24.
[57]
Wanshan Yang, Ting Huang, Junlin Zeng, Yan Tang, Lijun Chen, Shivakant Mishra, and Youjian Eugene Liu. 2019. Purchase prediction in free online games via survival analysis. In Proceedings of the IEEE International Conference on Big Data (Big Data’19). IEEE, 4444–4449.
[58]
Wanshan Yang, Gemeng Yang, Ting Huang, Lijun Chen, and Youjian Eugene Liu. 2018. Whales, dolphins, or minnows? Towards the player clustering in free online games based on purchasing behavior via data mining technique. In Proceedings of the IEEE International Conference on Big Data (Big Data’18). IEEE, 4101–4108.
[59]
Zijie Zeng, Jing Lin, Lin Li, Weike Pan, and Zhong Ming. 2019. Next-item recommendation via collaborative filtering with bidirectional item similarity. ACM Trans. Inf. Syst. 38, 1 (2019), 1–22.
[60]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Comput. Surv. 52, 1 (2019), 1–38.
[61]
Yu Zhang and Qiang Yang. 2021. A survey on multi-task learning. IEEE Trans. Knowl. Data Eng. (2021), 1–1. https://ieeexplore.ieee.org/document/9392366
[62]
Ziwei Zhang, Peng Cui, and Wenwu Zhu. 2020. Deep learning on graphs: A survey. IEEE Trans. Knowl. Data Eng. 34, 1 (2020), 249–270. https://ieeexplore.ieee.org/document/9039675.
[63]
Hongke Zhao, Binbin Jin, Qi Liu, Yong Ge, Enhong Chen, Xi Zhang, and Tong Xu. 2020. Voice of charity: Prospecting the donation recurrence & donor retention in crowdfunding. IEEE Trans. Knowl. Data Eng. 32, 8 (2020), 1652–1665.
[64]
Shiwei Zhao, Runze Wu, Jianrong Tao, Manhu Qu, Hao Li, and Changjie Fan. 2020. Multi-source data multi-task learning for profiling players in online games. In Proceedings of the IEEE Conference on Games (CoG’20). IEEE, 104–111.
[65]
Angyu Zheng, Liang Chen, Fenfang Xie, Jianrong Tao, Changjie Fan, and Zibin Zheng. 2020. Keep you from leaving: Churn prediction in online games. In Proceedings of the International Conference on Database Systems for Advanced Applications. Springer, 263–279.

Cited By

View all
  • (2025)Predicting the churn patterns of monetizers and non-monetizers: exploring the influence of behavioral variability in churn predictionInternet Research10.1108/INTR-05-2024-0747Online publication date: 14-Jan-2025
  • (2024)AI-based early detection to prevent user churn in MMORPGKorean Journal of Applied Statistics10.5351/KJAS.2024.37.4.52537:4(525-539)Online publication date: 31-Aug-2024
  • (2024)Skewness-aware Boosting Regression Trees for Customer Contribution Prediction in Financial Precision MarketingCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3648346(461-470)Online publication date: 13-May-2024
  • Show More Cited By

Index Terms

  1. perCLTV: A General System for Personalized Customer Lifetime Value Prediction in Online Games

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Information Systems
      ACM Transactions on Information Systems  Volume 41, Issue 1
      January 2023
      759 pages
      ISSN:1046-8188
      EISSN:1558-2868
      DOI:10.1145/3570137
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 09 January 2023
      Online AM: 23 April 2022
      Accepted: 31 March 2022
      Revised: 02 February 2022
      Received: 14 May 2021
      Published in TOIS Volume 41, Issue 1

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Personalized customer lifetime value
      2. multi-task learning
      3. churn prediction
      4. payment prediction
      5. online games

      Qualifiers

      • Research-article
      • Refereed

      Funding Sources

      • National Natural Science Foundation of China

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)467
      • Downloads (Last 6 weeks)47
      Reflects downloads up to 15 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Predicting the churn patterns of monetizers and non-monetizers: exploring the influence of behavioral variability in churn predictionInternet Research10.1108/INTR-05-2024-0747Online publication date: 14-Jan-2025
      • (2024)AI-based early detection to prevent user churn in MMORPGKorean Journal of Applied Statistics10.5351/KJAS.2024.37.4.52537:4(525-539)Online publication date: 31-Aug-2024
      • (2024)Skewness-aware Boosting Regression Trees for Customer Contribution Prediction in Financial Precision MarketingCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3648346(461-470)Online publication date: 13-May-2024
      • (2024)The MMO Economist: AI Empowers Robust, Healthy, and Sustainable P2W MMO EconomiesCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3648344(443-452)Online publication date: 13-May-2024
      • (2024)Collaborative-Enhanced Prediction of Spending on Newly Downloaded Mobile Games under Consumption UncertaintyCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3648297(10-19)Online publication date: 13-May-2024
      • (2024)Match experiences affect interest: Impacts of matchmaking and performance on churn in a competitive gameHeliyon10.1016/j.heliyon.2024.e2489110:3(e24891)Online publication date: Feb-2024
      • (2024)Data-driven preference learning methods for sorting problems with multiple temporal criteriaEuropean Journal of Operational Research10.1016/j.ejor.2024.12.020Online publication date: Dec-2024
      • (2024)Deep Learning-Based Customer Lifetime Value Prediction in Imbalanced Data Scenarios: A Case StudyAdvances in Swarm Intelligence10.1007/978-981-97-7184-4_18(209-218)Online publication date: 22-Aug-2024
      • (2023)Personal or General? A Hybrid Strategy with Multi-factors for News RecommendationACM Transactions on Information Systems10.1145/355537341:2(1-29)Online publication date: 13-Apr-2023
      • (2023)Multi-Source Multi-Label Learning for User Profiling in Online GamesIEEE Transactions on Multimedia10.1109/TMM.2022.317168325(4135-4147)Online publication date: 1-Jan-2023
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media