[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content

HRCR: Hidden Markov-Based Reinforcement to Reduce Churn in Question Answering Forums

  • Conference paper
  • First Online:
PRICAI 2019: Trends in Artificial Intelligence (PRICAI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11670))

Included in the following conference series:

Abstract

The high rate of churning users who abandon the Community Question Answering forums (CQAs) may be one of the crucial issues that hinder their development. More personalized question recommendation to users might help to manage this problem better. In this paper, we propose a new algorithm (we name HRCR) that recommends questions to users such to reduce their churning probability. We present our algorithm in a two-fold structure: First, we use Hidden Markov Models (HMMs) to uncover the users’ engagement states inside a CQA. Second, we apply a Reinforcement Learning Model (RL) to recommend users the questions that match better with their engagement mood and thus help them get into a better engagement state (the one with the least churning probability). Experiments on a large-scale offline dataset from Stack Overflow show a meaningful reduction in the churning probability of the users who comply with HRCR’s question recommendations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 35.99
Price includes VAT (United Kingdom)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 44.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://stackoverflow.com/.

  2. 2.

    https://archive.org/details/stackexchange.

References

  1. Akaike, H.: A new look at the statistical model identification. IEEE Trans. Autom. Control 19(6), 716–723 (1974)

    Article  MathSciNet  Google Scholar 

  2. Bosu, A., Corley, C.S., Heaton, D., Chatterji, D., Carver, J.C., Kraft, N.A.: Building reputation in stackoverflow: an empirical investigation. In: 2013 10th Working Conference on Mining Software Repositories (MSR), pp. 89–92. IEEE (2013)

    Google Scholar 

  3. Brown, M.B., Forsythe, A.B.: Robust tests for the equality of variances. J. Am. Stat. Assoc. 69(346), 364–367 (1974)

    Article  Google Scholar 

  4. Chang, S., Pal, A.: Routing questions for collaborative answering in community question answering. In: 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013), pp. 494–501. IEEE (2013)

    Google Scholar 

  5. Chen, S.S., Gopinath, R.A.: Model selection in acoustic modeling. In: Sixth European Conference on Speech Communication and Technology (1999)

    Google Scholar 

  6. Choi, S., Ha, H., Hwang, U., Kim, C., Ha, J.W., Yoon, S.: Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:1801.05532 (2018)

  7. Christopher, M.B.: Pattern Recognition and Machine Learning, vol. 1. Springer, New York (2016)

    Google Scholar 

  8. Csikszentmihalyi, M.: Beyond Boredom and Anxiety. Josseybass, San Francisco. Well-Being: The Foundations of Hedonic Psychology, pp. 134–154 (1975)

    Google Scholar 

  9. Dror, G., Koren, Y., Maarek, Y., Szpektor, I.: I want to answer; who has a question?: Yahoo! answers recommender system. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1109–1117. ACM (2011)

    Google Scholar 

  10. Dror, G., Pelleg, D., Rokhlenko, O., Szpektor, I.: Churn prediction in new users of Yahoo! answers. In: Proceedings of the 21st International Conference on World Wide Web, pp. 829–834. ACM (2012)

    Google Scholar 

  11. Karnstedt, M., Hennessy, T., Chan, J., Hayes, C.: Churn in social networks: a discussion boards case study. In: 2010 IEEE Second International Conference on Social Computing, pp. 233–240. IEEE (2010)

    Google Scholar 

  12. Li, C., Biswas, G.: A Bayesian approach to temporal data clustering using hidden Markov models. In: ICML, pp. 543–550 (2000)

    Google Scholar 

  13. Movshovitz-Attias, D., Movshovitz-Attias, Y., Steenkiste, P., Faloutsos, C.: Analysis of the reputation system and user contributions on a question answering website: stackoverflow. In: Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 886–893. ACM (2013)

    Google Scholar 

  14. Nakamura, J., Csikszentmihalyi, M.: Flow theory and research. In: Handbook of Positive Psychology, pp. 195–206 (2009)

    Google Scholar 

  15. Oliveira, N., Muller, M., Andrade, N., Reinecke, K.: The exchange in stackexchange: divergences between stack overflow and its culturally diverse participants. Proc. ACM Hum.-Comput. Interact. 2(CSCW), 130 (2018)

    Article  Google Scholar 

  16. Pudipeddi, J.S., Akoglu, L., Tong, H.: User churn in focused question answering sites: characterizations and prediction. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 469–474. ACM (2014)

    Google Scholar 

  17. Rabiner, L.R., Juang, B.H.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)

    Article  Google Scholar 

  18. San Pedro, J., Karatzoglou, A.: Question recommendation for collaborative question answering systems with RankSLDA. In: Proceedings of the 8th ACM Conference on Recommender Systems, pp. 193–200. ACM (2014)

    Google Scholar 

  19. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, vol. 1. MIT Press, Cambridge (1998)

    MATH  Google Scholar 

  20. Tang, X., Chen, Y., Li, X., Liu, J., Ying, Z.: A reinforcement learning approach to personalized learning recommendation systems. Br. J. Math. Stat. Psychol. 72(1), 108–135 (2019)

    Article  Google Scholar 

  21. Trimponias, G., Ma, X., Yang, Q.: Rating worker skills and task strains in collaborative crowd computing: a competitive perspective. In: The World Wide Web Conference, pp. 1853–1863. ACM (2019)

    Google Scholar 

  22. Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992)

    MATH  Google Scholar 

  23. Yuan, S., Zhang, Y., Tang, J., Hall, W., Cabotà, J.B.: Expert finding in community question answering: a review. Artif. Intell. Rev. 52, 1–32 (2019)

    Article  Google Scholar 

  24. Zhang, J., Ackerman, M.S., Adamic, L.: Expertise networks in online communities: structure and algorithms. In: Proceedings of the 16th International Conference on World Wide Web, pp. 221–230. ACM (2007)

    Google Scholar 

  25. Zheng, L., Chen, L.: Mutual benefit aware task assignment in a bipartite labor market. In: 2016 IEEE 32nd International Conference on Data Engineering (ICDE). pp. 73–84. IEEE (2016)

    Google Scholar 

Download references

Acknowledgement

This research has been supported in part by project 16214817 from the Research Grants Council of Hong Kong and the 5GEAR project from the Academy of Finland. We would like to also thank our reviewers and Mr. Young D. Kwon for their valuable comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Reza Hadi Mogavi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mogavi, R.H., Gujar, S., Ma, X., Hui, P. (2019). HRCR: Hidden Markov-Based Reinforcement to Reduce Churn in Question Answering Forums. In: Nayak, A., Sharma, A. (eds) PRICAI 2019: Trends in Artificial Intelligence. PRICAI 2019. Lecture Notes in Computer Science(), vol 11670. Springer, Cham. https://doi.org/10.1007/978-3-030-29908-8_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29908-8_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29907-1

  • Online ISBN: 978-3-030-29908-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics