[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Log in

Online optimization for user-specific hybrid recommender systems

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

User-specific hybrid recommender systems aim at harnessing the power of multiple recommendation algorithms in a user-specific hybrid scenario. While research has previously focused on self-learning hybrid configurations, such systems are often too complex to take out of the lab and are seldom tested against real-world requirements. In this work, we describe a self-learning user-specific hybrid recommender system and assess its ability towards meeting a set of pre-defined requirements relevant to online recommendation scenarios: responsiveness, scalability, system transparency and user control. By integrating a client-server architectural design, the system was able to scale across multiple computing nodes in a very flexible way. A specific user-interface for a movie recommendation scenario is proposed to illustrate system transparency and user control possibilities, which integrate directly in the hybrid recommendation process. Finally, experiments were performed focusing both on weak and strong scaling scenarios on a high performance computing environment. Results showed performance to be limited only by the slowest integrated recommendation algorithm with very limited hybrid optimization overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Notes

  1. http://www.imdb.com

  2. http://www.amazon.com

  3. http://www.netflixprize.com

  4. http://www.thefilterbubble.com

  5. http://docs.python.org/2/library/xmlrpclib.html

  6. https://github.com/sidooms/Recsys-frontend

  7. http://www.ugent.be/hpc/en

  8. http://www.twitter.com

  9. http://www.mymedialite.net

  10. http://pybrain.org

References

  1. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749

    Article  Google Scholar 

  2. Adomavicius G, Tuzhilin A (2011) Context-aware recommender systems. In: Recommender systems handbook. Springer, pp 217–253

  3. Anand SS, Mobasher B (2003) Intelligent techniques for web personalization. In: Proceedings of the 2003 international conference on intelligent techniques for web personalization. Springer-Verlag, pp 1–36

  4. Bao X, Bergman L, Thompson R (2009) Stacking recommendation engines with additional meta-features. In: Proceedings of the third ACM conference on recommender systems. ACM, pp 109–116

  5. Bell RM, Koren Y, Volinsky C (2007) The bellkor solution to the netflix prize

  6. Bellogín A (2012) Performance prediction and evaluation in recommender systems: an information retrieval perspective. Ph.D. thesis, Universidad Autonoma de Madrid

  7. Bobadilla J, Serradilla F, Bernal J (2010) A new collaborative filtering metric that improves the behavior of recommender systems. Knowl Based Syst 23(6):520–528

    Article  Google Scholar 

  8. Bostandjiev S, O’Donovan J, Höllerer T (2012) Tasteweights: a visual interactive hybrid recommender system. In: Proceedings of the sixth ACM conference on Recommender systems. ACM, pp 35–42

  9. Brand M (2003) Fast online svd revisions for lightweight recommender systems. In: SDM. SIAM

  10. Burke R (2000) Knowledge-based recommender systems. Encycl Libr Inf Syst 69(Supplement 32):175–186

    Google Scholar 

  11. Burke R (2002) Hybrid recommender systems: survey and experiments. User Model User-Adapted Interact 12(4):331–370

    Article  MATH  Google Scholar 

  12. Chandramouli B, Levandoski JJ, Eldawy A, Mokbel MF (2011) Streamrec: a real-time recommender system. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data. ACM, pp 1243–1246

  13. Das AS, Datar M, Garg A, Rajaram S (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on World Wide Web. ACM, pp 271–280

  14. De Pessemier T, Vanhecke K, Dooms S, Martens L (2011) Content-based recommendation algorithms on the hadoop mapreduce framework. In: 7th International conference on web information systems and technologies (WEBIST-2011). Ghent University, Department of Information technology, pp 237–240

  15. Dooms S, Audenaert P, Fostier J, De Pessemier T, Martens L (2013) In-memory, distributed content-based recommender system. J Intell Inf Syst:1–25

  16. Dooms S, De Pessemier T, Martens L (2011) An online evaluation of explicit feedback mechanisms for recommender systems. In: 7th international conference on web information systems and technologies (WEBIST-2011). Ghent University, Department of Information technology, pp 391–394

  17. Dooms S, De Pessemier T, Martens L (2013) Movietweetings: a movie rating dataset collected from twitter. In: Workshop on Crowdsourcing and human computation for recommender systems, CrowdRec at RecSys, vol 13

  18. Dooms S, De Pessemier T, Martens L (2013) Offline optimization for user-specific hybrid recommender systems. Multimed Tools Appl:1–24

  19. Dooms S, De Pessemier T, Verslype D, Nelis J, De Meulenaere J, Van den Broeck W, Martens L, Develder C (2013) Omus: an optimized multimedia service for the home environment. Multimed Tools Appl:1–31

  20. Duda RO, Hart PE, Stork DG (2012) Pattern classification. Wiley

  21. Ekstrand M, Riedl J (2012) When recommenders fail: predicting recommender failure for algorithm selection and combination. In: Proceedings 6th ACM conference recommender systems (RecSys 2012). ACM, pp 233–236

  22. Gantner Z, Rendle S, Freudenthaler C, Schmidt-Thieme L (2011) MyMediaLite: a free recommender system library. In: Proceedings 5th ACM conference recommender systems (RecSys 2011)

  23. Gretarsson B, O’Donovan J, Bostandjiev S, Hall C, Höllerer T (2010) Smallworlds: visualizing social recommendations. In: Computer graphics forum, vol 29. Wiley Online Library, pp 833–842

  24. Guy I, Carmel D (2011) Social recommender systems. In: Proceedings of the 20th international conference companion on World wide web. ACM, pp 283–284

  25. Hager G, Wellein G (2010) Introduction to high performance computing for scientists and engineers. CRC Press

  26. Herlocker JL, Konstan JA, Borchers A, Riedl J (1999) An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. ACM, pp 230–237

  27. Herlocker JL, Konstan JA, Riedl J (2000) Explaining collaborative filtering recommendations. In: Proceedings of the 2000 ACM conference on computer supported cooperative work. ACM, pp 241–250

  28. Jahrer M, Töscher A, Legenstein R (2010) Combining predictions for accurate recommender systems. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 693–702

  29. Jannach D, Zanker M, Felfernig A, Friedrich G (2010) Recommender systems: an introduction. Cambridge University Press

  30. Jiang J, Lu J, Zhang G, Long G (2011) Scaling-up item-based collaborative filtering recommendation algorithm based on hadoop. In: 2011 IEEE World Congress on Services (SERVICES). IEEE, pp 490–497

  31. Kille B, Albayrak S (2012) Modeling difficulty in recommender systems. In: Workshop on recommendation utility evaluation: beyond RMSE (RUE 2011), p 30

  32. Lops P, de Gemmis M, Semeraro G (2011) Content-based recommender systems: State of the art and trends. In: Recommender systems handbook. Springer, pp 73–105

  33. Moore AW (2001) Cross-validation for detecting and preventing overfitting. School of Computer Science Carneigie Mellon University

  34. Nikulin V, Huang TH, Ng SK, Rathnayake SI, McLachlan GJ (2011) A very fast algorithm for matrix factorization. Stat Probab Lett 81(7):773–782

    Article  MATH  MathSciNet  Google Scholar 

  35. Peralta V (2007) Extraction and integration of movielens and imdb data. Tech. rep., Technical Report, Laboratoire PRiSM, Université de Versailles, France

  36. Polikar R (2006) Ensemble based systems in decision making. IEEE Circ Syst Mag 6(3):21–45

    Article  Google Scholar 

  37. Rendle S, Schmidt-Thieme L (2008) Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In: Proceedings of the 2008 ACM conference on recommender systems. ACM, pp 251–258

  38. Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J (1994) Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings 1994 ACM conference computer supported cooperative work. ACM, pp 175–186

  39. Ricci F (2010) Mobile recommender systems. Inf Technol Tour 12(3):205–231

    Article  Google Scholar 

  40. Schafer JB, Konstan JA, Riedl J (2002) Meta-recommendation systems: user-controlled integration of diverse recommendations. In: Proceedings of the eleventh international conference on information and knowledge management. ACM, pp 43–51

  41. Schein AI, Popescul A, Ungar LH, Pennock DM (2002) Methods and metrics for cold-start recommendations. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 253–260

  42. Schelter S, Boden C, Markl V (2012) Scalable similarity-based neighborhood methods with mapreduce. In: Proceedings of the sixth ACM conference on recommender systems. ACM, pp 163–170

  43. Tintarev N, Masthoff J (2007) Effective explanations of recommendations: user-centered design. In: Proceedings of the 2007 ACM conference on recommender systems. ACM, pp 153–156

  44. Tintarev N, Masthoff J (2011) Designing and evaluating explanations for recommender systems. In: Recommender systems handbook. Springer, pp 479–510

  45. Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques. Morgan Kaufmann

  46. Zhao ZD, Shang MS (2010) User-based collaborative-filtering recommendation algorithms on hadoop. In: Third international conference on knowledge discovery and data mining, 2010. WKDD’10. IEEE, pp 478–481

Download references

Acknowledgments

The described research activities were funded by a PhD grant to Simon Dooms of the Agency for Innovation by Science and Technology (IWT Vlaanderen). This work was carried out using the Stevin Supercomputer Infrastructure at Ghent University, funded by Ghent University, the Hercules Foundation and the Flemish Government - department EWI.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simon Dooms.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dooms, S., De Pessemier, T. & Martens, L. Online optimization for user-specific hybrid recommender systems. Multimed Tools Appl 74, 11297–11329 (2015). https://doi.org/10.1007/s11042-014-2232-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2232-7

Keywords

Navigation