Abstract
User-specific hybrid recommender systems aim at harnessing the power of multiple recommendation algorithms in a user-specific hybrid scenario. While research has previously focused on self-learning hybrid configurations, such systems are often too complex to take out of the lab and are seldom tested against real-world requirements. In this work, we describe a self-learning user-specific hybrid recommender system and assess its ability towards meeting a set of pre-defined requirements relevant to online recommendation scenarios: responsiveness, scalability, system transparency and user control. By integrating a client-server architectural design, the system was able to scale across multiple computing nodes in a very flexible way. A specific user-interface for a movie recommendation scenario is proposed to illustrate system transparency and user control possibilities, which integrate directly in the hybrid recommendation process. Finally, experiments were performed focusing both on weak and strong scaling scenarios on a high performance computing environment. Results showed performance to be limited only by the slowest integrated recommendation algorithm with very limited hybrid optimization overhead.
Similar content being viewed by others
References
Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749
Adomavicius G, Tuzhilin A (2011) Context-aware recommender systems. In: Recommender systems handbook. Springer, pp 217–253
Anand SS, Mobasher B (2003) Intelligent techniques for web personalization. In: Proceedings of the 2003 international conference on intelligent techniques for web personalization. Springer-Verlag, pp 1–36
Bao X, Bergman L, Thompson R (2009) Stacking recommendation engines with additional meta-features. In: Proceedings of the third ACM conference on recommender systems. ACM, pp 109–116
Bell RM, Koren Y, Volinsky C (2007) The bellkor solution to the netflix prize
Bellogín A (2012) Performance prediction and evaluation in recommender systems: an information retrieval perspective. Ph.D. thesis, Universidad Autonoma de Madrid
Bobadilla J, Serradilla F, Bernal J (2010) A new collaborative filtering metric that improves the behavior of recommender systems. Knowl Based Syst 23(6):520–528
Bostandjiev S, O’Donovan J, Höllerer T (2012) Tasteweights: a visual interactive hybrid recommender system. In: Proceedings of the sixth ACM conference on Recommender systems. ACM, pp 35–42
Brand M (2003) Fast online svd revisions for lightweight recommender systems. In: SDM. SIAM
Burke R (2000) Knowledge-based recommender systems. Encycl Libr Inf Syst 69(Supplement 32):175–186
Burke R (2002) Hybrid recommender systems: survey and experiments. User Model User-Adapted Interact 12(4):331–370
Chandramouli B, Levandoski JJ, Eldawy A, Mokbel MF (2011) Streamrec: a real-time recommender system. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data. ACM, pp 1243–1246
Das AS, Datar M, Garg A, Rajaram S (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on World Wide Web. ACM, pp 271–280
De Pessemier T, Vanhecke K, Dooms S, Martens L (2011) Content-based recommendation algorithms on the hadoop mapreduce framework. In: 7th International conference on web information systems and technologies (WEBIST-2011). Ghent University, Department of Information technology, pp 237–240
Dooms S, Audenaert P, Fostier J, De Pessemier T, Martens L (2013) In-memory, distributed content-based recommender system. J Intell Inf Syst:1–25
Dooms S, De Pessemier T, Martens L (2011) An online evaluation of explicit feedback mechanisms for recommender systems. In: 7th international conference on web information systems and technologies (WEBIST-2011). Ghent University, Department of Information technology, pp 391–394
Dooms S, De Pessemier T, Martens L (2013) Movietweetings: a movie rating dataset collected from twitter. In: Workshop on Crowdsourcing and human computation for recommender systems, CrowdRec at RecSys, vol 13
Dooms S, De Pessemier T, Martens L (2013) Offline optimization for user-specific hybrid recommender systems. Multimed Tools Appl:1–24
Dooms S, De Pessemier T, Verslype D, Nelis J, De Meulenaere J, Van den Broeck W, Martens L, Develder C (2013) Omus: an optimized multimedia service for the home environment. Multimed Tools Appl:1–31
Duda RO, Hart PE, Stork DG (2012) Pattern classification. Wiley
Ekstrand M, Riedl J (2012) When recommenders fail: predicting recommender failure for algorithm selection and combination. In: Proceedings 6th ACM conference recommender systems (RecSys 2012). ACM, pp 233–236
Gantner Z, Rendle S, Freudenthaler C, Schmidt-Thieme L (2011) MyMediaLite: a free recommender system library. In: Proceedings 5th ACM conference recommender systems (RecSys 2011)
Gretarsson B, O’Donovan J, Bostandjiev S, Hall C, Höllerer T (2010) Smallworlds: visualizing social recommendations. In: Computer graphics forum, vol 29. Wiley Online Library, pp 833–842
Guy I, Carmel D (2011) Social recommender systems. In: Proceedings of the 20th international conference companion on World wide web. ACM, pp 283–284
Hager G, Wellein G (2010) Introduction to high performance computing for scientists and engineers. CRC Press
Herlocker JL, Konstan JA, Borchers A, Riedl J (1999) An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. ACM, pp 230–237
Herlocker JL, Konstan JA, Riedl J (2000) Explaining collaborative filtering recommendations. In: Proceedings of the 2000 ACM conference on computer supported cooperative work. ACM, pp 241–250
Jahrer M, Töscher A, Legenstein R (2010) Combining predictions for accurate recommender systems. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 693–702
Jannach D, Zanker M, Felfernig A, Friedrich G (2010) Recommender systems: an introduction. Cambridge University Press
Jiang J, Lu J, Zhang G, Long G (2011) Scaling-up item-based collaborative filtering recommendation algorithm based on hadoop. In: 2011 IEEE World Congress on Services (SERVICES). IEEE, pp 490–497
Kille B, Albayrak S (2012) Modeling difficulty in recommender systems. In: Workshop on recommendation utility evaluation: beyond RMSE (RUE 2011), p 30
Lops P, de Gemmis M, Semeraro G (2011) Content-based recommender systems: State of the art and trends. In: Recommender systems handbook. Springer, pp 73–105
Moore AW (2001) Cross-validation for detecting and preventing overfitting. School of Computer Science Carneigie Mellon University
Nikulin V, Huang TH, Ng SK, Rathnayake SI, McLachlan GJ (2011) A very fast algorithm for matrix factorization. Stat Probab Lett 81(7):773–782
Peralta V (2007) Extraction and integration of movielens and imdb data. Tech. rep., Technical Report, Laboratoire PRiSM, Université de Versailles, France
Polikar R (2006) Ensemble based systems in decision making. IEEE Circ Syst Mag 6(3):21–45
Rendle S, Schmidt-Thieme L (2008) Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In: Proceedings of the 2008 ACM conference on recommender systems. ACM, pp 251–258
Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J (1994) Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings 1994 ACM conference computer supported cooperative work. ACM, pp 175–186
Ricci F (2010) Mobile recommender systems. Inf Technol Tour 12(3):205–231
Schafer JB, Konstan JA, Riedl J (2002) Meta-recommendation systems: user-controlled integration of diverse recommendations. In: Proceedings of the eleventh international conference on information and knowledge management. ACM, pp 43–51
Schein AI, Popescul A, Ungar LH, Pennock DM (2002) Methods and metrics for cold-start recommendations. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 253–260
Schelter S, Boden C, Markl V (2012) Scalable similarity-based neighborhood methods with mapreduce. In: Proceedings of the sixth ACM conference on recommender systems. ACM, pp 163–170
Tintarev N, Masthoff J (2007) Effective explanations of recommendations: user-centered design. In: Proceedings of the 2007 ACM conference on recommender systems. ACM, pp 153–156
Tintarev N, Masthoff J (2011) Designing and evaluating explanations for recommender systems. In: Recommender systems handbook. Springer, pp 479–510
Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques. Morgan Kaufmann
Zhao ZD, Shang MS (2010) User-based collaborative-filtering recommendation algorithms on hadoop. In: Third international conference on knowledge discovery and data mining, 2010. WKDD’10. IEEE, pp 478–481
Acknowledgments
The described research activities were funded by a PhD grant to Simon Dooms of the Agency for Innovation by Science and Technology (IWT Vlaanderen). This work was carried out using the Stevin Supercomputer Infrastructure at Ghent University, funded by Ghent University, the Hercules Foundation and the Flemish Government - department EWI.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dooms, S., De Pessemier, T. & Martens, L. Online optimization for user-specific hybrid recommender systems. Multimed Tools Appl 74, 11297–11329 (2015). https://doi.org/10.1007/s11042-014-2232-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2232-7