[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3563359.3596661acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article
Open access

RECBOT: Virtual Museum navigation through a Chatbot assistant and personalized Recommendations

Published: 16 June 2023 Publication History

Abstract

The trend for digitalization of museums has been on the rise in recent years, as museums seek to make their collections and exhibitions more accessible to a wider audience. This has involved the use of technologies such as virtual and augmented reality, online exhibits, and digital archives. These digital initiatives have allowed museums to reach new audiences and provide immersive experiences that enhance visitors’ engagement with the exhibits. Following this trend, in the current work, we propose a conversational agent that assists remote visitors in accessing a museum’s collection. The proposed architecture includes a chatbot for user interaction that employs Natural Language Processing techniques for understanding the user’s input. To increase visitor engagement, a hybrid recommender system is developed that combines content-based and collaborative-filtering components. The available data is modeled in the form of a Knowledge Graph, which allows for useful insights to be extracted from it.

References

[1]
Deborah Agostino, Michela Arnaboldi, and Antonio Lampis. 2020. Italian state museums during the COVID-19 crisis: from onsite closure to online openness. Museum Management and Curatorship 35, 4 (2020), 362–372. https://doi.org/10.1080/09647775.2020.1790029
[2]
Nazakat Ali. 2020. Chatbot: A Conversational Agent employed with Named Entity Recognition Model using Artificial Neural Network. arXiv e-prints, Article arXiv:2007.04248 (June 2020), 10 pages. https://doi.org/10.48550/arXiv.2007.04248 arxiv:2007.04248 [cs.CL]
[3]
Pierre Baldi, Paolo Frasconi, and Padhraic Smyth. 2003. Modeling the Internet and the Web. Wiley Chichester.
[4]
Tom Bocklisch, Joey Faulkner, Nick Pawlowski, and Alan Nichol. 2017. Rasa: Open source language understanding and dialogue management. arXiv preprint arXiv:1712.05181 (2017), 9 pages.
[5]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Advances in Neural Information Processing Systems, C.J. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K.Q. Weinberger (Eds.). Vol. 26. Curran Associates, Inc., 9 pages. https://proceedings.neurips.cc/paper_files/paper/2013/file/1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf
[6]
Pedro JS Cardoso, João MF Rodrigues, João AR Pereira, and João DP Sardo. 2017. An object visit recommender supported in multiple visitors and museums. In Universal Access in Human–Computer Interaction. Design and Development Approaches and Methods: 11th International Conference, UAHCI 2017, Held as Part of HCI International 2017, Vancouver, BC, Canada, July 9–14, 2017, Proceedings, Part I 11. Springer, Springer International Publishing, Cham, 301–312. https://doi.org/10.1007/978-3-319-58706-6_24
[7]
Janneth Chicaiza and Priscila Valdiviezo-Diaz. 2021. A comprehensive survey of knowledge graph-based recommender systems: Technologies, development, and contributions. Information 12, 6 (2021), 232. https://doi.org/DOI = 10.3390/info12060232
[8]
Yuanfei Dai, Shiping Wang, Neal N Xiong, and Wenzhong Guo. 2020. A survey on knowledge graph embedding: Approaches, applications and benchmarks. Electronics 9, 5 (2020), 29 pages. https://doi.org/DOI = 10.3390/electronics9050750
[9]
Google 2023. Dialogflow. Google. Retrieved March 29, 2023 from https://cloud.google.com/dialogflow
[10]
Europeana Foundation 2023. Discover Europe’s digital cultural heritage. Europeana Foundation. Retrieved March 29, 2023 from https://www.europeana.eu/en
[11]
Alessio Ferrato, Carla Limongelli, Mauro Mezzini, and Giuseppe Sansonetti. 2022. The META4RS Proposal: Museum Emotion and Tracking Analysis For Recommender Systems. In Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery, 406–409. https://doi.org/10.1145/3511047.3537664
[12]
Matthew Honnibal, Ines Montani, Sofie Van Landeghem, Adriane Boyd, 2020. spaCy: Industrial-strength natural language processing in python. (2020).
[13]
Anran Jiao. 2020. An intelligent chatbot system based on entity extraction using RASA NLU and neural network. In Journal of physics: conference series, Vol. 1487. IOP Publishing, 012014. https://doi.org/10.1088/1742-6596/1487/1/012014
[14]
Stefan Kopp, Lars Gesellensetter, Nicole C Krämer, and Ipke Wachsmuth. 2005. A conversational agent as museum guide–design and evaluation of a real-world application. In Intelligent Virtual Agents: 5th International Working Conference, IVA 2005, Kos, Greece, September 12-14, 2005. Proceedings 5. Springer, 329–343. https://doi.org/10.1007/11550617_28
[15]
Laurent Lescop. 2021. Expanding Museums: new tools and concepts for mediation and virtualization. In Proceedings of the Museum Environments: Challenges and Opportunities conference 2021. HAL, Cairo, Egypt.
[16]
Olga Loboda, Julianne Nyhan, Simon Mahony, Daniela Romano, and Melissa Terras. 2019. Content-based recommender systems for heritage: Developing a personalised museum tour. In Proc. 1st International ‘Alan Turing’Conference on Decision Support and Recommender Systems. DSRS-Turing, 11–16.
[17]
Octavian-Mihai Machidon, Aleš Tavčar, Matjaž Gams, and Mihai Duguleană. 2020. CulturalERICA: A conversational agent improving the exploration of European cultural heritage. Journal of Cultural Heritage 41 (2020), 152–165. https://doi.org/10.1016/j.culher.2019.07.010
[18]
Chihiro Maehara, Kotaro Yatsugi, Daewoong Kim, and Taketoshi Ushiama. 2012. An exhibit recommendation system based on semantic networks for museum. Innovations in Intelligent Machines–2: Intelligent Paradigms and Applications 2 (2012), 131–141. https://doi.org/10.1007/978-3-642-23190-2_10
[19]
Yeo-Gyeong Noh and Jin-Hyuk Hong. 2021. Designing Reenacted Chatbots to Enhance Museum Experience. Applied Sciences 11, 16 (2021), 15 pages. https://doi.org/10.3390/app11167420
[20]
Grand View Research. 2020. Recommendation Engine Market Size, Share & Trends nalysis Report By Type (Collaborative Filtering, Hybrid Recommendation), By Deployment, By Application, By Organization, By End-use, By Region, And Segment Forecasts, 2021 - 2028. Grand View Research. Retrieved March 27, 2023 from https://www.grandviewresearch.com/industry-analysis/recommendation-engine-market-report#
[21]
S Reshmi and Kannan Balakrishnan. 2018. Enhancing inquisitiveness of chatbots through NER integration. In 2018 International Conference on Data Science and Engineering (ICDSE). IEEE, IEEE, Kochi, India, 1–5. https://doi.org/10.1109/ICDSE.2018.8527788
[22]
Tuukka Ruotsalo, Krister Haav, Antony Stoyanov, Sylvain Roche, Elena Fani, Romina Deliai, Eetu Mäkelä, Tomi Kauppinen, and Eero Hyvönen. 2013. SMARTMUSEUM: A mobile recommender system for the Web of Data. Journal of Web Semantics 20 (2013), 50–67. https://doi.org/10.1016/j.websem.2013.03.001
[23]
Giancarlo Sperlí. 2020. A deep learning based chatbot for cultural heritage. In Proceedings of the 35th Annual ACM Symposium on Applied Computing. Association for Computing Machinery, New York, NY, USA, 935–937. https://doi.org/10.1145/3341105.3374129
[24]
Aleš Tavčar, Antonya Csaba, and Eugen Valentin Butila. 2016. Recommender system for virtual assistant supported museum tours. Informatica 40, 3 (2016), 279–284.
[25]
Miguel Torres-Ruiz, Felix Mata, Roberto Zagal, Giovanni Guzmán, Rolando Quintero, and Marco Moreno-Ibarra. 2020. A recommender system to generate museum itineraries applying augmented reality and social-sensor mining techniques. Virtual Reality 24 (2020), 175–189. https://doi.org/10.1007/s10055-018-0366-z
[26]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Eric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In Proceedings of The 33rd International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 48), Maria Florina Balcan and Kilian Q. Weinberger (Eds.). PMLR, New York, New York, USA, 2071–2080. https://proceedings.mlr.press/v48/trouillon16.html
[27]
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In Proceedings of the International Conference on Learning Representations (ICLR) 2015 (proceedings of the international conference on learning representations (iclr) 2015 ed.). ICLR, 12 pages. https://www.microsoft.com/en-us/research/publication/embedding-entities-and-relations-for-learning-and-inference-in-knowledge-bases/

Cited By

View all
  • (2024)CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive ExperiencesAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664874(102-105)Online publication date: 27-Jun-2024
  • (2024)VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642235(1-20)Online publication date: 11-May-2024
  • (2024)Frankenstein's Monster in the Metaverse: User Interaction With Customized Virtual AgentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345620530:11(7162-7171)Online publication date: Nov-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UMAP '23 Adjunct: Adjunct Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization
June 2023
446 pages
ISBN:9781450398916
DOI:10.1145/3563359
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Natural Language Processing
  2. chatbot
  3. conversational agent
  4. online museum
  5. recommender system
  6. virtual tour

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • GSRT (General Secreteriat for Reserach and Innovation)

Conference

UMAP '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)593
  • Downloads (Last 6 weeks)71
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive ExperiencesAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664874(102-105)Online publication date: 27-Jun-2024
  • (2024)VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642235(1-20)Online publication date: 11-May-2024
  • (2024)Frankenstein's Monster in the Metaverse: User Interaction With Customized Virtual AgentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345620530:11(7162-7171)Online publication date: Nov-2024
  • (2024)Custom Named Entity Recognition VS ChatGPT Prompting: A Paleontology Experiment2024 Panhellenic Conference on Electronics & Telecommunications (PACET)10.1109/PACET60398.2024.10497008(1-5)Online publication date: 28-Mar-2024
  • (2024)Multimodal Supported Chatbot Framework for People with Aphasia2024 Moratuwa Engineering Research Conference (MERCon)10.1109/MERCon63886.2024.10689068(566-571)Online publication date: 8-Aug-2024
  • (2024)eXtended Reality Services for Outdoor Cultural Spaces: System Design and Evaluation Framework Using Unbiased Biometric Data2024 15th International Conference on Information, Intelligence, Systems & Applications (IISA)10.1109/IISA62523.2024.10786698(1-8)Online publication date: 17-Jul-2024
  • (2024)Human-Centric Virtual Museum: Redefining the Museum Experience Through Immersive and Interactive EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2408861(1-12)Online publication date: 14-Oct-2024
  • (2024)Educating with Artificial Intelligence, Educating for Artificial Intelligence: Role, Impacts, and Possibilities in the Phygital ScenarioProceedings of the 2nd International and Interdisciplinary Conference on Digital Environments for Education, Arts and Heritage10.1007/978-3-031-73823-4_10(84-92)Online publication date: 30-Nov-2024
  • (2023)Novel Museum Digitalization Framework: The Use Case of Athens Museum of Paleontology and Geology2023 14th International Conference on Information, Intelligence, Systems & Applications (IISA)10.1109/IISA59645.2023.10345932(1-7)Online publication date: 10-Jul-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media