Abstract
The study of intelligent user interfaces and user modeling and adaptation is well suited for augmenting educational visits to museums. We have defined a novel integrated framework for museum visits and claim that such a framework is essential in such a vast domain that inherently implies complex interactivity. We found that it requires a significant investment in software and hardware infrastructure, design and implementation of intelligent interfaces, and a systematic and iterative evaluation of the design and functionality of user interfaces, involving actual visitors at every stage. We defined and built a suite of interactive and user-adaptive technologies for museum visitors, which was then evaluated at the Buonconsiglio Castle in Trento, Italy: (1) animated agents that help motivate visitors and focus their attention when necessary, (2) automatically generated, adaptive video documentaries on mobile devices, and (3) automatically generated post-visit summaries that reflect the individual interests of visitors as determined by their behavior and choices during their visit. These components are supported by underlying user modeling and inference mechanisms that allow for adaptivity and personalization. Novel software infrastructure allows for agent connectivity and fusion of multiple positioning data streams in the museum space. We conducted several experiments, focusing on various aspects of PEACH. In one, conducted with 110 visitors, we found evidence that even older users are comfortable interacting with a major component of the system.
Similar content being viewed by others
References
Abowd G., Atkeson C., Hong J., Long S., Kooper R. and Pinkerton M. (1997). Cyberguide: a mobile context-aware tour guide. Wirel. Netw. 3(5): 421–433
Albertini, A., Brunelli, R., Stock, O., Zancanaro, M.: Communicating user’s focus of attention by image processing as input for a mobile museum guide. The 10th International Conference on Intelligent User Interfaces, pp. 299–301. San Diego, CA (2005)
Alfaro I., Nardon M., Pianesi F., Stock O. and Zancanaro M. (2004). Using cinematic techniques on mobile devices for cultural tourism. Inform. Technol. Tourism 7(2): 61–71
Andreatta, C., Lecca, M., Messelodi, S.: Memory-based object recognition in digital images. The 10th International Fall Workshop – Vision, Modeling, and Visualization, pp. 33–40. Erlangen, Germany (2005)
Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Sotto Voce: exploring the interplay of conversation and mobile audio spaces. In: Wixon, D. (ed.) The SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, pp. 431–438. ACM Press, New York (2002)
Arijon D. (1976). Grammar of the Film Language. Communication Arts Books. Hasting House, New York
Bares, W., Grégoire, J., Lester, J.: Realtime constraint-based cinematography for complex interactive 3d worlds. The Tenth National Conference on Innovative Applications of Artificial Intelligence, pp. 1101–1106. Madison, Wisconsin, USA (1998)
Baus J., Cheverst K. and Kray C. (2005). A survey of map-based mobile guides. In: Meng., L., Zipf, A., and Reichenbacher, T. (eds) Map-based Mobile Services – Theories, Methods and Implementations., pp 197–213. Springer, Heidelberg
Bellotti F., Berta R., Margarone M. and Gloria A. (2002). User testing a hypermedia tour guide. IEEE Pervasive Comput. 1(2): 33–41
Benelli, G., Bianchi, A., Marti, P., Not, E., Sennati, D.: HIPS: hypen-interaction within physical space. International Conference on Multimedia Computing and Systems, pp. 1075–1078. Florence, Italy (1999)
Berkovich, M., Date, J., Keeler, R., Louw, M., O’Toole, M.: Discovery point: enhancing the museum experience with technology. Conference on Human Factors in Computing Systems, pp. 994–995. Florida, USA (2003)
Berkovsky, S., Gorfinkel, A., Kuflik, T., Manevitz, L.: Case-based to content-based user model mediation. Workshop on Ubiquitous User Modeling, held in conjunction with ECAI-2006. Riva delGarda, Italy (2006)
Bohnenberger, T., Jacobs, O., Jameson, A., Aslan, I.: Decision-theoretic planning meets user requirements: enhancements and studies of an intelligent shopping guide. Pervasive computing: Third International Conference, pp. 279–196. Munich, Germany (2005)
Busetta, P., Donà, A., Nori, M.: Channeled multicast for group communications. The First International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1280–1287. Bologna, Italy (2002)
Busetta, P., Merzi, M., Rossi, S., Legras, F.: Intra-role coordination using group communication: a preliminary report. International Workshop on Agent Communication Languages and Conversation Policies, pp. 231–253. Melbourne, Australia (2003)
Butz, A.: Anymation with CATHI. The Fourteenth National Conference on Artificial Intelligence and Ninth Innovative Applications of Artificial Intelligence Conference, pp. 957–962. Providence, Rhode Island, USA (1997)
Callaway C. and Lester J. (2002). Narrative Prose Generation. Artif. Intell. 139(2): 213–252
Callaway C., Not E., Novello A., Rocchi C., Stock O. and Zancanaro M. (2005a). Automatic Cinematography and Multilingual NLG for Generating Video Documentaries. Artif. Intell. 165(1): 57–89
Callaway, C., Kuflik, T., Not, E., Novello, A., Stock, O., Zancanaro, M.: Personal reporting of a museum visit as an entrypoint to future cultural experience. The 10th International Conference on Intelligent User Interfaces, pp. 275–277. San Diego, CA (2005b)
Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a context-aware electronic tourist guide: some issues and experiences. The CHI 2000 Conference on Human factors in computing systems, pp. 17–24. The Hague, Netherlands (2000)
Cheverst K., Mitchell K. and Davies N. (1999). Design of an object model for a context sensitive tourist guide. Comput. Graph. 23(6): 883–891
Csikszentmihalyi M. (1990). Flow: The Psychology of Optimal Experience. Harper and Row, New York
Davis F.D. (1989). Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quart. 13: 319–340
Dey A., Salber D. and Abowd G. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum-Comput. Interact. J. 16(2–4): 97–166
Efstratiou, C., Friday, A., Davies, N., Cheverst, K.: A platform supporting coordinated adaptation in mobile systems. The 4th IEEE Workshop on Mobile Computing Systems and Applications, pp. 128–137. Callicoon, New York (2003)
Friedman, D.A., Feldman, Y.A.: Knowledge-based cinematography and its applications. The 16th European Conference on Artificial Intelligence, pp. 256–262. Valencia, Spain (2004)
Gena C. (2005). Methods and techniques for the evaluation of user-adaptive systems. Knowledge Eng. Rev. 20(1): 1–37
Gena C. and Torre I. (2004). The importance of adaptivity to provide on-board services. A preliminary evaluation of an adaptive tourist information service on board vehicles. Appl. Artif. Intell. 18(6): 549–580
Goren-Bar D., Graziola I., Pianesi F. and Zancanaro M. (2006). The influence of personality factors on visitor attitudes towards adaptivity dimensions for mobile museum guides. User Model. User-Adapt. Interact. 16(1): 31–62
Goren-Bar D., Graziola I., Rocchi C., Pianesi F., Stock O. and Zancanaro M. (2005). Designing and redesigning an affective interface for an adaptive museum guide. In: Tao, J., Tan, T., and Picard, R. (eds) Affective Computing and Intelligent Interaction ACII-2005 First International Conference on Affective Computing and Intelligent Interaction., pp. Beijing, China
Goren-Bar, D., Prete, M.: Report on a museum tour report. In: Maybury M., Stock O., Wahlster W. (eds.) INTETAIN 2005: First Conference on Intelligent Technologies for Interactive Entertainment, pp. 230–234. Springer, LNAI 3814
Grinter, E., Aoki, P. M., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Revisiting the visit: Understanding how technology can shape the museum visit. ACM Conference on Computer Supported Cooperative Work, pp. 146–155. New Orleans, LA (2002)
Halliday, M.A.K., Hasan, R.: Language, Context and Text: Aspects of Language in a Social-Semiotic Perspective. Deakin University Press. (1985)
Halper, N., Oliver, P.: CamPlan: A camera planning agent. The AAAI Spring Symposium Workshop on Smart Graphics, pp. 92–100. Stanford, USA (2000)
Hatala, M., Kalantari, L., Wakkary, R., Newby, K.: Ontology and rule based retrieval of sound objects in augmented audio reality system for museum visitors. The 2004 ACM Symposium on Applied computing, pp. 1045–1050. Nicosia, Cyprus (2004)
Heckmann, D., Schwartz, T., Brandherm, B., Schmitz, M.: von Wilamowitz-Moellendorff, M.: GUMO – the general user model ontology. The 10th International Conference on User Modelling, pp. 428–432. Edinburgh, UK (2005)
Höök K. (2000). Steps to take before IUIs become real. J. Interact. Comput. 12(4): 409–426
Jameson A. and Schwarzkopf E. (2002). Pros and cons of controllability: An empirical study. In: Brusilovsky, P. and Conejo, E. (eds) Adaptive Hypermedia and Adaptive Web-based Systems: AH2002., pp 193–202. Springer Verlag, Heidelberg
Karp, P., Feiner, S.: Automated presentation planning of animation using task decomposition with heuristic reasoning. Graphics Interface’93, pp. 118–127. Toronto, Ontario Canada (1993)
Katz, S., Kahanov, Y., Kashtan, N., Kuflik T., Graziola, I., Rocchi, C., Stock, O., Zancanaro, M.: Preparing personalized multimedia presentations for a mobile museum visitors guide – a methodological approach. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006, Archives & Museum Informatics, Toronto: published March 1, 2006 at http://www.archimuse.com/mw2006/papers/katz/katz.html. (2006)
Kay J., Kummerfeld B. and Lauder P. (2005a). Consistent modelling of users, devices and sensors in a ubiquitous computing environment. User Model. User-Adapt. Interact. 15(3–4): 197–234
Kay, J., Lum, A., Niu, W.: A scrutable museum tour guide system. The 2nd Workshop on Multi-User and Ubiquitous User Interfaces, Sonderforschungsbereich 378, Saarland, pp. 19–20 (2005b)
Krüger, A., Butz, A., Müller, C., Stahl, C., Wasinger, R., Steinberg, K., Dirschl, A.: The connected user interface: realizing a personal situated navigation service. The 9th International Conference on Intelligent User Interfaces, pp. 161–168. Madeira, Portugal (2004)
Krüger, A., Kruppa, M., Müller, C., Wasinger, R.: Readapting multimodal presentations to heterogenous user groups. AAAI-Workshop on Intelligent and Situation-Aware Media and Presentations, T. R. WS-02–08, AAAI Press, pp. 46–54. (2002)
Kruppa, M., Aslan, I.: Parallel presentations for heterogeneous user groups – an initial user study. In: Maybury, M., Stock O., Wahlster, W. (eds.) INTETAIN 2005: First Conference on Intelligent Technologies for Interactive Entertainment, pp. 54–63. Springer, LNAI 3814 (2005)
Kruppa, M., Krüger, A.: Concepts for a combined use of personal digitalassistants and large remote displays. Simulation und Visualisierung, pp. 349–361. Magdeburg, Germany (2003)
Long, S., Aust, D., Abowd, G., Atkeson, C.: Cyberguide: Prototyping context-aware mobile applications. Conference on Human Factors in Computing Systems, pp. 293–294. Vancouver, Canada (1996)
Malaka R. and Zipf A. (2000). DEEP MAP – Challenging IT research in the framework of a tourist information System. In: Fesenmaier, D., Klein, S. and Buhalis, D. (eds) Informaton and Communication Technologies in Tourism 2000: ENTER 2000., pp 15–27. Springer, Wien
Mann, W., Thompson, S.: Rhetorical structure theory: a theory of text organization. T. R. ISI/RS87–190, USC/ISI, Marina del Rey, CA (1987)
McCrae R.R. and John O.P. (1992). An introduction to the five-factors model and its applications. J. Personality 60: 175–215
McKeown K.R. (1985). Text Generation: Using Discourse Strategies and Focus Constraints to Generate Natural Language Text. Cambridge University Press, London, UK
Nardon, M., Pianesi, F., Zancanaro, M.: Interactive documentaries: first usability studies. The 2nd Workshop on Personalization in Future TV, Malaga, Spain, available online at: http://itv.eltrun.aueb.gr/topics/ah02tv02/ (2002)
Niederee, C., Stewart, A., Mehta, B., Hemmje, M.: A multi-dimensional, unified user model for cross-system personalization. Workshop On Environments For Personalized Information Access, pp. 34–54. Gallipoli, Italy (2004)
Norman D.A. (1998). The Invisible Computer. MIT Press, Cambridge, MA
Not E., Petrelli D., Sarini M., Stock O., Strapparava C. and Zancanaro M. (1998). Hypernavigation in the physical space: adapting presentations to the user and to the situational context. New Rev. Hypermedia Multimedia 4: 33–45
Novak T.P., Hoffman D.L. and Yung Y.F. (2000). Measuring the customer experience in on-line environments: a structural modeling approach. Marketing Science 19: 22–44
Oberlander J., O’Donnell M., Knott A. and Mellish C. (1998). Conversation in the museum: experiments in dynamic hypermedia with the intelligent labelling explorer. New Rev. Hypermedia Multimedia. 4: 11–32
Petrelli D. and Not E. (2005). User-centered design of flexible hypermedia for a mobile guide: reflections on the hyperaudio experience. User Model. User-Adapt. Interact. 15(3–4): 303–338
Popovich P.M., Hyde K.R., Zakrajsek T. and Blumer C. (1987). The development of the attitudes toward computer usage scale. Educ. Psychol. Meas. 47: 261–269
Potonniee, O.: Ubiquitous personalization: a smart card based approach. The 4th Gemplus Developer Conference, Singapore, available online at: http://www.gemplus.com/smart/rd/publications/pdf/Pot02per.pdf. (2002)
Raptis, D., Tselios, N., Avouris, N.: Context-based design of mobile applications for museums: a survey of existing practices. The 7th International Conference on Human Computer Interaction with Mobile Devices & Services, pp. 153–160. Salzburg, Austria (2005)
Reiter, E.: Has a consensus NL generation architecture appeared, and is it psycholinguistically plausible? The Seventh International Workshop on Natural Language Generation, pp. 163–170. Kennebunkport, ME (1994)
Rocchi, C., Zancanaro, M.: Adaptive Video Documentaries. The HyperText Conference, pp. 36–37. Nottingham, UK (2003).
Rocchi, C., Zancanaro, M.: Template-based adaptive video documentaries. Artifical Intelligence in Mobile Systems, pp. 79–83. Nottingham, UK (2004)
Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., Krüger, A.: The museum visit: generating seamless personalized presentations on multiple devices. The 2004 Conference on Intelligent User Interfaces, pp. 316–318. Madeira, Portugal (2004)
Rotter J.B. (1966). Generalized Expectancies for Internal Versus External Control of Reinforcement. Psychol. Monogr. 80: 1–28
Sarini, M., Strapparava, C.: Building a user model for a museum exploration and information-providing adaptive system. In: Brusilovsky, P., De Bra, P. (eds.) The 2nd Workshop on Adaptive Hypertext and Hypermedia, Report No. 98/12, CS Reports, Eindhoven University of Technology, Eindhoven, The Netherlands, pp. 63–68 (1998)
Shneiderman, B.: (1998) Eight Golden Rules for Interface Design. Designing the User Interface, 3rd edn. Addison Wesley, Reading MA
Stock, O.: The ALFRESCO Project Team.: ALFRESCO: enjoying the combination of NLP and hypermedia for information exploration. In: Maybury, M.T. (ed.) Intelligent Multimedia Interfaces, pp. 197–224. AAAI Press, Menlo Park, CA (1993)
Stokmans M.J.W. (1999). Reading attitude and its effect on leisure time reading. Poetics 26: 245–261
Totterdell P. and Boyle E. (1990). The evaluation of adaptive systems. In: Browne, D., Totterdell, P. and Norman, M. (eds) Adaptive User Interfaces., pp 161–194. Academic Press, London
van Mulken, S., André, E., Mueller, J.: The persona effect: how substantial is it. Human Computer Interaction Conference, pp. 53–58. Berlin, Germany (1998)
Want, R., Schilit, B., Adams, N., Gold, R., Petersen, K., Ellis, J., Goldberg, D., Weiser, M.: The PARCTab ubiquitous computing experiment. T.R.CSL-95–1. Xerox PARC, Palo Alto, CA (1995)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stock, O., Zancanaro, M., Busetta, P. et al. Adaptive, intelligent presentation of information for the museum visitor in PEACH. User Model User-Adap Inter 17, 257–304 (2007). https://doi.org/10.1007/s11257-007-9029-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11257-007-9029-6