Abstract
We summarize the state of the art in the field of distributed user interfaces (DUIs). Topics surveyed include pervasive and ubiquitous computing, migratory and migratable interfaces, plasticity and adaptivity in interaction, and applications to multi-display and multi-surface environments. Based on this survey, we then draw some general conclusions on past and current research within the field. Our purpose is to provide a solid foundation for future research in distributed user interfaces.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aquino, N., Vanderdonckt, J., Condori-Fernández, N., Tubío, Ó.D., Pastor, O.: Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering. In: Proceedings of the International Symposium on Empirical Software Engineering and Measurement. Association for Computing Machinery, New York (2010)
Baecker, R.M.: Readings in Groupware and Computer-Supported Cooperative Work. Morgan Kaufmann Publishers, San Francisco, CA (1993)
Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 537–544. ACM, New York (2003)
Balme, L., Demeure, A., Barralon, N., Coutaz, J., Calvary, G.: CAMELEON-RT: A software architecture reference model for distributed, migratable, and plastic user interfaces. In: Proceedings of the Symposium on Ambient Intelligence, Lecture Notes in Computer Science, vol. 3295, pp. 291–302. Springer, Berlin (2004)
Bandelloni, R., Paterno, F.: Flexible interface migration. In: Proceedings of the ACM Conference on Intelligent User Interfaces, pp. 148–155. Association for Computing Machinery, New York (2004)
Baudisch, P., Cutrell, E., Hinckley, K., Gruen, R.: Mouse ether: accelerating the acquisition of targets across multi-monitor displays. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1379–1382. ACM Press, New York (2004)
Benko, H., Feiner, S.: Multi-monitor mouse. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1208–1211. ACM, New York (2005)
Bharat, K.A., Cardelli, L.: Migratory applications. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 133–142. Association for Computing Machinery, New Yok (1995)
Biehl, J.T., Bailey, B.P.: ARIS: an interface for application relocation in an interactive space. In: Proceedings of the Graphics Interface Conference, pp. 107–116. Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Ontario (2004)
Biehl, J.T., Bailey, B.P.: A toolset for creating iconic interfaces for interactive workspaces. In: Proceedings of IFIP INTERACT, Lecture Notes in Computer Science, vol. 3585, pp. 699–712. Springer, Berlin/New York (2005)
Biehl, J.T., Bailey, B.P.: Improving interfaces for managing applications in multiple-device environments. In: Proceedings of the ACM Conference on Advanced Visual Interfaces, pp. 35–42. ACM, New York (2006)
Biehl, J.T., Baker, W.T., Bailey, B.P., Tan, D.S., Inkpen, K.M., Czerwinski, M.: IMPROMPTU: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 939–948. ACM, New York (2008)
Bolt, R.A.: “Put-That-There”: voice and gesture at the graphics interface. Comput. Graph. (SIGGRAPH ’80 Proceedings) 14(3), 262–270 (1980)
Booth, K.S., Fisher, B.D., Lin, C.J.R., Argue, R.: The ‘mighty mouse’ multi-screen collaboration tool. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 209–212. ACM, New York (2002)
Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003)
Coutaz, J., Balme, L., Lachenal, C., Barralon, N.: Software infrastructure for distributed migratable user interfaces. In: Proceedings of the UbiHCISys Workshop on UbiComp (2003)
Coutaz, J., Lachenal, C., Dupuy-Chessa, S.: Ontology for multi-surface interaction. In: Proceedings of IFIP INTERACT, pp. 447–454. Springer, Berlin/New York (2003)
Demeure, A., Calvary, G., Sottet, J.S., Vanderdonckt, J.: A reference model for distributed user interfaces. In: Proceedings of the International Workshop on Task Models and Diagrams for User Interface Design, pp. 79–86. ACM, New York (2005)
Demeure, A., Sottet, J.S., Calvary, G., Coutaz, J., Ganneau, V., Vanderdonckt, J.: The 4C reference model for distributed user interfaces. In: Proceedings of the International Conference on Autonomic and Autonomous Systems, pp. 61–69. IEEE Xplore, Piscataway (2008)
Dey, A.K., Ljungstrand, P., Schmidt, A.: Workshop: Distributed and disappearing user interfaces in ubiquitous computing. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 487–488. ACM, New York (2001)
Everitt, K., Shen, C., Ryall, K., Forlines, C.: MultiSpace: enabling electronic document micro-mobility in table-centric, multi-device environments. In: Proceedings of IEEE Tabletop, pp. 27–34. IEEE Computer Society Press, Los Alamitos (2006)
Feiner, S., Shamash, A.: Hybrid user interfaces: Breeding virtually bigger interfaces for physically smaller computers. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 9–17. ACM, New York (1991)
Fox, A., Johanson, B., Hanrahan, P., Winograd, T.: Integrating information appliances into an interactive workspace. IEEE Comput. Graph. Appl. 20(3), 54–65 (2000)
Graham, T.C.N., Urnes, T., Nejabi, R.: Efficient distributed implementation of semi-replicated synchronous groupware. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 1–10. ACM, New York (1996)
Grolaux, D., Roy, P.V., Vanderdonckt, J.: Migratable user interfaces: beyond migratory interfaces. In: Proceedings of the IEEE/ACM Conference on Mobile and Ubiquitous Systems, pp. 422–430. IEEE Service Center, Piscataway (2004)
Grudin, J.: Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 458–465. ACM, New York (2001)
Guimbretière, F., Stone, M.C., Winograd, T.: Fluid interaction with high-resolution wall-size displays. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 21–30. ACM, New York (2001)
Han, R., Perret, V., Naghshineh, M.: WebSplitter: A unified XML framework for multi-device collaborative web browsing. In: Proceedings of the ACM Conference on Computer-Supported Cooperative Work, pp. 221–230. Association for Computing Machinery, New York (2000)
Harrison, C.: Appropriated interaction surfaces. IEEE Comput. 43(6), 86–89 (2010)
Johanson, B., Hutchins, G., Winograd, T., Stone, M.: PointRight: experience with flexible input redirection in interactive workspaces. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 227–234. ACM, New York (2002)
Johanson, B., Winograd, T., Fox, A.: Interactive workspaces. IEEE Comput. 36(4), 99–101 (2003)
Johanson, B., Winograd, T., Fox, A.: Invisible computing: interactive workspaces. IEEE Comput. 36(4), 99–103 (2003)
Kim, K., Javed, W., Williams, C., Elmqvist, N., Irani, P.: Hugin: A framework for awareness and coordination in mixed-presence collaborative information visualization. In: Proceedings of the ACM Conference on Interactive Tabletops and Surfaces, pp. 231–240. ACM, New York (2010)
Klokmose, C.N., Beaudouin-Lafon, M.: VIGO: instrumental interaction in multi-surface environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 869–878. ACM, New York (2009)
Kobayashi, M., Igarashi, T.: Ninja cursors: using multiple cursors to assist target acquisition on large screens. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 949–958. ACM, New York (2008)
Kohtake, N., Ohsawa, R., Yonezawa, T., Matsukura, Y., Iwai, M., Takashio, K., Tokuda, H.: u-Texture: self-organizable universal panels for creating smart surroundings. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 3660, pp. 19–36. Springer, Berlin (2005)
Luyten, K., Coninx, K.: Distributed user interface elements to support smart interaction spaces. In: Proceedings the IEEE International Symposium on Multimedia, pp. 277–286. IEEE Computer Society, Los Alamitos (2005)
Melchior, J., Grolaux, D., Vanderdonckt, J., Roy, P.V.: A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications. In: Proceedings of the ACM Symposium on Engineering Interactive Computing System, pp. 69–78. Association for Computing Machinery, New York (2009)
Modahl, M., Agarwalla, B., Abowd, G.D., Ramachandran, U., Saponas, T.S.: Toward a standard ubiquitous computing framework. In: Proceedings of the Workshop on Middleware for Pervasive and Ad-hoc Computing, pp. 135–139. ACM, New York (2004)
Modahl, M., Bagrak, I., Wolenetz, M., Hutto, P.W., Ramachandran, U.: MediaBroker: an architecture for pervasive computing. In: Proceedings of the IEEE Conference on Pervasive Computing, pp. 253–262. IEEE Computer Society, Los Alamitos (2004)
Mori, G., Paternò, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Software Eng. 30(8), 507–520 (2004)
Myers, B.A., Nichols, J., Wobbrock, J.O., Miller, R.C.: Taking handheld devices to the next level. Computer 37(12), 36–43 (2004)
Myers, B.A., Stiel, H., Gargiulo, R.: Collaboration using multiple PDAs connected to a PC. In: Proceedings of the ACM Conference on Computer-Supported Cooperative Work, pp. 285–294. Association for Computing Machinery, New York (1998)
Nacenta, M.A., Aliakseyeu, D., Subramanian, S., Gutwin, C.: A comparison of techniques for multi-display reaching. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 371–380. Association for Computing Machinery, New York (2005)
Nacenta, M.A., Mandryk, R.L., Gutwin, C.: Targeting across displayless space. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 777–786. ACM, New York (2008)
Nacenta, M.A., Sakurai, S., Yamaguchi, T., Miki, Y., Itoh, Y., Kitamura, Y., Subramanian, S., Gutwin, C.: E-conic: a perspective-aware interface for multi-display environments. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 279–288. ACM, New York (2007)
Nacenta, M.A., Sallam, S., Champoux, B., Subramanian, S., Gutwin, C.: Perspective cursor: perspective-based interaction for multi-display environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 289–298. Association for Computing Machinery, New York (2006)
Pinhanez, C.: The everywhere displays projector: a device to create ubiquitous graphical interfaces. Lect. Notes Comput. Sci. 2201, 315–331 (2001)
Ponnekanti, S., Lee, B., Fox, A., Hanrahan, P., Winograd, T.: ICrafter: a service framework for ubiquitous computing environments. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 2201, pp. 56–75. Springer, Berlin (2001)
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: a unified approach to image-based modeling and spatially immersive displays. Comput. Graph. (SIGGRAPH ’98 Proceedings) 32, 179–188 (1998)
Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 31–40. Association for Computing Machinery. New York (1997)
Rekimoto, J., Saitoh, M.: Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 378–385. ACM, New York (1999)
Rekimoto, J., Ullmer, B., Oba, H.: DataTiles: a modular platform for mixed physical and graphical interactions. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 269–276. ACM, New York (2001)
Robertson, S., Wharton, C., Ashworth, C., Franzke, M.: Dual device user interface design: PDAs and interactive television. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 79–86. Association for Computing Machinery, New York (1996)
Rogers, Y., Lindley, S.E.: Collaborating around vertical and horizontal large interactive displays: which way is best? Interact. Comput. 16(6), 1133–1152 (2004)
Román, M., Hess, C., Cerqueira, R., Ranganathan, A., Campbell, R.H., Nahrstedt, K.: Gaia: A middleware infrastructure for active spaces. IEEE Pervasive Comput. 1(4), 74–83 (2002)
Shen, C., Everitt, K., Ryall, K.: UbiTable: impromptu face-to-face collaboration on horizontal interactive surfaces. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 2864, pp. 281–288. Springer, Berlin (2003)
Sousa, J.P., Garlan, D.: Aura: an architectural framework for user mobility in ubiquitous computing environments. In: Proceedings of the IEEE/IFIP Conference on Software Architecture, pp. 29–43. IEEE Computer Society, Los Alamitos (2002)
Stefik, M., Bobrow, D.G., Foster, G., Lanning, S., Tatar, D.G.: WYSIWIS revised: early experiences with multiuser interfaces. ACM Trans. Office Info. Syst. 5(2), 147–167 (1987)
Streitz, N.A., Geissler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: i-LAND: an interactive landscape for creativity and innovation. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 120–127. Addison-WesleyAssociation for Computing Machinery, Addison-Wesley, Harlow/New York (1999)
Streitz, N.A., Rexroth, P., Holmer, T.: Does ‘roomware’ matter? investigating the role of personal and public information devices and their combination in meeting room collaboration. In: Proceedings of the European Conference on Computer-Supported Cooperative Work, pp. 297–312. Kluwer Academic Publishers, Dordrecht/Boston/London (1997)
Streitz, N.A., Tandler, P., Müller-Tomfelde, C.: Human-Computer Interaction in the New Millenium, Chap. Roomware: Towards the Next Generation of Human-Computer Interaction based on an Integrated Design of Real and Virtual Worlds, pp. 553–578. Addison Wesley, Harlow (2001)
Tan, D.S., Meyers, B., Czerwinski, M.: WinCuts: manipulating arbitrary window regions for more effective use of screen space. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1525–1528. ACM, New York (2004)
Tandler, P.: Software infrastructure for ubiquitous computing environments: supporting synchronous collaboration with heterogeneous devices. Lect. Notes Comput. Sci. 2201, 96–115 (2001)
Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., Steinmetz, R.: ConnecTables: dynamic coupling of displays for the flexible creation of shared workspaces. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 11–20. ACM, New York (2001)
Terrenghi, L., Quigley, A.J., Dix, A.J.: A taxonomy for and analysis of multi-person-display ecosystems. Pers. Ubiquitous Comput. 13(8), 583–598 (2009)
Thevenin, D., Coutaz, J.: Plasticity of user interfaces: framework and research agenda. In: Proceedings of IFIP INTERACT, pp. 110–117. IOS Press, Ohmsha (1999)
Vanderdonckt, J.: Distributed user interfaces: How to distribute user interface elements across users, platforms, and environments. In: Proceedings of the International Conference on Interaccion (2010)
Vanderdonckt, J., Mendonca, H., Massó, J.P.M.: Distributed user interfaces in ambient environment. Commun. Comput. Info. Sci. 11(3), 121–130 (2008)
Vandervelpen, C., Coninx, K.: Towards model-based design support for distributed user interfaces. In: Proceedings of the Nordic Conference on Human-Computer Interaction, pp. 61–70. ACM, New York (2004)
Villanueva, P.G., Tesoriero, R., Gallud, J.: Multi-pointer and collaborative system for mobile devices. In: Proceedings of the ACM Mobile HCI Conference, pp. 435–438. ACM, New York (2010)
Wallace, J., Ha, V., Ziola, R., Inkpen, K.: Swordfish: user tailored workspaces in multi-display environments. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1487–1492. ACM, New York (2006)
Wallace, J.R., Mandryk, R.L., Inkpen, K.M.: Comparing content and input redirection in MDEs. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work, pp. 157–166. ACM, New York (2008)
Weiser, M.: The computer for the twenty-first century. Sci. Am. 3(265), 94–104 (1991)
Wellner, P.: Interacting with paper on the DigitalDesk. Commun. ACM 36(7), 86–96 (1993)
Wellner, P., Mackay, W., Gold, R.: Introduction to the special issue on computer-augmented environments: back to the real world. Commun. ACM 36(7), 24 (1993)
Wigdor, D., Jiang, H., Forlines, C., Borkin, M., Shen, C.: WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1237–1246. ACM, New York (2009)
Wilson, A., Shafer, S.: XWand: UI for intelligent spaces. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 545–552. ACM, New York (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Elmqvist, N. (2011). Distributed User Interfaces: State of the Art. In: Gallud, J., Tesoriero, R., Penichet, V. (eds) Distributed User Interfaces. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-4471-2271-5_1
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2271-5_1
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2270-8
Online ISBN: 978-1-4471-2271-5
eBook Packages: Computer ScienceComputer Science (R0)