Abstract
The advantage of tangible interaction is that it allows people to interact naturally. Tabletops are a collective support which can be used by several people simultaneously. In previous work, tabletop and tangible interaction were shown to be of interest in the learning process; the previous application was based on a classification task helping very young children in the recognition and learning of colors on one tabletop. This paper concerns distribution between connected tabletops. In order to provide a supervision tool in our case, this paper proposes more generally to distribute user interfaces between interactive tabletops which use tangible interaction. A design model is proposed for this type of system and is applied to design a distributed application for children and a supervisor on two interactive tabletops. An evaluation, with twelve test groups, each composed of three participants, has involved a distributed application for the learning and recognition of colors. This study is supported by observations, trace analysis and questionnaires. In the study, we analyze if design choices, guided by the model and providing generic objects, allow the users to interact remotely, easily and understandably. The user satisfaction when using the distributed tangible tabletops is also studied. After the discussion, a conclusion and future works are proposed.
Similar content being viewed by others
Notes
Because this work focuses solely on tangible interaction without touch.
They can also be video projected onto the surface of the tabletop, as in [31].
Designed by the RFidees Company; see www.rfidees.fr.
Created using a Playmobil® figure.
During this first evaluation, the choice was to involve only adult participants and to study the impact of tangigets and distribution choices. For the adults (simulating children in our case), the main task can be considered as a classical classification task. Previous evaluation involving children on the classification task had already been validated by a previous study [32, 36].
References
Alibali, M.W., diRusso, A.A.: The function of gesture in learning to count: more than keeping track. Cognit. Dev. 14, 37–56 (1999)
Ampofo-Boateng, K., Thomson, J.A., Grieve, R., Pitcainr, T., Lee, D.N., Demetre, J.D.: A developmental and training study of childrens ability to find safe routes to cross the road. Br. J. Dev. Psychol. 11(1), 31–45 (1993)
Bangor, A., Kortum, P., Miller, J.: Determining what individual sus scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009)
Baudisch, P., Becker, T., Rudeck, F.: Lumino: Tangible blocks for tabletop computers based on glass fiber bundles. In: Proceedings of CHI 2010, pp. 1165–1174. Atlanta, GA (2010)
Bellifemine, F., Caire, G., Greenwood, D.: Developing Multi-Agent Systems with JADE. John Wiley & Sons, Hoboken (2007)
Bouabid, A., Lepreux, S., Kolski, C.: Distributed tabletops: study involving two RFID tabletops with generic tangible objects. In: S. Casteleyn, P. Dolog, C. Pautasso (eds.) Current Trends in Web Engineering, no. 9881 in Lecture Notes in Computer Science, pp. 167–173. Springer International Publishing (2016). https://doi.org/10.1007/978-3-319-46963-8_15
Branton, C., Ullmer, B., Wiggins, A., Rogge, L., Setty, N., Beck, S.D., Reeser, A.: toward rapid and iterative development of tangible, collaborative, distributed user interfaces. In: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’13, pp. 239–248. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2494603.2480312
Brave, S., Ishii, H., Dahley, A.: Tangible interfaces for remote collaboration and communication. In: Proceedings of the 1998 ACM conference on Computer Supported Cooperative Work, pp. 169–178. ACM (1998)
Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P., Thomas, B., Weerdmeester, B., McClelland, I. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor and Francis, London (1996)
Burnett, A.: Montessori education today and yesterday. Elem. Sch. J. 63(2), 71–77 (1962)
Caelen, J., Perrot, C.: Bibliothque dobjets. Tech. Rep. IMAGIT ANR project, LIG, Grenoble (2011)
Coulouris, G., Dollimore, J., Kindberg, T.: Distributed Systems: Concepts and Design Third. Addison-Wesley, Boston (2001)
Daniel, F., Soi, S., Casati, F.: Distributed user interface orchestration: on the composition of multi-user (search) applications. In: S. Ceri, M. Brambilla (eds.) Search Computing, no. 6585 in Lecture Notes in Computer Science, pp. 182–191. Springer Berlin Heidelberg (2011). https://doi.org/10.1007/978-3-642-19668-3_17
Elmqvist, N.: Distributed user interfaces: state of the art. In: Gallud, J.A., Tesoriero, R., Penichet, V.M. (eds.) Distributed User Interfaces, Human–Computer Interaction Series, pp. 1–12. Springer, London (2011)
Fitzmaurice, G.W., Ishii, H., Buxton, W.A.S.: Bricks: Laying the foundations for graspable user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’95, pp. 442–449. ACM Press/Addison-Wesley Publishing Co., New York, NY, USA (1995). https://doi.org/10.1145/223904.223964. http://dx.doi.org/https://doi.org/10.1145/223904.223964
Fyhri, A., Bjornskau, T., Ulleberg, P.: Traffic education for children with a tabletop model. Transp. Res. Part F Traffic Psychol. Behav. 7(4–5), 197–207 (2004)
Gallud, J.A., Tesoriero, R., Penichet, V.M.R. (eds.): Distributed user interfaces—designing interfaces for the distributed ecosystem. Human–Computer Interaction Series. Springer (2011)
Grolaux, D., Vanderdonckt, J., Roy, P.V.: Attach me, detach me, assemble me like you work. In: M.F. Costabile, F. Patern (eds.) Human–Computer Interaction—INTERACT 2005, no. 3585 in Lecture Notes in Computer Science, pp. 198–212. Springer Berlin Heidelberg (2005). https://doi.org/10.1007/11555261_19
de la Gua, E., Lozano, M., Penichet, V.R.: TrainAb: A solution based on tangible and distributed user interfaces to improve cognitive disabilities. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’13, pp. 3039–3042. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2468356.2479605
Hachet, M., Decle, F., Knodel, S., Guitton, P.: Navidget for 3d interaction: Camera positioning and further uses. Int. J. Hum. Comput. Stud. 67(3), 225–236 (2009)
Hariri, M., Tabary, D., Lepreux, S., Kolski, C.: Context aware business adaptation toward user interface adaptation. Commun. SIWN 3, 46–52 (2008)
Havrez, C., Lepreux, S., Lebrun, Y., Haudegond, S., Ethuin, P., Kolski, C.: A design model for tangible interaction: case study in waste sorting. In: IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design and Evaluation of Human-Machine System. Kyoto, Japan (2016)
Hodge, S., Anderson, B.: Teaching and learning with an interactive whiteboard: a teachers journey. Learn. Media and Technol. 32(3), 271–282 (2007)
Holmquist, L.E., Redstrm, J., Ljungstrand, P.: Token-based access to digital information. In: Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing, HUC 99, p. 234245. Springer-Verlag, London, UK (1999)
Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’06, pp. 437–446. ACM, New York, NY, USA (2006). https://doi.org/10.1145/1124772.1124838. http://doi.acm.org/https://doi.org/10.1145/1124772.1124838
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, pp. 234–241. ACM (1997). http://dl.acm.org/citation.cfm?id=258715
Ishii, H., Ullmer, B.: Tangible user interfaces. In: J.A. Jacko (ed.) The Human–Computer Interaction Handbook. CRC Press, Boca Raton, Ch. 21, p. 465490. (2012)
Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction—TEI ’07, pp. 139–146. ACM Press (2007)
Karatas, F., Bourimi, M., Kesdogan, D., Villanueva, P.G., Fardoun, H.M.: evaluating usability and privacy in collaboration settings with DUIs: problem analysis and case studies. In: M.D. Lozano, J.A. Gallud, R. Tesoriero, V.M.R. Penichet (eds.) Distributed User Interfaces: Usability and Collaboration, HumanComputer Interaction Series, pp. 119–127. Springer London (2013). https://doi.org/10.1007/978-1-4471-5499-0_10
Kennewell, S., Tanner, H., Jones, S., Beauchamp, G.: Analysing the use of interactive technology to implement interactive teaching. J. Comput. Assist Learn. 24(1), 61–73 (2008)
Kubicki, S., Lebrun, Y., Lepreux, S., Adam, E., Kolski, C., Mandiau, R.: Simulation in contexts involving an interactive table and tangible objects. Simul. Model. Pract. Theory 31, 116–131 (2013)
Kubicki, S., Lepreux, S., Kolski, C.: Evaluation of an interactive table with tangible objects: application with children in a classroom. In: Proceedings of the 2nd Workshop on Child Computer Interaction UI Technologies and Educational Pedagogy, In Conjunction with CHI 2011 Conference. (2011)
Kubicki, S., Lepreux, S., Kolski, C.: RFID-driven situation awareness on TangiSense, a table interacting with tangible objects. Pers. Ubiquitous Comput. 16(8), 1079–1094 (2012). https://doi.org/10.1007/s00779-011-0442-9
Kubicki, S., Lepreux, S., Kolski, C.: Distributed UI on interactive tabletops: issues and context model. In: Lozano, M.D., Gallud, J.A., Tesoriero, R., Penichet, V.M.R. (eds.) Distributed User Interfaces: Usability and Collaboration, HumanComputer Interaction Series, pp. 27–38. Springer, London (2013). https://doi.org/10.1007/978-1-4471-5499-0_3
Kubicki, S., Lepreux, S., Lebrun, Y., Dos Santos, P., Kolski C.and Caelen, J.: New human-computer interactions using tangible objects: application on a digital tabletop with rfid technology. In: J. Jacko (ed.) Human–Computer Interaction, 13th International Conference, HCI International 2009, pp. 446–455. Part III, LNCS 5612, Springer-Verlag, San Diego, CA, USA (2009)
Kubicki, S., Wolff, M., Lepreux, S., Kolski, C.: RFID interactive tabletop application with tangible objects: exploratory study to observe young children behaviors. Pers. Ubiquitous Comput. 19(8), 1259–1274 (2015). https://doi.org/10.1007/s00779-015-0891-7
Lebrun, Y., Adam, E., Kubicki, S., Mandiau, R.: A multi-agent system approach for interactive table using RFID. In: Y. Demazeau, F. Dignum, J. Corchado, P. J.B. (eds.) Advances in Intelligent and Soft-Computing, Advances in Practical Applications of Agents and Multiagent Systems, vol. 70, p. 125134. Springer, Berlin (2010)
Lebrun, Y., Lepreux, S., Kolski, C., Mandiau, R.: Combination between multi-agent system and tangigets for DUI design on several tabletops. In: M. Lozano, A. Mashat, H. Fardoun, J. Gallud, V. Penichet, R. Tesoriero, J. Vanderdonckt (eds.) DUI 2013: 3rd Workshop on Distributed User Interfaces: Models, Methods and Tools. In conjunction with ACM EICS 2013, pp. 54–57. London, UK (2013)
Lepreux, S., Castet, J., Couture, N., Dubois, E., Kolski, C., Kubicki, S., Maquil, V., Riviere, G.: Interaction tangible sur table, définitions et modèles. Journal d’Interaction Personne-Système Volume 5 (2016). http://jips.episciences.org/2182
Lepreux, S., Kubicki, S., Kolski, C., Caelen, J.: Distributed interactive surfaces: a step towards the distribution of tangible and virtual objects. In: Gallud, J.A., Tesoriero, R., Penichet, V.M.R. (eds.) Distributed User Interfaces, Human–Computer Interaction Series, pp. 133–143. Springer, London (2011). https://doi.org/10.1007/978-1-4471-2271-5_15
Lepreux, S., Kubicki, S., Kolski, C., Caelen, J.: From centralized interactive tabletops to distributed surfaces: the tangiget concept. Int. J. Hum. Comput. Interact. 28(11), 709–721 (2012)
Luyten, K., Bergh, JVd, Vandervelpen, C., Coninx, K.: Designing distributed user interfaces for ambient intelligent environments using models and simulations. Comput. Gr. 30(5), 702–713 (2006). https://doi.org/10.1016/j.cag.2006.07.004
Manca, M., Patern, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’16, pp. 27–37. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2933242.2933259
Marshall, P., Rogers, Y., Pantidi, N.: Using f-formations to analyse spatial patterns of interaction in physical environments. In: Proceedings of the ACM 2011 Conference on Computer Supported CooperativeWork—CSCW ’11, pp. 445–454. ACM Press (2011). https://doi.org/10.1145/1958824.1958893
Martin, P.E.: Pupitre du 21ème siècle pour la classe du 21ème siècle. Revue de l’Enseignement Public et Informatique 97, 89–98 (2000)
Melchior, J.: distributed user interfaces in space and time. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’11, pp. 311–314. ACM, New York, NY, USA (2011). https://doi.org/10.1145/1996461.1996544
Muller-Tomfelde, C. (ed.): Tabletops—Horizontal Interactive Displays. Human-Computer Interaction Series. Springer London, London (2010). http://link.springer.com/10.1007/978-1-84996-113-4
Muller-Tomfelde, C.: Interacting with mouse and touch devices on horizontal interactive displays. Univ. Access in the Inf. Soc. 11(3), 285–294 (2011). https://doi.org/10.1007/s10209-011-0238-8
Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.: Interactive development of cross-device user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 2793–2802. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2556288.2556980
Olson, J.S., Grudin, J., Horvitz, E.: A Study of preferences for sharing and privacy. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’05, pp. 1985–1988. ACM, New York, NY, USA (2005). https://doi.org/10.1145/1056808.1057073
Penichet, V.M.R., Lozano, M.D., Gallud, J.A., Tesoriero, R.: 12 + 1 Questions in the design of distributed user interfaces. In: Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction, DUI ’14, pp. 37–41. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2677356.2677664
Qin, Y., Liu, J., Wu, C., Shi, Y.: uEmergency: A Collaborative system for emergency management on very large tabletop. In: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces, pp. 399–402. ACM, New York, NY, USA (2012). https://doi.org/10.1145/2396636.2396710
Rädle, R., Jetter, H.C., Marquardt, N., Reiterer, H., Rogers, Y.: Huddlelamp: Spatially-aware mobile displays for ad-hoc around-the-table collaboration. In: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS ’14, pp. 45–54. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2669485.2669500. http://doi.acm.org.ins2i.bib.cnrs.fr/https://doi.org/10.1145/2669485.2669500
Robinson, P., Tuddenham, P.: distributed tabletops: supporting remote and mixed- presence tabletop collaboration. In: Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 19–26 (2007)
Seffah, A., Forbrig, P., Javahery, H.: Multi-devices multiple user interfaces: development models and research opportunities. J. Syst. Softw. 73, 287–300 (2004). https://doi.org/10.1016/j.jss.2003.09.017
Shaer, O., Hornecker, E.: Tangible User Interfaces : Past, Present, and Future Directions. Foundations and Trends in Human Computer Interaction. Now Publishers, Hanover (2010)
Shaer, O., Leland, N., Calvillo-Gamez, E.H., Jacob, R.J.K.: The TAC paradigm : specifying tangible user interfaces. Pers. Ubiquitous Comput. 8, 359–369 (2004)
Shmorgun, I., Lamas, D., Mercer, E.: Towards a pattern language for distributed user interfaces. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’16, pp. 2712–2718. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2851581.2892304
Sylla, C., Branco, P., Coutinho, C., Coquet, E.: Tuis vs. guis: comparing the learning potential with preschoolers. Pers. Ubiquitous Comput. 16, 421–432 (2012)
Tesoriero, R., Lozano, M., Vanderdonckt, J., Gallud, J.A., Penichet, V.M.: Distributed user interfaces: collaboration and usability. In: CHI ’12 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’12, pp. 2719–2722. ACM, New York, NY, USA (2012). https://doi.org/10.1145/2212776.2212704
Thomson, J.A., Ampofo-Boateng, K., Pitcairn, T.K., Grieve, R., Lee, D.N., Demetre, J.D.: Behavioral group training of children to find safe routes to cross the road. Br. J. Educ. Psychol. 62, 173–183 (1992)
Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Caroll, J.M. (ed.) Human-Computer Interaction in the New Millennium, vol. 1, p. 579601. AddisonWesley, Boston (2001)
Ullmer, B., Ishii, H., Jacob, R.J.K.: Tangible query interfaces: Physically constrained tokens for manipulating database queries. In: Proceedings of Interact’ 03, pp. 279–286 (2003)
Ullmer, B.A.: Tangible interfaces for manipulating aggregates of digital information. Ph.D. thesis, Massachusetts Institute of Technology (2002)
Vanderdonckt, J., Mendonca, H., Mass, J.P.M.: Distributed user interfaces in ambient environment. In: M. Mhlhuser, A. Ferscha, E. Aitenbichler (eds.) Constructing Ambient Intelligence, no. 11 in Communications in Computer and Information Science, pp. 121–130. Springer Berlin Heidelberg (2007). https://doi.org/10.1007/978-3-540-85379-4_15
Vandervelpen, C., Coninx, K.: Towards model-based design support for distributed user interfaces. In: Proceedings of the Third Nordic Conference on Human-computer Interaction, NordiCHI ’04, pp. 61–70. ACM, New York, NY, USA (2004). https://doi.org/10.1145/1028014.1028023
Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J.D., Borchers, J.: Slap widgets: bridging the gap between virtual and physical controls on tabletops. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’09, pp. 481–490. ACM, New York, NY, USA (2009). https://doi.org/10.1145/1518701.1518779
Wozniak, P., Goyal, N., Kucharski, P., Lischke, L., Mayer, S., Fjeld, M.: Ramparts: Supporting sensemaking with spatially-aware mobile interactions. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pp. 2447–2460. ACM, New York, NY, USA (2016)
Woźniak, P., Lischke, L., Schmidt, B., Zhao, S., Fjeld, M.: Thaddeus: A dual device interaction space for exploring information visualisation. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, NordiCHI ’14, pp. 41–50. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2639189.2639237
Yamashita, N., Kaii, K., Kuzuoka, H., Hirata, K.: Improving visibility of remote gestures in distributed tabletop collaboration. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 95–104. ACM, New York, NY, USA (2011)
Acknowledgements
The authors warmly thank Sebastien Kubicki for his work on the first centralized version of the application [32, 36]. They also thank the 36 participants, Steve Gabet for his contribution to the distributed version, Carole for her proofreading, the anonymous reviewers for their numerous constructive remarks.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bouabid, A., Lepreux, S. & Kolski, C. Design and evaluation of distributed user interfaces between tangible tabletops. Univ Access Inf Soc 18, 801–819 (2019). https://doi.org/10.1007/s10209-017-0602-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-017-0602-4