More Web Proxy on the site http://driver.im/

research-article

The concurrent use of touch and mid-air gestures or floor mat interaction on a public display

Authors:

Andrew Vande MoereAuthors Info & Claims

PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive Displays

Article No.: 9, Pages 1 - 9

https://doi.org/10.1145/3078810.3078819

Published: 07 June 2017 Publication History

Abstract

This paper investigates a novel approach to simultaneously use the qualities of touch and mid-air gestures or floor mat interaction on a public display. We demonstrate that although the concurrent use of multiple interaction modalities appeared functionally possible and has the potential to augment a single display with both personal and public functionalities, it is hampered by issues relating to display and interaction blindness, in addition to social discomfort and what we propose to name affordance blindness. We describe this blindness as the inability to understand the interaction modalities of a public display. Overall, passers-by tend to assume that a public display only supports a single interaction modality, an issue that is hard to overcome with ergonomic or visual interventions, or via physical curiosity objects. Although user engagement was relatively limited, we believe that our qualitative results highlight several crucial design and usability aspects when designing multi-modal, interactive public displays. Furthermore, this study demonstrates that previous knowledge on public display interaction cannot be simply ported to other contexts, and that more diverse content-types or contextual use cases should be evaluated "in-the-wild" to attain more generalizable insights.

References

[1]

Matthias Baldauf, Stefan Suette, Peter Fröhlich, and Ulrich Lehner. 2014. Interactive Opinion Polls on Public Displays: Studying Privacy Requirements in the Wild. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14), 495--500.

Digital Library

[2]

Alexander Biskupski, Andreas R. Fender, Tiare M. Feuchtner, Marcel Karsten, and Jonas D. Willaredt. 2014. Drunken Ed: A Balance Game for Public Large Screen Displays. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14), 289--292.

Digital Library

[3]

Victor Cheung and Stacey D. Scott. 2015. Studying Attraction Power in Proxemics-Based Visual Concepts for Large Public Interactive Displays. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15), 93--102.

Digital Library

[4]

Travis Cox, Marcus Carter, and Eduardo Velloso. 2016. Public DisPLAY: Social Games on Interactive Public Screens. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16), 371--380.

Digital Library

[5]

Peter Dalsgaard, Kim Halskov, and Ole Sejer Iversen. 2016. Participation Gestalt: Analysing Participatory Qualities of Interaction in Public Space. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 4435--4446.

Digital Library

[6]

Nicholas S. Dalton, Emily Collins, and Paul Marshall. 2015. Display Blindness?: Looking Again at the Visibility of Situated Displays Using Eye-tracking. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3889--3898.

Digital Library

[7]

Guiying Du, Lukas Lohoff, Jakub Krukar, and Sergey Mukhametov. 2016. Comparing Two Methods to Overcome Interaction Blindness on Public Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16), 243--244.

Digital Library

[8]

Olivier Friard and Marco Gamba. 2016. BORIS: a free, versatile open-source event-logging software for video/audio coding and live observations. Methods in Ecology and Evolution 7, 11: 1325--1330.

[9]

Sven Gehring and Antonio Krüger. 2012. Using media facades to engage social interaction. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing.

Digital Library

[10]

Luke Hespanhol, Martin Tomitsch, Ian McArthur, Joel Fredericks, Ronald Schroeter, and Marcus Foth. 2015. Vote As You Go: Blending Interfaces for Community Engagement into the Urban Space. In Proceedings of the 7th International Conference on Communities and Technologies (C&T '15), 29--37.

Digital Library

[11]

Steven Houben and Christian Weichel. 2013. Overcoming Interaction Blindness Through Curiosity Objects. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13), 1539--1544.

Digital Library

[12]

Elaine M. Huang, Anna Koster, and Jan Borchers. 2008. Overcoming Assumptions and Uncovering Practices: When Does the Public Really Look at Public Displays? In Pervasive Computing: 6th International Conference, Pervasive 2008 Sydney, Australia, May 19--22, 2008 Proceedings. Springer Berlin Heidelberg, Berlin, Heidelberg, 228--243.

Digital Library

[13]

Shigeyoshi Iizuka, Wataru Naito, and Kentaro Go. 2013. A Study for Personal Use of the Interactive Large Public Display. In Human Interface and the Management of Information. Information and Interaction Design. HIMI 2013. Lecture Notes in Computer Science. Springer Berlin Heidelberg, 55--61.

Digital Library

[14]

Wendy Ju and David Sirkin. 2010. Animate Objects: How Physical Motion Encourages Public Interaction. In Persuasive Technology: 5th International Conference, PERSUASIVE 2010, Copenhagen, Denmark, June 7--10, 2010. Proceedings. Springer Berlin Heidelberg, 40--51.

Digital Library

[15]

Marko Jurmu, Masaki Ogawa, Sebastian Boring, Jukka Riekki, and Tokuda Hideyuki. 2013. Waving to a touch interface: descriptive field study of a multipurpose multimodal public display. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays.

Digital Library

[16]

Mohamed Khamis, Ludwig Trotter, Markus Tessmann, Christina Dannhart, Andreas Bulling, and Florian Alt. 2016. EyeVote in the Wild: Do Users Bother Correcting System Errors on Public Displays? In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM '16), 57--62.

Digital Library

[17]

Hannu Kukka, Fabio Kruger, Vassilis Kostakos, Timo Ojala, and Marko Jurmu. 2011. Information to Go: Exploring In-Situ Information Pick-Up "In the Wild." In Human-Computer Interaction - INTERACT 2011. Springer Berlin Heidelberg, 487--504.

Digital Library

[18]

Hannu Kukka, Heidi Oja, Vassilis Kostakos, Jorge Gonçalves, and Timo Ojala. 2013. What makes you click: exploring visual signals to entice interaction on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[19]

Kabo Lee, Sarah Clinch, Chris Winstanley, and Nigel Davies. 2014. I Love My Display: Combatting Display Blindness with Emotional Attachment. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), 154:154--154:159.

Digital Library

[20]

Daniel Michelis and Jörg Müller. 2011. The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center. International Journal of Human-Computer Interaction 27, 6: 562--579.

[21]

Meredith Ringel Morris, Anqi Huang, Andreas Paepcke, and Terry Winograd. 2006. Cooperative Gestures: Multi-user Gestural Interactions for Co-located Groupware. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 1201--1210.

Digital Library

[22]

Jörg Müller, Gilles Bailly, Thor Bossuyt, and Niklas Hillgren. 2014. MirrorTouch: Combining Touch and Mid-air Gestures for Public Displays. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14), 319--328.

Digital Library

[23]

Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking glass: a field study on noticing interactivity of a shop window. In CHI '12 Extended Abstracts on Human Factors in Computing Systems.

Digital Library

[24]

Jörg Müller, Dennis Wilmsmann, Juliane Exeler, Markus Buzeck, Albrecht Schmidt, Tim Jay, and Antonio Krüger. 2009. Display Blindness: The Effect of Expectations on Attention Towards Digital Signage. In Proceedings of the 7th International Conference on Pervasive Computing (Pervasive '09), 1--8.

Digital Library

[25]

Kenton O'Hara, Maxine Glancy, and Simon Robertshaw. 2008. Understanding Collective Play in an Urban Screen Game. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08), 67--76.

Digital Library

[26]

Timo Ojala, Vassilis Kostakos, and Hannu Kukka. 2012. Multipurpose Interactive Public Displays in the Wild: Three Years Later. Computer 45, 5.

Digital Library

[27]

Gonzalo Parra, Joris Klerkx, and Erik Duval. 2014. Understanding Engagement with Interactive Public Displays: An Awareness Campaign in the Wild. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), 180:180--180:185.

Digital Library

[28]

Walter Robert, Ten Koppel, Gilles Bailly, Jörg Müller, and Walter Robert. 2012. Chained displays: configurations of public displays can be used to influence actor-, audience-, and passer-by behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[29]

Carsten Röcker, Steve Hinske, and Carsten Magerkurth. 2007. Intelligent Privacy Support for Large Public Displays. In Universal Access in Human-Computer Interaction. Ambient Interaction.

Digital Library

[30]

Elisa Rubegni, Nemanja Memarovic, and Marc Langheinrich. 2011. Talking to Strangers: Using Large Public Displays to Facilitate Social Interaction. In International Conference of Design, User Experience, and Usability.

[31]

Patrick Steiger and Bettina Ansel Suter. 1994. MINNELLI - Experiences with an Interactive Information Kiosk for Casual Users. In Proc. UBILAB '94, 124--133.

[32]

Martin Tomitsch, Christopher Ackad, Oliver Dawson, Luke Hespanhol, and Judy Kay. 2014. Who Cares About the Content? An Analysis of Playful Behaviour at a Public Display. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), 160:160--160:165.

Digital Library

[33]

Nina Valkanova, Sergi Jorda, Martin Tomitsch, and Andrew Vande Moere. 2013. Reveal-it!: the impact of a social visualization projection on public awareness and discourse. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[34]

Nina Valkanova, Robert Walter, Andrew Vande Moere, and Jörg Müller. 2014. MyPosition: sparking civic discourse by a public interactive poll visualization. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing.

Digital Library

[35]

Radu-Daniel Vatavu. 2013. On designing interactivity awareness for ambient displays. Multimedia Tools and Applications 1, 66: 59--80.

Digital Library

[36]

Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04), 137--146.

Digital Library

[37]

Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

[38]

Miaosen Wang, Sebastian Boring, and Saul Greenberg. 2012. Proxemic peddler: a public advertising display that captures and preserves the attention of a passerby. In Proceedings of the 2012 International Symposium on Pervasive Displays.

Digital Library

[39]

Yan Zhai, Guoying Zhao, Toni Alatalo, Janne Heikkilä, Timo Ojala, and Xinyuan Huang. 2013. Gesture interaction for wall-sized touchscreen display. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing.

Digital Library

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Biedermann PCoenen JDe Roeck DVande Moere A(2023)PosterTalk: Expanding Participatory Agency in Public Survey Platforms via Middle-Out GatekeepingProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595984(2573-2592)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595984
Show More Cited By

Index Terms

The concurrent use of touch and mid-air gestures or floor mat interaction on a public display
1. Human-centered computing
  1. Collaborative and social computing
  2. Human computer interaction (HCI)

Recommendations

Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Freehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...
Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction
Human-Computer Interaction – INTERACT 2015
Abstract
Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to ...
Preliminary Comparison of a Curved Public Display vs a Flat Public Display
Human-Computer Interaction. Design Practice in Contemporary Societies
Abstract
In this paper, we describe how passers-by are affected by a curved public display compared to a flat public display. Through observing social behaviors of people around a curved public display, we found that firstly more people tend to stop in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive Displays

June 2017

186 pages

ISBN:9781450350457

DOI:10.1145/3078810

General Chair:
Marc Langheinrich
Universitá della Svizzera italiana (USI), Lugano, Switzerland
,
Program Chair:
Sarah Clinch
University of Manchester, Manchester, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PerDis '17

Sponsor:

SIGMOBILE

PerDis '17: 6th International Symposium on Pervasive Displays

June 7 - 9, 2017

Lugano, Switzerland

Acceptance Rates

PerDis '17 Paper Acceptance Rate 21 of 38 submissions, 55%;

Overall Acceptance Rate 213 of 384 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
363
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Biedermann PCoenen JDe Roeck DVande Moere A(2023)PosterTalk: Expanding Participatory Agency in Public Survey Platforms via Middle-Out GatekeepingProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595984(2573-2592)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595984
Mao LOno KQi MWatanabe MHuang J(2023)Comparison of Panel and Pie Menus for Mid-Air Interaction in a Photo Booth: Muscle Activity, Performance, and User ExperienceInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227941240:23(8313-8327)Online publication date: 12-Nov-2023
https://doi.org/10.1080/10447318.2023.2279412
Prandi CNisi VRibeiro MNunes N(2021)Sensing and making sense of tourism flows and urban data to foster sustainability awareness: a real-world experienceJournal of Big Data10.1186/s40537-021-00442-w8:1Online publication date: 24-Mar-2021
https://doi.org/10.1186/s40537-021-00442-w
Coenen JBiedermann PClaes SVande Moere A(2021)The Stakeholder Perspective on Using Public Polling Displays for Civic EngagementProceedings of the 10th International Conference on Communities & Technologies - Wicked Problems in the Age of Tech10.1145/3461564.3461585(61-74)Online publication date: 20-Jun-2021
https://dl.acm.org/doi/10.1145/3461564.3461585
Sprecher BHavekost TFietkau J(2021)How Content Drives Interaction With Public DisplaysCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3490525(25-28)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3447932.3490525
Sugiura NOgura RMatsuda YKomuro TOgawa K(2021)Users’ Content Memorization in Multi-User Interactive Public DisplaysInternational Journal of Human–Computer Interaction10.1080/10447318.2021.194868638:5(447-455)Online publication date: 6-Jul-2021
https://doi.org/10.1080/10447318.2021.1948686
Huang JMao LQi MZhang DAn MHan RJi T(2021)Differences in muscle activity, kinematics, user performance, and subjective assessment between touchscreen and mid-air interactions on a tabletBehaviour & Information Technology10.1080/0144929X.2021.197022741:14(3028-3043)Online publication date: 25-Aug-2021
https://doi.org/10.1080/0144929X.2021.1970227
Limerick HCobus VPrange SClinch SRukzio EGugenheimer J(2020)Call to interactProceedings of the 9TH ACM International Symposium on Pervasive Displays10.1145/3393712.3395338(63-70)Online publication date: 4-Jun-2020
https://dl.acm.org/doi/10.1145/3393712.3395338
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents