More Web Proxy on the site http://driver.im/

article

Facilitating peripheral interaction: design and evaluation of peripheral interaction for a gesture-based lighting control with multimodal feedback

Authors:

Marigo Heijboer,

Saskia BakkerAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 20, Issue 1

Pages 1 - 22

https://doi.org/10.1007/s00779-015-0893-5

Published: 01 February 2016 Publication History

Abstract

Most interactions with today's interfaces require a person's full and focused attention. To alleviate the potential clutter of focal information, we investigated how interactions could be designed to take place in the background or periphery of attention. This paper explores whether gestural, multimodal interaction styles of an interactive light system allow for this. A study compared the performance of interactions with the light system in two conditions: the central condition in which participants interacted only with the light system, and the peripheral condition in which they interacted with the system while performing a high-attentional task simultaneously. Our study furthermore compared different feedback styles (visual, auditory, haptic, and a combination). Results indicated that especially for the combination feedback style, the interaction could take place without participants' full visual attention, and performance did not significantly decrease in the peripheral condition. This seems to indicate that these interactions at least partly took place in their periphery of attention and that the multimodal feedback style aided this process.

References

[1]

Baayen RH, Milin P (2010) Analyzing reaction times. Int J Psychol Res 2(3):12---28

[2]

Bakker S, van den Hoven E, Eggen B (2010) Design for the periphery. In: EuroHaptics 2010: proceedings of the EuroHaptics 2010 special symposium. Amsteram, The Netherlands, pp 71---80

[3]

Bakker S, van den Hoven E, Eggen B, Overbeeke K (2012) Exploring peripheral interaction design for primary school teachers. In: Proceedings of TEI 2012. Kingston, Ontario, Canada. February 19---22, 2012, pp 245---252

[4]

Bakker S, van den Hoven E, Eggen B (2013) FireFlies: physical peripheral interaction design for the everyday routine of primary school teachers. In: Proceedings of the 7th international conference on tangible, embedded, and embodied interaction. Barcelona, Spain (TEI'13), pp 57---64

[5]

Bakker S, van den Hoven E, Eggen B (2014a) Peripheral interaction: characteristics and considerations. Pers Ubiquitous Comput 19(1):239---254

[6]

Bakker S, van den Hoven E, Eggen B (2014b) Evaluating peripheral interaction design. Hum Comput Interact 30(6):473---506

[7]

Bernsen NO (1993) Modality theory: supporting multimodal interface design. In: Proceedings of the ERCIM workshop on multimodal human---computer interaction. Nancy, pp 13---23

[8]

Berto R (2005) Exposure to restorative environments helps restore attentional capacity. J Environ Psychol 25(3):249---259

[9]

Bongers AJ (2004) Interaction with our electronic environment: an ecological approach to physical interface design. Cahier book series. Hogeschool van Utrecht, Utrecht

[10]

Bongers AJ (2006) Multimodal human---computer interaction: interfacing with the ecology. Interactivation--towards an e-cology of people, our technological environment, and the arts. Academisch Proefschrift, Amsterdam, pp 99---114

[11]

Bongers AJ, van den Akker M (2011) Light pointer. http://interactivelight.id.tue.nl/. Accessed 6 Dec 2014

[12]

Bongers AJ, van der Veer GC (2007) Towards a multimodal interaction space: categorisation and applications. Pers Ubiquitous Comput 11(8):609---619

[13]

Brewster S, Lumsden J, Bell M, Hall M, Tasker S (2003) Multimodal `eyes-free' interaction techniques for wearable devices. In: Proceedings of CHI2003. Ft. Lauderdal, Florida, USA, pp 473---480

[14]

Cockburn A, Quinn P, Gutwin C, Ramos G, Looser J (2011) Air pointing: design and evaluation of spatial target acquisition with and without visual feedback. Int J Hum Comput Sci 69:401---414

[15]

Sluis R van de, Eggen JH, Jansen J, Kohar H (2001) User interface for an in-home environment. In: Proceedings of INTERACT'01. Tokyo 2001, pp 383---390

[16]

Edge D, Blackwell AF (2009) Peripheral tangible interaction by analytic design. In: Proceedings of TEI 2009, pp 69---76

[17]

Eggen B, van Mensvoort K (2009) Making sense of what is going on around: designing environmental awareness information displays. In: Markopoulos P, de Ruyter B, Mackay W (eds) Awareness systems: advances in theory, methodology and design. Springer, London, pp 99---124

[18]

Gibson JJ (1979) The ecological approach to visual perception. Houghton Mifflin, Boston

[19]

Hausen D (2012) Peripheral interaction: facilitating interaction with secondary tasks. In: Proceedings of TEI 2012, Kingston, Ontario, Canada, pp 387---388

[20]

Hausen D, Butz A (2011) Extending interaction to the periphery. In: Proceedings of workshop embodied interaction: theory and practice in HCI. In conjunction with 29th ACM International Conference on Human Factors in Computing Systems (CHI 2011). http://www.medien.ifi.lmu.de/forschung/publikationen/detail?pub=hausen2011chi. Accessed 6 Dec 2014

[21]

Hausen D, Boring S, Polleti J, Butz A (2012) Exploring design and combination of ambient information and peripheral interaction. In: Proceedings of the 9th International ACM Conference on Designing Interactive Systems. DIS 2012. June 11---15, 2012. Newcastle, UK. http://www.medien.ifi.lmu.de/forschung/publikationen/detail?pub=hausen2012dis. Accessed 6 Dec 2014

[22]

Hausen D, Boring S, Lueling C, Rodestock S, Butz A (2012a) StaTube: facilitating state management in instant messaging systems. In: Proceedings of TEI, 2012. Kingston, Ontario, Canada, pp 283---290

[23]

Hausen D, Tabard S, von Thermann A, Holzner K, Butz A (2014) Evaluating peripheral interaction. In: Proceedings of the 8th International Conference on Tangible Embedded and Embodied Interaction, pp 21---28

[24]

Heijboer M, van den Hoven E (2008) Keeping up appearances: interpretation of tangible artifact design. In: Proceedings of NordiCHI 2008: using bridges. Lund, Sweden, pp 162---171

[25]

Hudson SE, Harrison C, Harrison BL, LaMarca A (2010) Whack gestures: inexact and inattentive interaction with mobile devices. In: Proceedings of TEI 2010. Cambridge, Massachusetts, USA, pp 109---112

[26]

Ishii H, Wisneski C, Brave S, Dahley A, Gorbet M, Ullmer B, Yarin P (1998) ambientROOM: integrating ambient media with architecture. In: conference summary of CHI 1998. ACM Press, pp 173---174

[27]

Ishii H, Ren S, Frei P (2001) Pinwheels: visualizing information flow in an architectural space. In: Extended Abstract of CHI'01, pp 111---112

[28]

Kahneman D (1973) Attention and effort. Prentice Hall, Englewood Cliffs

[29]

Kelly SP, Dockree P, Reilly RB, Robertson IH (2003) EEG alpha power and coherence time courses in a sustained attention task. In: Proceedings of the 1st International IEEE EMBS Conference on Neural Engineering. Italy, pp 83---86

[30]

Kress G, van Leeuwen TV (2001) Multimodal discourse, the modes and media of contemporary communication. Oxford University Press, Oxford

[31]

Li FF, Van Rullen R, Koch C, Perona P (2002) Rapid natural scene categorization in the near absence of attention. In: Proceedings of the National Academy of Sciences of the United States of America, pp 9596---9601

[32]

Mankoff J, Dey AK, Hsieh G, Kientz J, Lederer S, Ames M (2003) Heuristic evaluation of ambient displays. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 169---176

[33]

Meerbeek B, Bingley P, Rijnen W, van den Hoven E (2010) Pipet: a design concept supporting photo sharing. In: Proceedings of the 6th Nordic conference on human---computer interaction: extending boundaries, pp 335---342

[34]

Motamedi N (2007) Keep in touch: a tactile-vision intimate interface. In: Proceedings of TEI'07. Baton Rouge, LA, USA, pp 21---22

[35]

Nigay L, Coutaz J (1993) A design space for multimodal systems: concurrent processing and data fusion. In: Proceedings of the INTERACT'93 and CHI'93 conference on human factors in computing systems, pp 172---178

[36]

Oakley I, O'Modhrain S (2005) Tilt to scroll: evaluating a motion based vibrotactile mobile interface. World Haptics 2005:40---49

[37]

Oakley I, Park J (2007) Designing eyes-free interaction. Haptic Audio Interact Des 4813:121---132

[38]

Pavlovic VI, Sharma P, Huang TS (1997) Visual interpretation of hand gestures for human---computer interaction: a review. IEEE Trans Pattern Anal Mach Intell 19(7):677---695

[39]

Pirhonen A, Brewster S, Holguin C (2002) Gestural and audio methaphors as a means of control for mobile devices. In: Proceedings of CHI 2002. Minneapolis, Minnesota, USA, pp 291---298

[40]

Poupyrev I, Maruyama S, Rekimoto J (2002) Ambient touch: designing tactile interfaces for handheld devices. In: Proceedings of UIST'02. Paris, France, pp 51---60

[41]

Rahman M, Gustafson S, Irani P, Subramanian S (2009) Tilt techniques: investigating the dexterity of wrist-based Input. In: Proceedings of CHI 2009. Boston, Massachusetts, USA, pp 1943---1952

[42]

Rasmussen J (1986) Information processing and human---machine interaction: an approach to cognitive engineering. North-Holland, Amsterdam

[43]

Rasmussen J, Goodstein JP, Pejtersen AM (1994) Cognitive systems engineering. Wiley, Hoboken

[44]

Swindells C, Inkpen KM, Dill JC, Tory M (2002) That one there! Pointing to establish device identity. In: Proceeding of the 15th annual ACM symposium on user interface software and technology, pp 151---160

[45]

Valkkynen P, Niemala M, Tuomisto T (2006) Evaluation touching and pointing with a mobile terminal for physical browsing. In: Proceedings of NordiCHI 2006, pp 28---37

[46]

van den Hoven E, Mazalek A (2011) Grasping gestures: gesturing with physical artifacts. Artif Intell Eng Des Anal Manuf 25:255---271

[47]

Weiser M (1991) The computer for the twenty-first century. Sci Am 265:94---104

[48]

Weiser M, Brown JS (1997) The coming age of calm technology. In: Denning PJ, Metcalfe RM (eds) Beyond calculation: the next fifty years of computing. Springer, New York, pp 75---86

[49]

Wickens CD, McCarley JS (2008) Applied attention theory. CRC Press, Boca Raton

[50]

Wickens CD, Hollands JG, Banbury S, Parasuraman R (2013) Engineering psychology and human performance, 4th edn. Pearson, London

[51]

Zhao S, Dragicevic P, Chignell M, Balakrishanan R, Baudisch P (2007) earPod: eyes-free menu selection using touch input and reactive audio feedback. In: Proceedings of the CHI 07: ACM conference on human factors in computing systems. San Jose, California, USA, pp 1395---1404

Cited By

Abd El Ghani MBerthouze NSingh A(2024)Optimizing In-Cabin Communication and User Experience in Future Vehicles through Dynamic Expressive Interior LightingAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685015(8-15)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685015
Panda PNicholas MNguyen DOfek EPahud MRintel SGonzalez-Franco MHinckley KLanier J(2023)Beyond Audio: Towards a Design Space of Headphones as a Site for Interaction and SensingProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596022(904-916)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596022
Schipor OVatavu RWu W(2019)SAPIENSProceedings of the ACM on Human-Computer Interaction10.1145/33311533:EICS(1-24)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331153
Show More Cited By

Facilitating peripheral interaction: design and evaluation of peripheral interaction for a gesture-based lighting control with multimodal feedback
1. Human-centered computing

Recommendations

Reflexive Interaction: Extending the concept of Peripheral Interaction
OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

Human-computer interaction (HCI) continues to evolve and interaction scenarios have to fulfill mobility, flexibility, and ad-hoc interaction where ever users are. To address this, traditional interaction concepts are being extended. While Peripheral ...
Peripheral interaction: shaping the research and design space
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

In everyday life, we are able to perform various activities simultaneously without consciously paying attention to them. For example, we can easily read a newspaper while drinking coffee. This latter activity takes place in our background or periphery ...
Exploring peripheral interaction design for primary school teachers
TEI '12: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction

This paper explores the concept of peripheral interactions; interactions with technology that take place in the background or periphery of the attention. We present two designs for a classroom setting. CawClock makes selected time frames audible in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 20, Issue 1

February 2016

160 pages

ISSN:1617-4909

Issue’s Table of Contents

Copyright © Copyright © 2016 Springer-Verlag London.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 February 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
125
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Abd El Ghani MBerthouze NSingh A(2024)Optimizing In-Cabin Communication and User Experience in Future Vehicles through Dynamic Expressive Interior LightingAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685015(8-15)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685015
Panda PNicholas MNguyen DOfek EPahud MRintel SGonzalez-Franco MHinckley KLanier J(2023)Beyond Audio: Towards a Design Space of Headphones as a Site for Interaction and SensingProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596022(904-916)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596022
Schipor OVatavu RWu W(2019)SAPIENSProceedings of the ACM on Human-Computer Interaction10.1145/33311533:EICS(1-24)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331153
Popovici IVatavu RWu W(2019)TV Channels in Your Pocket! Linking Smart Pockets to Smart TVsProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325119(193-198)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325119
Popovici ISchipor OVatavu R(2019)HoverInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.03.012129:C(95-107)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.ijhcs.2019.03.012
Shakeri GWilliamson JBrewster SBoll SPfleging BDonmez BPolitis ILarge D(2017)Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture InteractionProceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3122986.3123011(84-93)Online publication date: 24-Sep-2017
https://dl.acm.org/doi/10.1145/3122986.3123011

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents