More Web Proxy on the site http://driver.im/

poster

Modeling human interaction resources to support the design of wearable multimodal systems

Authors:

Max MühlhäuserAuthors Info & Claims

ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

Pages 299 - 306

https://doi.org/10.1145/1322192.1322244

Published: 12 November 2007 Publication History

Abstract

Designing wearable application interfaces that integrate well into real-world processes like aircraft maintenance or medical examinations is challenging. One of themain success criteria is how well the multimodal interaction with the computer system fits an already existing real-world task. Therefore, the interface design needs to take the real-world task flow into account from the beginning.

We propose a model of interaction devices and human interaction capabilities that helps evaluate how well different interaction devices/techniques integrate with specific real-world scenarios. The model was developed based on a survey of wearable interaction research literature. Combining this model with descriptions of observed real-world tasks, possible conflicts between task performance and device requirements can be visualized helping the interface designer to find a suitable solution.

References

[1]

M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-wimp user interfaces. In CHI '00: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 446--453, New York, NY, USA, 2000. ACM Press.

Digital Library

[2]

T. W. Bleser and J. Sibert. Toto: a tool for selecting interaction techniques. In UIST '90: Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, pages 135--142, New York, NY, USA, 1990. ACM Press.

Digital Library

[3]

M. Boronowsky, T. Nicolai, C. Schlieder, and A. Schmidt. Winspect: A case study for wearable computing-supported inspection tasks. Fifth International Symposium on Wearable Computers (ISWC'01), pages 8--9, 2001.

Digital Library

[4]

C. Bürgy. An Interaction Constraints Model for Mobile and Wearable Computer-Aided Engineering Systems in Industrial Applications. PhD thesis, Carnegie Mellon University, 2002.

[5]

W. Buxton. Lexical and pragmatic considerations of input structures. SIGGRAPH Comput. Graph., 17(1):31--37, 1983.

Digital Library

[6]

S. K. Card, J. D. Mackinlay, and G. G. Robertson. The design space of input devices. In CHI '90: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 117--124, New York, NY, USA, 1990. ACM Press.

Digital Library

[7]

S. K. Card, J. D. Mackinlay, and G. G. Robertson. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst., 9(2):99--122, 1991.

Digital Library

[8]

L. E. Dunne and B. Smyth. Psychophysical elements of wearability. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 299--302, New York, NY, USA, 2007. ACM Press.

Digital Library

[9]

M. Fukumoto. A finger-ring shaped wearable handset based on bone-conduction. Wearable Computers, 2005. Proceedings. Ninth IEEE International Symposium on, pages 10--13, 2005.

Digital Library

[10]

F. Gemperle, C. Kasabach, J. Stivoric, M. Bauer, and R. Martin. Design for wearability. In ISWC '98: Proceedings of the 2nd IEEE International Symposium on Wearable Computers, page 116, Washington, DC, USA, 1998. IEEE Computer Society.

Digital Library

[11]

B. Howard and S. Howard. Lightglove: Wrist-Worn Virtual Typing and Pointing. Proceedings of the Fifth International Symposium on Wearable Computers, pages 172--173, 2001.

Digital Library

[12]

A. Jameson and K. Klöckner. User multitasking with mobile multimodal systems. In W. Minker, D. Bühler, and L. Dybkjær, editors, Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Kluwer Academic Publishers, Dordrecht, 2004.

[13]

T. Klug. Computer aided observations of complex mobile situations. In CHI '07: CHI '07 extended abstracts on Human factors in computing systems, pages 2507--2512, New York, NY, USA, 2007. ACM Press.

Digital Library

[14]

J. S. Lipscomb and M. E. Pique. Analog input device physical characteristics. SIGCHI Bull., 25(3):40--45, 1993.

Digital Library

[15]

Y. Liu, R. Feyen, and O. Tsimhoni. Queueing network-model human processor (qn-mhp): A computational architecture for multitask performance in human-machine systems. ACM Trans. Comput.-Hum. Interact., 13(1):37--70, 2006.

Digital Library

[16]

C. Metzger, M. Anderson, and T. Starner. FreeDigiter: A Contact-Free Device for Gesture Control. Proceedings of the Eighth International Symposium onWearable Computers (ISWC'04)-Volume 00, pages 18--21, 2004.

Digital Library

[17]

H. Noma, A. Ohmura, N. Kuwahara, and K. Kogure. Wearable sensors for auto-event-recording on medical nursing-user study of ergonomic design. Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, 1.

Digital Library

[18]

J. Perng, B. Fisher, S. Hollar, and K. Pister. Acceleration sensing glove (ASG). Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 178--180, 1999.

Digital Library

[19]

J. Rekimoto. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proceedings of the 5th IEEE International Symposium on Wearable Computers, Zurich, Switzerland, 2001.

Digital Library

[20]

T. Starner. Wearable Computing and Context Awareness. PhD thesis, Massachusetts Institute of Technology, May 1999.

Digital Library

[21]

T. Starner, J. Auxier, D. Ashbrook, and M. Gandy. The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring. International Symposium on Wearable Computing, 2000.

Digital Library

[22]

B. Thomas, K. Grimmer, D. Makovec, J. Zucco, and B. Gunther. Determination of placement of a body-attached mouse as a pointinginput device forwearable computers. Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 193--194, 1999.

Digital Library

[23]

B. Thomas, S. Tyerman, and K. Grimmer. Evaluation of text input mechanisms for wearable computers. Virtual Reality, 3(3):187--199, 1998.

Digital Library

[24]

A. Toney, L. Dunne, B. Thomas, and S. Ashdown. A shoulder pad insert vibrotactile display. Wearable Computers, 2003. Proceedings. Seventh IEEEInternational Symposium on, pages 35--44, 2003.

Digital Library

[25]

A. Toney, B. Mulley, B. Thomas, and W. Piekarski. Minimal social weight user interactions for wearable computers in business suits. Wearable Computers, 2002.(ISWC 2002). Proceedings. Sixth International Symposium on, pages 57--64, 2002.

Digital Library

[26]

wearIT@work Project Homepage, http://www.wearitatwork.com/, 7 2007.

Cited By

Palanque PNavarre D(2021)Dependability and Safety: Two Clouds in the Blue Sky of Multimodal InteractionProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479881(781-787)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479881
Ferreira DGoncalves JKostakos VBarkhuus LDey AQuigley ADiamond SIrani PSubramanian S(2014)Contextual experience sampling of mobile application micro-usageProceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628367(91-100)Online publication date: 23-Sep-2014
https://dl.acm.org/doi/10.1145/2628363.2628367
Moldovan ROrza BVlaicu APorumb C(2014)Advanced human-computer interaction in external resource annotation2014 IEEE International Conference on Automation, Quality and Testing, Robotics10.1109/AQTR.2014.6857852(1-6)Online publication date: May-2014
https://doi.org/10.1109/AQTR.2014.6857852
Show More Cited By

Index Terms

Modeling human interaction resources to support the design of wearable multimodal systems
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Multimodal interaction for data visualization
AVI '18: Proceedings of the 2018 International Conference on Advanced Visual Interfaces

Multimodal interaction offers many potential benefits for data visualization. It can help people stay in the flow of their visual analysis and presentation, with the strengths of one interaction modality offsetting the weaknesses of others. Furthermore, ...
Using on-body displays for extending the output of wearable devices
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive Displays

In this work, we explore wearable on-body displays. These displays have the potential of extending the display space of smart watches to the user's body. Our research is motivated by wearable computing devices moving technology closer to the human. ...
Wearable remote control of a mobile device: comparing one- and two-handed interaction
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

While wearable technologies are suitable for remotely controlling mobile devices, few studies have examined user preferences for one- or two-handed touch interaction with these wearables, especially when worn on the wrist and hand area. As these ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

November 2007

402 pages

ISBN:9781595938176

DOI:10.1145/1322192

General Chairs:
Kenji Mase
Nagoya University, Japan
,
Dominic Massaro
UC Santa Cruz, USA
,
Program Chairs:
Kazuya Takeda
Nagoya University, Japan
,
Deb Roy
MIT, USA
,
Alexandros Potamianos
Technical University of Crete, Greece

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI07

Sponsor:

ICMI07: International Conference on Multimodal Interface

November 12 - 15, 2007

Aichi, Nagoya, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
586
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Palanque PNavarre D(2021)Dependability and Safety: Two Clouds in the Blue Sky of Multimodal InteractionProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479881(781-787)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479881
Ferreira DGoncalves JKostakos VBarkhuus LDey AQuigley ADiamond SIrani PSubramanian S(2014)Contextual experience sampling of mobile application micro-usageProceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628367(91-100)Online publication date: 23-Sep-2014
https://dl.acm.org/doi/10.1145/2628363.2628367
Moldovan ROrza BVlaicu APorumb C(2014)Advanced human-computer interaction in external resource annotation2014 IEEE International Conference on Automation, Quality and Testing, Robotics10.1109/AQTR.2014.6857852(1-6)Online publication date: May-2014
https://doi.org/10.1109/AQTR.2014.6857852
Gauffre GCharfi SBortolaso CBach CDubois E(2009)Developing Mixed Interactive Systems: A Model-Based Process for Generating and Managing Design SolutionsThe Engineering of Mixed Reality Systems10.1007/978-1-84882-733-2_10(183-208)Online publication date: 15-Oct-2009
https://doi.org/10.1007/978-1-84882-733-2_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents