Article

Usability Evaluation of Multimodal Interfaces: Is the Whole the Sum of Its Parts?

Authors:

Ina Wechsung,

Klaus-Peter Engelbrecht,

Stefan Schaffer,

Julia Seebode,

Florian Metze,

Sebastian MöllerAuthors Info & Claims

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques

Pages 113 - 119

https://doi.org/10.1007/978-3-642-02577-8_13

Published: 14 July 2009 Publication History

Abstract

Usability evaluation of multimodal systems is a complex issue. Multimodal systems provide multiple channels to communicate with the system. Thus, the single modalities as well as their combination have to be taken into account. This paper aims to investigate how ratings of single modalities relate to the ratings of their combination. Therefore a usability evaluation study was conducted testing an information system in two unimodal versions and one multimodal version. Multiple linear regression showed that for overall and global judgments ratings of the single modalities are very good predictors for the ratings of the multimodal system. For separate usability aspects (e.g. hedonic qualities) the prediction was less accurate.

References

[1]

Chen, F.: Designing Human Interface in Speech Technology. Springer, New York (2005).

Crossref

Google Scholar

[2]

Baddeley, A.D., Hitch, G.J.: Working memory. In: Bower, G. (ed.) The psychology of learning and motivation, pp. 47-89. Academic Press, New York (1974).

Google Scholar

[3]

Wickens, C.D.: Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science 3, 159-177 (2002).

Google Scholar

[4]

Oviatt, S.L.: Ten myths of multimodal interaction. Communications of the ACM 42(11), 576-583 (1999).

Crossref

Google Scholar

[5]

Schomaker, L., Nijtmans, J., Camurri, A., Lavagetto, F., Morasso, P., Benoît, C., Guiard-Marigny, T., Le Goff, B., Robert-Ribes, J., Adjoudani, A., Defée, I., Münch, S., Hartung, K., Blauert, J.: A Taxonomy of Multimodal Interaction in the Human Information Processing System. A Report of the ESPRIT Project 8579 MIAMI. NICI, Nijmegen (1995).

Google Scholar

[6]

Schnotz, W., Bannert, M., Seufert, T.: Towards an integrative view of text and picture comprehension: Visualization effects on the construction of mental models. In: Otero, J., Graesser, A., Leon, J.A. (eds.) The Psychology of Science Text Comprehension., pp. 385- 416. Erlbaum, Mahwah (2002).

Google Scholar

[7]

Kirakowski, J.: The software usability measurement inventory: background and usage. In: Jordan, P. (ed.) Usability Evaluation in Industry, pp. 169-177. Taylor & Francis, London (1996).

Google Scholar

[8]

Hone, K.S., Graham, R.: Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI). Nat. Lang. Eng. 6(3-4), 287-303 (2000).

Crossref

Google Scholar

[9]

Beringer, N., Kartal, U., Louka, K., Schiel, F., Türk, U.: PROMISE: A Procedure for Multimodal Interactive System Evaluation. In: Procs of the Workshop Multimodal Resources and Multimodal Systems Evaluation, Las Palmas, Gran Canaria, Spain, pp. 77-80 (2002).

Google Scholar

[10]

Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrge-nommener hedonischer und pragmatischer Qualität. In: Ziegler, J., Szwillus, G. (eds.) Mensch & Computer 2003, Interaktion in Bewegung, pp. 187-196. B.G. Teubner, Leipzig (2003).

Google Scholar

Cited By

View all

Ghosh SJoshi ATripathi S(2013)Empirical evaluation of multimodal input interactionsProceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction design - Volume Part I10.1007/978-3-642-39209-2_5(37-47)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39209-2_5

Recommendations

Multimodal Usability
Usability of user interfaces: from monomodal to multimodal
BCS-HCI '07: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2

This workshop is aimed at reviewing and comparing existing Usability Evaluation Methods (UEMs) which are applicable to monomodal and multimodal applications, whether they are web-oriented or not. It addresses the problem on how to assess the usability ...
Evaluation of spoken multimodal conversation
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Spoken multimodal dialogue systems in which users address face-only or embodied interface agents have been gaining ground in research for some time. Although most systems are still strictly task-oriented, the field is now moving towards domain-oriented ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques

July 2009

891 pages

ISBN:9783642025761

Editor:
Julie A. Jacko
Institute of Health Informatics, MMC 912, University of Minnesota, Minneapolis, USA 55455

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 14 July 2009

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ghosh SJoshi ATripathi S(2013)Empirical evaluation of multimodal input interactionsProceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction design - Volume Part I10.1007/978-3-642-39209-2_5(37-47)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39209-2_5

Abstract

References

Cited By

Recommendations

Multimodal Usability

Usability of user interfaces: from monomodal to multimodal

Evaluation of spoken multimodal conversation

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations