More Web Proxy on the site http://driver.im/

research-article

i*Chameleon: a platform for developing multimodal application with comprehensive development cycle

Authors:

Kenneth W. K. Lo,

Will W. W. Tang,

Alvin T. S. Chan,

Stephen C. F. ChanAuthors Info & Claims

SAC '13: Proceedings of the 28th Annual ACM Symposium on Applied Computing

Pages 1103 - 1108

https://doi.org/10.1145/2480362.2480570

Published: 18 March 2013 Publication History

Abstract

We present i*Chameleon, a configurable and extensible multimodal platform for developing highly interactive applications. The platform leverages a principled and comprehensive development cycle to systematically capture the multimodal interaction artifact. Importantly, by introducing MVC architectural pattern, it enforces the concept of separation-of-concerns to enable cross collaboration among device engineers, programmers, modality designers and interaction designers who are collectively working on different aspects of human computer interaction and programming. Collectively, the development efforts are combined, integrated and compiled by the i*Chameleon kernel to derive the multimodal interactive application. The i*Chameleon platform sets itself apart from previous works in that it advocates the need to engineer a software development approach that leverages a MVC software architectural pattern to promote ease of software development through division of responsibilities among engineers and HCI designers. To validate the usefulness of i*Chameleon, we describe several application case examples to demonstrate the ease of developing multimodal applications through systematic integration of the design models as described above.

References

[1]

Bouchet, J., and Nigay, L. ICARE: a component-based approach for the design and development of multimodal interfaces. In Proc. CHI '04. ACM Press, New York, 2004, 1325--1328.

Digital Library

[2]

Bouchet, J., Nigay, L., and Ganille, T. ICARE software components for rapidly developing multimodal interfaces. In Proc. ICMI '04. ACM Press, New York, 2004, 251--258.

Digital Library

[3]

Dragicevic, P., Fekete J.-D., Kastler, E. A., and Chantrerie, L. Input Device Selection and Interaction Configuration with ICON, In Proc. of IHM-HCI, Springer Verlag, 2001, 543--558.

[4]

Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., and Gee, J. Reflective physical prototyping through integrated design, test, and analysis. In Proc. UIST '06, ACM Press, New York, 2006, 229--308.

Digital Library

[5]

Lalanne, D., and Kohlas, J. Multimodal interfaces: A survey of principles, models and frameworks. Human Machine Interaction, LNCS, Springer, 2009, 3--26.

[6]

Lawson, J. Y. L., Al-Akkad, A. A., Vanderodonckt, J., and Macq, B. An open Source Workbench for Prototyping Multimodal Interactions Based on Off-The-Shelf Heterogeneous Components. In Proc. EICS '09, ACM Press, New York, 2009, 245--254.

Digital Library

[7]

Luyten, K., Vanacken, D., Weiss, M., Borchers, J., Izadi, S., and Wigdor, D. Engineering patterns for multi-touch interfaces. In Proc. EICS '10, ACM Press, New York, 2010, 365--366.

Digital Library

[8]

Maynes-Aminzade, D., Winograd, T., and Igarashi, T. Eyepatch: prototyping camera-based interaction through Examples. In Proc. UIST '06. ACM Press, New York, 2006, 33--42.

Digital Library

[9]

Ngai, G., Chan, S. C. F., Ng., V. T. Y., Cheung, J. C. Y., Choy, S. S. S., Lau, W. W. Y., and Tse, J. T. P. i*CATch: a scalable plug-n-play wearable computing framework for novices and children. In Proc. CHI '10, ACM Press, New York, 2010, 443--452.

Digital Library

[10]

Nigay, L. and Coutaz, J. A generic platform for addressing the multimodal challenge. In Proc. CHI '95, ACM Press, New York, 1995, 98--105.

Digital Library

[11]

Nigay, L., Bouchet, J., Juras, D., Mansoux, B., Ortega, M., Serrano, M., and Lawson, J. Y. L. Software engineering for multimodal interactive systems. Multimodal User Interfaces, Springer, 2008, 201--218.

[12]

Noceti, N., Caputo, B., Castellini, C., Baldassarre, L., Barla, A., Rosasco, L., Odone, F., and Sandini, G. Towards a Theoretical Framework for Learning Multi-modal Patterns for Embodied Agents. In Proc. ICIAP '09, Springer, 2009, 239--248.

Digital Library

[13]

Obrenovic, Z. Starcevic, D., and Devedzic, V. Using ontologies in the design of multimodal user interfaces. In Proc. HCII '03, IOS Press, 2003, 535--542.

[14]

Oviatt, S. Ten myths of multimodal interaction. Communications of the ACM, ACM Press, 42(11), 1999, 74--81.

Digital Library

[15]

Oviatt, S. Advances in robust multimodal interface design. IEEE Computer Graphics and Applications, IEEE Computer Society Press, 23(5), 2003, 62--68.

Digital Library

[16]

Oviatt, S. Multimodal interfaces. The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, J. Jacko, A. Sears, Eds. ch. 14, CRC Press, Boca Raton, 2006, 286--304.

Digital Library

[17]

Serrano, M., Nigay, L., Lawson, J. Y. L., Ramsay, A., Murray-Smith, R., and Denef, S. The OpenInterface framework: a tool for multimodal interaction. In Proc. CHI '08, ACM Press, New York, 2008, 3501--3506.

Digital Library

[18]

Tang, W. W. W., Lo, K. W. K., Chan, A. T. S., Chan, S. C. F., Leong, H. V., and Ngai, G., i*Chameleon: a scalable and extensible framework for multimodal interaction. In Proc. CHI '11, ACM Press, New York, 2011, 305--310.

Digital Library

Cited By

Elouali NLe Pallec XRouillard JTarby JWang STao YChen LLee C(2014)A Model-based Approach for Engineering Multimodal Mobile InteractionsProceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia10.1145/2684103.2684112(52-61)Online publication date: 8-Dec-2014
https://dl.acm.org/doi/10.1145/2684103.2684112

Index Terms

i*Chameleon: a platform for developing multimodal application with comprehensive development cycle
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

i*Chameleon: a scalable and extensible framework for multimodal interaction
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

i*Chameleon is a multimodal interaction framework that enables programmers to readily prototype and test new interactive devices or interaction modes. It allows users to customize their own desktop environment for interaction beyond the usual KVM ...
Software engineering for parallel systems: the TRAPPER approach
HICSS '95: Proceedings of the 28th Hawaii International Conference on System Sciences

TRAPPER is a graphical programming environment for parallel systems. The novel approach introduced with TRAPPER is the support of the different stages of the software engineering process with emphasis on the specific problems of parallel systems. The ...
Modular Human-Computer Interaction Platform on Mobile Devices for Distributed Development
Computers Helping People with Special Needs
Abstract
For people with visual disabilities, mobile devices have become an indispensable part for independent and self-determined living. Increasing performance of mobile devices and availability of mobile sensors and actors can improve the usability and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '13: Proceedings of the 28th Annual ACM Symposium on Applied Computing

March 2013

2124 pages

ISBN:9781450316569

DOI:10.1145/2480362

Conference Chairs:
Sung Y. Shin
South Dakota State University, United States
,
José Carlos Maldonado
ICMC - University of São Paulo, Brazil

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAC '13

Sponsor:

SIGAPP

SAC '13: SAC '13

March 18 - 22, 2013

Coimbra, Portugal

Acceptance Rates

SAC '13 Paper Acceptance Rate 255 of 1,063 submissions, 24%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Elouali NLe Pallec XRouillard JTarby JWang STao YChen LLee C(2014)A Model-based Approach for Engineering Multimodal Mobile InteractionsProceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia10.1145/2684103.2684112(52-61)Online publication date: 8-Dec-2014
https://dl.acm.org/doi/10.1145/2684103.2684112

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents