More Web Proxy on the site http://driver.im/

research-article

Eyejam: a gaze-controlled musical interface

Authors:

Carlos H. Morimoto,

Antonio Diaz-Tula,

José A. T. Leyva,

Carlos E. L. ElmadjianAuthors Info & Claims

IHC '15: Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems

Article No.: 37, Pages 1 - 9

https://doi.org/10.1145/3148456.3148493

Published: 03 November 2015 Publication History

Abstract

Gaze-based interfaces use eye trackers as input devices to substitute, for example, the keyboard and mouse of a conventional graphical user interface. For people with severe motor disabilities, gaze is one of the few alternatives to interact with the world. The most common gaze interaction paradigm is called dwell-time, where keys are selected using fixations longer than a certain "dwell". Though simple, this mechanism does not permit the selection of keys at precise moments, a requirement to play music and certain video games. In this paper we introduce two gaze interaction techniques that overcome this limitation. The first is an extension of the dwell-time, where selection is triggered when the gaze exits the focused key. The second is based on the Context Switching paradigm, that uses saccades for selection instead of fixations. Results of a user experiment show that the Context Switching paradigm permits a more accurate timing control while playing music at 45 and 70 beats per minute.

References

[1]

D.W. Hansen and Qiang Ji. 2010. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 3 (march 2010), 478--500.

Digital Library

[2]

Anthony Hornof. 2014. The Prospects For Eye-Controlled Musical Performance. In Proceedings of the International Conference on New Interfaces for Musical Expression. London, United Kingdom, 461--466.

[3]

Anthony Hornof, Troy Rogers, and Tim Halverson. 2007. EyeMusic: performing live music and multimedia compositions with eye movements. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME).

Digital Library

[4]

Aulikki Hyrskykari, Howell Istance, and Stephen Vickers. 2012. Gaze Gestures or Dwell-based Interaction?. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12). New York, NY, USA, 229--232.

Digital Library

[5]

P. Isokoski. 2000. Text input methods for eye trackers using off-screen targets. In ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applications. ACM, New York, NY, 15--21.

Digital Library

[6]

Robert J. K. Jacob. 1991. The use of eye movements in human-computer interaction techniques: what you look at is what you get. ACM Trans. Inf. Syst. 9, 2 (1991), 152--169.

Digital Library

[7]

J. Kim, G. Schiemer, and T. Narushima. 2007. Oculog: Playing with eye movements. In Proceedings of the 7th International Conference on New Interfaces for Musical Expression (NIME 2007). New York, 50--55.

Digital Library

[8]

I. Scott MacKenzie and R. William Soukoreff. 2002. A Character-level Error Analysis Technique for Evaluating Text Entry Methods. In Proceedings of the Second Nordic Conference on Human-computer Interaction (NordiCHI '02). ACM, New York, NY, USA, 243--246.

Digital Library

[9]

P. Majaranta and K. J. Räihä. 2007. Text Entry by Gaze:Utilizing eye tracking. In Text entry systems: Mobility, accessibility, universality, I.S. MacKenzie and K.T. Ishii (Eds.). Morgan Kaufmann, 175--187.

[10]

C.H. Morimoto and A. Amir. 2010. Context Switching for Fast Key Selection in Text Entry Applications. In Proceedings of the ACM Symposium on Eye Tracking Research & Applications - ETRA 2010. Austin, TX, 271--274.

Digital Library

[11]

Takehiko Ohno. 1998. Features of Eye Gaze Interface for Selection Tasks. In Proc. of the Third Asia Pacific Computer Human Interaction- APCHI'98. IEEE Computer Society, 1--6.

Digital Library

[12]

A. Polli. 1999. Active vision: controlling sound with eye movements. Leonardo 32, 5 (1999), 405--411.

[13]

Kari-Jouko Räihä and Saila Ovaska. 2012. An exploratory study of eye typing fundamentals: dwell time, text entry rate, errors, and workload. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 3001--3010.

Digital Library

[14]

Dario D. Salvucci and Joseph H. Goldberg. 2000. Identifying Fixations and Saccades in Eye-tracking Protocols. In Proceedings of the 2000 Symposium on Eye Tracking Research & Applications (ETRA '00). ACM, New York, NY, USA, 71--78.

Digital Library

[15]

Zacharias Vamvakousis and Rafael Ramirez. 2012. Temporal Control In the EyeHarp Gaze-Controlled Musical Interface. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), G. Essl, B. Gillespie, M. Gurevich, and S. O'Modhrain (Eds.). University of Michigan, Ann Arbor, Michigan.

[16]

Stephen Vickers, Howell Istance, and Matthew Smalley. 2010. EyeGuitar: Making Rhythm Based Music Video Games Accessible Using Only Eye Movements. In Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology (ACE '10). ACM, New York, NY, USA, 36--39.

Digital Library

[17]

J. O. Wobbrock, J. Rubinstein, M. W. Sawyer, and A. T. Duchowski. 2008. Longitudinal evaluation of discrete consecutive gaze gesture for text entry. In Proceedings of Eye Tracking Research & Applications, ETRA 2008. ACM Press, Savannah, GA, 11--18.

Digital Library

Cited By

Davanzo NValente LLudovico LAvanzini F(2023)Kiroll: A Gaze-Based Instrument for Quadriplegic Musicians Based on the Context-Switching ParadigmProceedings of the 18th International Audio Mostly Conference10.1145/3616195.3616225(59-62)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1145/3616195.3616225
Ivanyi BTjemsland TTsalidis de Zabala CToth LDyrholm MNaylor SParadiso ALamb DChudge JAdjorlu ASerafin S(2023)DuoRhythmo: Design and remote user experience evaluation (UXE) of a collaborative accessible digital musical interface (CADMI) for people with ALS (PALS)Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581285(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581285
Davanzo NAvanzini FLudovico LMoreno DMoreira ATymoshchuk OAzevedo JMarques C(2023)A Case Study on Netychords: Crafting Accessible Digital Musical Instrument Interaction for a Special Needs ScenarioComputer-Human Interaction Research and Applications10.1007/978-3-031-49425-3_22(353-372)Online publication date: 23-Dec-2023
https://doi.org/10.1007/978-3-031-49425-3_22
Show More Cited By

Eyejam: a gaze-controlled musical interface
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

HMAGIC: head movement and gaze input cascaded pointing
PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Augmentative and alternative communication tools allow people with severe motor disabilities to interact with computers. Two commonly used tools are video-based interfaces and eye trackers. Video-based interfaces map head movements captured by a camera ...
Simple gaze gestures and the closure of the eyes as an interaction technique
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

We created a set of gaze gestures that utilize the following three elements: simple one-segment gestures, off-screen space, and the closure of the eyes. These gestures are to be used as the moving tool in a gaze-only controlled drawing application. We ...
Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Head-mounted displays let users explore virtual environments through a viewport that is coupled with head movement. In this work, we investigate gaze as an alternative modality for viewport control, enabling exploration of virtual worlds with less head ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IHC '15: Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems

November 2015

514 pages

ISBN:9781450353625

DOI:10.1145/3148456

Editors:
Artur Henrique Kronbauer
Universidade Salvador (UNFACS) and Universidade do Estado da Bahia (UNEB)
,
Ecivaldo Mattos
Universidade Federal da Bahia UFBA)
,
Andreia Libório Sampaio
Universidade Federal do Ceará (UFC)
,
Clodis Boscarioli
Universidade Estadual do Oeste do Paraná (UNIOSTE)

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fundação de Amparo à Pesquisa do Estado de São Paulo

Conference

IHC 2015

IHC 2015: XIV Brazilian Symposium on Human Factors in Computer Systems

November 3 - 6, 2015

Salvador, Brazil

Acceptance Rates

Overall Acceptance Rate 331 of 973 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
81
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Davanzo NValente LLudovico LAvanzini F(2023)Kiroll: A Gaze-Based Instrument for Quadriplegic Musicians Based on the Context-Switching ParadigmProceedings of the 18th International Audio Mostly Conference10.1145/3616195.3616225(59-62)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1145/3616195.3616225
Ivanyi BTjemsland TTsalidis de Zabala CToth LDyrholm MNaylor SParadiso ALamb DChudge JAdjorlu ASerafin S(2023)DuoRhythmo: Design and remote user experience evaluation (UXE) of a collaborative accessible digital musical interface (CADMI) for people with ALS (PALS)Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581285(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581285
Davanzo NAvanzini FLudovico LMoreno DMoreira ATymoshchuk OAzevedo JMarques C(2023)A Case Study on Netychords: Crafting Accessible Digital Musical Instrument Interaction for a Special Needs ScenarioComputer-Human Interaction Research and Applications10.1007/978-3-031-49425-3_22(353-372)Online publication date: 23-Dec-2023
https://doi.org/10.1007/978-3-031-49425-3_22
Davanzo NAvanzini F(2020)Hands-Free Accessible Digital Musical Instruments: Conceptual Framework, Challenges, and PerspectivesIEEE Access10.1109/ACCESS.2020.30199788(163975-163995)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3019978
Valencia SLamb DWilliams SKulkarni HParadiso ARingel Morris MBigham JAzenkot SKane S(2019)Dueto: Accessible, Gaze-Operated Musical ExpressionProceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3308561.3354603(513-515)Online publication date: 24-Oct-2019
https://dl.acm.org/doi/10.1145/3308561.3354603
Davanzo NDondi PMosconi MPorta MMorimoto CPfeiffer T(2018)Playing music with the eyes through an isomorphic interfaceProceedings of the Workshop on Communication by Gaze Interaction10.1145/3206343.3206350(1-5)Online publication date: 15-Jun-2018
https://dl.acm.org/doi/10.1145/3206343.3206350

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents