More Web Proxy on the site http://driver.im/

research-article

Public Access

Exploring the Design of Audio-Kinetic Graphics for Education

Authors:

Annika Muehlbradt,

Darren Guinness,

Shaun K. KaneAuthors Info & Claims

ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal Interaction

Pages 455 - 463

https://doi.org/10.1145/3242969.3243004

Published: 02 October 2018 Publication History

Abstract

Creating tactile representations of visual information, especially moving images, is difficult due to a lack of available tactile computing technology and a lack of tools for authoring tactile information. To address these limitations, we developed a software framework that enables educators and other subject experts to create graphical representations that combine audio descriptions with kinetic motion. These audio-kinetic graphics can be played back using off-the-shelf computer hardware. We report on a study in which 10 educators developed content using our framework, and in which 18 people with vision impairments viewed these graphics on our output device. Our findings provide insights on how to translate knowledge of visual information to non-visual formats.

Supplementary Material

suppl.mov (icmi1132.mp4)

Supplemental video

Download
36.48 MB

References

[1]

Black, J. A., & Hayden, D. S. (2010, June). The Note-Taker: An assistive technology that allows students who are legally blind to take notes in the classroom. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on (pp. 1--8). IEEE.

[2]

Braier, J., Lattenkamp, K., Räthel, B., Schering, S., Wojatzki, M., & Weyers, B. (2015). Haptic 3D surface representation of table-based data for people with visual impairments. ACM Transactions on Accessible Computing (TACCESS), 6(1), 1.

Digital Library

[3]

Brown, C., & Hurst, A. (2012, February). VizTouch: automatically generated tactile visualizations of coordinate spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (pp. 131--138). ACM.

Digital Library

[4]

Capovilla, D., Krugel, J., & Hubwieser, P. (2013, March). Teaching algorithmic thinking using haptic models for visually impaired students. In Learning and Teaching in Computing and Engineering (LaTiCE), 2013 (pp. 167--171). IEEE.

Digital Library

[5]

Cavender, A. C., Bigham, J. P., & Ladner, R. E. (2009, October). ClassInFocus: enabling improved visual attention strategies for deaf and hard of hearing students. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility (pp. 67--74). ACM.

Digital Library

[6]

Crombie, D., Lenoir, R., McKenzie, N., & Ioannidis, G. (2004, July). The bigger picture: Automated production tools for tactile graphics. In International Conference on Computers for Handicapped Persons (pp. 713--720). Springer, Berlin, Heidelberg.

[7]

Follmer, S., Leithinger, D., Olwal, A., Hogge, A., & Ishii, H. (2013, October). inFORM: dynamic physical affordances and constraints through shape and object actuation. In Uist (Vol. 13, pp. 417--426).

Digital Library

[8]

Freire, A. P., Linhalis, F., Bianchini, S. L., Fortes, R. P., & Maria da Graça, C. P. (2010). Revealing the whiteboard to blind students: An inclusive approach to provide mediation in synchronous e-learning activities. Computers & Education, 54(4), 866--876.

Digital Library

[9]

Guinness, D. (2018). Using robots to improve the accessibility of online videos. ACM SIGACCESS Accessibility and Computing, (120), 20--23.

Digital Library

[10]

Guinness, D., Szafir, D., & Kane, S. K. (2017, June). GUI Robots: Using off-the-shelf robots as tangible input and output devices for unmodified GUI applications. In Proceedings of the 2017 Conference on Designing Interactive Systems (pp. 767--778). ACM.

Digital Library

[11]

Hornecker, E., & Buur, J. (2006, April). Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI conference on Human Factors in computing systems (pp. 437--446). ACM.

Digital Library

[12]

Horstmann*, M., Lorenz, M., Watkowski, A., Ioannidis, G., Herzog, O., King, A., ... & King, N. (2004). Automated interpretation and accessible presentation of technical diagrams for blind people. New Review of Hypermedia and Multimedia, 10(2), 141--163.

Digital Library

[13]

Hughes, G., & Robinson, P. (2007, October). Photonote evaluation: aiding students with disabilities in a lecture environment. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility (pp. 99--106). ACM.

Digital Library

[14]

Ishii, H., & Ullmer, B. (1997, March). Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (pp. 234--241). ACM.

Digital Library

[15]

Jacobsson, M., Fernaeus, Y., & Holmquist, L. E. (2008). Glowbots: Designing and implementing engaging human-robot interaction.

[16]

Jayant, C., Renzelmann, M., Wen, D., Krisnandi, S., Ladner, R., & Comden, D. (2007, October). Automated tactile graphics translation: in the field. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility(pp. 75--82). ACM.

Digital Library

[17]

Jeon, M., Smith, M. T., Walker, J. W., & Kuhl, S. A. (2014, June). Constructing the immersive interactive sonification platform (iISoP). In International Conference on Distributed, Ambient, and Pervasive Interactions (pp. 337--348). Springer, Cham.

[18]

Kane, S. K., & Bigham, J. P. (2014, March). Tracking @stemxcomet: teaching programming to blind students via 3D printing, crisis management, and twitter. In Proceedings of the 45th ACM technical symposium on Computer science education (pp. 247--252). ACM.

Digital Library

[19]

Kelly, R. (2000). Working with WebQuests: Making the web accessible to students with disabilities. Teaching Exceptional Children, 32(6), 4--13.

[20]

Kushalnagar, R. S., Ludie, S. A., & Kushalnagar, P. (2011, October). Multi-view platform: an accessible live classroom viewing approach for low vision students. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (pp. 267--268). ACM.

Digital Library

[21]

Ladner, R. E., Ivory, M. Y., Rao, R., Burgstahler, S., Comden, D., Hahn, S., ... & Martin, A. (2005, October). Automating tactile graphics translation. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility (pp. 150--157). ACM.

Digital Library

[22]

Manshad, M. S., Pontelli, E., & Manshad, S. J. (2011, October). MICOO (multimodal interactive cubes for object orientation): a tangible user interface for the blind and visually impaired. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (pp. 261--262). ACM.

Digital Library

[23]

McGookin, D., Robertson, E., & Brewster, S. (2010, April). Clutching at straws: using tangible interaction to provide non-visual access to graphs. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1715--1724). ACM.

Digital Library

[24]

Pangaro, G., Maynes-Aminzade, D., & Ishii, H. (2003). The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. ACM Transactions on Graphics, 22(3), 699--699.

Digital Library

[25]

Stangl, A., Hsu, C. L., & Yeh, T. (2015, October). Transcribing across the senses: community efforts to create 3D printable accessible tactile pictures for young children with visual impairments. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (pp. 127--137). ACM.

Digital Library

[26]

Suzuki, R., Stangl, A., Gross, M. D., & Yeh, T. (2017, October). FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 190--199). ACM.

Digital Library

[27]

Swaminathan, S., Roumen, T., Kovacs, R., Stangl, D., Mueller, S., & Baudisch, P. (2016, May). Linespace: A sensemaking platform for the blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 2175--2185). ACM.

Digital Library

[28]

Völkel, T., Weber, G., & Baumann, U. (2008, July). Tactile graphics revised: the novel brailledis 9000 pin-matrix device with multitouch input. In International Conference on Computers for Handicapped Persons (pp. 835--842). Springer, Berlin, Heidelberg.

Digital Library

[29]

Wang, Z., Li, B., Hedgpeth, T., & Haven, T. (2009, October). Instant tactile-audio map: enabling access to digital maps for people with visual impairment. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility (pp. 43--50). ACM.

Digital Library

[30]

Way, T. P., & Barner, K. E. (1997). Automatic visual to tactile translation. II. Evaluation of the TACTile image creation system. IEEE Transactions on Rehabilitation Engineering, 5(1), 95--105.

[31]

Yeh, T., & Kim, J. (2018). CraftML: Where 3D Modeling is Web Programming.

Cited By

Shaheen N(2024)Exploring Blind and Low-Vision Youth’s Digital Access Needs in School: Toward Accessible Instructional TechnologiesACM Transactions on Accessible Computing10.1145/368880517:3(1-31)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.1145/3688805
Tlapa-Monge LMontané-Jiménez L(2023)A Systematic Mapping Study on Accessibility in Data Visualizations for Visually Impaired Users2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)10.1109/CONISOFT58849.2023.00032(186-196)Online publication date: 6-Nov-2023
https://doi.org/10.1109/CONISOFT58849.2023.00032
Soares MFurukawa CCagnin MPaiva D(2023)Accessible learning objects: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-023-01025-723:4(1931-1945)Online publication date: 4-Aug-2023
https://doi.org/10.1007/s10209-023-01025-7
Show More Cited By

Index Terms

Exploring the Design of Audio-Kinetic Graphics for Education
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies

Recommendations

What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning
Evaluating the quality of accessible image captions with human raters is difficult, as it may be difficult for a visually impaired user to know how comprehensive a caption is, whereas a sighted assistant may not know what information a user will need from ...
"I can do everything but see!" -- How People with Vision Impairments Negotiate their Abilities in Social Contexts
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

This research takes an orientation to visual impairment (VI) that does not regard it as fixed or determined alone in or through the body. Instead, we consider (dis)ability as produced through interactions with the environment and configured by the ...
BrailleBlocks: Computational Braille Toys for Collaborative Learning
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Braille literacy has fallen in recent years, and many blind children now grow up without learning Braille. However, learning Braille can increase employment chances and improve literacy skills. We introduce BrailleBlocks, a system to help visually ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal Interaction

October 2018

687 pages

ISBN:9781450356923

DOI:10.1145/3242969

General Chairs:
Sidney K. D'Mello
University of Illinois, USA
,
Panayiotis (Panos) Georgiou
University of Southern California, USA
,
Stefan Scherer
University of Southern California, USA
,
Program Chairs:
Emily Mower Provost
University of Michigan, USA
,
Mohammad Soleymani
University of Southern California, USA
,
Marcelo Worsley
Northwestern University, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: Specialist Interest Group in Computer-Human Interaction of the ACM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

ICMI '18

Sponsor:

SIGCHI

ICMI '18: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 16 - 20, 2018

CO, Boulder, USA

Acceptance Rates

ICMI '18 Paper Acceptance Rate 63 of 149 submissions, 42%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
497
Total Downloads

Downloads (Last 12 months)109
Downloads (Last 6 weeks)13

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shaheen N(2024)Exploring Blind and Low-Vision Youth’s Digital Access Needs in School: Toward Accessible Instructional TechnologiesACM Transactions on Accessible Computing10.1145/368880517:3(1-31)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.1145/3688805
Tlapa-Monge LMontané-Jiménez L(2023)A Systematic Mapping Study on Accessibility in Data Visualizations for Visually Impaired Users2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)10.1109/CONISOFT58849.2023.00032(186-196)Online publication date: 6-Nov-2023
https://doi.org/10.1109/CONISOFT58849.2023.00032
Soares MFurukawa CCagnin MPaiva D(2023)Accessible learning objects: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-023-01025-723:4(1931-1945)Online publication date: 4-Aug-2023
https://doi.org/10.1007/s10209-023-01025-7
Fan DSiu ALaw WZhen RO'Modhrain SFollmer S(2022)Slide-Tone and Tilt-Tone: 1-DOF Haptic Techniques for Conveying Shape Characteristics of Graphs to Blind UsersProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517790(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517790
Siu AChase EKim GBoadi-Agyemang AGonzalez EFollmer S(2021)Haptic Guidance to Support Design Education and Collaboration for Blind and Visually Impaired PeopleDesign Thinking Research10.1007/978-3-030-76324-4_9(167-180)Online publication date: 12-Aug-2021
https://doi.org/10.1007/978-3-030-76324-4_9
Chase ESiu ABoadi-Agyemang AKim GGonzalez EFollmer S(2020)PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics ExplorationProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3418023(1-4)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3418023
Guinness DMuehlbradt ASzafir DKane SBigham JAzenkot SKane S(2019)RoboGraphics: Using Mobile Robots to Create Dynamic Tactile GraphicsProceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3308561.3354597(673-675)Online publication date: 24-Oct-2019
https://dl.acm.org/doi/10.1145/3308561.3354597
Kim LFollmer SBrewster SFitzpatrick GCox AKostakos V(2019)SwarmHapticsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300918(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300918

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents