More Web Proxy on the site http://driver.im/

poster

Making Math Graphs More Accessible in Remote Learning: Using Sonification to Introduce Discontinuity in Calculus

Authors:

Luke DuBoisAuthors Info & Claims

ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 77, Pages 1 - 4

https://doi.org/10.1145/3441852.3476533

Published: 17 October 2021 Publication History

Abstract

Math graphs need to be accessible to People with Visual Impairments (PVI). While tactile graphics are a common way for PVI to access math graphs, their use becomes complicated in remote learning. To make math graphs more accessible in remote education, we focused on sonification, the use of non-speech sound. In this study, we designed techniques of sonification of math graphs to introduce the concept of discontinuity in calculus to PVI. First, we conducted a remote interview with six participants to understand their experiences with math education using graphs. Based on these findings, we developed a series of sonifications of math graphs that we remotely evaluated with three participants from our initial interviews. Our findings reveal that sonification can intuitively convey simple patterns and trends in math graphs with a little practice, be useful to introduce the discontinuities, and be more effective with descriptions of the sound and graphs.

Supplementary Material

VTT File (PD1044.vtt)

Download
2.00 KB

MP4 File (PD1044.mp4)

Presentation video

Download
8.43 MB

References

[1]

Dragan Ahmetovic, Niccolò Cantù, Cristian Bernareggi, João Guerreiro, Sergio Mascetti, and Anna Capietto. 2019. Multimodal Exploration of Mathematical Function Graphs with AudioFunctions.web. In Proceedings of the 16th Web For All 2019 Personalization - Personalizing the Web (W4A ’19), Association for Computing Machinery, New York, NY, USA, 1–2.  

Digital Library

[2]

Edward C. Bell and Arielle M. Silverman. 2019. Access to Math and Science Content for Youth Who Are Blind or Visually Impaired. Journal of Blindness Innovation and Research, 9(1). Retrieved April 6, 2021 from https://nfb.org/images/nfb/publications/jbir/jbir19/jbir090101.html.  

[3]

Terri L. Bonebright, Mike A. Nees, Tayla T. Connerley, and Glenn R. McCain. 2001. Testing the effectiveness of sonified graphs for education: A programmatic research project. Georgia Institute of Technology.

[4]

Lorna M. Brown, Stephen A. Brewster, S. A. Ramloll, R. Burton, and Beate Riedel. 2003. Design guidelines for audio presentation of graphs and tables. In: 9th International Conference on Auditory Display (ICAD), Boston, Massachusetts, 6-9 July 2003, pp. 284-287.  

[5]

Lorna M. Brown, Stephen A. Brewster, Ramesh Ramloll, Wai Yu, and Beate Riedel. 2002. Browsing Modes For Exploring Sonified Line Graphs. In Proceedings of Bcs-Hci 2002, 6–9.  

[6]

Lawrence A. Chang. 1983. Handbook for Spoken Mathematics: (Larry's Speakeasy). Lawrence Livermore Laboratory, The Regents of the University of California.  

[7]

Rhodri Cusack and Brian Roberts. 2000. Effects of differences in timbre on sequential grouping. Perception & psychophysics 62, 1112-1120.

[8]

Benjamin K. Davison. 2012. Evaluating auditory graphs with blind students in a classroom. SIGACCESS Access. Comput. 102 (January 2012), 4–7.  

Digital Library

[9]

Benjamin K. Davison. 2013. Universal graph literacy: understanding how blind and low vision students can satisfy the common core standards with accessible auditory graphs. Ph.D. Dissertation. Georgia Institute of Technology.  

[10]

Desmos, Inc. 2021. Desmos | Beautiful, Free Math. Retrieved June 20, 2021 from https://www.desmos.com/.  

[11]

Polly Edman. 1992. Tactile Graphics. American Foundation for the Blind.  

[12]

John H. Flowers. 2005. Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. Georgia Institute of Technology.  

[13]

Lila Harrar and Tony Stockman. 2007. Designing auditory graph overviews: an examination of discrete vs. continuous sound and the influence of presentation speed. Georgia Institute of Technology.

[14]

Thomas Hermann, Andy Hunt, and John G. Neuhoff. 2011. The sonification handbook. Logos Verlag, Berlin.  

[15]

Steven M. Hetzler and Robert M. Tardiff. 2006. Two tools for integrating sonifications into calculus instruction. Georgia Institute of Technology.  

[16]

Steven M. Hetzler and Robert M. Tardiff. 2007. The Three “R”s: Real Students in Real Time Doing Real Work Learning Calculus. Georgia Institute of Technology.  

[17]

Eric Hsu and David Bressoud. 2015. Placement and student performance in Calculus I. Insights and recommendations from the MAA national study of college calculus (2015), 59–67.  

[18]

Claire Kearney-Volpe, Chancey Fleet, Keita Ohshiro, Veronica Alfaro Arias, and Amy Hurst. 2021. Making the elusive more tangible: remote tools & techniques for teaching web development to screen reader users. In Proceedings of the 18th International Web for All Conference (W4A '21). Association for Computing Machinery, New York, NY, USA, Article 9, 1–14.  

Digital Library

[19]

Jeongyeon Kim, Yoonah Lee, and Inho Seo. 2019. Math Graphs for the Visually Impaired: Audio Presentation of Elements of Mathematical Graphs. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19), Association for Computing Machinery, New York, NY, USA, 1–6.  

Digital Library

[20]

Barbara B. Lockee. 2021. Online education in the post-COVID era. Nature Electronics 4, 1 (January 2021), 5–6. 00534-0.  

[21]

Al Maneki. 2015. Guidelines for Collegiate Faculty to Teach Mathematics to Blind or Visually Impaired Students. 2015 CUPM Curriculum Guide. Retrieved June 21, 2021 from https://www.maa.org/sites/default/files/cupm/FacultyGuidelinesForTeachingVisuallyImpairedStudents.pdf.

[22]

D. L. Mansur, M. M. Blattner, and K. I. Joy. 1985. Sound graphs: a numerical data analysis method for the blind. J Med Syst 9, 3 (June 1985), 163–174.  

[23]

National Federation of the Blind. 2021. Homepage. Retrieved June 20, 2021 from https://www.nfb.org/.  

[24]

Michael A. Nees. 2018. Auditory Graphs Are Not the “Killer App” of Sonification, But They Work. Ergonomics in Design 26, 4 (October 2018), 25–28.  

[25]

Michael A. Nees and Lauren F. Berry. 2013. Audio assistive technology and accommodations for students with visual impairments: Potentials and problems for delivering curricula and educational assessments. Performance Enhancement & Health 2, 3 (September 2013), 101–109.

[26]

Michael A. Nees and Bruce N. Walker. 2009. Auditory Interfaces and Sonification. In The Universal Access Handbook, C. Stephanidis Ed., Lawrence Erlbaum Associates, New York, 507–521.  

[27]

Ofsted. 2021. Research review series: mathematics. Retrieved June 20, 2021 from https://www.gov.uk/government/publications/research-review-series-mathematics/research-review-series-mathematics.

[28]

Keita Ohshiro. 2021. Sonification of Math Graphs for People with Visual Impairments. Retrieved June 20, 2021 from https://bick-jp.github.io/p5jsMathGraphSonification/index.html.  

[29]

Processing Foundation. 2021. p5.js. Retrieved June 20, 2021 from https://p5js.org/.  

[30]

Daniel R. Smith and Bruce N. Walker. 2005. Effects of auditory context cues and training on performance of a point estimation sonification task. Applied Cognitive Psychology 19, 8 (2005), 1065–1087.  

[31]

Brianna J. Tomlinson, Jared Batterman, Yee Chieh Chew, Ashley Henry, and Bruce N. Walker. 2016. Exploring Auditory Graphing Software in the Classroom: The Effect of Auditory Graphs on the Classroom Environment. ACM Trans. Access. Comput. 9, 1 (November 2016), 3:1-3:27.  

Digital Library

[32]

Robert Upson. 2001. Sonifications as mathematics teaching tools. In Proceedings of the 7th International Conference on Auditory Display (ICAD2001), Espoo, Finland, July-August. pp. 222-226.

[33]

Karen Vines, Chris Hughes, Laura Alexander, Carol Calvert, Chetz Colwell, Hilary Holmes, Claire Kotecki, Kaela Parks, and Victoria Pearson. 2019. Sonification of numerical data for education, Open Learning: The Journal of Open, Distance and e-Learning, 34:1, 19-39.

[34]

Bruce N. Walker and Michael A. Nees. 2011. Theory of Sonification. The sonification handbook, 9–39. Logos Verlag, Berlin.

[35]

WGBH Educational Foundation. 2020. Guidelines for Describing STEM Images. Retrieved June 20, 2021 from https://www.wgbh.org/foundation/ncam/guidelines/guidelines-for-describing-stem-images.

Cited By

Shaheen N(2024)Exploring Blind and Low-Vision Youth’s Digital Access Needs in School: Toward Accessible Instructional TechnologiesACM Transactions on Accessible Computing10.1145/368880517:3(1-31)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.1145/3688805
Lee SKohga MLandau SO'Modhrain SSubramonyam H(2024)AltCanvas: A Tile-Based Editor for Visual Content Creation with Generative AI for Blind or Visually Impaired PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675600(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675600
Wimer BSouth LWu KSzafir DBorkin MMetoyer R(2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: Dec-2024
https://doi.org/10.1109/TVCG.2024.3356566
Show More Cited By

Index Terms

Making Math Graphs More Accessible in Remote Learning: Using Sonification to Introduce Discontinuity in Calculus

Index terms have been assigned to the content through auto-classification.

Recommendations

Math Graphs for the Visually Impaired: Audio Presentation of Elements of Mathematical Graphs
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

The sense of sight takes a dominating role in learning mathematical graphs. Most visually impaired students drop out of mathematics because necessary content is inaccessible. Sonification and auditory graphs have been the primary methods of representing ...
Exploration of Sonification Feedback for People with Visual Impairment to Use Ski Simulator
AHs '23: Proceedings of the Augmented Humans International Conference 2023

Training opportunities for visually impaired (VI) skiers are limited because it is essential for them to have sighted people who guide them with their voices. This study investigates an auditory feedback system that enables ski training using a ski ...
The accessible aquarium: identifying and evaluating salient creature features for sonification
Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility

Informal learning environments (e.g., aquaria, zoos, science centers) are often inaccessible to the visually impaired. Sonification can make such environments more accessible while also adding to the experience of sighted visitors. This study was to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

October 2021

730 pages

ISBN:9781450383066

DOI:10.1145/3441852

Editors:
Jonathan Lazar
University of Maryland, USA
,
Jinjuan Heidi Feng
Towson University, USA
,
Faustina Hwang
Towson University, USA

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

ASSETS '21

Sponsor:

SIGACCESS

ASSETS '21: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility

October 18 - 22, 2021

Virtual Event, USA

Acceptance Rates

ASSETS '21 Paper Acceptance Rate 36 of 134 submissions, 27%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
233
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)14

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shaheen N(2024)Exploring Blind and Low-Vision Youth’s Digital Access Needs in School: Toward Accessible Instructional TechnologiesACM Transactions on Accessible Computing10.1145/368880517:3(1-31)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.1145/3688805
Lee SKohga MLandau SO'Modhrain SSubramonyam H(2024)AltCanvas: A Tile-Based Editor for Visual Content Creation with Generative AI for Blind or Visually Impaired PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675600(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675600
Wimer BSouth LWu KSzafir DBorkin MMetoyer R(2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: Dec-2024
https://doi.org/10.1109/TVCG.2024.3356566
Li HBellona JSmith LBower ARoberts J(2023)“Let the Volcano Erupt!”: Designing Sonification to Make Oceanography Accessible for Blind and Low Vision Students in Museum EnvironmentProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614482(1-6)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614482
Ramôa GMoured OSchwarz TMüller KStiefelhagen R(2023)Enabling People with Blindness to Distinguish Lines of Mathematical Charts with Audio-Tactile Graphic ReadersProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594818(384-391)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594818
Fitzpatrick JNeff F(2023)Perceptually congruent sonification of auditory line chartsJournal on Multimodal User Interfaces10.1007/s12193-023-00413-w17:4(285-300)Online publication date: 30-Aug-2023
https://doi.org/10.1007/s12193-023-00413-w
Jariwala AJamshidi FMarghitu DChapman R(2023)Development and assessment of MyAccessible Math: promoting self-learning for students with vision impairmentUniversal Access in the Information Society10.1007/s10209-023-01068-wOnline publication date: 23-Nov-2023
https://doi.org/10.1007/s10209-023-01068-w
Zhao KMulet JSorita COriola BSerrano MJouffrais C(2022)Remote Graphic-Based Teaching for Pupils with Visual Impairments: Understanding Current Practices and Co-designing an Accessible Tool with Special Education TeachersProceedings of the ACM on Human-Computer Interaction10.1145/35677336:ISS(538-567)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567733
Siu AS-H Kim GO'Modhrain SFollmer S(2022)Supporting Accessible Data Visualization Through Audio Data NarrativesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517678(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517678
Sharif AWang OMuongchan AReinecke KWobbrock J(2022)VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-InProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517431(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517431

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents