research-article

Personal Perspectives on Using Automatic Speech Recognition to Facilitate Communication between Deaf Students and Hearing Customers

Authors:

James R. Mallory,

Michael Stinson,

Lisa Elliot,

Donna EastonAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 419 - 421

https://doi.org/10.1145/3132525.3134779

Published: 19 October 2017 Publication History

Get Access

Abstract

Automatic Speech Recognition (ASR) and the wide use of smart phones and their apps have allowed huge inroads when preparing deaf and hard-of-hearing (D/HH) students to be effective and productive in the hearing workplace. This paper presents both a hearing instructor's experiences and a deaf researcher's observations when preparing deaf and hard of hearing students as computer technicians for the hearing work place.

References

[1]

Acero, A., Deng, L., Kristjansson, T.T., Zhang, J.: HMM adaptation using vector taylor series for noisy speech recognition. In: Proceedings of Annual Conference of International Speech Communication Association (INTERSPEECH), pp. 869-872 (2000)

Google Scholar

[2]

Bahl, L., Brown, P., de Souza, P., Mercer, R.: Maximum mutual information estimation of HMM parameters for speech recognition. In: Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 49-52 (1986)

Google Scholar

[3]

Baker, J., Deng, L., Glass, J., Khudanpur, S., Lee, C.H., Morgan, N., O'Shgughnessy, D.: Research developments and directions in speech recognition and understanding, part i. IEEE Signal Process. Mag. 26(3), 75-80 (2009)

Crossref

Google Scholar

[4]

Baker, J., Deng, L., Glass, J., Khudanpur, S., Lee, C.H., Morgan, N., O'Shgughnessy, D.: Updated minds report on speech recognition and understanding (research developments and directions in speech recognition and understanding, part ii ). IEEE Signal Process. Mag. 26(4), 78-85 (2009)

Crossref

Google Scholar

[5]

Biem, A., Katagiri, S., McDermott, E., Juang, B.H.: An application of discriminative feature extraction to filter-bank-based speech recognition. IEEE Trans. Speech Audio Process. 9, 96-110 (2001)

Crossref

Google Scholar

[6]

Bilmes, J.: Buried Markov models: a graphical modeling approach to automatic speech recognition. Comput. Speech Lang. 17, 213-231 (2003)

Crossref

Google Scholar

Cited By

View all

de Lacerda Pataca CHassan STinker NPeiris RHuenerfauth M(2024)Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing IndividualsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642258(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642258
McDonnell EEagle TSinlapanuntakul PMoon SRingland KFroehlich JFindlater L(2024)“Caption It in an Accessible Way That Is Also Enjoyable”: Characterizing User-Driven Captioning Practices on TikTokProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642177(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642177
Chen SWaller JSeita MVogler CKushalnagar RWang Q(2024)Towards Co-Creating Access and Inclusion: A Group Autoethnography on a Hearing Individual's Journey Towards Effective Communication in Mixed-Hearing Ability Higher Education SettingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642017(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642017
Show More Cited By

Index Terms

Personal Perspectives on Using Automatic Speech Recognition to Facilitate Communication between Deaf Students and Hearing Customers
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Recent advances in Automatic Speech Recognition (ASR) have made this technology a potential solution for transcribing audio input in real-time for people who are Deaf or Hard of Hearing (DHH). However, ASR is imperfect; users must cope with errors in ...
Deaf, Hard of Hearing, and Hearing Perspectives on Using Automatic Speech Recognition in Conversation
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

This experience report describes the accessibility challenges in using the top seven most popular Automatic Speech Recognition (ASR) applications on personal devices for commands and group conversation, by five deaf, hard of hearing and hearing ...
Cued Speech automatic recognition in normal-hearing and deaf subjects

This article discusses the automatic recognition of Cued Speech in French based on hidden Markov models (HMMs). Cued Speech is a visual mode which, by using hand shapes in different positions and in combination with lip patterns of speech, makes all the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
253
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

de Lacerda Pataca CHassan STinker NPeiris RHuenerfauth M(2024)Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing IndividualsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642258(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642258
McDonnell EEagle TSinlapanuntakul PMoon SRingland KFroehlich JFindlater L(2024)“Caption It in an Accessible Way That Is Also Enjoyable”: Characterizing User-Driven Captioning Practices on TikTokProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642177(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642177
Chen SWaller JSeita MVogler CKushalnagar RWang Q(2024)Towards Co-Creating Access and Inclusion: A Group Autoethnography on a Hearing Individual's Journey Towards Effective Communication in Mixed-Hearing Ability Higher Education SettingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642017(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642017
McDonnell E(2023)Understanding Social and Environmental Factors to Enable Collective Access Approaches to the Design of Captioning TechnologyACM SIGACCESS Accessibility and Computing10.1145/3584732.3584735(1-1)Online publication date: 15-Feb-2023
https://dl.acm.org/doi/10.1145/3584732.3584735
de Lacerda Pataca CWatkins MPeiris RLee SHuenerfauth M(2023)Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing UsersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581511(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581511
Tang XChang XChen NNi YLC RTong X(2023)Community-Driven Information Accessibility: Online Sign Language Content Creation within d/Deaf CommunitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581286(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581286
Kim YIm HLee SCho HLee S(2023)“We Speak Visually”: User-Generated Icons for Better Video-Mediated Mixed-Group Communications Between Deaf and Hearing ParticipantsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581151(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581151
McDonnell EMoon SJiang LGoodman SKushalnagar RFroehlich JFindlater L(2023)“Easier or Harder, Depending on Who the Hearing Person Is”: Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing StatusProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580809(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580809
de Lacerda Pataca CCosta P(2023)Hidden Bawls, Whispers, and Yelps: Can Text Convey the Sound of Speech, Beyond Words?IEEE Transactions on Affective Computing10.1109/TAFFC.2022.317472114:1(6-16)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TAFFC.2022.3174721
Alonzo OElliot LDingman BLee SAl Amin AHuenerfauth M(2022)Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals in the U.S.: Their Reading Experiences, Interests and Perceptions of Social AccessibilityACM Transactions on Accessible Computing10.1145/352019815:2(1-31)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3520198
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings

Deaf, Hard of Hearing, and Hearing Perspectives on Using Automatic Speech Recognition in Conversation

Cued Speech automatic recognition in normal-hearing and deaf subjects