More Web Proxy on the site http://driver.im/

research-article

Watch Your Language: Using Smartwatches to Support Communication

Authors:

Humphrey Curtis,

Timothy NeateAuthors Info & Claims

ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 51, Pages 1 - 21

https://doi.org/10.1145/3597638.3608379

Published: 22 October 2023 Publication History

Abstract

With an ageing population and increased prevalence of people living with complex communication needs there is a growing need to design scalable high-tech augmentative and alternative communication (AAC) apps to support agency and social participation. For end-users it is currently difficult to regulate the prominence of most mainstream high-tech AAC devices and tablet-based apps – they are socially conspicuous, offer poor portability, are aesthetically unconsidered, and obstruct vital non-verbal communication pathways. In response to this, we leverage participatory design techniques to design and evaluate two discreet and inconspicuous AAC smartwatch apps. We engage with a community of people living with the language impairment aphasia, to collaboratively build and iterate both a smartwatch app for ‘public’ communication: Watch Out and ‘private’ cognitive support: Watch In. Following this, we evaluate both apps during an experience prototyping workshop with an actor and subsequent focus group. We report results from communication interactions with both apps, interviews and feedback responses. Participants were not only successful in using both AAC smartwatch apps but, critically, the wearable and discreet intervention did not restrict users’ agency and non-verbal communication.

References

[1]

Apple Accessibility. 2023. Use Assistivetouch on Apple Watch. https://support.apple.com/en-gb/guide/watch/apdec70bfd2d/watchos

[2]

Apple. 2023. Apple Watch Hermès. https://www.apple.com/uk/apple-watch-hermes/

[3]

Apple. 2023. MacOS - continuity. https://www.apple.com/uk/macos/continuity/

[4]

National Aphasia Association. 2022. Home. https://www.aphasia.org/

[5]

Edna M Babbitt and Leora R Cherney. 2010. Communication confidence in persons with aphasia. Topics in Stroke Rehabilitation 17, 3 (2010), 214–223.

[6]

Cynthia L Bennett, Erin Brady, and Stacy M Branham. 2018. Interdependence as a frame for assistive technology research and design. In Proceedings of the 20th international acm sigaccess conference on computers and accessibility. ACM Press, New York, USA, 161–173.

Digital Library

[7]

Marcelo L Berthier. 2005. Poststroke aphasia: epidemiology, pathophysiology and treatment. Drugs & aging 22 (2005), 163–182.

[8]

Filip Bircanin, Bernd Ploderer, Laurianne Sitbon, Andrew A Bayor, and Margot Brereton. 2019. Challenges and opportunities in using augmentative and alternative communication (AAC) technologies: Design considerations for adults with severe disabilities. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction. ACM Press, New York, USA, 184–196.

Digital Library

[9]

Rolf Black. 2011. The Phonicstick: a joystick to generate novel words using phonics. In The proceedings of the 13th International ACM SIGACCESS conference on Computers and accessibility. ACM Press, New York, USA, 325–326.

Digital Library

[10]

Caterina Breitenstein, Tanja Grewe, Agnes Flöel, Wolfram Ziegler, Luise Springer, Peter Martus, Walter Huber, Klaus Willmes, E Bernd Ringelstein, Karl Georg Haeusler, 2017. Intensive speech and language therapy in patients with chronic aphasia after stroke: a randomised, open-label, blinded-endpoint, controlled trial in a health-care setting. The Lancet 389, 10078 (2017), 1528–1538.

[11]

Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. ACM Press, New York, USA, 424–433.

Digital Library

[12]

Marta E Cecchinato, Anna L Cox, and Jon Bird. 2015. Smartwatches: the good, the bad and the ugly?. In Proceedings of the 33rd Annual ACM Conference extended abstracts on human factors in computing systems. ACM Press, New York, USA, 2133–2138.

Digital Library

[13]

Xiang’Anthony’ Chen, Tovi Grossman, Daniel J Wigdor, and George Fitzmaurice. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 159–168.

Digital Library

[14]

Andy Clark and David Chalmers. 1998. The extended mind. analysis 58, 1 (1998), 7–19.

[15]

CNET. 2023. Apple Watch Straps may someday track your hand gestures. https://www.cnet.com/tech/mobile/apple-watch-straps-may-someday-track-your-hand-gestures/

[16]

Chris Code, Ilias Papathanasiou, Silvia Rubio-Bruno, María de la Paz Cabana, Maria Marta Villanueva, Line Haaland-Johansen, Tatjana Prizl-Jakovac, Ana Leko, Nada Zemva, Ruth Patterson, 2016. International patterns of the public awareness of aphasia. International journal of language & communication disorders 51, 3 (2016), 276–284.

[17]

Humphrey Curtis, Timothy Neate, and Carlota Vazquez Gonzalez. 2022. State of the Art in AAC: A Systematic Review and Taxonomy. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 1–22.

Digital Library

[18]

Humphrey Curtis, Zihao You, William Deary, Miruna-Ioana Tudoreanu, and Timothy Neate. 2023. Envisioning the (In) Visibility of Discreet and Wearable AAC Devices. In ACM Conference on Human Factors in Computing Systems. ACM, ACM Press, New York, USA, 1–20.

[19]

Ruth JP Dalemans, Luc De Witte, Derick Wade, and Wim van den Heuvel. 2010. Social participation through the eyes of people with aphasia. International journal of language & communication disorders 45, 5 (2010), 537–550.

[20]

Rajkumar Darbar, Prasanta Kr Sen, and Debasis Samanta. 2016. PressTact: Side pressure-based input for smartwatch interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, USA, 2431–2438.

Digital Library

[21]

Bronwyn Davidson, Tami Howe, Linda Worrall, Louise Hickson, and Leanne Togher. 2008. Social participation for older people with aphasia: The impact of communication disability on friendships. Topics in stroke rehabilitation 15, 4 (2008), 325–340.

[22]

Milad Dehghani and Ki Joon Kim. 2019. The effects of design, size, and uniqueness of smartwatches: perspectives from current versus potential users. Behaviour & Information Technology 38, 11 (2019), 1143–1153.

[23]

Aimee Dietz, Sarah E Wallace, and Kristy Weissling. 2020. Revisiting the role of augmentative and alternative communication in aphasia rehabilitation. American journal of speech-language pathology 29, 2 (2020), 909–913.

[24]

Lucy Dunne, Halley Profita, and Clint Zeagler. 2014. Social aspects of wearability and interaction. In Wearable Sensors. Elsevier, University of Minnesota, USA, 25–43.

[25]

Heather A Faucett, Kate E Ringland, Amanda LL Cullen, and Gillian R Hayes. 2017. (In) visibility in disability and assistive technology. ACM Transactions on Accessible Computing (TACCESS) 10, 4 (2017), 1–17.

Digital Library

[26]

Alexander Fiannaca, Ann Paradiso, Mira Shah, and Meredith Ringel Morris. 2017. AACrobat: Using mobile devices to lower communication barriers and provide autonomy with gaze-based AAC. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM Press, New York, USA, 683–695.

Digital Library

[27]

Hyunjae Gil, DoYoung Lee, Seunggyu Im, and Ian Oakley. 2017. TriTap: identifying finger touches on smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 3879–3890.

Digital Library

[28]

D Jeffery Higginbotham. 2009. In-person interaction in AAC: New perspectives on utterances, multimodality, timing, and device design. Perspectives on Augmentative and Alternative Communication 18, 4 (2009), 154–160.

[29]

D Jeffery Higginbotham, Howard Shane, Susanne Russell, and Kevin Caves. 2007. Access to AAC: Present, past, and future. Augmentative and alternative communication 23, 3 (2007), 243–257.

[30]

Jiahui Hou, Xiang-Yang Li, Peide Zhu, Zefan Wang, Yu Wang, Jianwei Qian, and Panlong Yang. 2019. Signspeaker: A real-time, high-precision smartwatch-based sign language translator. In The 25th Annual International Conference on Mobile Computing and Networking. ACM Press, New York, USA, 1–15.

Digital Library

[31]

Steven Houben and Nicolai Marquardt. 2015. Watchconnect: A toolkit for prototyping smartwatch-centric cross-device applications. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM Press, New York, USA, 1247–1256.

Digital Library

[32]

Gareth Iacobucci. 2017. A service under pressure. BMJ 356 (2017), 2 pages.

[33]

Seray Ibrahim, Asimina Vasalou, Laura Benton, and Michael Clarke. 2022. A methodological reflection on investigating children’s voice in qualitative research involving children with severe speech and physical impairments. Disability & society 37, 1 (2022), 63–88.

[34]

Seray B Ibrahim. 2020. Communication and Non-Speaking Children with Physical Disabilities: Opportunities and Reflections from Design-Oriented Research. Ph. D. Dissertation. UCL (University College London).

[35]

Seray B Ibrahim, Asimina Vasalou, and Michael Clarke. 2018. Design opportunities for AAC and children with severe speech and physical impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–13.

Digital Library

[36]

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, and Jon Froehlich. 2020. SoundWatch: Exploring smartwatch-based deep learning approaches to support sound awareness for deaf and hard of hearing users. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 1–13.

Digital Library

[37]

Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, and Yong Jeong. 2017. Smartwatch wearing behavior analysis: a longitudinal study. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–31.

Digital Library

[38]

R Jokel, J Cupit, E Rochon, and C Leonard. 2009. Relearning lost vocabulary in nonfluent progressive aphasia with MossTalk Words®. Aphasiology 23, 2 (2009), 175–191.

[39]

Shaun K Kane, Barbara Linam-Church, Kyle Althoff, and Denise McCall. 2012. What we talk about: designing a context-aware communication tool for people with aphasia. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. ACM Press, New York, USA, 49–56.

Digital Library

[40]

Shaun K Kane, Meredith Ringel Morris, Ann Paradiso, and Jon Campbell. 2017. " At times avuncular and cantankerous, with the reflexes of a mongoose" Understanding Self-Expression through Augmentative and Alternative Communication Devices. In Proceedings of the 2017 acm conference on computer supported cooperative work and social computing. ACM Press, New York, USA, 1166–1179.

Digital Library

[41]

Teresa lacono, Pat Mirenda, and David Beukelman. 1993. Comparison of unimodal and multimodal AAC techniques for children with intellectual disabilities. Augmentative and Alternative Communication 9, 2 (1993), 83–94.

[42]

Janice Light. 1989. Toward a definition of communicative competence for individuals using augmentative and alternative communication systems. Augmentative and alternative communication 5, 2 (1989), 137–144.

[43]

Janice Light and David McNaughton. 2012. The changing face of augmentative and alternative communication: Past, present, and future challenges., 197–204 pages.

[44]

Janice Light, David McNaughton, David Beukelman, Susan Koch Fager, Melanie Fried-Oken, Thomas Jakobs, and Erik Jakobs. 2019. Challenges and opportunities in augmentative and alternative communication: Research and technology development to enhance communication and participation for individuals with complex communication needs. Augmentative and Alternative Communication 35, 1 (2019), 1–12.

[45]

Fannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai, Laura Dabbish, Geoff Kaufman, and Andrés Monroy-Hernández. 2021. Significant otter: Understanding the role of biosignals in communication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–15.

Digital Library

[46]

Stephen J Macdonald, Lesley Deacon, Jackie Nixon, Abisope Akintola, Anna Gillingham, Jacqueline Kent, Gillian Ellis, Debbie Mathews, Abolaji Ismail, Sylvia Sullivan, 2018. ‘The invisible enemy’: disability, loneliness and isolation. Disability & Society 33, 7 (2018), 1138–1159.

[47]

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, and Leah Findlater. 2021. What do we mean by “accessibility research”? A literature survey of accessibility papers in CHI and ASSETS from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–18.

Digital Library

[48]

Kelly Mack, Emma McDonnell, Venkatesh Potluri, Maggie Xu, Jailyn Zabala, Jeffrey Bigham, Jennifer Mankoff, and Cynthia Bennett. 2022. Anticipate and adjust: Cultivating access in human-centered methods. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–18.

Digital Library

[49]

Azeem Majeed, Edward John Maile, and Andrew B Bindman. 2020. The primary care response to COVID-19 in England’s National Health Service. Journal of the Royal Society of Medicine 113, 6 (2020), 208–210.

[50]

Meethu Malu, Pramod Chundury, and Leah Findlater. 2018. Exploring accessible smartwatch interactions for people with upper body motor impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–12.

Digital Library

[51]

Meethu Malu, Pramod Chundury, and Leah Findlater. 2019. Motor Accessibility of Smartwatch Touch and Bezel Input. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 563–565.

Digital Library

[52]

Elena Márquez Segura, James Fey, Ella Dagan, Samvid Niravbhai Jhaveri, Jared Pettitt, Miguel Flores, and Katherine Isbister. 2018. Designing future social wearables with live action role play (larp) designers. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–14.

Digital Library

[53]

M Shannon McCord and Gloria Soto. 2004. Perceptions of AAC: An ethnographic investigation of Mexican-American families. Augmentative and alternative communication 20, 4 (2004), 209–227.

[54]

David Mcnaughton and Diane Nelson Bryen. 2007. AAC technologies to enhance participation and access to meaningful societal roles for adolescents and adults with developmental disabilities who require AAC. Augmentative and alternative communication 23, 3 (2007), 217–229.

[55]

Albert Mehrabian. 2017. Nonverbal communication. Routledge, New York, USA.

[56]

Sally Millar, Janet Scott, 1998. What is augmentative and alternative communication? An introduction. Augmentative communication in practice: An introduction 1 (1998), 3–12.

[57]

Alison Moorcroft, Nerina Scarinci, and Carly Meyer. 2020. ‘We were just kind of handed it and then it was smoke bombed by everyone’: How do external stakeholders contribute to parent rejection and the abandonment of AAC systems?International journal of language & communication disorders 55, 1 (2020), 59–69.

[58]

Timothy Neate, Aikaterini Bourazeri, Abi Roper, Simone Stumpf, and Stephanie Wilson. 2019. Co-created personas: Engaging and empowering users with diverse needs within the design process. In Proceedings of the 2019 CHI conference on human factors in computing systems. ACM Press, New York, USA, 1–12.

Digital Library

[59]

Timothy Neate, Vasiliki Kladouchou, Stephanie Wilson, and Shehzmani Shams. 2022. “Just Not Together”: The Experience of Videoconferencing for People with Aphasia during the Covid-19 Pandemic. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–16.

Digital Library

[60]

Timothy Neate, Abi Roper, Stephanie Wilson, and Jane Marshall. 2019. Empowering expression for users with aphasia through constrained creativity. In Proceedings of the 2019 CHI conference on human factors in computing systems. ACM Press, New York, USA, 1–12.

Digital Library

[61]

Timothy Neate, Abi Roper, Stephanie Wilson, Jane Marshall, and Madeline Cruice. 2020. CreaTable content and tangible interaction in Aphasia. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–14.

Digital Library

[62]

Christopher S Norrie, Annalu Waller, and Elizabeth FS Hannah. 2021. Establishing context: AAC device adoption and support in a special-education setting. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 2 (2021), 1–30.

Digital Library

[63]

Mmachi God’sglory Obiorah, Anne Marie Marie Piper, and Michael Horn. 2021. Designing AACs for people with aphasia dining in restaurants. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–14.

Digital Library

[64]

Amanda M O’Brien, Ralf W Schlosser, Howard Shane, Oliver Wendt, Christina Yu, Anna A Allen, Jacqueline Cullen, Andrea Benz, and Lindsay O’Neill. 2020. Providing visual directives via a smart watch to a student with Autism Spectrum Disorder: an intervention note. Augmentative and Alternative Communication 36, 4 (2020), 249–257.

[65]

Rebecca Palmer, Helen Hughes, and Tim Chater. 2017. What do people with aphasia want to be able to say? A content analysis of words identified as personally relevant by people with aphasia. PloS one 12, 3 (2017), e0174065.

[66]

Phil Parette and Marcia Scherer. 2004. Assistive technology use and stigma. Education and training in developmental disabilities 39, 3 (2004), 217–226.

[67]

Susie Parr. 2007. Living with severe aphasia: Tracking social exclusion. Aphasiology 21, 1 (2007), 98–123.

[68]

Gail V Pashek. 1997. A case study of gesturally cued naming in aphasia: Dominant versus nondominant hand training. Journal of Communication Disorders 30, 5 (1997), 349–366.

[69]

Jennifer Pearson, Simon Robinson, and Matt Jones. 2015. It’s About Time: Smartwatches as public displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1257–1266.

Digital Library

[70]

Helen Petrie. 1997. User-centred design and evaluation of adaptive and assistive technology for disabled and elderly users. it-Information Technology 39, 2 (1997), 7–12.

[71]

Halley P Profita. 2016. Designing wearable computing technology for acceptability and accessibility. ACM SIGACCESS Accessibility and Computing 114 (2016), 44–48.

Digital Library

[72]

Halley P Profita, Abigale Stangl, Laura Matuszewska, Sigrunn Sky, and Shaun K Kane. 2016. Nothing to hide: Aesthetic customization of hearing AIDS and cochlear implants in an online community. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 219–227.

Digital Library

[73]

Graham Pullin. 2009. Design meets disability. MIT press, Cambridge, Massachusetts, USA.

[74]

Sneha Raman and Tara French. 2022. Participatory design in sensitive contexts: A proposal for a conceptual framework. The Design Journal 25, 5 (2022), 752–767.

[75]

Pirkko Rautakoski. 2011. Training total communication. Aphasiology 25, 3 (2011), 344–365.

[76]

Reza Rawassizadeh, Blaine A Price, and Marian Petre. 2014. Wearables: Has the age of smartwatches finally arrived?Commun. ACM 58, 1 (2014), 45–47.

Digital Library

[77]

Samuel Sennott and Adam Bowker. 2009. Autism, aac, and proloquo2go. Perspectives on Augmentative and Alternative Communication 18, 4 (2009), 137–145.

[78]

Tom Shakespeare 2006. The social model of disability. The disability studies reader 2 (2006), 197–204.

[79]

Kristen Shinohara and Jacob O Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, USA, 705–714.

Digital Library

[80]

Katie A Siek, Yvonne Rogers, and Kay H Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In INTERACT, Vol. 5. Springer, ACM Press, New York, USA, 267–280.

[81]

Kiley Sobel, Alexander Fiannaca, Jon Campbell, Harish Kulkarni, Ann Paradiso, Ed Cutrell, and Meredith Ringel Morris. 2017. Exploring the design space of AAC awareness displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 2890–2903.

Digital Library

[82]

Katta Spiel, Laura Malinverni, Judith Good, and Christopher Frauenberger. 2017. Participatory evaluation with autistic children. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 5755–5766.

Digital Library

[83]

Nick Statt. 2020. Apple now sells more watches than the entire Swiss watch industry. https://www.theverge.com/2020/2/5/21125565/apple-watch-sales-2019-swiss-watch-market-estimates-outsold

[84]

Ke Sun, Yuntao Wang, Chun Yu, Yukang Yan, Hongyi Wen, and Yuanchun Shi. 2017. Float: one-handed and touch-free target selection on smartwatches. In Proceedings of the 2017 chi conference on human factors in computing systems. ACM Press, New York, USA, 692–704.

Digital Library

[85]

Krzysztof Szklanny, Marcin Wichrowski, and Alicja Wieczorkowska. 2022. Prototyping Mobile Storytelling Applications for People with Aphasia. Sensors 22, 1 (2022), 14.

[86]

Carla Tamburro, Timothy Neate, Abi Roper, and Stephanie Wilson. 2020. Accessible creativity with a comic spin. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 1–11.

Digital Library

[87]

Ha Trinh, Annalu Waller, Keith Vertanen, Per Ola Kristensson, and Vicki L Hanson. 2012. Applying prediction techniques to phoneme-based AAC systems. In Proceedings of the Third Workshop on Speech and Language Processing for Assistive Technologies. ACM Press, New York, USA, 19–27.

Digital Library

[88]

Ha Trinh, Annalu Waller, Keith Vertanen, Per Ola Kristensson, and Vicki L Hanson. 2012. iSCAN: A phoneme-based predictive communication aid for nonspeaking individuals. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. ACM Press, New York, USA, 57–64.

Digital Library

[89]

Stephanie Valencia, Michal Luria, Amy Pavel, Jeffrey P Bigham, and Henny Admoni. 2021. Co-designing socially assistive sidekicks for motion-based aac. In Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction. ACM Press, New York, USA, 24–33.

Digital Library

[90]

Stephanie Valencia, Mark Steidl, Michael Rivera, Cynthia Bennett, Jeffrey Bigham, and Henny Admoni. 2021. Aided Nonverbal Communication through Physical Expressive Objects. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 1–11.

Digital Library

[91]

Mieke van de Sandt-Koenderman. 2004. High-tech AAC and aphasia: Widening horizons?Aphasiology 18, 3 (2004), 245–263.

[92]

Marin Vuković, Željka Car, Melita Fertalj, Ida Penezić, Valerija Miklaušić, Jasmina Ivšac, Nina Pavlin-Bernardić, and Lidija Mandić. 2016. Location-based smartwatch application for people with complex communication needs. In 2016 International Multidisciplinary Conference on Computer and Energy Science (SpliTech). IEEE, IEEE, Split, Croatia, 1–7.

[93]

Annalu Waller. 2019. Telling tales: unlocking the potential of AAC technologies. International journal of language & communication disorders 54, 2 (2019), 159–169.

[94]

Annalu Waller, Rolf Black, David A O’Mara, Helen Pain, Graeme Ritchie, and Ruli Manurung. 2009. Evaluating the standup pun generating software with children with cerebral palsy. ACM Transactions on Accessible Computing (TACCESS) 1, 3 (2009), 1–27.

Digital Library

[95]

Hongyi Wen, Julian Ramos Rojas, and Anind K Dey. 2016. Serendipity: Finger gesture recognition using an off-the-shelf smartwatch. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 3847–3851.

Digital Library

[96]

Renata Whurr and Marjorie Lorch. 1991. The use of a prosthesis to facilitate writing in aphasia and right hemiplegia. Aphasiology 5, 4-5 (1991), 411–418.

[97]

Kristin Williams, Karyn Moffatt, Jonggi Hong, Yasmeen Faroqi-Shah, and Leah Findlater. 2016. The cost of turning heads: A comparison of a head-worn display to a smartphone for supporting persons with aphasia in conversation. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, USA, 111–120.

Digital Library

[98]

Stephanie Wilson, Abi Roper, Jane Marshall, Julia Galliers, Niamh Devane, Tracey Booth, and Celia Woolf. 2015. Codesign for people with aphasia through tangible design languages. CoDesign 11, 1 (2015), 21–34.

[99]

Xuhai Xu, Jun Gong, Carolina Brum, Lilian Liang, Bongsoo Suh, Shivam Kumar Gupta, Yash Agarwal, Laurence Lindsey, Runchang Kang, Behrooz Shahsavari, 2022. Enabling hand gesture customization on wrist-worn devices. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 1–19.

Digital Library

[100]

Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and future mobile and wearable device use by people with visual impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, USA, 3123–3132.

Digital Library

Cited By

Curtis HJenkins AIbrahim SNeate T(2024)Looking Past Screens: Exploring Mixed Reality and Discreet AAC DevicesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675655(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675655
Sattar SCurtis HNeate T(2024)Public Assistive Displays: Employing Public Interactive Displays to Improve Public Transport Access 4AllExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650890(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650890
Curtis HNeate T(2024)Beyond Repairing with Electronic Speech: Towards Embodied Communication and Assistive TechnologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642274(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642274

Index Terms

Watch Your Language: Using Smartwatches to Support Communication
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies

Recommendations

Breaking Badge: Augmenting Communication with Wearable AAC Smartbadges and Displays
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

People living with complex communication needs employ multimodal pathways to communicate including: limited speech, paralinguistics, non-verbal communication and leveraging low-tech devices. However, most augmentative and alternative communication (AAC) ...
Envisioning the (In)Visibility of Discreet and Wearable AAC Devices
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

High-tech augmentative and alternative communication (AAC) devices can offer vital communication support for those with complex communication needs (CCNs). Unfortunately, these devices are rarely adopted. Abandonment has been linked to many factors – ...
Looking Past Screens: Exploring Mixed Reality and Discreet AAC Devices
ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

Augmentative and alternative communication (AAC) technologies are typically fixed-form factor mobile devices, which can be physically obtrusive and visually identifiable – perpetuating public stigmas and limiting non-verbal communication. These ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

October 2023

1163 pages

ISBN:9798400702204

DOI:10.1145/3597638

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

UKRI

Conference

ASSETS '23

Sponsor:

SIGACCESS

ASSETS '23: The 25th International ACM SIGACCESS Conference on Computers and Accessibility

October 22 - 25, 2023

NY, New York, USA

Acceptance Rates

ASSETS '23 Paper Acceptance Rate 55 of 182 submissions, 30%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
408
Total Downloads

Downloads (Last 12 months)265
Downloads (Last 6 weeks)42

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Curtis HJenkins AIbrahim SNeate T(2024)Looking Past Screens: Exploring Mixed Reality and Discreet AAC DevicesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675655(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675655
Sattar SCurtis HNeate T(2024)Public Assistive Displays: Employing Public Interactive Displays to Improve Public Transport Access 4AllExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650890(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650890
Curtis HNeate T(2024)Beyond Repairing with Electronic Speech: Towards Embodied Communication and Assistive TechnologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642274(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642274

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten