More Web Proxy on the site http://driver.im/

demonstration

Supporting Older Adults in Locating Mobile Interface Features with Voice Input

Authors:

Debaleena ChattopadhyayAuthors Info & Claims

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 97, Pages 1 - 4

https://doi.org/10.1145/3373625.3418044

Published: 29 October 2020 Publication History

Abstract

As mobile applications continue to offer more features, tackling the complexity of mobile interfaces can become challenging for older adults. Owing to a small screen and frequent updates that modify the visual layouts of menus and buttons, older adults can find it challenging to locate a function on a mobile interface quickly—even when familiar with the application. To address this issue, we present a system that supports older adults to quickly locate an on-screen feature on a mobile interface using speech queries. Our system allows users to ask for a function related to the current mobile screen using voice input. When that function is available, it provides visual guidance for users to engage with the pertinent user interface (UI) widget. The label and location of all UI components on the current screen are acquired via the Android’s Assist API. We discuss four scenarios of use.

Supplementary Material

MP4 File (a97-yu-supplement.mp4)

Download
4.78 MB

References

[1]

Monica Anderson. 2016. More Americans using smartphones for getting directions, streaming TV. Retrieved September 13, 2019 from https://www.pewresearch.org/fact-tank/2016/01/29/us-smartphone-use/.

[2]

Angeliki Angeletou, Markus Garschall, Christina Hochleitner, and Manfred Tscheligi. 2013. I need to know, i cannot, i don’t understand: older users’ requirements for a navigation application. Assistive Technology: From Research to Practice 33 (2013), 34–39.

[3]

Mortimer Mamelak Allison B. Sekuler, Patrick J. Bennett. 2000. Effects of aging on the useful field of view. Experimental aging research 26, 2 (2000), 103–120.

[4]

Karlene K Ball, Bettina L Beard, Daniel L Roenker, Richard L Miller, and David S Griggs. 1988. Age and visual search: Expanding the useful field of view. JOSA A 5, 12 (1988), 2210–2219.

[5]

Anke M Brock, Jon E Froehlich, João Guerreiro, Benjamin Tannert, Anat Caspi, Johannes Schöning, and Steve Landau. 2018. Sig: Making maps accessible and putting accessibility in maps. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, SIG03.

Digital Library

[6]

Michelle C Carlson, Lynn Hasher, S Lisa Connelly, and Rose T Zacks. 1995. Aging, distraction, and the benefits of predictable location.Psychology and aging 10, 3 (1995), 427.

[7]

Jerri D Edwards, Lesley A Ross, Virginia G Wadley, Olivio J Clay, Michael Crowe, Daniel L Roenker, and Karlene K Ball. 2006. The useful field of view test: normative data for older adults. Archives of Clinical Neuropsychology 21, 4 (2006), 275–286.

[8]

Toshiyuki Hagiya, Toshiharu Horiuchi, and Tomonori Yazaki. 2016. Typing tutor: Individualized tutoring in text entry for older adults based on input stumble detection. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 733–744.

Digital Library

[9]

Graeme S Halford, Nelson Cowan, and Glenda Andrews. 2007. Separating cognitive capacity from knowledge: A new hypothesis. Trends in cognitive sciences 11, 6 (2007), 236–242.

[10]

Bran Knowles and Vicki L Hanson. 2018. The Wisdom of Older Technology (Non-) Users. Commun. ACM 61, 3 (2018), 72–77.

Digital Library

[11]

Bran Knowles, Vicki L Hanson, Yvonne Rogers, Anne Marie Piper, Jenny Waycott, and Nigel Davies. 2019. HCI and Aging: Beyond Accessibility. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W07.

Digital Library

[12]

Junhan Kong, Anhong Guo, and Jeffrey P Bigham. 2019. Supporting Older Adults in Using Complex User Interfaces with Augmented Reality. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 661–663.

[13]

Qingchuan Li and Yan Luximon. 2019. Older adults’ use of mobile device: usability challenges while navigating various interfaces. Behaviour & Information Technology(2019), 1–25.

[14]

Rui Mata, Lael J Schooler, and Jörg Rieskamp. 2007. The aging decision maker: cognitive aging and the adaptive selection of decision strategies.Psychology and aging 22, 4 (2007), 796.

[15]

Roberto Menghi, Silvia Ceccacci, Francesca Gullà, Lorenzo Cavalieri, Michele Germani, and Roberta Bevilacqua. 2017. How older people who have never used touchscreen technology interact with a tablet. In IFIP Conference on Human-Computer Interaction. Springer, 117–131.

[16]

Donald A. Norman. 2008. THE WAY I SEE ITSimplicity is Not the Answer. Interactions 15, 5 (Sept. 2008), 45–46. https://doi.org/10.1145/1390085.1390094

Digital Library

[17]

Daisuke Sato, Masatomo Kobayashi, Hironobu Takagi, Chieko Asakawa, and Jiro Tanaka. 2011. How voice augmentation supports elderly web users. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility. 155–162.

Digital Library

[18]

Ja Eun Yu and Debaleena Chattopadhyay. 2020. ”Maps are hard for me”: How Older Adults Struggle with Mobile Maps. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. in press.

Cited By

Sakhnini NSharifi HChattopadhyay D(2024)How Proficiency and Feelings impact the Preference and Perception of Mobile Technology Support in Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688520(1-5)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3688520
Figueira ICha YBranham S(2024)Intersecting Liminality: Acquiring a Smartphone as a Blind or Low Vision Older AdultProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675622(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675622
Coghlan SWaycott JNui LCaine KStigall B(2021)Swipe a Screen or Say the Word: Older Adults’ Preferences for Information-seeking with Touchscreen and Voice-User InterfacesProceedings of the 33rd Australian Conference on Human-Computer Interaction10.1145/3520495.3520512(130-143)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3520495.3520512

Index Terms

Supporting Older Adults in Locating Mobile Interface Features with Voice Input
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens

Index terms have been assigned to the content through auto-classification.

Recommendations

“Where is history”: Toward Designing a Voice Assistant to help Older Adults locate Interface Features quickly
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Older adults often struggle to locate a function quickly in feature-rich user interfaces (UIs). Mobile UIs not only pack a ton of features in a small screen but also get frequent updates to their visual layouts—thereby exacerbating the problem. This ...
“Maps are hard for me”: Identifying How Older Adults Struggle with Mobile Maps
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Despite a global upward trend in mobile device ownership, older adults continue to use few applications and fewer features. For example, besides directions, maps provide information about public transit, traffic, and amenities. Mobile maps can assist ...
Reducing the Search Space on demand helps Older Adults find Mobile UI Features quickly, on par with Younger Adults
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

As mobile user interfaces (UI) become feature-rich, navigation gets more complex. Finding features quickly starts demanding information-intensive strategies for decision-making—which can be challenging for older adults. Older adults examine fewer ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 2020

764 pages

ISBN:9781450371032

DOI:10.1145/3373625

Editors:
Tiago Guerreiro
University of Lisbon, Portugal
,
Hugo Nicolau
INESC-ID, Portugal
,
Karyn Moffatt
McGill University, Canada

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2020

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

ASSETS '20

Sponsor:

SIGACCESS

ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 26 - 28, 2020

Virtual Event, Greece

Acceptance Rates

ASSETS '20 Paper Acceptance Rate 46 of 167 submissions, 28%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
183
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sakhnini NSharifi HChattopadhyay D(2024)How Proficiency and Feelings impact the Preference and Perception of Mobile Technology Support in Older AdultsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688520(1-5)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3688520
Figueira ICha YBranham S(2024)Intersecting Liminality: Acquiring a Smartphone as a Blind or Low Vision Older AdultProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675622(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675622
Coghlan SWaycott JNui LCaine KStigall B(2021)Swipe a Screen or Say the Word: Older Adults’ Preferences for Information-seeking with Touchscreen and Voice-User InterfacesProceedings of the 33rd Australian Conference on Human-Computer Interaction10.1145/3520495.3520512(130-143)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3520495.3520512

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents