More Web Proxy on the site http://driver.im/

poster

Public Access

BusStopCV: A Real-time AI Assistant for Labeling Bus Stop Accessibility Features in Streetscape Imagery

Authors:

Minchu Kulkarni,

Jaye Jungmin Ahn,

Katrina Oi Yau Ma,

Michael Saugstad,

Yochai Eisenberg,

Valerie Novack,

Brent Chamberlain,

Jon E. FroehlichAuthors Info & Claims

ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 91, Pages 1 - 6

https://doi.org/10.1145/3597638.3614481

Published: 22 October 2023 Publication History

All formats PDF

Abstract

Public transportation provides vital connectivity to people with disabilities, facilitating access to work, education, and health services. While modern navigation applications provide a suite of information about transit options—including real-time updates about bus or train arrivals—they lack data about the accessibility of the transit stops themselves. Bus stop features such as seatings, shelters, and landing areas are critical, but few cities provide this information. In this demo paper, we introduce BusStopCV, a Human+AI web prototype for scalably collecting data on bus stop features using real-time computer vision and human labeling. We describe BusStopCV’s design, custom training with the YOLOv8 model, and an evaluation of 100 randomly selected bus stops in Seattle, WA. Our findings demonstrate the potential of BusStopCV and highlight opportunities for future work.

References

[1]

2016. Stations & Stops. https://nacto.org/publication/transit-street-design-guide/stations-stops/

[2]

Marc A. Adams, Christine B. Phillips, Akshar Patel, and Ariane Middel. 2022. Training Computers to See the Built Environment Related to Physical Activity: Detection of Microscale Walkability Features Using Computer Vision. International Journal of Environmental Research and Public Health 19, 8 (April 2022), 4548. https://doi.org/10.3390/ijerph19084548

[3]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300233

Digital Library

[4]

Apple. 2023. Maps - Apple. https://www.apple.com/maps/

[5]

The MARTA Army. [n. d.]. Operation Bus Stop Census. https://www.martaarmy.org/stop-census

[6]

Saurav Dev Bhatta and Matthew P. Drennan. 2003. The economic benefits of public investment in transportation: A review of recent literature. Journal of Planning Education and Research 22, 3 (2003), 288–296. ISBN: 0739-456X Publisher: Sage Publications Thousand Oaks, CA.

[7]

Michael Duan, Shosuke Kiami, Logan Milandin, Johnson Kuang, Michael Saugstad, Maryam Hosseini, and Jon E. Froehlich. 2022. Scaling Crowd+AI Sidewalk Accessibility Assessments: Initial Experiments Examining Label Quality and Cross-city Training on Performance. In The 24th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Athens Greece, 1–5. https://doi.org/10.1145/3517428.3550381

Digital Library

[8]

Google. 2023. Google Maps. https://www.google.com/maps

[9]

Andrea Hamre and Ralph Buehler. 2014. Commuter Mode Choice and Free Car Parking, Public Transportation Benefits, Showers/Lockers, and Bike Parking at Work: Evidence from the Washington, DC Region. Journal of Public Transportation 17, 2 (June 2014), 67–91. https://doi.org/10.5038/2375-0901.17.2.4

[10]

Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia L. Bennett, Vicki Le, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle H. Ng, and Jon E. Froehlich. 2015. Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis. ACM Transactions on Accessible Computing 6, 2 (March 2015), 1–23. https://doi.org/10.1145/2717513

Digital Library

[11]

Kotaro Hara, Vicki Le, and Jon Froehlich. 2013. Combining crowdsourcing and google street view to identify street-level accessibility problems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). Association for Computing Machinery, New York, NY, USA, 631–640. https://doi.org/10.1145/2470654.2470744

Digital Library

[12]

Kotaro Hara, Jin Sun, Robert Moore, David Jacobs, and Jon Froehlich. 2014. Tohme: detecting curb ramps in google street view using crowdsourcing, computer vision, and machine learning. In Proceedings of the 27th annual ACM symposium on User interface software and technology(UIST ’14). Association for Computing Machinery, New York, NY, USA, 189–204. https://doi.org/10.1145/2642918.2647403

Digital Library

[13]

Maryam Hosseini, Mikey Saugstad, Fabio Miranda, Andres Sevtsuk, Claudio T. Silva, and Jon E. Froehlich. 2022. Towards Global-Scale Crowd+ AI Techniques to Map and Assess Sidewalks for People with Disabilities. arXiv preprint arXiv:2206.13677 (2022).

[14]

Junehyung Jeon and Ayoung Woo. 2023. Deep learning analysis of street panorama images to evaluate the streetscape walkability of neighborhoods for subsidized families in Seoul, Korea. Landscape and Urban Planning 230 (Feb. 2023), 104631. https://doi.org/10.1016/j.landurbplan.2022.104631

[15]

Jiyun Lee, Donghyun Kim, and Jina Park. 2022. A Machine Learning and Computer Vision Study of the Environmental Characteristics of Streetscapes That Affect Pedestrian Satisfaction. Sustainability 14, 9 (Jan. 2022), 5730. https://doi.org/10.3390/su14095730 Number: 9 Publisher: Multidisciplinary Digital Publishing Institute.

[16]

Todd Litman. 2012. Evaluating public transportation health benefits. Victoria Transport Policy Institute Victoria, BC, Canada.

[17]

Gerhard Neuhold, Tobias Ollmann, Samuel Rota Bulo, and Peter Kontschieder. 2017. The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes. In 2017 IEEE International Conference on Computer Vision (ICCV). IEEE, Venice, 5000–5009. https://doi.org/10.1109/ICCV.2017.534

[18]

National Association of City Transportation Officials. [n. d.]. Stations & Stops | National Association of City Transportation Officials. https://nacto.org/publication/transit-street-design-guide/stations-stops/

[19]

Roboflow. 2023. Roboflow: Give your software the power to see objects in images and video. https://roboflow.com/

[20]

Manaswi Saha, Michael Saugstad, Hanuma Teja Maddali, Aileen Zeng, Ryan Holland, Steven Bower, Aditya Dash, Sage Chen, Anthony Li, Kotaro Hara, and Jon Froehlich. 2019. Project Sidewalk: A Web-based Crowdsourcing Tool for Collecting Sidewalk Accessibility Data At Scale. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–14. https://doi.org/10.1145/3290605.3300292

Digital Library

[21]

Wayne Sarasua, Robert Awuah-Baffour, Bradley University, Mark Fawley, TRW, Carlton Byars, MARTA, Jeffery Orton, and Utah Transit Authority. 1997. Design and Development of a Bus Stop Inventory to Support an Intelligent Transportation System: The MARTA Experience. Journal of Public Transportation 1, 4 (Dec. 1997), 61–80. https://doi.org/10.5038/2375-0901.1.4.4

[22]

Ultralytics. 2023. Home - Ultralytics YOLOv8 Docs. https://docs.ultralytics.com/

[23]

Ultralytics. 2023. Train. https://docs.ultralytics.com/modes/train

[24]

King County Washington. 2017. Transit Stops for King County Metro / transitstop point. https://gis-kingcounty.opendata.arcgis.com/datasets/kingcounty::transit-stops-for-king-county-metro-transitstop-point/about

[25]

Galen Weld, Esther Jang, Anthony Li, Aileen Zeng, Kurtis Heimerl, and Jon E. Froehlich. 2019. Deep Learning for Automatically Detecting Sidewalk Accessibility Problems Using Streetscape Imagery. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Pittsburgh PA USA, 196–209. https://doi.org/10.1145/3308561.3353798

Digital Library

[26]

Haiying Zhou, Kun-Mean Hou, Decheng Zuo, and Jian Li. 2012. Intelligent Urban Public Transportation for Accessibility Dedicated to People with Disabilities. Sensors 12, 8 (Aug. 2012), 10678–10692. https://doi.org/10.3390/s120810678 Number: 8 Publisher: Molecular Diversity Preservation International.

Cited By

Froehlich JLi CHosseini MMiranda FSevtsuk AEisenberg Y(2024)The Future of Urban Accessibility: The Role of AIProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688550(1-6)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3688550
Lengkong CMayas CKrömker HHirth M(2024)The Development of Human-Centered Design in Public Transportation: A Literature ReviewHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-031-60480-5_3(40-62)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60480-5_3

Index Terms

BusStopCV: A Real-time AI Assistant for Labeling Bus Stop Accessibility Features in Streetscape Imagery
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Deep Learning for Automatically Detecting Sidewalk Accessibility Problems Using Streetscape Imagery
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Recent work has applied machine learning methods to automatically find and/or assess pedestrian infrastructure in online map imagery (e.g., satellite photos, streetscape panoramas). While promising, these methods have been limited by two interrelated ...
A Feasibility Study of Using Google Street View and Computer Vision to Track the Evolution of Urban Accessibility
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Previous work has explored scalable methods to collect data on the accessibility of the built environment by combining manual labeling, computer vision, and online map imagery. In this poster paper, we explore how to extend these methods to track the ...
On the Need of Trustworthy Sensing and Crowdsourcing for Urban Accessibility in Smart City
Special Issue on Connected Communities

Mobility in urban environments is an undisputed key factor that can affect citizens’ well-being and quality of life. This is particularly relevant for those people with disabilities or with reduced mobility who have to face the presence of barriers in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

October 2023

1163 pages

ISBN:9798400702204

DOI:10.1145/3597638

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

NSF (National Science Foundation)

Conference

ASSETS '23

Sponsor:

SIGACCESS

ASSETS '23: The 25th International ACM SIGACCESS Conference on Computers and Accessibility

October 22 - 25, 2023

NY, New York, USA

Acceptance Rates

ASSETS '23 Paper Acceptance Rate 55 of 182 submissions, 30%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
220
Total Downloads

Downloads (Last 12 months)174
Downloads (Last 6 weeks)41

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Froehlich JLi CHosseini MMiranda FSevtsuk AEisenberg Y(2024)The Future of Urban Accessibility: The Role of AIProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688550(1-6)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3688550
Lengkong CMayas CKrömker HHirth M(2024)The Development of Human-Centered Design in Public Transportation: A Literature ReviewHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-031-60480-5_3(40-62)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60480-5_3

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents