[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3308558.3313651acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Crowd-Mapping Urban Objects from Street-Level Imagery

Published: 13 May 2019 Publication History

Abstract

Knowledge about the organization of the main physical elements (e.g. streets) and objects (e.g. trees) that structure cities is important in the maintenance of city infrastructure and the planning of future urban interventions. In this paper, a novel approach to crowd-mapping urban objects is proposed. Our method capitalizes on strategies for generating crowdsourced object annotations from street-level imagery, in combination with object density and geo-location estimation techniques to enable the enumeration and geo-tagging of urban objects. To address both the coverage and precision of the mapped objects within budget constraints, we design a scheduling strategy for micro-task prioritization, aggregation, and assignment to crowd workers. We experimentally demonstrate the feasibility of our approach through a use case pertaining to the mapping of street trees in New York City and Amsterdam. We show that anonymous crowds can achieve high recall (up to 80%) and precision (up to 68%), with geo-location precision of approximately 3m. We also show that similar performance could be achieved at city scale, possibly with stringent budget constraints.

References

[1]
Vahid Balali, Armin Ashouri Rad, and Mani Golparvar-Fard. 2015. Detection, classification, and mapping of U.S. traffic signs using google street view images for roadway inventory management. Visualization in Engineering 3, 1 (dec 2015), 15.
[2]
Stefano Bocconi, Alessandro Bozzon, Achilleas Psyllidis, Christiaan Titos Bolivar, and Geert-Jan Houben. 2015. Social Glass: A Platform for Urban Analytics and Decision-making Through Heterogeneous Social Data. In Proceedings of the 24th International Conference on World Wide Web(WWW '15 Companion). ACM, New York, NY, USA, 175-178.
[3]
Chris Clews, Roza Brajkovich-Payne, Emily Dwight, Ayob Ahmad Fauzul, Madeleine Burton, Olivia Carleton, Julie Cook, Charlotte Deroles, Ruby Faulkner, Mary Furniss, Anahera Herewini, Daymen Huband, Nerissa Jones, Cho Wool Kim, Alice Li, Jacky Lu, James Stanley, Nick Wilson, and George Thomson. 2016. Alcohol in urban streetscapes: a comparison of the use of Google Street View and on-street observation. BMC Public Health 16, 1 (dec 2016), 442.
[4]
Tim Cresswell. 2014. Place: an introduction. John Wiley & Sons.
[5]
Michael F Goodchild. 2007. Citizens as sensors: the world of volunteered geography. GeoJournal 69, 4 (2007), 211-221.
[6]
Cullen Gordon. 1961. The concise townscape.
[7]
Peter Geoffrey Hall. 1984. The world cities. Weidenfeld & Nicolson.
[8]
Kotaro Hara, Jon E. Froehlich, Shiri Azenkot, Megan Campbell, Cynthia L. Bennett, Vicki Le, Sean Pannella, Robert Moore, Kelly Minckler, and Rochelle H. Ng. 2015. Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis. ACM Transactions on Accessible Computing 6, 2 (mar 2015), 1-23.
[9]
Kotaro Hara, Victoria Le, and Jon Froehlich. 2012. A feasibility study of crowdsourcing and google street view to determine sidewalk accessibility. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '12. ACM Press, New York, New York, USA, 273.
[10]
Kotaro Hara, Vicki Le, and Jon Froehlich. 2013. Combining crowdsourcing and google street view to identify street-level accessibility problems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13. ACM Press, New York, New York, USA, 631.
[11]
Kotaro Hara, Jin Sun, Robert Moore, David Jacobs, and Jon Froehlich. 2014. Tohme: Detecting Curb Ramps in Google Street View using Crowdsourcing, Computer Vision, and Machine Learning. Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14Figure 1 (2014), 189-204.
[12]
Darren Hardy, James Frew, and Michael F Goodchild. 2012. Volunteered geographic information production as a spatial process. International Journal of Geographical Information Science 26, 7(2012), 1191-1212.
[13]
Brent J Hecht and Darren Gergle. 2010. On the localness of user-generated content. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. ACM, 229-232.
[14]
Hsun-Ping Hsieh, Shou-De Lin, and Yu Zheng. 2015. Inferring Air Quality for Station Location Recommendation Based on Urban Big Data. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '15. ACM Press, New York, New York, USA, 437-446.
[15]
Allan B Jacobs. 1993. Great streets. (1993).
[16]
Johannes Kopf, Billy Chen, Richard Szeliski, and Michael Cohen. 2010. Street Slide: Browsing Street Level Imagery. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2010) 29, 4(2010), 96:1 - 96:8.
[17]
Karl Kropf. 1996. Urban tissue and the character of towns. Urban Design International 1, 3 (1996), 247-263.
[18]
Vladimir Krylov, Eamonn Kenny, and Rozenn Dahyot. 2018. Automatic discovery and geotagging of objects from street view imagery. Remote Sensing 10, 5 (2018), 661.
[19]
Katsumi Kumai, Masaki Matsubara, Yuhki Shiraishi, Daisuke Wakatsuki, Jianwei Zhang, Takeaki Shionome, Hiroyuki Kitagawa, and Atsuyuki Morishima. 2018. Skill-and-Stress-Aware Assignment of Crowd-Worker Groups to Task Streams. Sixth AAAI Conference on Human Computation and Crowdsourcing (jun 2018). https://aaai.org/ocs/index.php/HCOMP/HCOMP18/paper/view/17921
[20]
Xiaojiang Li and Carlo Ratti. 2018. Mapping the spatial distribution of shade provision of street trees in Boston using Google Street View panoramas. Urban Forestry and Urban Greening 31 (2018), 109-119.
[21]
Xiaojiang Li, Chuanrong Zhang, Weidong Li, Robert Ricard, Qingyan Meng, and Weixing Zhang. 2015. Assessing street-level urban greenery using Google Street View and a modified green view index. Urban Forestry & Urban Greening 14 (2015), 675-685.
[22]
Tsung Yi Lin, Yin Cui, Serge Belongie, and James Hays. 2015. Learning deep representations for ground-to-aerial geolocalization. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 07-12-June-2015. IEEE, 5007-5015.
[23]
Ying Long and Liu Liu. 2017. How green are the streets? An analysis for central areas of Chinese cities using Tencent Street View. PLOS ONE 12, 2 (feb 2017), e0171110.
[24]
Afra Mashhadi, Giovanni Quattrone, Licia Capra, and Peter Mooney. 2012. On the accuracy of urban crowd-sourcing for maintaining large-scale geospatial databases. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration. ACM, 15.
[25]
Yair Movshovitz-Attias, Qian Yu, Martin C. Stumpe, Vinay Shet, Sacha Arnoud, and Liron Yatziv. 2015. Ontological supervision for fine grained classification of Street View storefronts. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1693-1702.
[26]
Gerhard Neuhold, Tobias Ollmann, Samuel Rota Bulo, and Peter Kontschieder. 2017. The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes. In Proceedings of the IEEE International Conference on Computer Vision, Vol. 2017-Octob. 5000-5009. arXiv:1711.11556
[27]
Vítor Oliveira. 2016. Urban morphology: an introduction to the study of the physical form of cities. Springer.
[28]
S. K. Ploeger, M. Sawada, A. Elsabbagh, M. Saatcioglu, M. Nastev, and E. Rosetti. 2016. Urban RAT: New Tool for Virtual and Site-Specific Mobile Rapid Data Collection for Seismic Risk Assessment. Journal of Computing in Civil Engineering 30, 2 (mar 2016), 04015006.
[29]
Daniel R. Richards and Peter J. Edwards. 2017. Quantifying street tree regulating ecosystem services using Google Street View. Ecological Indicators 77 (jun 2017), 31-40.
[30]
Alex Rodriguez and Alessandro Laio. 2014. Machine learning. Clustering by fast search and find of density peaks.Science (New York, N.Y.) 344, 6191 (jun 2014), 1492-6.
[31]
Manaswi Saha, Kotaro Hara, Soheil Behnezhad, Anthony Li, Michael Saugstad, Hanuma Maddali, Sage Chen, and Jon E. Froehlich. 2017. A Pilot Deployment of an Online Tool for Large-Scale Virtual Auditing of Urban Accessibility. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS '17). ACM, New York, NY, USA, 305-306.
[32]
Waldo R Tobler. 1970. A computer movie simulating urban growth in the Detroit region. Economic geography 46, sup1 (1970), 234-240.
[33]
Griet Vanwolleghem, Delfien Van Dyck, Fabian Ducheyne, Ilse De Bourdeaudhuij, and Greet Cardon. 2014. Assessing the environmental characteristics of cycling routes to school: a study on the reliability and validity of a Google Street View-based audit. International Journal of Health Geographics 13, 1 (jun 2014), 19.
[34]
Leye Wang, Daqing Zhang, Yasha Wang, Chao Chen, Xiao Han, and Abdallah M'Hamed. 2016. Sparse mobile crowdsensing: Challenges and opportunities. IEEE Communications Magazine 54, 7 (2016), 161-167.
[35]
Jan Dirk Wegner, Steve Branson, David Hall, Konrad Schindler, and Pietro Perona. 2016. Cataloging Public Objects Using Aerial and Street-Level Images - Urban Trees. In CVPR. IEEE Computer Society, 6014-6023. http://dblp.uni-trier.de/db/conf/cvpr/cvpr2016.html#WegnerBHSP16
[36]
Jianwei Zhang, Yuhki Shiraishi, Katsumi Kumai, and Atsuyuki Morishima. 2016. Real-time Captioning of Sign Language by Groups of Deaf and Hard-of-hearing People. In Proceedings of the 18th International Conference on Information Integration and Web-based Applications and Services(iiWAS '16). ACM, 54-63.

Cited By

View all
  • (2024)Conversational Crowdsensing in the Age of Industry 5.0: A Parallel Intelligence and Large Models Powered Novel Sensing ApproachIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.345164911:6(8046-8063)Online publication date: Dec-2024
  • (2024)Sociotechnical Perspectives for Data Practices. The Impact of Data-Driven Approaches to Design Theory and ActionNetworks, Markets & People10.1007/978-3-031-74679-6_8(80-90)Online publication date: 26-Nov-2024
  • (2024)Web Crowdsourcing for Coastal Flood Prevention and ManagementWeb Engineering10.1007/978-3-031-62362-2_35(410-413)Online publication date: 16-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '19: The World Wide Web Conference
May 2019
3620 pages
ISBN:9781450366748
DOI:10.1145/3308558
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • IW3C2: International World Wide Web Conference Committee

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Crowd-Mapping
  2. Crowdsourcing
  3. Street-Level Imagery
  4. Task Scheduling
  5. Urban Objects

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '19
WWW '19: The Web Conference
May 13 - 17, 2019
CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)3
Reflects downloads up to 03 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Conversational Crowdsensing in the Age of Industry 5.0: A Parallel Intelligence and Large Models Powered Novel Sensing ApproachIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.345164911:6(8046-8063)Online publication date: Dec-2024
  • (2024)Sociotechnical Perspectives for Data Practices. The Impact of Data-Driven Approaches to Design Theory and ActionNetworks, Markets & People10.1007/978-3-031-74679-6_8(80-90)Online publication date: 26-Nov-2024
  • (2024)Web Crowdsourcing for Coastal Flood Prevention and ManagementWeb Engineering10.1007/978-3-031-62362-2_35(410-413)Online publication date: 16-Jun-2024
  • (2023)Leveraging Human-AI Collaboration in Crowd-Powered Source Search: A Preliminary StudyJournal of Social Computing10.23919/JSC.2023.00024:2(95-111)Online publication date: Jun-2023
  • (2023)Hidden Indicators of Collective Intelligence in CrowdfundingProceedings of the ACM Web Conference 202310.1145/3543507.3583414(3806-3815)Online publication date: 30-Apr-2023
  • (2023)Crowd-Powered Source Searching in Complex EnvironmentsComputer Supported Cooperative Work and Social Computing10.1007/978-981-99-2385-4_15(201-215)Online publication date: 13-May-2023
  • (2023)Crowdmapping: Inclusive Cities and EvaluationComputational Science and Its Applications – ICCSA 2023 Workshops10.1007/978-3-031-37129-5_7(80-90)Online publication date: 30-Jun-2023
  • (2023)“Eyes on the Street”: Estimating Natural Surveillance Along Amsterdam’s City Streets Using Street-Level ImageryIntelligence for Future Cities10.1007/978-3-031-31746-0_12(215-229)Online publication date: 2-Jun-2023
  • (2021)Automatic context learning based on 360 imageries triangulation and 3D LiDAR validation2021 IEEE 24th International Conference on Information Fusion (FUSION)10.23919/FUSION49465.2021.9627057(1-8)Online publication date: 1-Nov-2021
  • (2021)Street view imagery in urban analytics and GIS: A reviewLandscape and Urban Planning10.1016/j.landurbplan.2021.104217215(104217)Online publication date: Nov-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media