More Web Proxy on the site http://driver.im/

research-article

Public Access

Acoussist: An Acoustic Assisting Tool for People with Visual Impairments to Cross Uncontrolled Streets

Authors:

Shuchisnigdha Deb,

Ming LiAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 4, Issue 4

Article No.: 133, Pages 1 - 30

https://doi.org/10.1145/3432216

Published: 18 December 2020 Publication History

Abstract

To cross uncontrolled roadways, where no traffic-halting signal devices are present, pedestrians with visual impairments must rely on their other senses to detect oncoming vehicles and estimate the correct crossing interval in order to avoid potentially fatal collisions. To overcome the limitations of human auditory performance, which can be particularly impacted by weather or background noise, we develop an assisting tool called Acoussist, which relies on acoustic ranging to provide an additional layer of protection for pedestrian safety. The vision impaired can use the tool to double-confirm surrounding traffic conditions before they proceed through a non-signaled crosswalk.

The Acoussist tool is composed of vehicle-mounted external speakers that emit acoustic chirps at a frequency range imperceptible by human ears, but detectable by smartphones operating the Acoussist app. This app would then communicate to the user when it is safe to cross the roadway. Several challenges exist when applying the acoustic ranging to traffic detection, including measuring multiple vehicles' instant velocities and directions with the presence many of them who emit homogeneous signals simultaneously. We address these challenges by leveraging insights from formal analysis on received signals' time-frequency (t-f) profiles. We implement a proof-of-concept of Acoussist using commercial off-the-shelf (COTS) portable speakers and smartphones. Extensive in-field experiments have been conducted to validate the effectiveness of Acoussist in improving mobility for people with visual impairments.

References

[1]

AASHTO. 2011. A Policy on Geometric Design of Highway and Streets. https://www.academia.edu/33524500/AASHTO_Green_Book_2011.PDF.

[2]

Heba Abdelnasser, Khaled A Harras, and Moustafa Youssef. 2015. UbiBreathe: A ubiquitous non-invasive WiFi-based breathing estimator. In Proceedings of the International Symposium on Mobile Ad Hoc Networking and Computing (Mobihoc). 277--286.

Digital Library

[3]

Iyad Abu Doush, Sawsan Alshatnawi, Abdel-Karim Al-Tamimi, Bushra Alhasan, and Safaa Hamasha. 2017. ISAB: integrated indoor navigation system for the blind. Interacting with Computers 29, 2 (2017), 181--202.

[4]

Alireza Asvadi, Cristiano Premebida, Paulo Peixoto, and Urbano Nunes. 2016. 3D Lidar-based static and moving obstacle detection in driving environments: An approach based on voxels and multi-region ground planes. Robotics and Autonomous Systems 83 (2016), 299--311.

Digital Library

[5]

Marco Baglietto, Antonio Sgorbissa, Damiano Verda, and Renato Zaccaria. 2011. Human navigation and mapping with a 6DOF IMU and a laser scanner. Robotics and Autonomous Systems 59, 12 (2011), 1060--1069.

Digital Library

[6]

Dana H Ballard. 1981. Generalizing the Hough transform to detect arbitrary shapes. Pattern recognition 13, 2 (1981), 111--122.

[7]

Nur Hasnifa Hasan Baseri, Ee Yeng Ng, Alireza Safdari, Mahmoud Moghavvemi, and Noraisyah Mohamed Shah. 2017. A Low Cost Street Crossing Electronic Aid for the Deaf and Blind. In Proceedings of the International Conference for Innovation in Biomedical Engineering and Life Sciences. 73--78.

[8]

Eli Billauer. 2019. Peak detection. http://billauer.co.il/peakdet.html.

[9]

Nicolae Botezatu, Simona Caraiman, Dariusz Rzeszotarski, and Pawel Strumillo. 2017. Development of a versatile assistive system for the visually impaired based on sensor fusion. In Proceedingss of the International Conference on System Theory, Control and Computing. IEEE, 540--547.

[10]

Simona Caraiman, Anca Morar, Mateusz Owczarek, Adrian Burlacu, Dariusz Rzeszotarski, Nicolae Botezatu, Paul Herghelegiu, Florica Moldoveanu, Pawel Strumillo, and Alin Moldoveanu. 2017. Computer vision for the visually impaired: the sound of vision system. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 1480--1489.

[11]

NDT Research Center. 2020. Attenuation of Sound Waves. https://www.nde-ed.org/EducationResources/CommunityCollege/Ultrasonics/Physics/attenuation.htm.

[12]

Volkan Cevher, Rama Chellappa, and James H McClellan. 2008. Vehicle speed estimation using acoustic wave patterns. IEEE Transactions on signal processing 57, 1 (2008), 30--47.

Digital Library

[13]

Jagmohan Chauhan, Yining Hu, Suranga Seneviratne, Archan Misra, Aruna Seneviratne, and Youngki Lee. 2017. BreathPrint: Breathing acoustics-based user authentication. In Proceedings of the International Conference on Mobile Systems, Applications, and Services. 278--291.

Digital Library

[14]

Sakmongkon Chumkamon, Peranitti Tuvaphanthaphiphat, and Phongsak Keeratiwintakorn. 2008. A blind navigation system using RFID for indoor environments. In Proceedings of the International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Vol. 2. 765--768.

[15]

Alice Clifford and Joshua Reiss. 2010. Calculating time delays of multiple active sources in live sound. In Proceedings of the Audio Engineering Society Convention. 1--8.

[16]

Maximo Cobos, Jose J Lopez, and David Martinez. 2011. Two-microphone multi-speaker localization based on a Laplacian mixture model. Digital Signal Processing 21, 1 (2011), 66--76.

Digital Library

[17]

Xunxue Cui, Kegen Yu, and Songsheng Lu. 2016. Direction finding for transient acoustic source based on biased TDOA measurement. IEEE Transactions on Instrumentation and Measurement 65, 11 (2016), 2442--2453.

[18]

Symeon Delikaris-Manias, Despoina Pavlidi, Ville Pulkki, and Athanasios Mouchtaris. 2016. 3D localization of multiple audio sources utilizing 2D DOA histograms. In Proceedings of the European Signal Processing Conference. 1473--1477.

[19]

Nilanjan Dey and Amira S Ashour. 2018. Applied examples and applications of localization and tracking problem of multiple speech sources. In Direction of arrival estimation and localization of multi-speech sources. Springer, 35--48.

[20]

Kaustubh Dhondge, Sejun Song, Baek-Young Choi, and Hyungbae Park. 2014. WiFiHonk: smartphone-based beacon stuffed WiFi Car2X-communication system for vulnerable road user safety. In Proceedings of the IEEE Vehicular Technology Conference. IEEE, 1--5.

[21]

DPS. 2019. Department of Public Safety Guide Book. http://www.dps.texas.gov/internetforms/forms/dl-7.pdf.

[22]

Hossam Elsayed, Bassem A Abdullah, and Gamal Aly. 2018. Fuzzy Logic Based Collision Avoidance System for Autonomous Navigation Vehicle. In Proceedings of the IEEE International Conference on Computer Engineering and Systems. 469--474.

[23]

Viktor Erdélyi, Trung-Kien Le, Bobby Bhattacharjee, Peter Druschel, and Nobutaka Ono. 2018. Sonoloc: Scalable positioning of commodity mobile devices. In Proceedings of the Annual International Conference on Mobile Systems, Applications, and Services. 136--149.

Digital Library

[24]

Christine Evers, Alastair H Moore, and Patrick A Naylor. 2016. Acoustic simultaneous localization and mapping (a-SLAM) of a moving microphone array and its surrounding speakers. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). 6--10.

Digital Library

[25]

Mojtaba Farmani, Michael Syskind Pedersen, Zheng-Hua Tan, and Jesper Jensen. 2015. Informed TDoA-based direction of arrival estimation for hearing aid applications. In Proceedings of the IEEE Global Conference on Signal and Information Processing. 953--957.

[26]

Brian G Ferguson. 2016. Source parameter estimation of aero-acoustic emitters using non-linear least squares and conventional methods. IET Radar, Sonar & Navigation 10, 9 (2016), 1552--1560.

[27]

Viacheslav Filonenko, Charlie Cullen, and James D Carswell. 2012. Asynchronous ultrasonic trilateration for indoor positioning of mobile phones. In Proceedings of the International Symposium on Web and Wireless Geographical Information Systems. 33--46.

Digital Library

[28]

Carlos Flores, Pierre Merdrignac, Raoul de Charette, Francisco Navas, Vicente Milanés, and Fawzi Nashashibi. 2018. A cooperative car-following/emergency braking system with prediction-based pedestrian avoidance capabilities. IEEE Transactions on Intelligent Transportation Systems 20, 99 (2018), 1--10.

[29]

Food, Drug Administration, et al. 2008. Guidance for industry and FDA staff information for manufacturers seeking marketing clearance of diagnostic ultrasound systems and transducers. Rockville, MD: FDA (2008).

[30]

Centers for Disease Control and Prevention. 2020. What Noises Cause Hearing Loss? https://www.cdc.gov/nceh/hearing_loss/what_noises_cause_hearing_loss.html

[31]

Sukru Yaren Gelbal, Sibel Arslan, Haoan Wang, Bilin Aksun-Guvenc, and Levent Guvenc. 2017. Elastic band based pedestrian collision avoidance using V2X communication. In Proceedings of the IEEE Intelligent Vehicles Symposium. 270--276.

[32]

W Gelmuda and A Kos. 2013. Multichannel ultrasonic range finder for blind people navigation. Bulletin of the Polish Academy of Sciences. Technical Sciences 61, 3 (2013).

[33]

GNU. 2019. GNU Scientific Library. https://www.gnu.org/software/gsl/.

[34]

Hüseyin Göksu. 2018. Vehicle speed measurement by on-board acoustic signal processing. Measurement and Control 51, 5-6 (2018), 138--149.

[35]

Google. 2019. Android NDK. https://developer.android.com/ndk.

[36]

Google. 2020. Audioset. https://research.google.com/audioset/

[37]

Google. 2020. Phone Device Metrics. https://material.io/resources/devices/.

[38]

João Guerreiro, Dragan Ahmetovic, Kris M Kitani, and Chieko Asakawa. 2017. Virtual navigation for blind people: Building sequential representations of the real-world. In Proceedings of the International ACM SIGACCESS Conference on computers and accessibility. 280--289.

Digital Library

[39]

João Guerreiro, Dragan Ahmetovic, Daisuke Sato, Kris Kitani, and Chieko Asakawa. 2019. Airport accessibility and navigation assistance for people with visual impairments. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1--14.

Digital Library

[40]

John Castillo Guerrero, Cristhian Quezada-V, and Diego Chacon-Troya. 2018. Design and implementation of an intelligent cane, with proximity sensors, gps localization and gsm feedback. In Proceedings of the IEEE Canadian Conference on Electrical & Computer Engineering. 1--4.

[41]

Jack Guy. 2019. EU requires carmakers to add fake engine noises to electric cars. https://www.cnn.com/2019/07/01/business/electric-vehicles-warning-noises-scli-intl-gbr/index.html.

[42]

Richard Guy and Khai Truong. 2012. CrossingGuard: exploring information content in navigation aids for visually impaired pedestrians. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 405--414.

Digital Library

[43]

Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia L Bennett, Vicki Le, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle H Ng, and Jon E Froehlich. 2015. Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with google street view: An extended analysis. ACM Transactions on Accessible Computing 6, 2 (2015), 1--23.

Digital Library

[44]

Satoshi Hashino and Ramin Ghurchian. 2010. A blind guidance system for street crossings based on ultrasonic sensors. In Proceedings of the IEEE International Conference on Information and Automation. 476--481.

[45]

Hongsen He, Xueyuan Wang, Yingyue Zhou, and Tao Yang. 2018. A steered response power approach with trade-off prewhitening for acoustic source localization. The Journal of the Acoustical Society of America 143, 2 (2018), 1003--1007.

[46]

Takuya Higuchi and Hirokazu Kameoka. 2015. Unified approach for audio source separation with multichannel factorial HMM and DOA mixture model. In Proceedings of the IEEE European Signal Processing Conference. 2043--2047.

[47]

Ping-Fan Ho and Jyh-Cheng Chen. 2017. Wisafe: Wi-fi pedestrian collision avoidance system. IEEE Transactions on Vehicular Technology 66, 6 (2017), 4564--4578.

[48]

Hsieh-Chang Huang, Ching-Tang Hsieh, and Cheng-Hsiang Yeh. 2015. An indoor obstacle detection system using depth information and region growth. Sensors 15, 10 (2015), 27116--27141.

[49]

Jingchang Huang, Xin Zhang, Qianwei Zhou, Enliang Song, and Baoqing Li. 2013. A practical fundamental frequency extraction algorithm for motion parameters estimation of moving targets. IEEE Transactions on Instrumentation and Measurement 63, 2 (2013), 267--276.

[50]

Wenchao Huang, Yan Xiong, Xiang-Yang Li, Hao Lin, Xufei Mao, Panlong Yang, and Yunhao Liu. 2014. Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. In Proceedings of the IEEE Conference on Computer Communications. 370--378.

[51]

Yasha Iravantchi, Mayank Goel, and Chris Harrison. 2019. BeamBand: Hand Gesture Sensing with Ultrasonic Beamforming. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 15.

Digital Library

[52]

Florian Jacob, Joerg Schmalenstroeer, and Reinhold Haeb-Umbach. 2013. DOA-based microphone array postion self-calibration using circular statistics. In Proceeding of the IEEE International Conference on Acoustics, Speech and Signal Processing. 116--120.

[53]

Slim Kammoun, Gaétan Parseihian, Olivier Gutierrez, Adrien Brilhault, Antonio Serpa, Mathieu Raynal, Bernard Oriola, MJ-M Macé, Malika Auvray, Michel Denis, et al. 2012. Navigation and space perception assistance for the visually impaired: The NAVIG project. Irbm 33, 2 (2012), 182--189.

[54]

Masanori Kato, Yuzo Senda, and Reishi Kondo. 2017. Tdoa estimation based on phase-voting cross correlation and circular standard deviation. In Proceedings of the IEEE European Signal Processing Conference. 1230--1234.

[55]

Dima Khaykin and Boaz Rafaely. 2012. Acoustic analysis by spherical microphone array processing of room impulse responses. The Journal of the Acoustical Society of America 132, 1 (2012), 261--270.

[56]

SamYong Kim, JeongKwan Kang, Se-Young Oh, YeongWoo Ryu, Kwangsoo Kim, SangCheol Park, and Jinwon Kim. 2008. An intelligent and integrated driver assistance system for increased safety and convenience based on all-around sensing. Journal of Intelligent and Robotic Systems 51, 3 (2008), 261--287.

Digital Library

[57]

SamYong Kim, SeYoung Oh, JeongKwan Kang, YoungWoo Ryu, Kwangsoo Kim, SangCheol Park, and KyongHa Park. 2005. Front and rear vehicle detection and tracking in the day and night times using vision and sonar sensor fusion. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. 2173--2178.

[58]

Charles Knapp and Glifford Carter. 1976. The generalized correlation method for estimation of time delay. IEEE/ACM Transactions on Acoustics, Speech, and Signal processing 24, 4 (1976), 320--327.

[59]

Dionyssos Kounades-Bastian, Laurent Girin, Xavier Alameda-Pineda, Sharon Gannot, and Radu Horaud. 2017. An EM algorithm for joint source separation and diarisation of multichannel convolutive speech mixtures. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 16--20.

[60]

Robert Layton and Karen Dixon. 2012. Stopping sight distance. https://cce.oregonstate.edu/sites/cce.oregonstate.edu/files/12-2-stopping- sight- distance.pdf.

[61]

Bing Li, J Pablo Munoz, Xuejian Rong, Jizhong Xiao, Yingli Tian, and Aries Arditi. 2016. ISANA: wearable context-aware indoor assistive navigation with obstacle avoidance for the blind. In Proceedings of the European Conference on Computer Vision. 448--462.

[62]

Qing Lin and Youngjoon Han. 2014. A context-aware-based audio guidance system for blind people using a multimodal profile model. Sensors 14, 10 (2014), 18670--18700.

[63]

Qingju Liu, Wenwu Wang, Teofilo de Campos, Philip JB Jackson, and Adrian Hilton. 2017. Multiple speaker tracking in spatial audio via PHD filtering and depth-audio fusion. IEEE Transactions on Multimedia 20, 7 (2017), 1767--1780.

[64]

Xuefeng Liu, Jiannong Cao, Shaojie Tang, and Jiaqi Wen. 2014. Wi-Sleep: Contactless sleep monitoring via WiFi signals. In Proceedings of the IEEE Real-Time Systems Symposium. 346--355.

[65]

Zhenyu Liu, Lin Pu, Zhen Meng, Xinyang Yang, Konglin Zhu, and Lin Zhang. 2015. POFS: A novel pedestrian-oriented forewarning system for vulnerable pedestrian safety. In Proceedings of the IEEE International Conference on Connected Vehicles and Expo. 100--105.

[66]

Kam W Lo and Brian G Ferguson. 2000. Broadband passive acoustic technique for target motion parameter estimation. IEEE Trans. Aerospace Electron. Systems 36, 1 (2000), 163--175.

[67]

Heinrich W Löllmann, Christine Evers, Alexander Schmidt, Heinrich Mellmann, Hendrik Barfuss, Patrick A Naylor, and Walter Kellermann. 2018. The LOCATA challenge data corpus for acoustic source localization and tracking. In Proceedings of the Sensor Array and Multichannel Signal Processing Workshop (SAM). 410--414.

[68]

Ningbo Long, Kaiwei Wang, Ruiqi Cheng, Kailun Yang, and Jian Bai. 2018. Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired. In Proceedings of the Millimetre Wave and Terahertz Sensors and Technology XI. 1--8.

[69]

Roberto López-Valcarce, Carlos Mosquera, and Fernando Pérez-González. 2004. Estimation of road vehicle speed using two omnidirectional microphones: a maximum likelihood approach. EURASIP Journal on Applied Signal Processing 2004 (2004), 1059--1077.

Digital Library

[70]

Shachar Maidenbaum, Shlomi Hanassy, Sami Abboud, Galit Buchs, Daniel-Robert Chebat, Shelly Levy-Tzedek, and Amir Amedi. 2014. The EyeCane, a new electronic travel aid for the blind: Technology, behavior & swift learning. Restorative Neurology and Neuroscience 32, 6 (2014), 813--824.

[71]

Wenguang Mao, Mei Wang, and Lili Qiu. 2018. Aim: acoustic imaging on a mobile. In Proceedings of the International Conference on Mobile Systems, Applications, and Services (Mobisys). 468--481.

Digital Library

[72]

MathWorks. 2020. MATLAB Audio Toolbox. https://www.mathworks.com/products/audio.html

[73]

Monsoon. 2019. Power monitor. https://www.msoon.com/online-store.

[74]

A Montanha, MJ Escalon, FJ Domínguez-Mayo, and AM Polidorio. 2016. A technological innovation to safely aid in the spatial orientation of blind people in a complex urban environment. In Proceedings of the International Conference on Image, Vision and Computing. 102--107.

[75]

Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In Proceedings of the International Conference on Mobile Systems, Applications, and Services. 45--57.

Digital Library

[76]

Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1515--1525.

Digital Library

[77]

Fawzi Nashashibi and Alexandre Bargeton. 2008. Laser-based vehicles tracking and classification using occlusion reasoning and confidence estimation. In Proceedings of the IEEE Intelligent Vehicles Symposium. 847--852.

[78]

Matthias Nieuwenhuisen, David Droeschel, Marius Beul, and Sven Behnke. 2016. Autonomous navigation for micro aerial vehicles in complex gnss-denied environments. Journal of Intelligent & Robotic Systems 84, 1-4 (2016), 199--216.

Digital Library

[79]

Joonas Nikunen and Tuomas Virtanen. 2014. Multichannel audio separation by direction of arrival based spatial covariance model and non-negative matrix factorization. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 6677--6681.

[80]

National Institutes of Health et al. 1990. Noise and Hearing Loss Consensus Conference. JAMA 263 (1990), 3185--3190.

[81]

American Council of the Blind. 2019. White Cane Law. https://www.acb.org/whitecane.

[82]

Eshed Ohn-Bar, João Guerreiro, Dragan Ahmetovic, Kris M Kitani, and Chieko Asakawa. 2018. Modeling expertise in assistive navigation interfaces for blind people. In Proceedings of the International Conference on Intelligent User Interfaces. 403--407.

Digital Library

[83]

Olakanmi Oladayo. 2014. A multidimensional walking aid for visually impaired using ultrasonic sensors network with voice guidance. International Journal of Intelligent Systems and Applications 6, 8 (2014), 53.

[84]

World Health Organization. 2018. Blindness and vision impairment report. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment.

[85]

En Peng, Patrick Peursum, Ling Li, and Svetha Venkatesh. 2010. A smartphone-based obstacle sensor for the visually impaired. In Proceedings of the International Conference on Ubiquitous Intelligence and Computing. 590--604.

[86]

Riccardo Polvara, Sanjay Sharma, Jian Wan, Andrew Manning, and Robert Sutton. 2018. Obstacle avoidance approaches for autonomous navigation of unmanned surface vehicles. The Journal of Navigation 71, 1 (2018), 241--256.

[87]

Kun Qian, Chenshu Wu, Fu Xiao, Yue Zheng, Yi Zhang, Zheng Yang, and Yunhao Liu. 2018. Acousticcardiogram: Monitoring heartbeats using acoustic signals on smart devices. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM). 1574--1582.

[88]

X Qian and C Ye. 2013. NCC-RANSAC: A fast plane extraction method for navigating a smart cane for the visually impaired. In Proceedings of the IEEE International Conference on Automation Science and Engineering. 261--267.

[89]

BG Quinn. 1995. Doppler speed and range estimation using frequency and amplitude estimates. The Journal of the Acoustical Society of America 98, 5 (1995), 2560--2566.

[90]

Alberto Rodríguez, J Javier Yebes, Pablo F Alcantarilla, Luis M Bergasa, Javier Almazán, and Andrés Cela. 2012. Assisting the visually impaired: obstacle detection and warning system by acoustic feedback. Sensors 12, 12 (2012), 17476--17496.

[91]

A Rodríguez Valiente, A Trinidad, JR García Berrocal, C Górriz, and R Ramírez Camacho. 2014. Extended high-frequency (9-20 kHz) audiometry reference thresholds in 645 healthy subjects. International Journal of Audiology 53, 8 (2014), 531--545.

[92]

Zoltan Rozsa and Tamas Sziranyi. 2018. Obstacle prediction for automated guided vehicles based on point clouds measured by a tilted LIDAR sensor. IEEE Transactions on Intelligent Transportation Systems 19, 8 (2018), 2708--2720.

[93]

Wenjie Ruan, Quan Z Sheng, Lei Yang, Tao Gu, Peipei Xu, and Longfei Shangguan. 2016. AudioGest: enabling fine-grained hand gesture detection by decoding echo signal. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing. 474--485.

Digital Library

[94]

Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Navcog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility. 270--279.

Digital Library

[95]

Dana Sauerburger. 1995. Safety awareness for crossing streets with no traffic control. Journal of Visual Impairment & Blindness 89, 5 (1995), 423--431.

[96]

Ralph Schmidt. 1986. Multiple emitter location and signal parameter estimation. IEEE transactions on antennas and propagation 34, 3 (1986), 276--280.

[97]

Jochen Schneider and Thomas Strothotte. 2000. Constructive exploration of spatial information by blind users. In Proceedings of the international ACM conference on Assistive technologies. 188--192.

Digital Library

[98]

Sharang Sharma, Manind Gupta, Amit Kumar, Meenakshi Tripathi, and Manoj Singh Gaur. 2017. Multiple distance sensors based smart stick for visually impaired people. In Proceedings of the IEEE Annual Computing and Communication Workshop and Conference. 1--5.

[99]

Tarun Sharma, JHM Apoorva, Ramananathan Lakshmanan, Prakruti Gogia, and Manoj Kondapaka. 2016. NAVI: Navigation aid for the visually impaired. In Proceedings of the International Conference on Computing, Communication and Automation. IEEE, 971--976.

[100]

Tushar Sharma, Tarun Nalwa, Tanupriya Choudhury, Suresh Chand Satapathy, and Praveen Kumar. 2017. Smart Cane: Better Walking Experience for Blind People. In Proceedings of the IEEE International Conference on Computational Intelligence and Networks. 22--26.

[101]

Bridget Smith and David Sandwell. 2003. Accuracy and resolution of shuttle radar topography mission data. Geophysical Research Letters 30, 9 (2003).

[102]

Ke Sun, Ting Zhao, Wei Wang, and Lei Xie. 2018. Vskin: Sensing touch gestures on surfaces of mobile devices using acoustic signals. In Proceedings of the International Conference on Mobile Computing and Networking. 591--605.

Digital Library

[103]

Yoiti Suzuki and Hisashi Takeshima. 2004. Equal-loudness-level contours for pure tones. The Journal of the Acoustical Society of America 116, 2 (2004), 918--933.

[104]

AA Tahat. 2009. A wireless ranging system for the blind long-cane utilizing a smart-phone. In Proceedings of the IEEE International Conference on Telecommunications. 111--117.

[105]

Amin Tahmasbi-Sarvestani, Hossein Nourkhiz Mahjoub, Yaser P Fallah, Ehsan Moradi-Pari, and Oubada Abuchaar. 2017. Implementation and evaluation of a cooperative vehicle-to-pedestrian safety application. IEEE Intelligent Transportation Systems Magazine 9, 4 (2017), 62--75.

[106]

Yu Takahashi, Tomoya Takatani, Keiichi Osako, Hiroshi Saruwatari, and Kiyohiro Shikano. 2009. Blind spatial subtraction array for speech enhancement in noisy environment. IEEE Transactions on Audio, Speech, and Language Processing 17, 4 (2009), 650--664.

Digital Library

[107]

Ruxandra Tapu, Bogdan Mocanu, Andrei Bursuc, and Titus Zaharia. 2013. A smartphone-based obstacle detection and classification system for assisting visually impaired people. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 444--451.

Digital Library

[108]

YingLi Tian, Xiaodong Yang, Chucai Yi, and Aries Arditi. 2013. Toward a computer vision-based wayfinding aid for blind persons to access unfamiliar indoor environments. Machine vision and applications 24, 3 (2013), 521--535.

[109]

Johannes Traa, David Wingate, Noah D Stein, and Paris Smaragdis. 2015. Robust source localization and enhancement with a probabilistic steered response power model. IEEE/ACM Transactions on Audio, Speech, and Language Processing 24, 3 (2015), 493--503.

Digital Library

[110]

David Tse and Pramod Viswanath. 2005. Fundamentals of wireless communication. Cambridge university press.

[111]

Jeremy G Turner, Jennifer L Parrish, Larry F Hughes, Linda A Toth, and Donald M Caspary. 2005. Hearing in laboratory animals: strain differences and nonauditory effects of noise. Comparative medicine 55, 1 (2005), 12--23.

[112]

Iwan Ulrich and Johann Borenstein. 2001. The GuideCane-applying mobile robot technologies to assist the visually impaired. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 31, 2 (2001), 131--136.

Digital Library

[113]

Jose Velasco, Mohammad J Taghizadeh, Afsaneh Asaei, Hervé Bourlard, Carlos J Martín-Arguedas, Javier Macias-Guarasa, and Daniel Pizarro. 2015. Novel GCC-PHAT model in diffuse sound field for microphone array pairwise distance based calibration. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 2669--2673.

[114]

Raghav H Venkatnarayan, Griffin Page, and Muhammad Shahzad. 2018. Multi-user gesture recognition using WiFi. In Proceedings of the ACM International Conference on Mobile Systems, Applications, and Services. 401--413.

Digital Library

[115]

Deutsche Version. 2020. Conversion of sound units. http://www.sengpielaudio.com/calculator-soundlevel.htm.

[116]

Deutsche Version. 2020. Damping of Air at High Frequencies. http://www.sengpielaudio.com/calculator-air.htm.

[117]

Tianyu Wang, Giuseppe Cardone, Antonio Corradi, Lorenzo Torresani, and Andrew T Campbell. 2012. WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads. In Proceedings of the ACM Workshop on Mobile Computing Systems & Applications. 5--10.

Digital Library

[118]

Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW based contactless respiration detection using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 170.

Digital Library

[119]

Wei Wang, Alex X Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the ACM Annual International Conference on Mobile Computing and Networking. 82--94.

[120]

Martin Weiss, Simon Chamorro, Roger Girgis, Margaux Luck, Samira E Kahou, Joseph P Cohen, Derek Nowrouzezahrai, Doina Precup, Florian Golemo, and Chris Pal. 2020. Navigation agents for the visually impaired: A sidewalk simulator and experiments. In Proceedings of the Conference on Robot Learning. 1314--1327.

[121]

Xinzhou Wu, Radovan Miucic, Sichao Yang, Samir Al-Stouhi, James Misener, Sue Bai, and Wai-hoi Chan. 2014. Cars talk to phones: A DSRC based vehicle-pedestrian safety system. In Proceedings of the IEEE Vehicular Technology Conference. IEEE, 1--7.

[122]

Li Xi, Liu Guosui, and Jinlin Ni. 1999. Autofocusing of ISAR images based on entropy minimization. IEEE Trans. Aerospace Electron. Systems 35, 4 (1999), 1240--1252.

[123]

Yanming Xiao, Jenshan Lin, Olga Boric-Lubecke, and M Lubecke. 2006. Frequency-tuning technique for remote detection of heartbeat and respiration using low-power double-sideband transmission in the Ka-band. IEEE Transactions on Microwave Theory and Techniques 54, 5 (2006), 2023--2032.

[124]

Jia Xu, Xiang-Gen Xia, Shi-Bao Peng, Ji Yu, Ying-Ning Peng, and Li-Chang Qian. 2012. Radar maneuvering target motion estimation based on generalized Radon-Fourier transform. IEEE Transactions on Signal Processing 60, 12 (2012), 6190--6201.

Digital Library

[125]

Yanni Yang, Jiannong Cao, Xiulong Liu, and Xuefeng Liu. 2019. Multi-Breath: Separate Respiration Monitoring for Multiple Persons with UWB Radar. In Proceedings of the IEEE Computer Software and Applications Conference. 840--849.

[126]

Cang Ye, Soonhac Hong, Xiangfei Qian, and Wei Wu. 2016. Co-robotic cane: A new robotic navigation aid for the visually impaired. IEEE Systems, Man, and Cybernetics Magazine 2, 2 (2016), 33--42.

[127]

Wenyi Zhang and Bhaskar D Rao. 2010. A two microphone-based approach for source localization of multiple speech sources. IEEE Transactions on Audio, Speech, and Language Processing 18, 8 (2010), 1913--1928.

Digital Library

[128]

Xiaojia Zhao, Yuxuan Wang, and DeLiang Wang. 2014. Robust speaker identification in noisy and reverberant conditions. IEEE/ACM Transactions on Audio, Speech, and Language Processing 22, 4 (2014), 836--845.

Digital Library

[129]

Yuhang Zhao, Cynthia L Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 116--130.

[130]

Shifeng Zhou. 2018. A Smart Cane to Help the Blind People Walk Confidently. Materials Science and Engineering 439, 3 (2018), 032121.

Cited By

Gupta CSridhar SMatthies DJouffrais CNanayakkara S(2024)SonicVista: Towards Creating Awareness of Distant Scenes through SonificationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596098:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659609
Dissanayake TMaekawa THara T(2023)Joint Estimation of the Distance and Relative Velocity of Obstacles via Smartphone Active Sound Sensing for Pedestrian Safety2023 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PERCOM56429.2023.10099353(32-42)Online publication date: 13-Mar-2023
https://doi.org/10.1109/PERCOM56429.2023.10099353
Jin YGao YXu XChoi SLi JLiu FLi ZJin Z(2022)EarCommandProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346136:2(1-28)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534613
Show More Cited By

Index Terms

Acoussist: An Acoustic Assisting Tool for People with Visual Impairments to Cross Uncontrolled Streets
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

CycleGuard: A Smartphone-based Assistive Tool for Cyclist Safety Using Acoustic Ranging

Every year 41,000 cyclists die in road traffic-related incidents worldwide [47]. One of the most startling and infuriating conflicts that cyclists experience is the so-called "right hook". It refers to a vehicle striking a cyclist heading in the same ...
ObstacleWatch: Acoustic-based Obstacle Collision Detection for Pedestrian Using Smartphone

Walking while using a smartphone is becoming a major pedestrian safety concern as people may unknowingly bump into various obstacles that could lead to severe injuries. In this paper, we propose ObstacleWatch, an acoustic-based obstacle collision ...
Vision-based active safety system for automatic stopping

Intelligent systems designed to reduce highway fatalities have been widely applied in the automotive sector in the last decade. Of all users of transport systems, pedestrians are the most vulnerable in crashes as they are unprotected. This paper deals ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 4, Issue 4

December 2020

1356 pages

EISSN:2474-9567

DOI:10.1145/3444864

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 December 2020

Published in IMWUT Volume 4, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

NSF (National Science Foundation)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
774
Total Downloads

Downloads (Last 12 months)194
Downloads (Last 6 weeks)20

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gupta CSridhar SMatthies DJouffrais CNanayakkara S(2024)SonicVista: Towards Creating Awareness of Distant Scenes through SonificationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596098:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659609
Dissanayake TMaekawa THara T(2023)Joint Estimation of the Distance and Relative Velocity of Obstacles via Smartphone Active Sound Sensing for Pedestrian Safety2023 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PERCOM56429.2023.10099353(32-42)Online publication date: 13-Mar-2023
https://doi.org/10.1109/PERCOM56429.2023.10099353
Jin YGao YXu XChoi SLi JLiu FLi ZJin Z(2022)EarCommandProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346136:2(1-28)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534613
Tang RDuan GXie LBu YZhao MLin ZLin Q(2022)Static Obstacle Detection based on Acoustic SignalsIEEE INFOCOM 2022 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFOCOMWKSHPS54753.2022.9798030(1-2)Online publication date: 2-May-2022
https://doi.org/10.1109/INFOCOMWKSHPS54753.2022.9798030
Kabil ARabieh KKaleem FAzer M(2022)Vehicle to Pedestrian Systems: Survey, Challenges and Recent TrendsIEEE Access10.1109/ACCESS.2022.322477210(123981-123994)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3224772
Watanabe HSumiya MTerada T(2022)Human-Machine Cooperative Echolocation Using UltrasoundIEEE Access10.1109/ACCESS.2022.322446810(125264-125278)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3224468

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents