Abstract
This paper investigates and compares the effectiveness of haptic and audio modality for navigation in low visibility environment using a sensory augmentation device. A second generation head-mounted vibrotactile interface as a sensory augmentation prototype was developed to help users to navigate in such environments. In our experiment, a subject navigates along a wall relying on the haptic or audio feedbacks as navigation commands. Haptic/audio feedback is presented to the subjects according to the information measured from the walls to a set of 12 ultrasound sensors placed around a helmet and a classification algorithm by using multilayer perceptron neural network. Results showed the haptic modality leads to significantly lower route deviation in navigation compared to auditory feedback. Furthermore, the NASA TLX questionnaire showed that subjects reported lower cognitive workload with haptic modality although both modalities were able to navigate the users along the wall.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kärcher, S.M., Fenzlaff, S., Hartmann, D., Nagel, S.K., König, P.: Sensory augmentation for the blind. Front. Hum. Neurosci. 6, 37 (2012)
Kim, Y., Harders, M., Gassert, R.: Identification of vibrotactile patterns encoding obstacle distance information. IEEE Trans. Haptics 8(3), 298–305 (2015)
Flores, G., Kurniawan, S., Manduchi, R., Martinson, E., Morales, L.M., Sisbot, E.A.: Vibrotactile guidance for wayfinding of blind walkers. IEEE Trans. Haptics 8(3), 306–317 (2015)
Shoval, S., Borenstein, J., Koren, Y.: Auditory guidance with the NavBelt-a computerized travel aid for the blind. IEEE Trans. Syst. Man Cybern. C Appl. Rev. 28(3), 459–467 (1998)
Holland, S., Morse, D.R., Gedenryd, H.: AudioGPS: spatial audio navigation with a minimal attention interface. Pers. Ubiquitous Comput. 6(4), 253–259 (2002)
Bertram, C., Evans, M.H., Javaid, M., Stafford, T., Prescott, T.: Sensory augmentation with distal touch: the tactile helmet project. In: Lepora, N.F., Mura, A., Krapp, H.G., Verschure, P.F., Prescott, T.J. (eds.) Living Machines 2013. LNCS, vol. 8064, pp. 24–35. Springer, Heidelberg (2013)
Cassinelli, A., Reynolds, C., Ishikawa, M.: Augmenting spatial awareness with haptic radar. In: 10th IEEE International Symposium on Wearable Computers, pp. 61–64 (2006)
Carton, A., Dunne, L.E.: Tactile distance feedback for fire-fighters: design and preliminary evaluation of a sensory augmentation glove. In: Proceedings of the 4th Augmented Human International Conference, pp. 58–64 (2013)
Marsalia, A.C.: Evaluation of vibrotactile alert systems for supporting hazard awareness and safety of distracted pedestrians, Master Thesis at Texas A&M University (2013)
Marston, J.R., Loomis, J.M., Klatzky, R.L., Golledge, R.G.: Nonvisual route following with guidance from a simple haptic or auditory display. J. Vis. Impair. Blind. 101(4), 203–211 (2007)
Hara, M., Shokur, S., Yamamoto, A., Higuchi, T., Gassert, R., Bleuler, H.: Virtual environment to evaluate multimodal feedback strategies for augmented navigation of the visually impaired. In: IEEE Engineering in Medicine and Biology Society, pp. 975–978 (2010)
Kaul, O.B., Rohs, M.: HapticHead: 3D guidance and target acquisition through a vibrotactile grid. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2533–2539 (2016)
Martinez, M., Constantinescu, A., Schauerte, B., Koester, D., Stiefelhagen, R.: Cognitive evaluation of haptic and audio feedback in short range navigation tasks. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part II. LNCS, vol. 8548, pp. 128–135. Springer, Heidelberg (2014)
Kerdegari, H., Kim, Y., Stafford, T., Prescott, T.J.: Centralizing bias and the vibrotactile funneling illusion on the forehead. In: Auvray, M., Duriez, C. (eds.) EuroHaptics 2014, Part II. LNCS, vol. 8619, pp. 55–62. Springer, Heidelberg (2014)
Kerdegari, H., Kim, Y., Prescott, T.: Tactile language for a head-mounted sensory augmentation device. In: Wilson, S.P., Verschure, P.F., Mura, A., Prescott, T.J. (eds.) Living Machines 2015. LNCS, vol. 9222, pp. 359–365. Springer, Heidelberg (2015)
Denef, S., Ramirez, L., Dyrks, T., Stevens, G.: Handy navigation in ever-changing spaces: an ethnographic study of firefighting practices. In: Proceedings of the 7th ACM Conference on Designing Interactive Systems, pp. 184–192 (2008)
Ando, Y., Yuta, S.: Following a wall by an autonomous mobile robot with a sonar-ring. In: Proceedings 1995 IEEE International Conference on Robotics and Automation, vol. 3, pp. 2599–2606 (1995)
Kerdegari, H., Kim, Y., Prescott, T.: Head-mounted sensory augmentation device: designing a tactile language. IEEE Trans. Haptics PP(99), 1 (2016)
Sherrick, C.E., Rogers, R.: Apparent haptic movement. Percept. Psychophys. 1(6), 175–180 (1966)
Kirman, J.H.: Tactile apparent movement: the effects of interstimulus onset interval and stimulus duration. Percept. Psychophys. 15(1), 1–6 (1974)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 239–250. Elsevier, North Holland Press, Amsterdam (1988)
Freire, A.L., Barreto, G.A., Veloso, M., Varela, A.T.: Short-term memory mechanisms in neural network learning of robot navigation tasks: a case study. In: 6th Latin American Robotics Symposium (LARS), no. 4 (2009)
Zou, A.-M., Hou, Z.-G., Fu, S.-Y., Tan, M.: Neural networks for mobile robot navigation: a survey. In: Wang, J., Yi, Z., Żurada, J.M., Lu, B.-L., Yin, H. (eds.) ISNN 2006. LNCS, vol. 3972, pp. 1218–1226. Springer, Heidelberg (2006)
Ando, B., Baglio, S., Marletta, V., Valastro, A.: A haptic solution to assist visually impaired in mobility tasks. IEEE Trans. Hum. Mach. Syst. 45(5), 641–646 (2015)
Acknowledgment
We would like to thank the subjects for their help in data collection for this study. This work was supported by the University of Sheffield Cross-Cutting Directors of Research and Innovation Network (CCDRI), Search and Rescue 2020 project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Kerdegari, H., Kim, Y., Prescott, T.J. (2016). Head-Mounted Sensory Augmentation Device: Comparing Haptic and Audio Modality. In: Lepora, N., Mura, A., Mangan, M., Verschure, P., Desmulliez, M., Prescott, T. (eds) Biomimetic and Biohybrid Systems. Living Machines 2016. Lecture Notes in Computer Science(), vol 9793. Springer, Cham. https://doi.org/10.1007/978-3-319-42417-0_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-42417-0_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42416-3
Online ISBN: 978-3-319-42417-0
eBook Packages: Computer ScienceComputer Science (R0)