[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content
Springer Nature Link
Log in

A Virtual Reality System for the Simulation of Neurodiversity

  • Conference paper
  • First Online:
Proceedings of Sixth International Congress on Information and Communication Technology

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 236))

Abstract

Autism is a neurodevelopmental disorder characterized by deficits in social communication and repetitive patterns of behavior. Individuals affected by Autism Spectrum Disorder (ASD) may face overwhelming sensory hypersensitivities that hamper their everyday life. In order to promote awareness about neurodiversity among the neurotypical population, we have developed an interactive virtual reality simulation to experience the oversensory stimulation that an individual with autism spectrum disorder may experience in a natural environment. In this experience, we project the user in a first-person perspective in a classroom where a teacher is presenting a lecture. As the user explores the classroom and attends the lecture, he/she is confronted with sensory distortions which are commonly experienced by persons with ASD. We provide the users with a virtual reality headset with motion tracking, two wireless controllers for interaction, and a wristband for physiological data acquisition to create a closed feedback loop. This wearable device measures blood volume pulse (BVP) and electrodermal activity (EDA), which we use to perform online estimations of the arousal levels of users as they respond to the virtual stimuli. We use this information to modulate the intensity of auditory and visual stimuli simulating a vicious cycle in which increased arousal translates into increased oversensory stimulation. Here, we present the architecture and technical implementation of this system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 159.50
Price includes VAT (United Kingdom)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 199.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://youtu.be/KmDGvquzn2k.

  2. 2.

    https://youtu.be/plPNhooUUuc.

  3. 3.

    https://youtu.be/BPDTEuotHe0.

  4. 4.

    https://youtu.be/IcS2VUoe12M.

  5. 5.

    https://youtu.be/ZLyGuVTH8sA.

  6. 6.

    https://youtu.be/OtwOz1GVkDg.

  7. 7.

    https://youtu.be/DgDR_gYk_a8.

  8. 8.

    http://gamejolt.com/games/auti-sim/12761.

  9. 9.

    https://www.training2care.co.uk/autism-reality-experience.htm.

  10. 10.

    https://developer.empatica.com/windows-streaming-server.html.

  11. 11.

    https://github.com/sccn/labstreaminglayer.

References

  1. Acharya UR, Joseph KP, Kannathal N, Lim CM, Suri JS (2006) Heart Rate Var: A Rev. https://doi.org/10.1007/s11517-006-0119-0

    Article  Google Scholar 

  2. Agrafioti F, Hatzinakos D, Anderson AK (2012) ECG pattern analysis for emotion detection. IEEE Trans Affect Comput 3(1):102–115. https://doi.org/10.1109/T-AFFC.2011.28

    Article  Google Scholar 

  3. Allen J (2007) Photoplethysmography Appl Clin Physiol Measur. https://doi.org/10.1088/0967-3334/28/3/R01

    Article  Google Scholar 

  4. Association AP et al (2013) Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub

    Google Scholar 

  5. Betella A, Cetnarski R, Zucca R, Arsiwalla XD, Martinez E, Omedas P, Mura A, Verschure PFMJ (2014) BrainX 3: embodied exploration of neural data. In: Proceedings of the 2014 virtual reality international conference. ACM, p 37

    Google Scholar 

  6. Betella A, Pacheco D, Zucca R, Arsiwalla XD, Omedas P, Lanatà A, Mazzei D, Tognetti A, Greco A, Carbonaro N, Wagner J, Lingenfelser F, André E, Rossi DD, Verschure PF (2014) Interpreting psychophysiological states using unobtrusive wearable sensors in virtual reality. In: ACHI 2014, the seventh international conference on advances in computer-human interactions pp 331–336

    Google Scholar 

  7. Chambon V, Farrer C, Pacherie E, Jacquet PO, Leboyer M, Zalla T (2017) Reduced sensitivity to social priors during action prediction in adults with autism spectrum disorders. Cognition 160:17–26. https://doi.org/10.1016/j.cognition.2016.12.005

    Article  Google Scholar 

  8. Critchley HD (2002) Review: electrodermal responses: what happens in the brain. The Neurosci 8(2):132–142. https://doi.org/10.1177/107385840200800209

    Article  Google Scholar 

  9. Goldman S, Wang C, Salgado MW, Greene PE, Kim M, Rapin I (2009) Motor stereotypies in children with autism and other developmental disorders. Dev Med Child Neurol 51(1):30–38

    Article  Google Scholar 

  10. Gomes E, Pedroso FS, Wagner MB (2008) Hipersensibilidade auditiva no transtorno do espectro autístico. Pró-Fono Revista de Atualização Científica 20(4):279–284. https://doi.org/10.1590/s0104-56872008000400013

    Article  Google Scholar 

  11. Henelius A, Torniainen J (2018) MIDAS: open-source framework for distributed online analysis of data streams. SoftwareX 7:156–161. https://doi.org/10.1016/j.softx.2018.04.004

    Article  Google Scholar 

  12. Mitchell P, Ropar D (2004) Visuo-Spat Abil Autism: A Rev. https://doi.org/10.1002/icd.348

    Article  Google Scholar 

  13. Szwoch W (2015) Emotion recognition using physiological signals. In: Proceedings of the mulitimedia, interaction, design and innnovation—MIDI ’15, pp 1–8. https://doi.org/10.1145/2814464.2814479

Download references

Acknowledgements

This research received funding from H2020-EU, ID: 787061 and ERC (PoC) H2020-EU, ID: 840052.

Author information

Authors and Affiliations

  1. Synthetic Perceptive Emotive Cognitive Systems (SPECS) Lab, Institute for Bioengineering of Catalonia (IBEC), Barcelona Institute of Science and Technology (BIST), Barcelona, Spain

    Héctor López-Carral, Maria Blancas-Muñoz, Anna Mura, Pedro Omedas, Àdria España-Cumellas, Enrique Martínez-Bueno & Paul F. M. J. Verschure

  2. Universitat Pompeu Fabra (UPF), Barcelona, Spain

    Héctor López-Carral & Maria Blancas-Muñoz

  3. Atos, London, UK

    Neil Milliken & Paul Moore

  4. BBC, Manchester, UK

    Leena Haque & Sean Gilroy

  5. Institució Catalana de Recerca i Estudis Avançats, Barcelona, Spain

    Paul F. M. J. Verschure

Authors
  1. Héctor López-Carral
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Blancas-Muñoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anna Mura
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pedro Omedas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Àdria España-Cumellas
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Enrique Martínez-Bueno
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Neil Milliken
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Paul Moore
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Leena Haque
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Sean Gilroy
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Paul F. M. J. Verschure
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul F. M. J. Verschure .

Editor information

Editors and Affiliations

  1. Middlesex University, London, UK

    Xin-She Yang

  2. University of Reading, Reading, UK

    Simon Sherratt

  3. JIS University, Kolkata, India

    Nilanjan Dey

  4. Global Knowledge Research Foundation, Ahmedabad, India

    Amit Joshi

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

López-Carral, H. et al. (2022). A Virtual Reality System for the Simulation of Neurodiversity. In: Yang, XS., Sherratt, S., Dey, N., Joshi, A. (eds) Proceedings of Sixth International Congress on Information and Communication Technology. Lecture Notes in Networks and Systems, vol 236. Springer, Singapore. https://doi.org/10.1007/978-981-16-2380-6_46

Download citation

Publish with us

Policies and ethics

Search

Navigation