More Web Proxy on the site http://driver.im/

research-article

CymaSense: A Novel Audio-Visual Therapeutic Tool for People on the Autism Spectrum

Authors:

Grégory Leplâtre,

Iain McGregorAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 62 - 71

https://doi.org/10.1145/3132525.3132539

Published: 19 October 2017 Publication History

Abstract

Music Therapy has been shown to be an effective intervention for clients with Autism Spectrum Condition (ASC), a lifelong neurodevelopmental condition that can affect people in a number of ways. This paper presents a study evaluating the use of a multimodal 3D interactive tool, CymaSense, within a series of music therapy sessions. Eight adults with ASC participated in an 8-week period using a single case experimental design approach. The study used qualitative and quantitative methodological tools for analysis within and beyond the therapy sessions. The results indicate an increase in communicative behaviours for both verbal and non-verbal participants.

Supplementary Material

suppl.mov (fp054.mp4)

Supplemental video

Download
46.34 MB

References

[1]

David Aldridge. 2003. Case Study Designs in Music Therapy. Jessica Kingsley Publishers.

[2]

American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders (5th ed.). .

[3]

Carolynn Bredek, Doreen Granpeesheh, Kathy Thompson, and Renat Matalon. 2014. Visual and Other Sensory Modifications. In Evidence-Based Treatment for Children with Autism. Elsevier, 115-132.

[4]

Butter Churn. 2017. Butterchurn visualizer. Retrieved March 14, 2017 from https://butterchurnviz.com/.

[5]

Franceli L. Cibrian, Oscar Peña, Deysi Ortega, and Monica Tentori. 2017. BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy. International Journal of Human-Computer Studies 0: 1-16.

[6]

Peter Ciuha, Bojan Klemenc, and Franc Solina. 2010. Visualization of concurrent tones in music with colours. Proceedings of the international conference on Multimedia - MM '10, ACM Press, 1677.

Digital Library

[7]

Cycling '74. 2017. Max. Retrieved February 14, 2016 from https://cycling74.com/products/max/.

[8]

Cymascope.com. 2015. Physics?:: Cymascope Research. Retrieved December 30, 2015 from http://cymascope.com/cyma_research/physics.html.

[9]

Theo Dimitriadis and Henk Smeijsters. 2011. Autistic spectrum disorder and music therapy: theory underpinning practice. Nordic Journal of Music Therapy 20, 2: 108-122.

[10]

C. L. Edgerton. 1994. The Effect of Improvisational Music Therapy on the Communicative Behaviors of Autistic Children. Journal of Music Therapy 31, 1: 31-62.

[11]

William Farr, Nicola Yuill, and Hayes Raffle. 2010. Social benefits of a tangible user interface for children with Autistic Spectrum Conditions. Autism 14, 3: 237-252.

[12]

Christopher Frauenberger, Julia Makhaeva, and Katharina Spiel. 2017. Blending Methods?: Developing Participatory Design Sessions for Autistic Children. .

[13]

Kostas Giannakis. 2006. A comparative evaluation of auditory-visual mappings for sound visualisation. Organised Sound 11, 3: 297.

Digital Library

[14]

Oliver Gingrich, Alain Renaud, and Eugenia Emets. 2013. KIMA - A Holographic Telepresence Environment Based on Cymatic Principles. Leonardo 46, 4: 332-343.

[15]

Ofer Golan and Simon Baron-Cohen. 2006. Systemizing empathy: Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Development and Psychopathology 18: 591-617.

[16]

Gina Green and J Ricciardi. 2015. Findings and conclusions: National standards project, phase 2. .

[17]

Haruki Hasegawa. 2015. Music Visualizer. Retrieved July 19, 2017 from https://music-visualizer.h6ah4i.com/.

[18]

A. Hillier, G. Greher, N. Poto, and M. Dougherty. 2012. Positive outcomes following participation in a music intervention for adolescents and young adults on the autism spectrum. Psychology of Music 40, 2: 201-215.

[19]

Juan Pablo Hourcade, Stacy R. Williams, Ellen A. Miller, Kelsey E. Huebner, and Lucas J. Liang. 2013. Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13: 3197-3206.

Digital Library

[20]

Tiffany L Hutchins and Patricia a Prelock. 2006. Using Social Stories and Comic Strip Conversations To Promote Socially Valid Outcomes for Children with Autism. Seminars in Speech and Language 27, 1: 047-059.

[21]

Hans Jenny. 1968. CYMATICS. The Sciences 8, 7: 12-18.

[22]

Ronna S Kaplan and Anita Louise Steele. 2005. An analysis of music therapy program goals and outcomes for clients with diagnoses on the autism spectrum. Journal of music therapy 42, 1: 2-19.

[23]

Mats B. Küssner. 2014. Shape, Drawing and Gesture: Cross-Modal Mappings of Sound and Music. .

[24]

Amanda Lazar, Raymundo Cornejo, Caroline Edasis, and Anne Marie Piper. 2016. Designing for the Third Hand?: Empowering Older Adults with Cognitive Impairments through Creating and Sharing. Proceedings of the Designing Interactive Systems Conference (DIS '16): 1047-1058.

Digital Library

[25]

H a Lim. 2007. The Effect of "Developmental Speech-Language Training through Music" on Speech Production in Children with Autism Spectrum Disorders. Journal of Music Therapy XLVII, 1: 2-26.

[26]

H a Lim and E Draper. 2011. The Effects of Music Therapy Incorporated with Applied Behavior Analysis Verbal Behavior Approach for Children with Autism Spectrum Disorders. Journal of Music Therapy 48, 4: 532-550.

[27]

John McGowan, Grégory Leplâtre, and Iain McGregor. 2017. CymaSense. Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems - DIS '17 Companion, ACM Press, 270-274.

Digital Library

[28]

Francois Michaud and Catherine Theberge-Turmel. 2002. Mobile Robotic Toys and Autism. In K. Dautenhahn, A. Bond, L. Cañamero, and B. Edmonds, eds., Socially Intelligent Agents: Creating relationships with Computers and Robots. Kluwer Publishers, 125-132.

[29]

Christine Norris and John Dattilo. 1999. Evaluating Effects of a Social Story Intervention on a Young Girl with Autism. Focus on Autism and Other Developmental Disabilities 14, 3: 180-186.

[30]

Novation. Launchpad | NovationMusic.com. Retrieved from https://global.novationmusic.com/launch/launchpad#.

[31]

Narcís Parés, Anna Carreras, Jaume Durany, et al. 2005. Promotion of Creative Activity in Children With Severe Autism Through Visuals in an Interactive Multisensory Environment. .

[32]

S Parsons and P Mitchell. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research 46, 430-443.

[33]

M. Pavlicevic. 2014. Afterword: Knock knock... Psychology of Music 42, 6: 2014-2016.

[34]

Mercédès Pavlicevic, Nicky O'Neil, Harriet Powell, Oonagh Jones, and Ergina Sampathianaki. 2013. Making music, making friends: Long-term music therapy with young adults with severe learning disabilities. Journal of intellectual disabilities?: JOID: 5-19.

[35]

Katherine Paxton and Irene A Estay. 2007. Counselling people on the autism spectrum: A practical manual. Counselling people on the autism spectrum: A practical manual.

[36]

J. Preis, R. Arnon, D. Silbert, and A. Rozegar. 2015. Does Music Matter? The Effects of Background Music on Verbal Expression and Engagement in Children with Autism Spectrum Disorders. Music Therapy Perspectives: 1-10.

[37]

Brian Reichow, Peter Doehring, Domenic V. Cicchetti, and Fred R. Volkmar. 2011. Evidence-based practices and treatments for children with autism. .

[38]

Kathryn E. Ringland, Rodrigo Zalapa, Megan Neal, Lizbeth Escobedo, Monica Tentori, and Gillian R. Hayes. 2014. SensoryPaint: A Multimodal Sensory Intervention for Children with Neurodevelopmental Disorders. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '14 Adjunct September: 873-884.

Digital Library

[39]

Jodi Robledo, Anne M Donnellan, and Karen Strandt-Conroy. 2012. An exploration of sensory and movement differences from the perspective of individuals with autism. Frontiers in integrative neuroscience 6, November: 107.

[40]

Roseann C. Schaaf and Lucy Jane Miller. 2005. Occupational therapy using a sensory integrative approach for children with developmental disabilities. Mental Retardation and Developmental Disabilities Research Reviews 11, 2: 143-148.

[41]

Scottish Autism. 2017. Scottish Autism - Autism Awareness Charity & Services for Children & Adults in Scotland. Retrieved April 4, 2017 from http://www.scottishautism.org/.

[42]

Sense Scotland. 2017. Sense Scotland. Retrieved April 4, 2017 from http://www.sensescotland.org.uk/.

[43]

Stephen M Shore. 2003. The Language of Music: Working with Children on the Autism Spectrum. Journal of Education 183, 2.

[44]

Kate Simpson and Deb Keen. 2011. Music interventions for children with autism: Narrative review of the literature. Journal of Autism and Developmental Disorders 41, 11: 1507-1514.

[45]

SkoogMusic. Skoogmusic | We create music technology that lets anyone make music. Retrieved July 3, 2015 from http://www.skoogmusic.com/.

[46]

S.M. Smith and G.N. Williams. 1997. A visualization of music. Proceedings. Visualization '97 (Cat. No. 97CB36155), IEEE, 499-503.

Digital Library

[47]

Soundspectrum. 2017. SoundSpectrum. Retrieved March 14, 2017 from https://www.soundspectrum.com/.

[48]

Lewis Sykes. 2011. The augmented tonoscope. - conference on Electronic Visualisation and the Arts: 1-6.

Digital Library

[49]

Colwyn Trevarthen. 2002. Autism, sympathy of motives and music therapy. Enfance 54, 1: 86.

[50]

Erez Tsur, Michael Friger, and Idan Menashe. 2016. The Unique Evolutionary Signature of Genes Associated with Autism Spectrum Disorder. Behavior Genetics 46, 6: 754-762.

[51]

Lilia Villafuerte, Milena Markova, and Sergi Jorda. 2012. Acquisition of social abilities through musical tangible user interface. Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 745.

Digital Library

[52]

Barbara L. Wheeler. 2015. Music Therapy Handbook. Guilford Publications.

[53]

Mitchell Whitelaw. 2008. Synesthesia and Cross-Modality in Contemporary Audiovisuals. The Senses & Society 3, 3: 259-276.

[54]

Tsung-Ren Yang, Pamela J Wolfberg, Shu-Chin Wu, and Pey-Yun Hwu. 2003. Supporting children on the autism spectrum in peer play at home and school: piloting the integrated play groups model in Taiwan. Autism?: the international journal of research and practice.

Cited By

Morgado Ramirez DBarbareschi GHolloway C(2024)Adult Autism Research Priorities and Conceptualization in Computing Research: Invitation to Co-lead with Autistic AdultsACM Transactions on Computer-Human Interaction10.1145/363514831:4(1-47)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3635148
Lopes ITertuliano MCoelho T(2023)Unlocking MemoriesHandbook of Research on Advances in Digital Technologies to Promote Rehabilitation and Community Participation10.4018/978-1-6684-9251-2.ch012(246-268)Online publication date: 8-Dec-2023
https://doi.org/10.4018/978-1-6684-9251-2.ch012
Dobesh SAlbert JAhmed SSharmin M(2023)Moving Towards an Accessible Approach to Music Therapy for Autistic People: A Systematic Review2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC57700.2023.00069(472-480)Online publication date: Jun-2023
https://doi.org/10.1109/COMPSAC57700.2023.00069
Show More Cited By

Index Terms

Recommendations

CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the ...
Evaluation of the Use of Real-time 3D Graphics to Augment Therapeutic Music Sessions for Young People on the Autism Spectrum

The present research evaluates the effectiveness of CymaSense, a real-time 3D visualisation application developed by the authors, as a means of improving the communicative behaviours of autistic participants through the addition of a visual modality ...
CymaSense: A Real-Time 3D Cymatics-Based Sound Visualisation Tool
DIS '17 Companion: Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems

What does music look like? Representation of music has taken many forms over time, from musical notation [16], through to random algorithm-based visualisations based on the amplitude of an audio signal [19]. One aspect of music visualisation that has ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

IIDI

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
481
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)3

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Morgado Ramirez DBarbareschi GHolloway C(2024)Adult Autism Research Priorities and Conceptualization in Computing Research: Invitation to Co-lead with Autistic AdultsACM Transactions on Computer-Human Interaction10.1145/363514831:4(1-47)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3635148
Lopes ITertuliano MCoelho T(2023)Unlocking MemoriesHandbook of Research on Advances in Digital Technologies to Promote Rehabilitation and Community Participation10.4018/978-1-6684-9251-2.ch012(246-268)Online publication date: 8-Dec-2023
https://doi.org/10.4018/978-1-6684-9251-2.ch012
Dobesh SAlbert JAhmed SSharmin M(2023)Moving Towards an Accessible Approach to Music Therapy for Autistic People: A Systematic Review2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC57700.2023.00069(472-480)Online publication date: Jun-2023
https://doi.org/10.1109/COMPSAC57700.2023.00069
Wang MJeon M(2023)Assistive Technology for Adults on the Autism Spectrum: A Systematic SurveyInternational Journal of Human–Computer Interaction10.1080/10447318.2022.216356840:10(2433-2452)Online publication date: 8-Jan-2023
https://doi.org/10.1080/10447318.2022.2163568
Maun RFabri MTrevorrow P(2023)Participatory Methods to Engage Autistic People in the Design of Digital Technology: A Systematic Literature ReviewJournal of Autism and Developmental Disorders10.1007/s10803-023-06015-554:8(2960-2971)Online publication date: 30-May-2023
https://doi.org/10.1007/s10803-023-06015-5
Colley MKränzle TRukzio E(2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519701
Maun RFabri MTrevorrow P(2021)Adapting Participatory Design Activities for Autistic Adults: A ReviewDesign, User Experience, and Usability: Design for Diversity, Well-being, and Social Development10.1007/978-3-030-78224-5_21(300-314)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78224-5_21
Khowaja KAl-Thani DAbdelaal YHassan AMou YHijab M(2021)Towards the Mixed-Reality Platform for the Learning of Children with Autism Spectrum Disorder (ASD): A Case Study in QatarHCI in Games: Serious and Immersive Games10.1007/978-3-030-77414-1_24(329-344)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-77414-1_24
Horvath ARühse VRaptis D(2020)SoundSculpt: A Design Framework for 3D Modelling and Digitally Fabricating Sound Patterns.Proceedings of the 32nd Australian Conference on Human-Computer Interaction10.1145/3441000.3441017(572-581)Online publication date: 2-Dec-2020
https://dl.acm.org/doi/10.1145/3441000.3441017
Horvath ARühse V(2020)The Chladni WallHCI International 2020 – Late Breaking Posters10.1007/978-3-030-60703-6_50(390-397)Online publication date: 8-Nov-2020
https://doi.org/10.1007/978-3-030-60703-6_50
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents