More Web Proxy on the site http://driver.im/

research-article

Open access

Do as I say, not as I do: Therapist Evaluation of a Practice and Supervision Aid

Authors:

Patty Beyrong Kuo,

Christina Soma,

Katherine Axford,

Jake J. Van EppsAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 6, Issue CSCW2

Article No.: 294, Pages 1 - 23

https://doi.org/10.1145/3555185

Published: 11 November 2022 Publication History

Abstract

Interactive software offers the potential to improve the quality of mental health care by promoting skill development, clinical insight, and shared reflection among mental health professionals. However, research on therapists' usage of interactive software has been primarily based in training and mock-clinical settings. In this paper, we present a qualitative study of clinicians' experience using CORE-MI, a collaborative recording and annotation software, in a real-world university counseling center. We describe how and why therapists, both trainees and licensed staff, used CORE-MI to support their practice and improve their skills. We also consider how usage varied with therapists' developmental level and how the software impacted relationships between supervisors and supervisees. Finally, we offer recommendations for future research and design of interactive systems in mental health settings.

References

[1]

Allan Abbass, Stephen Arthey, Jason Elliott, Tim Fedak, Dion Nowoweiski, Jasmina Markovski, and Sarah Nowoweiski. 2011. Web-conference supervision for advanced psychotherapy training: a practical guide. Psychotherapy 48, 2 (June 2011), 109--118.

[2]

Substance Abuse. 2019. Mental Health Services Administration.(2018). Key substance use and mental health indicators in the United States: Results from the 2017 National Survey on Drug Use and Health (HHS Publication No. SMA 18--5068, NSDUH Series H-53). Rockville, MD: Center for Behavioral Health Statistics and Quality. Substance Abuse and Mental Health Services Administration. Retrieved from https://www. samhsa. gov/data (2019).

[3]

Association of State and Provincial Psychology Boards (ASPPB). 2018. Code of conduct. Retrieved April 13, 2020 from https://cdn.ymaws.com/www.asppb.net/resource/resmgr/guidelines/code_of_conduct_2020_.pdf

[4]

John S. Baer, Elizabeth A. Wells, David B. Rosengren, Bryan Hartzler, Blair Beadnell, and Chris Dunn. 2009. Agency context and tailored training in technology transfer: a pilot evaluation of motivational interviewing training for community counselors. J. Subst. Abuse Treat. 37, 2 (September 2009), 191--202.

[5]

Jakob E. Bardram and Claus Bossen. 2005. Mobility Work: The Spatial Dimension of Collaboration at a Hospital. Comput. Support. Coop. Work 14, 2 (April 2005), 131--160.

Digital Library

[6]

Jakob E. Bardram and Steven Houben. 2018. Collaborative Affordances of Medical Records. Comput. Support. Coop. Work 27, 1 (February 2018), 1--36.

Digital Library

[7]

Eric P. S. Baumer, Vera Khovanskaya, Mark Matthews, Lindsay Reynolds, Victoria Schwanda Sosik, and Geri Gay. 2014. Reviewing reflection: on the use of reflection in interactive system design. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14), Association for Computing Machinery, New York, NY, USA, 93--102.

Digital Library

[8]

Gordon Baxter and Ian Sommerville. 2011. Socio-technical systems: From design methods to systems engineering. Interact. Comput. 23, 1 (January 2011), 4--17.

Digital Library

[9]

Pernille Bjørn and Morten Hertzum. 2011. Artefactual Multiplicity: A Study of Emergency-Department Whiteboards. Comput. Support. Coop. Work 20, 1 (April 2011), 93--121.

Digital Library

[10]

Claus Bossen, Lotte Groth Jensen, and Flemming Witt. 2012. Medical secretaries' care of records: the cooperative work of a non-clinical group. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12), Association for Computing Machinery, New York, NY, USA, 921--930.

Digital Library

[11]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qual. Res. Psychol. 3, 2 (January 2006), 77--101.

[12]

Mieke Brekelmans, Theo Wubbels, and Perry Den Brok. 2002. Teacher experience and the teacher--student relationship in the classroom environment. In Studies in educational learning environments: An international perspective. World Scientific, 73--99.

[13]

Alexis M. Briggie, Mark J. Hilsenroth, Francine Conway, J. Christopher Muran, and Jonathan M. Jackson. 2016. Patient comfort with audio or video recording of their psychotherapy sessions: Relation to symptomatology, treatment refusal, duration, and outcome. Prof. Psychol. Res. Pr. 47, 1 (February 2016), 66--76.

[14]

Ellie Brown, Naomi Moller, and Christine Ramsey-Wade. 2013. Recording therapy sessions: What do clients and therapists really think? Counselling and Psychotherapy Research 13, 4 (December 2013), 254--262.

[15]

Stephanie L. Budge, Jesse J. Owen, S. Mark Kopta, Takuya Minami, Matthew R. Hanson, and Glenn Hirsch. 2013. Differences among trainees in client outcomes associated with the phase model of change. Psychotherapy 50, 2 (June 2013), 150--157.

[16]

Federico Cabitza, Carla Simone, and Marcello Sarini. 2009. Leveraging Coordinative Conventions to Promote Collaboration Awareness. Comput. Support. Coop. Work 18, 4 (August 2009), 301--330.

[17]

Paul Dourish. 2003. The Appropriation of Interactive Technologies: Some Lessons from Placeless Documents. Comput. Support. Coop. Work 12, 4 (December 2003), 465--490.

Digital Library

[18]

Brianna Dym and Casey Fiesler. 2020. Social Norm Vulnerability and its Consequences for Privacy and Safety in an Online Community. Proc. ACM Hum.-Comput. Interact. 4, CSCW2 (October 2020), 1--24.

Digital Library

[19]

K. Anders Ericsson. 2006. The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance. In The Cambridge handbook of expertise and expert performance, (pp, K. Anders Ericsson (ed.). Cambridge University Press, xv, New York, NY, US, 683--703.

[20]

Carol A. Falender. 2018. Clinical supervision-the missing ingredient. Am. Psychol. 73, 9 (December 2018), 1240--1250.

[21]

Geraldine Fitzpatrick and Gunnar Ellingsen. 2013. A Review of 25 Years of CSCW Research in Healthcare: Contributions, Challenges and Future Agendas. Comput. Support. Coop. Work 22, 4 (August 2013), 609--665.

Digital Library

[22]

Eivind Flobak, Jo D. Wake, Joakim Vindenes, Smiti Kahlon, Tine Nordgreen, and Frode Guribye. 2019. Participatory Design of VR Scenarios for Exposure Therapy. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), Association for Computing Machinery, New York, NY, USA, 1--12.

Digital Library

[23]

Barry J. Fraser and Herbert J. Walberg. 2005. Research on teacher--student relationships and learning environments: Context, retrospect and prospect. Int. J. Educ. Res. 43, 1 (January 2005), 103--109.

[24]

James Gibson, Dolan Can, Bo Xiao, Zac E. Imel, David C. Atkins, Georgiou Panayiotis, and Shrikanth S. Narayanan. A Deep Learning Approach to Modeling Empathy in Addiction Counseling. In Proceedings of the Annual Conference of the International Speech Communication Association. Retrieved May 21, 2020 from https://www.researchgate.net/profile/David_Atkins2/publication/307889621_A_Deep_Learning_Approach_to_Modeling_Empathy_in_Addiction_Counseling/links/57f01b8d08ae280dd0aea732/A-Deep-Learning-Approach-to-Modeling-Empathy-in-Addiction-Counseling.pdf

[25]

Simon B. Goldberg, Tony Rousmaniere, Scott D. Miller, Jason Whipple, Stevan Lars Nielsen, William T. Hoyt, and Bruce E. Wampold. 2016. Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. J. Couns. Psychol. 63, 1 (January 2016), 1--11.

[26]

Andrea Grimes, Brian M. Landry, and Rebecca E. Grinter. 2010. Characteristics of shared health reflections in a local community. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (CSCW '10), Association for Computing Machinery, New York, NY, USA, 435--444.

[27]

Andrea Grimes, Brian M. Landry, and Rebecca E. Grinter. 2010. Characteristics of shared health reflections in a local community. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (CSCW '10), Association for Computing Machinery, New York, NY, USA, 435--444.

[28]

Mark Hancock, Thomas ten Cate, Sheelagh Carpendale, and Tobias Isenberg. 2010. Supporting sandtray therapy on an interactive tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), Association for Computing Machinery, New York, NY, USA, 2133--2142.

Digital Library

[29]

Christopher A. Harle, Alyson Listhaus, Constanza M. Covarrubias, Siegfried Of Schmidt, Sean Mackey, Peter J. Carek, Roger B. Fillingim, and Robert W. Hurley. 2016. Overcoming barriers to implementing patient-reported outcomes in an electronic health record: a case report. J. Am. Med. Inform. Assoc. 23, 1 (January 2016), 74--79.

[30]

Eric D. A. Hermes, Aaron R. Lyon, Stephen M. Schueller, and Joseph E. Glass. 2019. Measuring the Implementation of Behavioral Intervention Technologies: Recharacterization of Established Outcomes. J. Med. Internet Res. 21, 1 (January 2019), e11752.

[31]

Clara E. Hill, Sarah Knox, Barbara J. Thompson, Elizabeth Nutt Williams, Shirley A. Hess, and Nicholas Ladany. 2005. Consensual qualitative research: An update. J. Couns. Psychol. 52, 2 (April 2005), 196--205.

[32]

Pamela Hinds, Daniela Retelny, and Catherine Cramton. 2015. In the Flow, Being Heard, and Having Opportunities: Sources of Power and Power Dynamics in Global Teams. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), Association for Computing Machinery, New York, NY, USA, 864--875.

Digital Library

[33]

Tad Hirsch, Christina Soma, Kritzia Merced, Patty Kuo, Aaron Dembe, Derek D. Caperton, David C. Atkins, and Zac E. Imel. 2018. "It's hard to argue with a computer:" Investigating Psychotherapists' Attitudes towards Automated Evaluation. DIS (Des Interact Syst Conf) 2018, (June 2018), 559--571.

[34]

Mohammed (ehsan) Hoque, Matthieu Courgeon, Jean-Claude Martin, Bilge Mutlu, and Rosalind W. Picard. 2013. MACH: my automated conversation coach. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13), Association for Computing Machinery, New York, NY, USA, 697--706.

Digital Library

[35]

K. I. Howard, K. Moras, P. L. Brill, Z. Martinovich, and W. Lutz. 1996. Evaluation of psychotherapy. Efficacy, effectiveness, and patient progress. Am. Psychol. 51, 10 (October 1996), 1059--1064.

[36]

Inseok Hwang, Chungkuk Yoo, Chanyou Hwang, Dongsun Yim, Youngki Lee, Chulhong Min, Hjohn Kim, and Junehwa Song. 2014. TalkBetter: Family-driven Mobile Intervention Care for Children with Language Delay. (2014), 1283.

[37]

Zac E. Imel, Brian T. Pace, Christina S. Soma, Michael Tanana, Tad Hirsch, James Gibson, Panayiotis Georgiou, Shrikanth Narayanan, and David C. Atkins. 2019. Design feasibility of an automated, machine-learning based feedback system for motivational interviewing. Psychotherapy 56, 2 (June 2019), 318--328.

[38]

Rasmus Leth Jørnø, Karsten Gynther, and Ove Christensen. 2013. Challenging the CSCW matrix: a rough draft of a new conceptualisation of collaborative practices in learning environments. Open Learning: The Journal of Open, Distance and e-Learning 28, 3 (November 2013), 239--254.

[39]

Julie A. Kientz, Matthew S. Goodwin, Gillian R. Hayes, and Gregory D. Abowd. 2013. Interactive Technologies for Autism (1st ed.). Morgan & Claypool Publishers.

[40]

B. R. Krogstie, M. Prilla, D. Wessel, K. Knipfer, and V. Pammer. 2012. Computer Support for Reflective Learning in the Workplace: A Model. In 2012 IEEE 12th International Conference on Advanced Learning Technologies, 151--153.

[41]

M. J. Lambert, N. B. Hansen, and A. E. Finch. 2001. Patient-focused research: using patient outcome data to enhance treatment effects. J. Consult. Clin. Psychol. 69, 2 (April 2001), 159--172.

[42]

Wendy Levinson, Cara S. Lesser, and Ronald M. Epstein. 2010. Developing physician communication skills for patient-centered care. Health Aff. 29, 7 (July 2010), 1310--1318.

[43]

Jane Li, Toni Robertson, Susan Hansen, Tim Mansfield, and Jesper Kjeldskov. 2008. Multidisciplinary medical team meetings. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction Designing for Habitus and Habitat - OZCHI '08, ACM Press, New York, New York, USA.

Digital Library

[44]

Mark Mahoney. 2017. Collaborative Software Development Through Reflection and Storytelling. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion), Association for Computing Machinery, New York, NY, USA, 13--16.

[45]

Mark Matthews, Gavin Doherty, John Sharry, and Carol Fitzpatrick. 2008. Mobile phone mood charting for adolescents. Br. J. Guid. Counc. 36, 2 (May 2008), 113--129.

[46]

Theresa B. Moyers, Tim Martin, Jennifer K. Manuel, Stacey M. L. Hendrickson, and William R. Miller. 2005. Assessing competence in the use of motivational interviewing. J. Subst. Abuse Treat. 28, 1 (January 2005), 19--26.

[47]

David Murphy, Petr Slovak, Anja Thieme, Dan Jackson, Patrick Olivier, and Geraldine Fitzpatrick. 2019. Developing technology to enhance learning interpersonal skills in counsellor education. Br. J. Guid. Counc. 47, 3 (May 2019), 328--341.

[48]

John C. Norcross and Christie P. Karpiak. 2017. Our Best Selves: Defining and Actualizing Expertise in Psychotherapy. Couns. Psychol. 45, 1 (January 2017), 66--75.

[49]

Julian Oates, W. Wayne Weston, and John Jordan. 2000. The impact of patient-centered care on outcomes. Fam. Pract. 49, 9 (2000), 796--804.

[50]

Mark Olfson and Steven C. Marcus. 2010. National trends in outpatient psychotherapy. Am. J. Psychiatry 167, 12 (December 2010), 1456--1463.

[51]

Rupa A. Patel, Andrea Hartzler, Wanda Pratt, Anthony Back, Mary Czerwinski, and Asta Roseway. 2013. Visual feedback on nonverbal communication: A design exploration with healthcare professionals. In 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops, 105--112.

Digital Library

[52]

Laura Pina, Kael Rowan, Asta Roseway, Paul Johns, Gillian R. Hayes, and Mary Czerwinski. 2014. In situ cues for ADHD parenting strategies using mobile technology. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '14), ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 17--24.

Digital Library

[53]

Anne Marie Piper, Eileen O'Brien, Meredith Ringel Morris, and Terry Winograd. 2006. SIDES: A cooperative tabletop computer game for social skills development. In Proceedings of the 20th Anniversary ACM Conference on Computer Supported Cooperative Work, CSCW 2006, 1--10.

Digital Library

[54]

Carl R. Rogers. 1942. The use of electrically recorded interviews in improving psychotherapeutic techniques. Am. J. Orthopsychiatry 12, 3 (July 1942), 429--434.

[55]

Michael H. Ronnestad and Thomas M. Skovholt. 1993. Supervision of beginning and advanced graduate students of counseling and psychotherapy. Journal of Counseling & Development 71, 4 (April 1993), 396--405.

[56]

Craig S. Schwalbe, Hans Y. Oh, and Allen Zweben. 2014. Sustaining motivational interviewing: a meta-analysis of training studies. Addiction 109, 8 (August 2014), 1287--1294.

[57]

Kenichi Shimokawa, Michael J. Lambert, and David W. Smart. 2010. Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. J. Consult. Clin. Psychol. 78, 3 (June 2010), 298--311.

[58]

Petr Slovák, Nikki Theofanopoulou, Alessia Cecchet, Peter Cottrell, Ferran Altarriba Bertran, Ella Dagan, Julian Childs, and Katherine Isbister. 2018. "I just let him cry...: Designing Socio-Technical Interventions in Families to Prevent Mental Health Disorders. Retrieved from https://doi.org/10.1145/3274429

Digital Library

[59]

Petr Slovák, Anja Thieme, David Murphy, Paul Tennent, Patrick Olivier, and Geraldine Fitzpatrick. 2015. On Becoming a Counsellor: Challenges and Opportunities to Support Interpersonal Skills Training. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), Association for Computing Machinery, New York, NY, USA, 1336--1347.

Digital Library

[60]

Mary L. Smith and Gene V. Glass. 1977. Meta-analysis of psychotherapy outcome studies. Am. Psychol. 32, 9 (September 1977), 752--760.

[61]

Seokwoo Song, Seungho Kim, John Kim, Wonjeong Park, and Dongsun Yim. 2016. TalkLIME: mobile system intervention to improve parent-child interaction for children with language delay. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), Association for Computing Machinery, New York, NY, USA, 304--315.

Digital Library

[62]

Gunnar Stevens, Volkmar Pipek, and Volker Wulf. 2009. Appropriation Infrastructure: Supporting the Design of Usages. In End-User Development, Springer Berlin Heidelberg, 50--69.

[63]

Duncan Roderick Stevenson. 2011. Tertiary-Level Telehealth: A Media Space Application. Comput. Support. Coop. Work 20, 1--2 (April 2011), 61--92.

Digital Library

[64]

David R. Topor, Christopher G. AhnAllen, Elizabeth A. Mulligan, and Chandlee C. Dickey. 2017. Using Video Recordings of Psychotherapy Sessions in Supervision: Strategies to Reduce Learner Anxiety. Acad. Psychiatry 41, 1 (February 2017), 40--43.

[65]

Terence J. G. Tracey, Bruce E. Wampold, James W. Lichtenberg, and Rodney K. Goodyear. 2014. Expertise in psychotherapy: an elusive goal? Am. Psychol. 69, 3 (April 2014), 218--229.

[66]

Thea F. Van de Mortel and Others. 2008. Faking it: social desirability response bias in self-report research. Aust. J. Adv. Nurs. 25, 4 (2008), 40.

[67]

Scott H. Waltman, Sarah A. Frankel, and Michael A. Williston. 2016. Improving clinician self-awareness and increasing accurate representation of clinical competencies. Practice Innovations 1, 3 (September 2016), 178--188.

[68]

Bruce E. Wampold, Gregory W. Mondin, Marcia Moody, Frederick Stich, Kurt Benson, and Hyun-Nie Ahn. 1997. A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially,? all must have prizes." Psychol. Bull. 122, 3 (1997), 203.

[69]

Maja Wrzesien, Jean-Marie Burkhardt, Mariano Alcañiz, and Cristina Botella. 2011. How Technology Influences the Therapeutic Process: A Comparative Field Evaluation of Augmented Reality and In Vivo Exposure Therapy for Phobia of Small Animals. In Human-Computer Interaction -- INTERACT 2011, Springer Berlin Heidelberg, 523--540.

Cited By

Chandrasekaran ACurrano RBatool VChen KMurnane ESirkin DMauriello M(2024)Therapy for Therapists: Design Opportunities to Support the Psychological Well-being of Mental Health WorkersProceedings of the ACM on Human-Computer Interaction10.1145/36869578:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686957

Recommendations

Technology in mental health
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

Mental illness has been identified as one of the greatest challenges facing society in the coming decades. However, there are significant barriers to access for many people suffering from mental illness, including overburdened public health care systems,...
Therapist perspectives on telehealth-based virtual reality exposure therapy
Abstract
Virtual reality (VR) can enhance mental health care. In particular, the effectiveness of VR-based exposure therapy (VRET) has been well-demonstrated for treatment of anxiety disorders. However, most applications of VRET remain localized to clinic ...
Therapeutic Use of Role-Playing Game (RPG) in Mental Health: A Scoping Review
Background
Role-playing game (RPG) is a term that covers a series of forms and styles of games that involve, in some way, the creation, representation and progression of characters who interact in a fictional world under a system of structured ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 6, Issue CSCW2

CSCW

November 2022

8205 pages

EISSN:2573-0142

DOI:10.1145/3571154

Editor:
Jeff Nichols
Google

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2022

Published in PACMHCI Volume 6, Issue CSCW2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NIAAA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
420
Total Downloads

Downloads (Last 12 months)223
Downloads (Last 6 weeks)16

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chandrasekaran ACurrano RBatool VChen KMurnane ESirkin DMauriello M(2024)Therapy for Therapists: Design Opportunities to Support the Psychological Well-being of Mental Health WorkersProceedings of the ACM on Human-Computer Interaction10.1145/36869578:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686957

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents