[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

An analysis of cognitive change in online mental health communities: : A textual data analysis based on post replies of support seekers

Published: 01 March 2023 Publication History

Highlights

We propose a novel model for cognitive change recognition from reply posts.
We propose a Chinese dataset for cognitive change recognition.
We consider both text information and graphic emotional information.
The proposed method outperforms the baselines and the dictionary-based method.

Abstract

The replies of people seeking support in online mental health communities can be analyzed to discover if they feel better after receiving support; feeling better indicates a cognitive change. Most research uses key phrase matching and word frequency statistics to identify psychological cognitive change, methods that result in omissions and inaccuracy. This study constructs an intelligent method for identifying psychological cognitive change based on natural language processing technology. It incorporates information related to emotions that appears in reply text to help identify whether psychological cognitive change has occurred. The model first encodes the emotion information based on rule matching and manual annotation, then adds the encoded emotion lexicon and a cognitive change lexicon to a word2vec high-dimensional semantic word vector training, converts the annotated cognitive change recognition text into a vector matrix using the trained model, and train in the annotated text using TextCNN. To compare the results with those of the traditional methods (key phrase matching and sentiment word frequency statistics), this study uses a semi-automated approach to construct a lexicon of psychological cognitive change, as well as a keyword lexicon without cognitive change, based on word vectors and similarity. We compare the performance of the classifier before and after the fusion of the graphical emotion information, compare the LSTM and Transformer as baselines, and compare traditional word frequency statistics methods. The experimental results show that our proposed classification model performs better than the others; it achieves 84.38% precision, an 84.09% recall rate, and an 84.17% F1 value. Our work bears methodological implications for online mental health platforms.

References

[1]
A. Aldkheel, L. Zhou, K. Wang, Characterization of domestic violence through self-disclosure in social media: A case study of the time of COVID-19, in: 2021 IEEE International Conference on Intelligence and Security Informatics (ISI), 2021, pp. 1–3.
[2]
T. Althoff, K. Clark, J. Leskovec, Large-scale analysis of counseling conversations: An application of natural language processing to mental health, Transactions of the Association for Computational Linguistics 4 (2016) 463–476.
[3]
S. Bedrick, R. Beckley, B. Roark, R. Sproat, Robust kaomoji detection in Twitter, in: Proceedings of the Second Workshop on Language in Social Media, 2012, pp. 56–64.
[4]
J. Bronstein, An examination of social and informational support behavior codes on the Internet: the case of online health communities, Library & Information Science Research 39 (1) (2017) 63–68.
[5]
S. Cappallo, S. Svetlichnaya, P. Garrigues, T. Mensink, C.G. Snoek, New modality: Emoji challenges in prediction, anticipation, and retrieval, IEEE Transactions on Multimedia 21 (2) (2018) 402–415.
[6]
L. Chen, A. Baird, D. Straub, A linguistic signaling model of social support exchange in online health communities, Decision Support Systems 130 (2020).
[7]
Y. Chen, Y. Xu, Exploring the effect of social support and empathy on user engagement in online mental health communities, International Journal of Environmental Research and Public Health 18 (13) (2021) 6855.
[8]
Y. Chen, S. Deng, D.H. Kwak, A. Elnoshokaty, J. Wu, A multi-appeal model of persuasion for online petition success: A linguistic cue-based approach, Journal of the Association for Information Systems 20 (2) (2019) 3.
[9]
Z. Chen, Y. Cao, H. Yao, X. Lu, X. Peng, H. Mei, X. Liu, Emoji-powered sentiment and emotion detection from software developers’ communication data, ACM Transactions on Software Engineering and Methodology (TOSEM) 30 (2) (2021) 1–48.
[10]
G. Coppersmith, M. Dredze, C. Harman, K. Hollingshead, M. Mitchell, CLPsych 2015 shared task: Depression and PTSD on Twitter, in: Proceedings of the 2nd workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality (CLPsych@NAACL-HLT), 2015, pp. 31–39.
[11]
J. Davies, M. McKenna, K. Denner, J. Bayley, M. Morgan, The emoji current mood and experience scale: the development and initial validation of an ultra-brief, literacy independent measure of psychological health, Journal of Mental Health (2022) 1–9.
[12]
F. de Waal, S.D. Preston, Mammalian empathy: Behavioural manifestations and neural basis, Nature Reviews Neuroscience 18 (8) (2017) 498–509.
[13]
D. Demszky, D. Movshovitz-Attias, J. Ko, A. Cowen, G. Nemade, S. Ravi, GoEmotions: A dataset of fine-grained emotions, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, pp. 4040–4054.
[14]
J. Devlin, M.W. Chang, K. Lee, K. Toutanova, BERT: Pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 2019, pp. 4171–4186. VolumeLong and Short Papers.
[15]
Y. Feng, Z. Lu, W. Zhou, Z. Wang, Q. Cao, New emoji requests from Twitter users: When, where, why, and what we can do about them, ACM Transactions on Social Computing 3 (2) (2020) 1–25.
[16]
S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural computation 9 (8) (1997) 1735–1780.
[17]
A. Khatua, A. Khatua, E. Cambria, A tale of two epidemics: Contextual Word2Vec for classifying twitter streams during outbreaks, Information Processing & Management 56 (1) (2019) 247–257.
[18]
... & J. Kim, T. Gong, B. Kim, J. Park, W. Kim, E. Huang, S.J. Lee, No more one liners: Bringing context into emoji recommendations, ACM Transactions on Social Computing 3 (2) (2020) 1–25.
[19]
D.P. Kingma, J. Ba, Adam: A method for stochastic optimization, in: International Conference on Learning Representations (ICLR), 2015, 2015.
[20]
A. Kumar, K. Srinivasan, W.H. Cheng, A.Y. Zomaya, Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data, Information Processing & Management 57 (1) (2020).
[21]
T. Kushner, A Sharma, Bursts of activity: Temporal patterns of help-seeking and support in online mental health communities, Proceedings of the Web Conference 2020 (2020) 2906–2912.
[22]
J. Li, J. Tang, X. Liu, L. Ma, How do users adopt health information from social media? The narrative paradigm perspective, Health Information Management Journal 48 (3) (2019) 116–126.
[23]
Z. Liu, B.J. Jansen, Questioner or question: Predicting the response rate in social question and answering on Sina Weibo, Information Processing & Management 54 (2) (2018) 159–174.
[24]
Y. Lou, Y. Zhang, F. Li, T. Qian, D. Ji, Emoji-based sentiment analysis using attention networks, ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 19 (5) (2020) 1–13.
[25]
S. Ludwig, K. De Ruyter, D. Mahr, M. Wetzels, E. Brüggen, T. De Ruyck, Take their word for it: The symbolic role of linguistic style matches in user communities, MIS Quarterly: Management Information Systems 38 (4) (2014) 1201–1218.
[26]
T. Mikolov, I. Sutskever, K. Chen, G.S. Corrado, J. Dean, Distributed representations of words and phrases and their compositionality, Advances in Neural Information Processing Systems 26 (2013).
[27]
A. Park, M. Conway, Harnessing Reddit to understand the written-communication challenges experienced by individuals with mental health disorders: Analysis of texts from mental health communities, Journal of Medical Internet Research 20 (4) (2018) e8219.
[28]
A. Park, M. Conway, A.T. Chen, Examining thematic similarity, difference, and membership in three online mental health communities from Reddit: A text mining and visualization approach, Computers in Human Behavior 78 (2018) 98–112.
[29]
I. Park, S. Sarnikar, J. Cho, Disentangling the effects of efficacy-facilitating informational support on health resilience in online health communities based on phrase-level text analysis, Information & Management 57 (8) (2020).
[30]
S.R. Pendse, K. Niederhoffer, A. Sharma, Cross-cultural differences in the use of online mental health support forums, Proceedings of the ACM on Human-Computer Interaction 3 (CSCW) (2019) 1–29.
[31]
C.H. Peng, D. Yin, H. Zhang, More than words in medical question-and-answer sites: A content-context congruence perspective, Information Systems Research 31 (3) (2020) 913–928.
[32]
Z. Peng, X. Ma, D. Yang, K.W. Tsang, Q. Guo, Effects of support-seekers’ community knowledge on their expressed satisfaction with the received comments in mental health communities, in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–12.
[33]
M. Peters, M. Neumann, M. Iyyer, M. Gardner, L. Zettlemoyer, Deep contextualized word representations, in: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 2018, pp. 2227–2237. Long Papers.
[34]
G. Pounds, D. Hunt, N. Koteyko, Expression of empathy in a Facebook-based diabetes support group, Discourse, Context & Media 25 (2018) 34–43.
[35]
J. Prescott, T. Hanley, K. Ujhelyi, Peer communication in online mental health communities for young people: Directional and nondirectional support, JMIR Mental Health 4 (3) (2017) e6921.
[36]
Y. Pruksachatkun, S.R. Pendse, A. Sharma, Moments of change: Analyzing peer-based cognitive support in online mental health communities, in: Proceedings of the 2019 CHI conference on human factors in computing systems, 2019, pp. 1–13.
[37]
D. Rickwood, A. Wallace, V. Kennedy, S. O'Sullivan, N. Telford, S. Leicester, Young people's satisfaction with the online mental health service eheadspace: Development and implementation of a service satisfaction measure, JMIR Mental Health 6 (4) (2019) e12169.
[38]
K. Saha, J. Torous, E.D. Caine, et al., Psychosocial effects of the COVID-19 pandemic: Large-scale quasi-experimental study on social media, Journal of Medical Internet Research 22 (11) (2020) e22600.
[39]
K. Saha, A. Sharma, Causal factors of effective psychosocial outcomes in online mental health communities, Proceedings of the International AAAI Conference on Web and Social Media 14 (2020) 590–601.
[40]
A. Sharma, A.S. Miner, D.C. Atkins, et al., A computational approach to understanding empathy expressed in text-based mental health support, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 5263–5276.
[41]
D. Shin, S. He, G.M. Lee, A.B. Whinston, S. Cetintas, K.C. Lee, Enhancing social media analysis with visual data analytics: A deep learning approach, MIS Quarterly 44 (4) (2020) 1459–1492.
[42]
H. Sun, Z. Lin, C. Zheng, S. Liu, M. Huang, PsyQA: A Chinese dataset for generating long counseling text for mental health support, in: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, 2021, pp. 1489–1503.
[43]
Y. Tan, Z. Teng, Y. Qiu, H. Tang, H. Xiang, J. Chen, Potential of mobile technology to relieve the urgent mental health needs in China: Web-based survey, JMIR mHealth and uHealth 8 (7) (2020) e16215.
[44]
... & A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, I. Polosukhin, Attention is all you need, Advances in Neural Information Processing Systems 30 (2017).
[45]
J. Wolohan, M. Hiraga, A. Mukherjee, Z.A. Sayyed, M. Millard, Detecting linguistic traces of depression in topic-restricted text: Attending to self-stigmatized depression with NLP, in: Proceedings of the first international workshop on language cognition and computational models, 2018, pp. 11–21.
[46]
World Health Organization, World Health Statistics 2022 Report, 2022, https://www.who.int/data/gho/publications/world-health-statistics accessed 5 June 2022.
[47]
N. Xi, J. Hamari, Does gamification satisfy needs? A study on the relationship between gamification features and intrinsic need satisfaction, International Journal of Information Management 46 (2019) 210–221.
[48]
J. Xie, X. Liu, D. Dajun Zeng, X. Fang, Understanding medication nonadherence from social media: A sentiment-enriched deep learning approach, MIS Quarterly 46 (1) (2022) 341–372.
[49]
Z. Xie, R. Bi, Construction and inference technique of large-scale Chinese concreteness lexicon, Acta Scientiarum Naturalium Universitatis Pekinensis 58 (1) (2022) 1–6.
[50]
X. Yang, D. Gu, J. Wu, et al., Factors influencing health anxiety: The stimulus–organism–response model perspective, Internet Research 31 (6) (2021) 2033–2054.
[51]
... & T. Yang, F. Li, D. Ji, X. Liang, T. Xie, S. Tian, P. Liang, Fine-grained depression analysis based on Chinese micro-blog reviews, Information Processing & Management 58 (6) (2021).
[52]
T. Yokoi, M. Kobayashi, R. Ibrahim, Emoticon extraction method based on eye characters and symmetric string, in: 2015 IEEE International Conference on Systems, Man, and Cybernetics, 2015, pp. 2979–2984.
[53]
Y. Zhang, B. Wallace, A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification, in: Proceedings of the Eighth International Joint Conference on Natural Language Processing, 1, 2017, pp. 253–263. Long Papers.
[54]
M. Zhang, B. Fan, N. Zhang, W. Wang, W. Fan, Mining product innovation ideas from online reviews, Information Processing & Management 58 (1) (2021).
[55]
G. Zhao, Z. Liu, Y. Chao, X. Qian, CAPER: Context-aware personalized emoji recommendation, IEEE Transactions on Knowledge and Data Engineering 33 (9) (2020) 3160–3172.
[56]
Y. Zhao, L. Wu, J. Zhang, T. Le, How question characteristics impact answer outcomes on social question-and-answer websites, Journal of Global Information Management (JGIM) 29 (6) (2021) 1–21.
[57]
L. Zhou, D. Zhang, C.C. Yang, Y. Wang, Harnessing social media for health information management, Electronic Commerce Research and Applications 27 (2018) 139–151.
[58]
L. Zhou, Z. Zhang, L. Zhao, P. Yang, Attention-based BiLSTM models for personality recognition from user-generated content, Information Sciences 596 (2022) 460–471.
[59]
O. Zolotarev, Y. Solomentsev, A. Khakimova, M. Charnine, Identification of semantic patterns in full-text documents using neural network methods, in: Proceedings of the 29th International Conference on Computer Graphics and Vision, Graphicon-2019, 2019.

Cited By

View all
  • (2024)Cooperated delivery of drones and truck for “last 100 metres” in rural areasJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23304546:1(2595-2614)Online publication date: 1-Jan-2024
  • (2024)MedT2TFuture Generation Computer Systems10.1016/j.future.2024.07.030161:C(586-600)Online publication date: 1-Dec-2024
  • (2024)A deep learning and clustering‐based topic consistency modeling framework for matching health information supply and demandJournal of the Association for Information Science and Technology10.1002/asi.2484675:2(152-166)Online publication date: 4-Jan-2024
  • Show More Cited By

Index Terms

  1. An analysis of cognitive change in online mental health communities: A textual data analysis based on post replies of support seekers
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Information Processing and Management: an International Journal
          Information Processing and Management: an International Journal  Volume 60, Issue 2
          Mar 2023
          1443 pages

          Publisher

          Pergamon Press, Inc.

          United States

          Publication History

          Published: 01 March 2023

          Author Tags

          1. Online mental health community
          2. Cognitive change
          3. Emotion lexicon
          4. Natural language processing
          5. Text analysis

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 05 Jan 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Cooperated delivery of drones and truck for “last 100 metres” in rural areasJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23304546:1(2595-2614)Online publication date: 1-Jan-2024
          • (2024)MedT2TFuture Generation Computer Systems10.1016/j.future.2024.07.030161:C(586-600)Online publication date: 1-Dec-2024
          • (2024)A deep learning and clustering‐based topic consistency modeling framework for matching health information supply and demandJournal of the Association for Information Science and Technology10.1002/asi.2484675:2(152-166)Online publication date: 4-Jan-2024
          • (2023)Capturing mental modelsAdvanced Engineering Informatics10.1016/j.aei.2023.10208357:COnline publication date: 1-Aug-2023

          View Options

          View options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media