[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Sentiment recognition and analysis method of official document text based on BERT–SVM model

  • S.I.: Applications and Techniques in Cyber Intelligence (ATCI2022)
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Sentiment recognition analysis is an important method for studying social textual information. It has an important position in social text analysis and research. However, at present, the efficiency of official document text sentiment recognition is low, and manual judgment methods are often used, so the subjective consciousness is strong. This article aims to study the sentiment official document text recognition and analysis method based on the neural network BERT model. It extracts the sentiment information contained in the internet text information through the BERT–SVM model algorithm under deep learning and then mines the user's sentiment. Sentiment analysis is carried out on the sentences in the article, considering the influencing factors of individuals, society, and even the country, putting the method in the position of analyzing the different sentiments represented by a sentence or each word. This article first describes the related technologies of text sentiment recognition, such as feedforward neural networks, convolutional neural networks, and recurrent neural networks. By sentiment training using LSTM-RNN and LSTM-RNN-word2vec models, experiments show that the average accuracy of sentiment classification is 95.12%, the K nearest neighbors result is 90.87% and the Bayesian classifier is 86.84%. By comparison, the BERT–SVM model improves the accuracy of text sentiment classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Ko CH, Chen JK (2017) Grasping force based manipulation for multifingered hand-arm robot using neural networks. Numer Algebra Control Optim 4(1):59–74

    Article  MathSciNet  MATH  Google Scholar 

  2. Zhao H, Nan D (2017) Dynamic analysis of stochastic Cohen–Grossberg neural networks with time delays. Appl Math Comput 183(1):464–470

    MathSciNet  MATH  Google Scholar 

  3. Perna C, Rocca ML (2017) Designing neural networks for modeling biological data: a statistical perspective. Math Biosci Eng MBE 11(2):331–342

    MathSciNet  MATH  Google Scholar 

  4. Ganin Y, Ustinova E, Ajakan H et al (2017) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):2096–2030

    MathSciNet  MATH  Google Scholar 

  5. Goh ATC (2017) Seismic liquefaction potential assessed by neural networks. Environ Earth Sci 76(9):1467–1480

    Google Scholar 

  6. He H, Gang F, Jinde C (2019) Robust state estimation for uncertain neural networks with time-varying delay. J Jishou Univ (Nat Sci Edn) 19(8):1329–1339

    Google Scholar 

  7. Gong M, Zhao J, Liu J et al (2017) Change detection in synthetic aperture radar images based on deep neural networks. IEEE Trans Neural Netw Learn Syst 27(1):125–138

    Article  MathSciNet  Google Scholar 

  8. Alanis AY (2018) Electricity prices forecasting using artificial neural networks. IEEE Latin America Trans 16(1):105

    Article  MathSciNet  Google Scholar 

  9. Stappen L, Baird A, Cambria E et al (2021) Sentiment analysis and topic recognition in video transcriptions. IEEE Intell Syst 36(2):88–95

    Article  Google Scholar 

  10. Qin L, Che W, Li Y et al (2020) Dcr-net: a deep co-interactive relation network for joint dialog act recognition and sentiment classification In: Proceedings of the AAAI conference on artificial intelligence, 2020, vol 34, no. 05, pp 8665–8672

  11. Wei D, Tang N, Wen S (2020) The deep learning word vector model using part of speech and sentiment information. J Intell Fuzzy Syst 38(1):427–440

    Article  Google Scholar 

  12. Gross TW (2020) Sentiment analysis and emotion recognition: Evolving the paradigm of communication within data classification. Appl Mark Anal 6(1):22–36

    Google Scholar 

  13. Kumar A, Garg G (2019) Sentiment analysis of multimodal twitter data. Multimedia Tools Appl 78(17):24103–24119

    Article  Google Scholar 

  14. She D, Sun M, Yang J (2019) Learning discriminative sentiment representation from strongly-and weakly supervised CNNS. ACM Trans Multimedia Comput Commun Appl 15(3):1s–19

    Google Scholar 

  15. Nandwani P, Verma R (2021) A review on sentiment analysis and emotion detection from text. Soc Netw Anal Min 11(1):1–19

    Article  Google Scholar 

  16. Masino S (2014) A thesis submitted to the University of Manchester for the degree of PhD in Economics in the Faculty of Humanities

  17. Acheampong FA, Wenyu C, Nunoo-Ensah H (2020) Text—based emotion detection: advances, challenges, and opportunities. Eng Rep 2(7):e12189. https://doi.org/10.1002/eng2.12189

    Article  Google Scholar 

  18. Mohammad SM (2022) Ethics sheet for automatic emotion recognition and sentiment analysis. Comput Linguist 48(2):239–278

    Article  Google Scholar 

  19. Doma V, Pirouz M (2020) A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals. J Big Data 7(1):18

    Article  Google Scholar 

  20. Zhao S, Jia G, Yang J et al (2021) Emotion recognition from multiple modalities: fundamentals and methodologies. IEEE Signal Process Mag 38(6):59–73

    Article  Google Scholar 

  21. Poorna SS, Nair SD, Narayan A et al (2020) Bimodal emotion recognition using audio and facial features. J Comput Theor Nanosci 17(1):189–194

    Article  Google Scholar 

  22. Slavova V (2020) Emotional valence coded in the phonemic content—statistical evidence based on corpus analysis. Cybern Inf Technol 20(2):3–21

    Google Scholar 

  23. Razzaghnoori M, Sajedi H, Jazani IK (2017) Question classification in Persian using word vectors and frequencies. Cogn Syst Res 47:16–27

    Article  Google Scholar 

Download references

Funding

This study did not receive any funding in any form.

Author information

Authors and Affiliations

  1. East China Jiaotong University, Nanchang, 330013, Jiangxi, China

    Shule Hao

  2. Zhejiang University, Hangzhou, 310015, Zhejiang, China

    Peng Zhang

  3. Chongqing University, Chongqing, 400044, China

    Sen Liu

  4. Lanzhou College of Information Science and Technology, Lanzhou, 730099, Gansu, China

    Yuhang Wang

Authors
  1. Shule Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sen Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuhang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shule Hao.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest with any financial organizations regarding the material reported in this manuscript.

Ethical approval

This study does not violate and does not involve a moral and ethical statements.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, S., Zhang, P., Liu, S. et al. Sentiment recognition and analysis method of official document text based on BERT–SVM model. Neural Comput & Applic 35, 24621–24632 (2023). https://doi.org/10.1007/s00521-023-08226-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08226-4

Keywords

Search

Navigation