[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

A Lexicon Enhanced Collaborative Network for targeted financial sentiment analysis

Published: 01 March 2023 Publication History

Highlights

A novel methodology is proposed for fine-grained targeted financial sentiment analysis.
LECN is a unified and collaborative framework to capture connections between the target extraction (TE) and sentiment analysis (SA).
A dynamic weighting strategy based on sentiment lexicons enables the model to well determine sentiment polarities.
A message selective-passing mechanism enhances collaborative effects between TE and SA tasks.
Experimental results on four financial datasets demonstrate the proposed model outperforms competitive baselines.

Abstract

The increasing interest around emotions in online texts creates the demand for financial sentiment analysis. Previous studies mainly focus on coarse-grained document-/sentence-level sentiment analysis, which ignores different sentiment polarities of various targets (e.g., company entities) in a sentence. To fill the gap, from a fine-grained target-level perspective, we propose a novel Lexicon Enhanced Collaborative Network (LECN) for targeted sentiment analysis (TSA) in financial texts. In general, the model designs a unified and collaborative framework that can capture the associations of targets and sentiment cues to enhance the overall performance of TSA. Moreover, the model dynamically incorporates sentiment lexicons to guide the sentiment classification, which cultivates the model faculty of understanding financial expressions. In addition, the model introduces a message selective-passing mechanism to adaptively control the information flow between two tasks, thereby improving the collaborative effects. To verify the effectiveness of LECN, we conduct experiments on four financial datasets, including SemEVAL2017 Task5 subset1, SemEVAL2017 Task5 subset2, FiQA 2018 Task1, and Financial PhraseBank. Results show that LECN achieves improvements over the state-of-art baseline by 1.66 p.p., 1.47 p.p., 1.94 p.p., and 1.88 p.p. in terms of F1-score. A series of further analyses also indicate that LECN has a better capacity for comprehending domain-specific expressions and can achieve the mutually beneficial effect between tasks.

References

[1]
M.S. Akhtar, A. Kumar, D. Ghosal, A. Ekbal, P. Bhattacharyya, A multilayer perceptron based ensemble technique for fine-grained financial sentiment analysis, in: Proceedings of the 2017 conference on empirical methods in natural language processing, 2017, pp. 540–546.
[2]
W. Antweiler, M.Z. Frank, Is all that talk just noise? The information content of internet stock message boards, The Journal of Finance 59 (3) (2004) 1259–1294.
[3]
S. Baccianella, A. Esuli, F. Sebastiani, Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining, in: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, 2010, pp. 168–177.
[4]
L. Bao, P. Lambert, T. Badia, Attention and lexicon regularized LSTM for aspect-based sentiment analysis, in: Proceedings of the 57th annual meeting of the association for computational linguistics: Student research workshop, 2019, pp. 253–259.
[5]
R.K. Behera, M. Jena, S.K. Rath, S. Misra, Co-LSTM: Convolutional LSTM model for sentiment analysis in social big data, Information Processing & Management 58 (1) (2021).
[6]
F. Chen, Y. Huang, Knowledge-enhanced neural networks for sentiment analysis of Chinese reviews, Neurocomputing 368 (2019) 51–58.
[7]
G. Chen, Y. Tian, Y. Song, Joint aspect extraction and sentiment analysis with directional graph convolutional networks, in: Proceedings of the 28th International conference on computational linguistics, 2020, pp. 272–279.
[8]
H. Chen, Z. Zhai, F. Feng, R. Li, X. Wang, Enhanced multi-channel graph convolutional network for aspect sentiment triplet extraction, in: Proceedings of the 60th annual meeting of the association for computational linguistics, 1, 2022, pp. 2974–2985. Long Papers.
[9]
S. Consoli, L. Barbaglia, S. Manzan, Fine-grained, aspect-based sentiment analysis on economic and financial lexicon, Knowledge-Based Systems 247 (2022).
[10]
K. Cortis, A. Freitas, T. Daudert, M. Huerlimann, M. Zarrouk, S. Handschuh, B. Davis, Semeval-2017 task 5: Fine-grained sentiment analysis on financial microblogs and news, Association for Computational Linguistics (ACL) (2017).
[11]
T. Daudert, Exploiting textual and relationship information for fine-grained financial sentiment analysis, Knowledge-Based Systems 230 (2021).
[12]
S. Feuerriegel, H. Prendinger, News-based trading strategies, Decision Support Systems 90 (2016) 65–74.
[13]
R. He, W.S. Lee, H.T. Ng, D. Dahlmeier, An interactive multi-task learning network for end-to-end aspect-based sentiment analysis, in: Proceedings of the 57th annual meeting of the association for computational linguistics, 2019, pp. 504–515.
[14]
M. Hu, B. Liu, Mining and summarizing customer reviews, in: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, 2004, pp. 168–177.
[15]
M. Hu, Y. Peng, Z. Huang, D. Li, Y. Lv, Open-domain targeted sentiment analysis via span-based extraction and classification, in: Proceedings of the 57th annual meeting of the association for computational linguistics, 2019, pp. 537–546.
[16]
L. Jiang, M. Yu, M. Zhou, X. Liu, T. Zhao, Target-dependent Twitter sentiment classification, in: Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies, 2011, pp. 151–160.
[17]
M. Karamibekr, A.A. Ghorbani, Verb oriented sentiment classification, in: 2012 IEEE/WIC/ACM international conferences on web intelligence and intelligent agent technology, 1, 2012, pp. 327–331.
[18]
C. Kearney, S. Liu, Textual sentiment in finance: A survey of methods and models, International Review of Financial Analysis 33 (2014) 171–185.
[19]
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
[20]
G. Lample, M. Ballesteros, S. Subramanian, K. Kawakami, C. Dyer, Neural architectures for named entity recognition, in: Proceedings of annual conference of the North American chapter of the association for computational linguistics: Human language technologies, 2016, pp. 260–270.
[21]
X. Li, L. Bing, W. Lam, B. Shi, Transformation networks for target-oriented sentiment classification, in: Proceedings of the 56th annual meeting of the association for computational linguistics, 2018, pp. 946–956.
[22]
X. Li, L. Bing, P. Li, W. Lam, A unified model for opinion target extraction and target sentiment prediction, in: Proceedings of the AAAI Conference on Artificial Intelligence, 33, 2019, pp. 6714–6721.
[23]
X. Li, L. Bing, P. Li, W. Lam, Z. Yang, Aspect term extraction with history attention and selective transformation, in: Proceedings of the 27th international joint conference on artificial intelligence, 2018, pp. 4194–4200.
[24]
X. Li, P. Wu, W. Wang, Incorporating stock prices and news sentiments for stock market prediction: A case of Hong Kong, Information Processing & Management 57 (5) (2020).
[25]
B. Liang, R. Yin, L. Gui, J. Du, R. Xu, Jointly learning aspect-focused and inter-aspect relations with graph convolutional networks for aspect sentiment analysis, in: Proceedings of the 28th international conference on computational linguistics, 2020, pp. 150–161.
[26]
Z. Liu, D. Huang, K. Huang, Z. Li, J. Zhao, FinBERT: A pre-trained financial language representation model for financial text mining, in: Proceedings of the twenty-ninth international conference on international joint conferences on artificial intelligence, 2021, pp. 4513–4519.
[27]
Z. Liu, Y. Zhang, Attention modeling for targeted sentiment, in: Proceedings of the 15th conference of the European chapter of the association for computational linguistics, 2, 2017, pp. 572–577. Short Papers.
[28]
T. Loughran, B. McDonald, When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks, The Journal of Finance 66 (1) (2011) 35–65.
[29]
M. Maia, S. Handschuh, A. Freitas, B. Davis, R. McDermott, M. Zarrouk, A. Balahur, WWW'18 open challenge: Financial opinion mining and question answering, in: Companion proceedings of the web conference 2018, 2018, pp. 1941–1942.
[30]
P. Malo, A. Sinha, P. Korhonen, J. Wallenius, P. Takala, Good debt or bad debt: Detecting semantic orientations in economic texts, Journal of the Association for Information Science and Technology 65 (4) (2014) 782–796.
[31]
X. Man, T. Luo, J. Lin, Financial sentiment analysis (FSA): A survey, in: 2019 IEEE international conference on Industrial Cyber Physical Systems (ICPS), 2019, pp. 617–622.
[32]
D. Meškelė, F. Frasincar, ALDONAr: A hybrid solution for sentence-level aspect-based sentiment analysis using a lexicalized domain ontology and a regularized neural attention model, Information Processing & Management 57 (3) (2020).
[33]
Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., . . . Cohn, T. (2017). Dynet: The dynamic neural network toolkit. arXiv preprint arXiv:1701.03980.
[34]
H. Nguyen, K. Shirai, A joint model of term extraction and polarity classification for aspect-based sentiment analysis, in: 2018 10th International conference on Knowledge and Systems Engineering (KSE), 2018, pp. 323–328.
[35]
H. Peng, Y. Ma, Y. Li, E. Cambria, Learning multi-grained aspect target sequence for Chinese sentiment analysis, Knowledge-Based Systems 148 (2018) 167–176.
[36]
M. Pontiki, D. Galanis, H. Papageorgiou, I. Androutsopoulos, S. Manandhar, M. Al-Smadi, …., O. De Clercq, Semeval-2016 task 5: Aspect based sentiment analysis, in: International workshop on semantic evaluation, 2016, pp. 19–30.
[37]
M. Schuster, K.K. Paliwal, Bidirectional recurrent neural networks, IEEE Transactions on Signal Processing 45 (11) (1997) 2673–2681.
[38]
A. Sinha, S. Kedas, R. Kumar, P. Malo, SEntFiN 1.0: Entity-aware sentiment analysis for financial news, Journal of the Association for Information Science and Technology 73 (9) (2022) 1314–1335.
[39]
J. Singh, G. Singh, R. Singh, Optimization of sentiment analysis using machine learning classifiers, Human-centric Computing and information Sciences 7 (1) (2017) 1–12.
[40]
S. Sohangir, N. Petty, D. Wang, Financial sentiment lexicon analysis, in: 2018 IEEE 12th International Conference on Semantic Computing (ICSC), 2018, pp. 286–289.
[41]
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting, The Journal of Machine Learning Research 15 (1) (2014) 1929–1958.
[42]
P. Takala, P. Malo, A. Sinha, O. Ahlgren, Gold-standard for topic-specific sentiment analysis of economic texts, in: Proceedings of the Ninth International Conference on Language Resources and Evaluation, 2014, pp. 2152–2157.
[43]
D. Tang, B. Qin, X. Feng, T. Liu, Effective LSTMs for target-dependent sentiment classification, in: Proceedings of the 26th International Conference on Computational Linguistics, 2016, pp. 3298–3307.
[44]
D. Tang, B. Qin, T. Liu, Aspect level sentiment classification with deep memory network, in: Proceedings of the 2016 conference on empirical methods in natural language processing, 2016, pp. 214–224.
[45]
Y. Tay, L.A. Tuan, S.C. Hui, Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis, in: Proceedings of the AAAI conference on artificial intelligence, 32, 2018.
[46]
P.C. Tetlock, Giving content to investor sentiment: The role of media in the stock market, The Journal of Finance 62 (3) (2007) 1139–1168.
[47]
A.J. Viera, J.M. Garrett, Understanding interobserver agreement: The kappa statistic, Family Medicine 37 (5) (2005) 360–363.
[48]
Wang, G., Wang, T., Wang, B., Sambasivan, D., Zhang, Z., Zheng, H., & Zhao, B. Y. (2014). Crowds on wall street: Extracting value from social investing platforms. arXiv preprint arXiv:1406.1137.
[49]
W. Wang, S.J. Pan, D. Dahlmeier, X. Xiao, Coupled multi-layer attentions for co-extraction of aspect and opinion terms, in: Proceedings of the AAAI conference on artificial intelligence, 31, 2017.
[50]
T. Wilson, J. Wiebe, P. Hoffmann, Recognizing contextual polarity in phrase-level sentiment analysis, in: Proceedings of human language technology conference and conference on empirical methods in natural language processing, 2005, pp. 347–354.
[51]
Z. Wu, D.C. Ong, Context-guided bert for targeted aspect-based sentiment analysis, in: Proceedings of the AAAI conference on artificial intelligence, 35, 2021, pp. 14094–14102.
[52]
C. Xiang, J. Zhang, F. Li, H. Fei, D. Ji, A semantic and syntactic enhanced neural model for financial sentiment analysis, Information Processing & Management 59 (4) (2022).
[53]
Y. Yuan, X. Zhou, S. Pan, Q. Zhu, Z. Song, L. Guo, A relation-specific attention network for joint entity and relation extraction, International Joint Conference on Artificial Intelligence 2020 (2020) 4054–4060.

Cited By

View all
  • (2024)The Data Analysis of Enterprise Operational Risk Prediction Under Machine LearningJournal of Organizational and End User Computing10.4018/JOEUC.35570936:1(1-24)Online publication date: 24-Sep-2024
  • (2024)GP‐FMLNetCAAI Transactions on Intelligence Technology10.1049/cit2.123009:4(960-972)Online publication date: 19-Mar-2024
  • (2024)Transforming sentiment analysis for e-commerce product reviewsInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10365461:3Online publication date: 2-Jul-2024
  • Show More Cited By

Index Terms

  1. A Lexicon Enhanced Collaborative Network for targeted financial sentiment analysis
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Information Processing and Management: an International Journal
          Information Processing and Management: an International Journal  Volume 60, Issue 2
          Mar 2023
          1443 pages

          Publisher

          Pergamon Press, Inc.

          United States

          Publication History

          Published: 01 March 2023

          Author Tags

          1. Targeted financial sentiment analysis
          2. Attention mechanism
          3. Lexicon-based method
          4. Deep learning
          5. Natural language processing

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 25 Dec 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)The Data Analysis of Enterprise Operational Risk Prediction Under Machine LearningJournal of Organizational and End User Computing10.4018/JOEUC.35570936:1(1-24)Online publication date: 24-Sep-2024
          • (2024)GP‐FMLNetCAAI Transactions on Intelligence Technology10.1049/cit2.123009:4(960-972)Online publication date: 19-Mar-2024
          • (2024)Transforming sentiment analysis for e-commerce product reviewsInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10365461:3Online publication date: 2-Jul-2024
          • (2024)FollowAKOInvestorExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123522249:PBOnline publication date: 1-Sep-2024
          • (2023)Sentence Level Sentimental Analysis with Neural Network Using RSS News Feed on Stock Market InformationsSN Computer Science10.1007/s42979-023-01929-44:5Online publication date: 22-Jun-2023

          View Options

          View options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media