Abstract
Emotion detection and analysis aims at developing applications that can detect and analyse emotions expressed by the users in a given text. Such applications have received considerable attention from experts in computer science, psychology, communications and health care. Emotion-based sentiment analysis can be performed using supervised and unsupervised techniques. The existing studies using supervised and unsupervised emotion-based sentiment analysis are based on Ekman’s basic emotion model; have limited coverage of emotion-words, polarity shifters and negations; and lack emoticons and slang. The problems associated with existing approaches can be overcome by the development of an effective, sentence-level emotion-detection sentiment analysis system under a rule-based classification scheme with extended lexicon support and an enhanced model of emotion signals: emotion words, polarity shifters, negations, emoticons and slang. In this work, we propose a rule-based framework for emotion-based sentiment classification at the sentence level obtained from user reviews. The main contribution of this work is to integrate cognitive-based emotion theory (e.g. Ekman’s model) with sentiment analysis-based computational techniques (e.g. detection of emotion words, emoticons and slang) to detect and classify emotions from natural language text. The main focus is to improve the performance of state-of-the-art methods by including additional emotion-related signals, such as emotion words, emoticons, slang, polarity shifters and negations, to efficiently detect and classify emotions in user reviews. The improved results in terms of accuracy, precision, recall and F-measure demonstrate the superiority of the proposed method’s classification results compared with baseline methods. The framework is generalized and capable of classifying emotions in any domain.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Emoticons, available at: http://netforbeginners.about.com/cs/netiquette101/a/bl_emoticons101.htm, last accessed on Nov 20, 2016.
Emoticons, available at: http://www.sharpened.net/emoticons/, last accessed on Nov 20, 2016.
References
Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cogn Comput. 2013;5(2):234–42.
Yang L, Lin H, Lin Y, Liu S. Detection and extraction of hot topics on Chinese microblogs. Cogn Comput. 2016;8(4):577–86.
Agarwal B, Poria S, Mittal N, Gelbukh A, Hussain A. Concept-level sentiment analysis with dependency-based semantic parsing: a novel approach. Cogn Comput. 2015;7(4):487–99.
Sun R, Wilson N, Lynch M. Emotion: a unified mechanistic interpretation from a cognitive architecture. Cogn Comput. 2016;8(1):1–14.
Mohammad SM, Kiritchenko S. Using hashtags to capture fine emotion categories from tweets. Comput Intell. 2015;31(2):301–26.
Das D, Bandyopadhyay S. Sentence-level emotion and valence tagging. Cogn Comput. 2012;4(4):420–35.
Crossley SA, Kyle K, McNamara DS. Sentiment Analysis and Social Cognition Engine (SEANCE): an automatic tool for sentiment, social cognition, and social-order analysis. Behav Res Methods. 2016;49:1–19.
Cambria E, Grassi M, Hussain A, Havasi C. Sentic computing for social media marketing. Multimed Tools Appl. 2012;59(2):557–77.
Cambria E, Hussain A, Havasi C, Eckl C. Common sense computing: from the society of mind to digital intuition and beyond. In: LNCS, 5707. Berlin:Springer; 2009. p. 252–259.
Shaila SG, Vadivel A. Cognitive based sentence level emotion estimation through emotional expressions. In: Progress in systems engineering. Springer International Publishing; 2015. p. 707–713.
Cambria E. Affective computing and sentiment analysis. IEEE Intell Syst. 2016;31(2):102–7.
Quan C, Ren F. Sentence emotion analysis and recognition based on emotion words using Ren-CECps. Int J Adv Intel. 2010;2(1):105–17.
Li J, Ren F. Creating a Chinese emotion lexicon based on corpus Ren-CECps. In Cloud Computing and Intelligence Systems (CCIS), 2011 I.E. International Conference on 2011 Sep 15 IEEE; p. 80-84.
Socher R, Perelygin A, Wu JY, Chuang J, Manning CD, Ng AY, Potts C. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the conference on empirical methods in natural language processing (EMNLP) 2013 Oct 18 Vol. 1631. p. 1642.
Poria S, Chaturvedi I, Cambria E, Hussain A. Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis," 2016 IEEE 16th International Conference on Data Mining (ICDM), Barcelona pp. 439-448. doi:10.1109/ICDM.2016.0055.
Severyn A, Moschitti A. Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval 2015. ACM; p. 959-962.
Aminu M, Nirmalie W, Robert L. Contextual sentiment analysis for social media genres. Knowl-Based Syst. 2016; doi:10.1016/j.knosys.2016.05.032.
Pensa RG, Sapino ML, Schifanella C, Vignaroli L. Leveraging cross-domain social media analytics to understand TV topics popularity. IEEE Comput Intell Mag. 2016;11(3):10–21.
Chaumartin FR. UPAR7: a knowledge-based system for headline sentiment tagging, Proceedings of the 4th International Workshop on Semantic Evaluations. Association for Computational Linguistics, 2007.
WordNet Domains available at: http://wndomains.fbk.eu/index.html, last accessed on April 12, 2016.
Wordnet-Affect available at : http://wndomains.fbk.eu/index.html, last accessed on May 20, 2016.
SentiWordNet (SentiWordNet available at: http://sentwordnet.isti.cnr.it/, last accessed on August 5, 2016.
A. Agrawal, A. An. Unsupervised emotion detection from text using semantic and syntactic relations, In: Web Intelligence and Intelligent Agent Technology (WI-IAT), IEEE/WIC/ACM International Conferences on Vol. 1. 2012. 346–353.
Gievska S, Koroveshovski K, Chavdarova T A hybrid approach for emotion detection in support of affective interaction. In: 2014 I.E. International Conference on Data Mining Workshop. IEEE; 2014. p. 352-359.
Cambria E, Olsher D, Rajagopal D. SenticNet 3: a common and common-sense knowledge base for cognition-driven sentiment analysis. In: Twenty-eighth AAAI conference on artificial intelligence, 2014.
Boratto L, Carta S, Fenu G, Saia R. Using neural word embeddings to model user behavior and detect user segments. Knowl-Based Syst. 2016; doi:10.1016/j.knosys.2016.05.002.
Ekman’s basic emotions, available at: https://www.paulekman.com/wp-content/uploads/2013/07/Basic-Emotions.pdf, last accessed on September 24, 2016.
NRC emotion lexicon, available at: http://saifmohammad.com/WebDocs/NRC-Emotion-Lexicon-v0.92-InManyLanguages-web.xlsx, last accessed on November 10, 2016.
Douglas-Cowie E, Cowie R, Sneddon I, Cox C, Lowry O, Mcrorie M, Martin JC, Devillers L, Abrilian S, Batliner A, Amir N. The HUMAINE database: addressing the collection and annotation of naturalistic and induced emotional data. In: International Conference on Affective Computing and Intelligent Interaction 2007 Sep 12 Springer Berlin Heidelberg. p. 488-500).
Cambria E, Poria S, Bajpai R, Schuller B. SenticNet 4: a semantic resource for sentiment analysis based on conceptual primitives. In: COLING, 2016. 2666–2677.
Asghar MZ, Khan A, Ahmad S, Qasim M, Khan IA. Lexicon-enhanced sentiment analysis framework using rule-based classification scheme. PLoS One. 2017;12(2):e0171649. doi:10.1371/journal.pone.0171649.
Romanyshyn M. Rule-based sentiment analysis of Ukrainian reviews. Int J Artif Intell Appl. 2013;4(4):103.
Kundi F, Ahmad S, Khan A, Asghar. Detection and scoring of internet slangs for sentiment analysis using SentiWordNet. Life Sci J. 2014;11(9):66–72.
Pang, Lee L. Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. In: ACL; 2005. p. 115–124, .
Asghar MZ, et al. A unified framework for creating domain dependent polarity lexicons from user generated reviews. PLoS One. 2015;10(10):e0140204.
Asghar MZ, Ahmad S, Qasim M, Zahra R, Kundi FM. SentiHealth: creating health-related sentiment lexicon using hybrid approach. SpringerPlus. 2016;5(1):1–23. doi:10.1186/s40064-016-2809-x.
Acknowledgements
We are grateful to Prof. Dr. Shakeel Ahmad, Institute of Computing, Gomal University, for facilitating us by providing a licenced software and manuals during the execution of this project. We also are thankful to Furqan Khan for the execution and maintenance of software needed for conducting the experiments in the Opinion Mining and Sentiment Analysis Lab.
Funding
The authors received no specific funding for this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Informed Consent
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2008 (5). Additional informed consent was obtained from all patients for which identifying information is included in this article.
Human and Animal Rights
This study did not involve any experimental research on humans or animals; hence, an approval from an ethics committee was not applicable in this regard. The data collected from the online forums are publicly available data and no personally identifiable information of the forum users were collected or used for this study.
Rights and permissions
About this article
Cite this article
Asghar, M.Z., Khan, A., Bibi, A. et al. Sentence-Level Emotion Detection Framework Using Rule-Based Classification. Cogn Comput 9, 868–894 (2017). https://doi.org/10.1007/s12559-017-9503-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12559-017-9503-3