Abstract
Community Question and Answer (CQA) platforms are expected to provide relevant content that is not readily available through search engines. With an increase in the number of users and growth of internet, CQA platforms have transitioned from generic to domain specific systems. Expert rating, machine learning and statistical methods are being used for assessing the quality of answers. However, the research on importance of consistency as a quality parameter in the form of text cohesion in CQAs is limited. We extracted 109,113 CQAs from StackExchange related to Information Security of the last 8 years to evaluate text cohesion in answers. An empirical study conducted with 246 participants (Information Security Experts, Software Engineers and Computational Linguists) on the extracted answers stated that lack of text cohesion impacts the rating of answers in CQA. Software Engineers are seekers and viewers of answers, they responded to a survey that lack of text cohesion leads to difficulty in reading and remembering. Information Security Experts providing answers to CQA stated that they need text cohesion for understandability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H.R., Bertino, E., Dustdar, S.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76–81 (2013)
Ariel, M.: Accessibility theory: an overview. Text Represent.: Linguist. Psycholinguist. Aspects 8, 29–87 (2001)
Boehm, B.W., Brown, J.R., Lipow, M.: Quantitative evaluation of software quality. In: Proceedings of the 2nd International Conference on Software Engineering, pp. 592–605. IEEE Computer Society Press (1976)
Britton, B.K., Gülgöz, S.: Using Kintsch’s computational model to improve instructional text: effects of repairing inference calls on recall and cognitive structures. J. Educ. Psychol. 83(3), 329 (1991)
Burghardt, K., Alsina, E.F., Girvan, M., Rand, W., Lerman, K.: The myopia of crowds: cognitive load and collective evaluation of answers on stack exchange. PLoS ONE 12(3), e0173610 (2017)
Charolles, M., Ehrlich, M.F.: Aspects of textual continuity linguistic approaches. In: Advances in Psychology, vol. 79, pp. 251–267. Elsevier (1991)
Crossley, S.A., McNamara, D.S.: Say more and be more coherent: how text elaboration and cohesion can increase writing quality. Institute of Educational Sciences (2016)
Crossley, S.A., Kyle, K., McNamara, D.S.: The tool for the automatic analysis of text cohesion (TAACO): automatic assessment of local, global, and text cohesion. Behav. Res. Methods 48(4), 1227–1237 (2016)
Dahiya, Y., Talukdar, P.: Discovering response-eliciting factors in social question answering: a reddit inspired study. Director 24196(3295), 13–61 (2016)
McNamara, D.S., Ozuru, Y., Floyd, R.G.: Comprehension challenges in the fourth grade: the roles of text cohesion, text genre, and readers’ prior knowledge. Int. Electron. J. Element. Educ. 4, 229–257 (2011)
Graesser, A.C., McNamara, D.S., Louwerse, M.M., Cai, Z.: Coh-Metrix: analysis of text on cohesion and language. Behav. Res. Methods Instrum. Comput. 36(2), 193–202 (2004)
Halliday, M.A.K.: Explorations in the functions of language. Can. J. Linguist./Revue canadienne de linguistique 21(2), 196–199 (1976)
Kintsch, W., Van Dijk, T.A.: Toward a model of text comprehension and production. Psychol. Rev. 85(5), 363 (1978)
Li, B., Jin, T., Lyu, M.R., King, I., Mak, B.: Analyzing and predicting question quality in community question answering services. In: 21st International Conference on World Wide Web, pp. 775–782. ACM (2012)
Liu, J., Shen, H., Yu, L.: Question quality analysis and prediction in community question answering services with coupled mutual reinforcement. IEEE Trans. Serv. Comput. 10(2), 286–301 (2017)
McNamara, D.S., Kintsch, W.: Learning from texts: effects of prior knowledge and text coherence. Discourse Process. 22(3), 247–288 (1996)
Mitchell, T., et al.: Never-ending learning. Commun. ACM 61(5), 103–115 (2018)
For Now A: CQA Text Cohesion Analysis (2019). https://tinyurl.com/CQACohesion/. (Accessed 20 Dec 2019)
Ratner, B.: The correlation coefficient: its values range between \(\pm \)1, or do they? J. Target. Meas. Anal. Mark. 17(2), 139–142 (2009)
Ravi, S., Pang, B., Rastogi, V., Kumar, R.: Great question! Question quality in community Q&A. In: Eighth International AAAI Conference on Weblogs and Social Media 2014, pp. 426–435 (2014)
Van Der Maaten, L., Postma, E., Van den Herik, J.: Dimensionality reduction: a comparative review. J. Mach. Learn. Res. 10, 66–71 (2009)
Rupley, W.H., Willson, V.L.: Content, domain, and word knowledge: relationship to comprehension of narrative and expository text. Read. Writ. 8, 419–432 (1996)
Zowghi, D., Gervasi, V.: The three Cs of requirements: consistency, completeness, and correctness. In: International Workshop on Requirements Engineering: Foundations for Software Quality, pp. 155–164. Essener Informatik Beitiage, Essen, Germany (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Sanagavarapu, L.M., Pichen, J.A., Rizwi, S.M.A., Reddy, Y.R., Sharma, D. (2020). Text Cohesion in CQA - Does It Impact Rating?. In: B. R., P., Thenkanidiyoor, V., Prasath, R., Vanga, O. (eds) Mining Intelligence and Knowledge Exploration. MIKE 2019. Lecture Notes in Computer Science(), vol 11987. Springer, Cham. https://doi.org/10.1007/978-3-030-66187-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-66187-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-66186-1
Online ISBN: 978-3-030-66187-8
eBook Packages: Computer ScienceComputer Science (R0)