What Did The People Say? Evaluating the Effect of Comment Summarisation Tags on Perceived News Credibility Using Qualitative Approach
Pages 15 - 29
Abstract
The rise of fake news on social media has made it important to find effective strategies for assessing news credibility. This study explores how using comment summarization tags on Facebook and Twitter might help users determine if news is credible. We conducted interviews and think-aloud sessions with Australian and New Zealander participants who actively use these platforms. Participants interacted with true and fake news posts on their news feeds using a Chrome extension, and their thoughts on news credibility were recorded. We found that participants who saw comment summarisation tags were more accurate in determining news credibility. These findings show the effectiveness of comment summarisation tags in evaluating social media news posts (SMNPs). Our study provides insights into social media users’ strategies and platform features to assess credibility and respond to misinformation.
References
[1]
Ahmed W, Vidal-Alaball J, Downing J, and Seguí FL Dangerous messages or satire? analysing the conspiracy theory linking 5g to covid-19 through social network analysis J. Med. Internet Res. 2020 22 5 e19458
[2]
Allcott H and Gentzkow M Social media and fake news in the 2016 election J. Econ. Perspect. 2017 31 2 211-36
[3]
Ashbrook, A.: Fake news bots are here (2017)
[4]
Avram, M., Micallef, N., Patil, S., Menczer, F.: Exposure to social engagement metrics increases vulnerability to misinformation. arXiv preprint arXiv:2005.04682
[5]
Bhuiyan MM, Horning M, Lee SW, and Mitra T Nudgecred: supporting news credibility assessment on social media through nudges Proc. ACM Human-Comput. Interact. 2021 5 CSCW2 1-30
[6]
Clayton K et al. Real solutions for fake news? measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media Polit. Behav. 2020 42 4 1073-1095
[7]
Duffy A, Tandoc E, and Ling R Too good to be true, too good not to share: the social utility of fake news Inf. Commun. Soc. 2020 23 13 1965-1979
[8]
Fong B Analysing the behavioural finance impact of’fake news’ phenomena on financial markets: a representative agent model and empirical validation Finan. Innov. 2021 7 1 1-30
[9]
Geeng, C., Yee, S., Roesner, F.: Fake news on facebook and twitter: investigating how people (don’t) investigate. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI ’20, p. 1–14. Association for Computing Machinery (2020)
[10]
Government, A.: Australian broadcasting corporation annual report 2019–2020 (2020)
[11]
Grochalova, P.: How to edit facebook link preview? guide & tips | kontentino (2019)
[12]
Gwebu, K.L., Wang, J., Zifla, E.: Can warnings curb the spread of fake news? the interplay between warning, trust and confirmation bias. Behav. Inf. Technol. 1–22 (2021)
[13]
Jr., E.C.T., Lim, Z.W., Ling, R.: Defining “fake news”. Digit. J. 6(2), 137–153 (2018)
[14]
Karlsen, R., Aalberg, T.: Social media and trust in news: an experimental study of the effect of facebook on news story credibility. Digit. J., 1–17 (2021)
[15]
Kim B, Xiong A, Lee D, and Han K A systematic review on fake news research through the lens of news creation and consumption: research efforts, challenges, and future directions PLoS ONE 2021 16 12 e0260080
[16]
Knox, D.: Abc, sbs lead most trusted news. | tv tonight (2022)
[17]
Koch, T., Frischlich, L., Lermer, E.: The effects of warning labels and social endorsement cues on credibility perceptions of and engagement intentions with fake news (2021)
[18]
Kumar, S., Shah, N.: False information on web and social media: a survey. arXiv preprint arXiv:1804.08559 (2018)
[19]
Mao, F., Tan, Y., Cheetham, J.: Facebook Australia row: how facebook became so powerful in news (2021)
[20]
Molla, R.: Social studies: twitter vs. facebook (2016)
[21]
Mourão RR and Robertson CT Fake news as discursive integration: an analysis of sites that publish false, misleading, hyperpartisan and sensational information J. Stud. 2019 20 14 2077-2095
[22]
Musgrove AT, Powers JR, Rebar LC, and Musgrove GJ Real or fake? resources for teaching college students how to identify fake news Coll. Undergrad. Libr. 2018 25 3 243-260
[23]
Myllylahti, M.: Google, facebook and New Zealand news media: the problem of platform dependency (2018)
[24]
Pennycook G and Rand DG Lazy, not biased: susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning Cognition 2019 188 39-50
[25]
Shabayek, S., Théro, H., Almanla, D., Vincent, E.: Monitoring misinformation related interventions by facebook, twitter and youtube: methods and illustration (2022)
[26]
Shahid, F., Kamath, S., Sidotam, A., Jiang, V., Batino, A., Vashistha, A.: “it matches my worldview”: examining perceptions and attitudes around fake videos. In: CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2022)
[27]
Spiliotopoulos T and Oakley I An exploration of motives and behavior across facebook and twitter J. Syst. Inf. Technol. 2020 22 201-222
[28]
Sundar, S.S., Oeldorf-Hirsch, A., Xu, Q.: The bandwagon effect of collaborative filtering technology. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 3453–3458 (2008)
[29]
Vosoughi S, Roy D, and Aral S The spread of true and false news online Science 2018 359 6380 1146-1151
[30]
Waddell TF The authentic (and angry) audience: how comment authenticity and sentiment impact news evaluation Digit. J. 2020 8 2 249-266
[31]
Yaqub, W., Kakhidze, O., Brockman, M.L., Memon, N., Patil, S.: Effects of credibility indicators on social media news sharing intent. In: Proceedings of the 2020 Chi Conference on Human Factors in Computing Systems, pp. 1–14 (2020)
[32]
Yaqub, W., Kay, J., Goldwater, M.: Foundations for enabling people to recognise misinformation in social media news based on retracted science. Proc. ACM Hum.-Comput. Interact. 8(CSCW1) (2024).
Index Terms
- What Did The People Say? Evaluating the Effect of Comment Summarisation Tags on Perceived News Credibility Using Qualitative Approach
Index terms have been assigned to the content through auto-classification.
Recommendations
Factors influencing Internet users' perceived credibility of news-related blogs in Taiwan
This study investigates factors influencing Internet users' perceived credibility of news-related blogs in Taiwan. First, this paper identifies Taiwanese Internet users' beliefs about news-related blog credibility. Secondly, it examines whether these ...
On the credibility perception of news on Twitter
Searching for specific topics on Twitter, readers have to judge the credibility of tweets. In this paper, we examine the relationship between reader demographics, news attributes and tweet features with reader's credibility perception, and further ...
The effects of emotions, individual attitudes towards vaccination, and social endorsements on perceived fake news credibility and sharing motivations
AbstractIn recent times, the spread of false or “fake” anti-vaccination news and information on social media has been linked to the global rise of vaccine hesitancy, resulting in increased vaccine-preventable disease outbreaks. As such, the ...
Highlights- This study examines how emotions, pre-existing attitudes, and social endorsements affect the spread of fake news.
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Dec 2024
500 pages
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 03 December 2024
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025