More Web Proxy on the site http://driver.im/

research-article

Open access

Understanding Practices around Computational News Discovery Tools in the Domain of Science Journalism

Authors:

Sachita Nishal,

Jasmine Sinchai,

Nicholas DiakopoulosAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 8, Issue CSCW1

Article No.: 142, Pages 1 - 36

https://doi.org/10.1145/3637419

Published: 26 April 2024 Publication History

Abstract

Science and technology journalists today face challenges in finding newsworthy leads due to increased workloads, reduced resources, and expanding scientific publishing ecosystems. Given this context, we explore computational methods to aid these journalists' news discovery in terms of their agency and time-efficiency. We prototyped three computational information subsidies into an interactive tool that we used as a probe to better understand how such a tool may offer utility or more broadly shape the practices of professional science journalists. Our findings highlight central considerations around science journalists' user agency, contexts of use, and professional responsibility that such tools can influence and could account for in design. Based on this, we suggest design opportunities for enhancing and extending user agency over the longer-term; incorporating contextual, personal and collaborative notions of newsworthiness; and leveraging flexible interfaces and generative models. Overall, our findings contribute a richer view of the sociotechnical system around computational news discovery tools, and suggest ways to improve such tools to better support the practices of science journalists.

References

[1]

Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1--18. https://doi.org/10.1145/3173574.3174156

Digital Library

[2]

Sigurd Allern. 2002. Journalistic and Commercial News Values: News Organizations as Patrons of an Institution and Market Actors. Nordicom Review, Vol. 23, 1--2 (Sept. 2002), 137--152. https://doi.org/10.1515/nor-2017-0327

[3]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland UK, 1--13. https://doi.org/10.1145/3290605.3300233

Digital Library

[4]

Jacopo Amidei, Paul Piwek, and Alistair Willis. 2019. The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations. In Proceedings of the 12th International Conference on Natural Language Generation. Association for Computational Linguistics, Tokyo, Japan, 397--402. https://doi.org/10.18653/v1/W19--8648

[5]

Josh Anderson and Anthony Dudo. 2023. A View From the Trenches: Interviews With Journalists About Reporting Science News. Science Communication, Vol. 45, 1 (2023), 39--64. https://doi.org/10.1177/10755470221149156

[6]

Martin W. Angler. 2017. Science journalism: an introduction 1st edition ed.). Routledge, London ; New York.

[7]

Franziska Badenschier and Holger Wormer. 2012. Issue Selection in Science Journalism: Towards a Special Theory of News Values for Science News? In The Sciences' Media Connection --Public Communication and its Repercussions, Simone Rödder, Martina Franzen, and Peter Weingart (Eds.). Vol. 28. Springer Netherlands, Dordrecht, 59--85. https://doi.org/10.1007/978--94-007--2085--5_4

[8]

Aleszu Bajak. 2016. The Economics of Being a Young Science Writer. https://undark.org/2016/10/26/economics-young-science-writer/ Retrieved November 2, 2022.

[9]

Charlie Beckett. 2019. New Powers, New Responsibilities: A Global Survey of Journalism and Artificial Intelligence. Technical Report. JournalismAI, London School of Economics and Political Science, UK.

[10]

Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Margaret Mitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 610--623. https://doi.org/10.1145/3442188.3445922

Digital Library

[11]

Deborah Blum. 2021. Science journalism grows up. Science, Vol. 372, 6540 (April 2021), 323--323. https://doi.org/10.1126/science.abj0434

[12]

Deborah Blum, Mary Knudson, and Robin Marantz Henig (Eds.). 2006. A field guide for science writers 2nd ed.). Oxford University Press, Oxford [England] ; New York.

[13]

Lutz Bornmann, Robin Haunschild, and Rüdiger Mutz. 2021. Growth Rates of Modern Science: A Latent Piecewise Growth Curve Approach to Model Publication Numbers from Established and New Literature Databases. Humanities and Social Sciences Communications, Vol. 8, 1 (Oct. 2021), 224. https://doi.org/10.1057/s41599-021-00903-w

[14]

Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology, Vol. 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oa

[15]

Meredith Broussard, Nicholas Diakopoulos, Andrea L. Guzman, Rediet Abebe, Michel Dupagne, and Ching-Hua Chuan. 2019. Artificial Intelligence and Journalism. Journalism & Mass Communication Quarterly, Vol. 96, 3 (Sept. 2019), 673--695. https://doi.org/10.1177/1077699019859901

[16]

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. http://arxiv.org/abs/2005.14165 arXiv:2005.14165 [cs].

[17]

Geoff Brumfiel. 2009. Science journalism: Supplanting the old media? Nature, Vol. 458, 7236 (March 2009), 274--277. https://doi.org/10.1038/458274a

[18]

Mandi Cai and Sachita Nishal. 2023. Motivations, Goals, and Pathways for AI Literacy for Journalism. In CHI'23 Workshop on AI Literacy: Finding Common Threads between Education, Design, Policy, and Explainability.

[19]

Dhivya Chandrasekaran and Vijay Mago. 2022. Evolution of Semantic Similarity textemdashA Survey. Comput. Surveys, Vol. 54, 2 (March 2022), 1--37. https://doi.org/10.1145/3440755

Digital Library

[20]

Suzannah Evans Comfort, Mike Gruszczynski, and Nicholas Browning. 2022. Building the Science News Agenda: The Permeability of Science Journalism to Public Relations. Journalism & Mass Communication Quarterly (2022), 10776990211047949. https://doi.org/10.1177/10776990211047949

[21]

Rumen Dangovski, Michelle Shen, Dawson Byrd, Li Jing, Desislava Tsvetkova, Preslav Nakov, and Marin Solja?i?. 2021. We Can Explain Your Research in Layman's Terms: Towards Automating Science Journalism at Scale. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35, 14 (May 2021), 12728--12737. https://doi.org/10.1609/aaai.v35i14.17507

[22]

Yael de Haan, Eric van den Berg, Nele Goutier, Sanne Kruikemeier, and Sophie Lecheler. 2022. Invisible Friend or Foe ? How Journalists Use and Perceive Algorithmic-Driven Tools in Their Research Process. Digital Journalism, Vol. 10, 10 (Feb. 2022), 1775--1793. https://doi.org/10.1080/21670811.2022.2027798

[23]

Vladimir de Semir. 1998. Press Releases of Science Journal Articles and Subsequent Newspaper Stories on the Same Topic. JAMA, Vol. 280, 3 (July 1998), 294. https://doi.org/10.1001/jama.280.3.294

[24]

Wesley Hanwen Deng, Boyuan Guo, Alicia Devrio, Hong Shen, Motahhare Eslami, and Kenneth Holstein. 2023. Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1--18. https://doi.org/10.1145/3544548.3581026

Digital Library

[25]

Mark Deuze. 2005. What Is Journalism?: Professional Identity and Ideology of Journalists Reconsidered. Journalism, Vol. 6, 4 (Nov. 2005), 442--464. https://doi.org/10.1177/1464884905056815

[26]

Mark Deuze and Charlie Beckett. 2022. Imagination, Algorithms and News : Developing AI Literacy for Journalism. Digital Journalism, Vol. 10, 10 (Sept. 2022), 1--6. https://doi.org/10.1080/21670811.2022.2119152

[27]

Nicholas Diakopoulos. 2020. Computational News Discovery: Towards Design Considerations for Editorial Orientation Algorithms in Journalism. Digital Journalism, Vol. 8, 7 (Aug. 2020), 945--967. https://doi.org/10.1080/21670811.2020.1736946

[28]

Nicholas Diakopoulos, Madison Dong, Leonard Bronner, and Jeremy Bowers. 2020. Generating Location-Based News Leads for National Politics Reporting. In Computation Journalism Symposium 2020.

[29]

Nicholas Diakopoulos, Mor Naaman, and Funda Kivran-Swaine. 2010. Diamonds in the rough: Social media visual analytics for journalistic inquiry. In 2010 IEEE Symposium on Visual Analytics Science and Technology. IEEE, 115 -- 122. https://doi.org/10.1109/vast.2010.5652922

[30]

Nicholas Diakopoulos, Daniel Trielli, and Grace Lee. 2021. Towards Understanding and Supporting Journalistic Practices Using Semi-Automated News Discovery Tools. Proc. ACM Hum.-Comput. Interact., Vol. 5, CSCW2, Article 406 (Oct 2021), bibinfonumpages30 pages. https://doi.org/10.1145/3479550

Digital Library

[31]

Yuxiao Dong, Hao Ma, Zhihong Shen, and Kuansan Wang. 2017. A Century of Science : Globalization of Scientific Collaborations, Citations, and Innovations. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '17). Association for Computing Machinery, New York, NY, USA, 1437--1446. https://doi.org/10.1145/3097983.3098016

Digital Library

[32]

Sharon Dunwoody. 2021. Science Journalism: Prospects in the Digital Age. In Routledge Handbook of Public Communication of Science and Technology 3rd ed.). Routledge.

[33]

Dominic Espinosa, Rajakrishnan Rajkumar, Michael White, and Shoshana Berleant. 2010. Further Meta-Evaluation of Broad-Coverage Surface Realization. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Cambridge, MA, 564--574. https://aclanthology.org/D10--1055

Digital Library

[34]

Declan Fahy and Matthew Nisbet. 2011. The Science Journalist Online: Shifting Roles and Emerging Practices. Journalism, Vol. 12, 7 (Oct. 2011), 778--793. https://doi.org/10.1177/1464884911412697

[35]

Alice Fleerackers, Laura L. Moorhead, Lauren A. Maggio, Kaylee Fagan, and Juan Pablo Alperin. 2022. Science in motion: A qualitative analysis of journalists' use and perception of preprints. PLOS ONE, Vol. 17, 11 (Nov. 2022), e0277769. https://doi.org/10.1371/journal.pone.0277769

[36]

Santo Fortunato, Carl T. Bergstrom, Katy Börner, James A. Evans, Dirk Helbing, Sta?a Milojevi?, Alexander M. Petersen, Filippo Radicchi, Roberta Sinatra, Brian Uzzi, Alessandro Vespignani, Ludo Waltman, Dashun Wang, and Albert-László Barabási. 2018. Science of science. Science, Vol. 359, 6379 (March 2018), eaao0185. https://doi.org/10.1126/science.aao0185

[37]

Nicholas Fraser, Liam Brierley, Gautam Dey, Jessica K. Polka, Máté Pálfy, Federico Nanni, and Jonathon Alexis Coates. 2021. The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape. PLOS Biology, Vol. 19, 4 (April 2021), e3000959. https://doi.org/10.1371/journal.pbio.3000959

[38]

Matthias Gamer, Jim Lemon, Ian Fellows, and Puspendra Singh. 2019. irr: Various Coefficients of Interrater Reliability and Agreement. https://cran.r-project.org/web/packages/irr/index.html

[39]

Oscar H. Gandy. 1980. Information in health: subsidised news. Media, Culture & Society, Vol. 2, 2 (April 1980), 103--115. https://doi.org/10.1177/016344378000200201

[40]

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, Andy Jones, Sam Bowman, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Nelson Elhage, Sheer El-Showk, Stanislav Fort, Zac Hatfield-Dodds, Tom Henighan, Danny Hernandez, Tristan Hume, Josh Jacobson, Scott Johnston, Shauna Kravec, Catherine Olsson, Sam Ringer, Eli Tran-Johnson, Dario Amodei, Tom Brown, Nicholas Joseph, Sam McCandlish, Chris Olah, Jared Kaplan, and Jack Clark. 2022. Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned. arxiv: 2209.07858 [cs.CL]

[41]

Albert Gatt and Emiel Krahmer. 2018. Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research, Vol. 61 (Jan. 2018), 65--170. https://doi.org/10.1613/jair.5477

[42]

Katy Gero, Alex Calderwood, Charlotte Li, and Lydia Chilton. 2022. A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing. In Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022). Association for Computational Linguistics, Dublin, Ireland, 11--24. https://doi.org/10.18653/v1/2022.in2writing-1.2

[43]

Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, Boston. HD6331. G826 2019

[44]

Ben Green and Yiling Chen. 2020. Algorithm-in-the-Loop Decision Making. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34, 09 (April 2020), 13663--13664. https://doi.org/10.1609/aaai.v34i09.7115

[45]

Sujata Gupta. 2022. Social Sciences. In A Tactical Guide to Science Journalism 1 ed.), Deborah Blum, Ashley Smart, and Tom Zeller Jr. (Eds.). Oxford University Press, 168--C23.P37. https://doi.org/10.1093/oso/9780197551509.003.0024

[46]

Marisela Gutierrez Lopez, Colin Porlezza, Glenda Cooper, Stephann Makri, Andrew MacFarlane, and Sondess Missaoui. 2022. A Question of Design : Strategies for Embedding AI-Driven Tools into Journalistic Work Routines. Digital Journalism, Vol. 11, 3 (March 2022), 1--20. https://doi.org/10.1080/21670811.2022.2043759

[47]

Chris Hager. 2021. pdfx. https://github.com/metachris/pdfx

[48]

Felix Hamborg, Meuschke, Norman, Breitinger, Corinna, and Gipp, Bela. 2017. news-please: A Generic News Crawler and Extractor. (March 2017). https://doi.org/10.5281/ZENODO.4120316

[49]

James T. Hamilton. 2016. Democracytextquoterights Detectives. Harvard University Press.

[50]

Jaron Harambam, Dimitrios Bountouridis, Mykola Makhortykh, and Joris van Hoboken. 2019. Designing for the Better by Taking Users into Account: A Qualitative Evaluation of User Control Mechanisms in (News) Recommender Systems. In Proceedings of the 13th ACM Conference on Recommender Systems. ACM, Copenhagen Denmark, 69--77. https://doi.org/10.1145/3298689.3347014

Digital Library

[51]

Tony Harcup and Deirdre O'Neill. 2001. What Is News? Galtung and Ruge revisited. Journalism Studies, Vol. 2, 2 (Jan. 2001), 261--280. https://doi.org/10.1080/14616700118449

[52]

Tony Harcup and Deirdre O'Neill. 2017. What is News?: News values revisited (again). Journalism Studies, Vol. 18, 12 (Dec. 2017). https://doi.org/10.1080/1461670X.2016.1150193

[53]

Jeffrey Heer. 2019. Agency plus Automation: Designing Artificial Intelligence into Interactive Systems. Proceedings of the National Academy of Sciences, Vol. 116, 6 (Feb. 2019), 1844--1850. https://doi.org/10.1073/pnas.1807184115

[54]

Natali Helberger, Max Van Drunen, Sarah Eskens, Mariella Bastian, and Judith Moeller. 2020. A freedom of expression perspective on AI in the media -- with a special focus on editorial decision making on social media platforms and in the news media. European Journal of Law and Technology, Vol. 11, 3 (Dec. 2020). https://ejlt.org/index.php/ejlt/article/view/752

[55]

Hendrik Heuer. 2021. The Explanatory Gap in Algorithmic News Curation. In Disinformation in Open Online Media: Third Multidisciplinary International Symposium, MISDOOM 2021, Virtual Event, September 21--22, 2021, Proceedings. Springer-Verlag, Berlin, Heidelberg, 1--15. https://doi.org/10.1007/978--3-030--87031--7_1

Digital Library

[56]

Matthew K. Hong, Adam Fourney, Derek DeBellis, and Saleema Amershi. 2021. Planning for Natural Language Failures with the AI Playbook. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--11. https://doi.org/10.1145/3411764.3445735

Digital Library

[57]

David M. Howcroft, Anya Belz, Miruna-Adriana Clinciu, Dimitra Gkatzia, Sadid A. Hasan, Saad Mahamood, Simon Mille, Emiel van Miltenburg, Sashank Santhanam, and Verena Rieser. 2020. Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. In Proceedings of the 13th International Conference on Natural Language Generation. Association for Computational Linguistics, Dublin, Ireland, 169--182. https://aclanthology.org/2020.inlg-1.23

[58]

Matthew Hutson. 2022. Artificial Intelligence. In A Tactical Guide to Science Journalism: Lessons From the Front Lines, Deborah Blum, Ashley Smart, and Tom Zeller Jr. (Eds.). Oxford University Press. https://doi.org/10.1093/oso/9780197551509.003.0035

[59]

Dietmar Jannach, Michael Jugovac, and Ingrid Nunes. 2019. Explanations and User Control in Recommender Systems. In Proceedings of the 23rd International Workshop on Personalization and Recommendation on the Web and Beyond - ABIS '19. ACM Press, Hof, Germany, 31--31. https://doi.org/10.1145/3345002.3349293

Digital Library

[60]

Dietmar Jannach, Sidra Naveed, and Michael Jugovac. 2017. User Control in Recommender Systems : Overview and Interaction Challenges. In E-Commerce and Web Technologies, Derek Bridge and Heiner Stuckenschmidt (Eds.). Vol. 278. Springer International Publishing, Cham, 21--33. https://doi.org/10.1007/978--3--319--53676--7_2

[61]

Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2022. Survey of Hallucination in Natural Language Generation. http://arxiv.org/abs/2202.03629

[62]

Bronwyn Jones, Rhianne Jones, and Ewa Luger. 2022. AI `Everywhere and Nowhere ': Addressing the AI Intelligibility Problem in Public Service Journalism. Digital Journalism, Vol. 10, 10 (Nov. 2022), 1731--1755. https://doi.org/10.1080/21670811.2022.2145328

[63]

Tomoko Komatsu, Marisela Gutierrez Lopez, Stephann Makri, Colin Porlezza, Glenda Cooper, Andrew MacFarlane, and Sondess Missaoui. 2020. AI Should Embody Our Values: Investigating Journalistic Values to Inform AI Technology Design. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction : Shaping Experiences, Shaping Society. ACM, Tallinn Estonia, 1--13. https://doi.org/10.1145/3419249.3420105

Digital Library

[64]

Maria Konow-Lund, Amanda Gearing, and Peter Berglez. 2019. Transnational Cooperation in Journalism. In Oxford Research Encyclopedia of Communication. https://doi.org/10.1093/acrefore/9780190228613.013.881

[65]

J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, Vol. 33, 1 (1977), 159--174. http://www.jstor.org/stable/2529310

[66]

Marilyn Lester. 1980. Generating Newsworthiness: The Interpretive Construction of Public Events. American Sociological Review, Vol. 45, 6 (1980), 984--994. https://doi.org/10.2307/2094914

[67]

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rockt"aschel, Sebastian Riedel, and Douwe Kiela. 2021. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. https://doi.org/10.48550/arXiv.2005.11401 arxiv: 2005.11401 [cs]

[68]

Bibo Lin and Seth C. Lewis. 2022. The One Thing Journalistic AI Just Might Do for Democracy. Digital Journalism, Vol. 10, 10 (Nov. 2022), 1627--1649. https://doi.org/10.1080/21670811.2022.2084131

[69]

Stephanie Lin, Jacob Hilton, and Owain Evans. 2022. TruthfulQA: Measuring How Models Mimic Human Falsehoods. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Dublin, Ireland, 3214--3252. https://doi.org/10.18653/v1/2022.acl-long.229

[70]

Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Sameena Shah, Robert Martin, and John Duprey. 2017. Reuters Tracer: Toward automated news production using large scale social media data. In 2017 IEEE International Conference on Big Data (Big Data). 1483--1493. https://doi.org/10.1109/BigData.2017.8258082

[71]

Henrietta Lyons, Eduardo Velloso, and Tim Miller. 2021. Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions. Proc. ACM Hum.-Comput. Interact., Vol. 5, CSCW1, Article 106 (Apr 2021), bibinfonumpages25 pages. https://doi.org/10.1145/3449180

Digital Library

[72]

Marcel Machill, Markus Beiler, and Jochen Schmutz. 2006. The Influence of Video News Releases on the Topics Reported in Science Journalism: An explorative case study of the relationship between science public relations and science journalism. Journalism Studies, Vol. 7, 6 (Dec. 2006), 869--888. https://doi.org/10.1080/14616700600980637

[73]

Ansel MacLaughlin, John Wihbey, and David Smith. 2018. Predicting news coverage of scientific articles. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 12. AAAI Press, 191--200. https://doi.org/10.1609/icwsm.v12i1.14999

[74]

Måns Magnusson, Jens Finn"as, and Leonard Wallentin. 2016. Finding the news lead in the data haystack: Automated local data journalism using crime data. In Computation Journalism Symposium 2016.

[75]

Neil Maiden, Konstantinos Zachos, Amanda Brown, George Brock, Lars Nyre, Aleksander Nygård Tonheim, Dimitris Apsotolou, and Jeremy Evans. 2018. Making the News: Digital Creativity Support for Journalists. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1--11. https://doi.org/10.1145/3173574.3174049

Digital Library

[76]

Neil Maiden, Konstantinos Zachos, Suzanne Franks, Lars Nyre, and Carl-Gustav Linden. 2023. Automating Science Journalism Tasks : Emerging Opportunities. Journalism Practice, Vol. 0, 0 (June 2023), 1--21. https://doi.org/10.1080/17512786.2023.2226116

[77]

Neil Maiden, Konstantinos Zachos, Suzanne Franks, Rebecca Wells, and Samantha Stallard. 2020. Designing Digital Content to Support Science Journalism. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society. ACM, Tallinn Estonia, 1--13. https://doi.org/10.1145/3419249.3420124

Digital Library

[78]

Jeovany Martínez-Mesa, David Alejandro González-Chica, Rodrigo Pereira Duquia, Renan Rangel Bonamigo, and Jo ao Luiz Bastos. 2016. Sampling: How to Select Participants in My Research Study? Anais Brasileiros de Dermatologia, Vol. 91, 3 (2016), 326--330. https://doi.org/10.1590/abd1806--4841.20165254

[79]

Nitika Mathur, Timothy Baldwin, and Trevor Cohn. 2019. Putting Evaluation in Context : Contextual Embeddings Improve Machine Translation Evaluation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 2799--2808. https://doi.org/10.18653/v1/P19--1269

[80]

John H. McManus. 1994. Market-driven journalism: let the citizen beware? Sage Publications, Thousand Oaks, Calif.

[81]

Marko Milosavljevi? and Igor Vobi?. 2021. Human Still in the Loop. In Algorithms, Automation, and News 1 ed.), Neil Thurman, Seth C. Lewis, and Jessica Kunert (Eds.). Routledge, 119--137. https://doi.org/10.4324/9781003099260--7

[82]

Rachel E. Moran and Sonia Jawaid Shaikh. 2022. Robots in the News and Newsrooms : Unpacking Meta-Journalistic Discourse on the Use of Artificial Intelligence in Journalism. Digital Journalism, Vol. 10, 10 (Nov. 2022), 1756--1774. https://doi.org/10.1080/21670811.2022.2085129

[83]

Enrico Motta, Enrico Daga, Andreas L. Opdahl, and Bjornar Tessem. 2020. Analysis and Design of Computational News Angles. IEEE Access, Vol. 8 (2020), 120613--120626. https://doi.org/10.1109/ACCESS.2020.3005513

[84]

Nina C. Müller and Jenny Wiik. 2023. From Gatekeeper to Gate-opener : Open-Source Spaces in Investigative Journalism. Journalism Practice, Vol. 17, 2 (Feb. 2023), 189--208. https://doi.org/10.1080/17512786.2021.1919543

[85]

Hellina Hailu Nigatu, Lisa Pickoff-White, John Canny, and Sarah Chasins. 2023. Co-Designing for Transparency : Lessons from Building a Document Organization Tool in the Criminal Justice Domain. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT '23). Association for Computing Machinery, New York, NY, USA, 1463--1478. https://doi.org/10.1145/3593013.3594093

Digital Library

[86]

Michelle Nijhuis. 2015. Freelancing Sucks. Long Live Freelancing. The Last Word On Nothing. https://www.lastwordonnothing.com/2015/01/14/freelancing-sucks-long-live-freelancing/ Retrieved November 2, 2022.

[87]

Matthew C. Nisbet and Declan Fahy. 2015. The Need for Knowledge-Based Journalism in Politicized Science Debates. The ANNALS of the American Academy of Political and Social Science, Vol. 658, 1 (March 2015), 223--234. https://doi.org/10.1177/0002716214559887

[88]

Sachita Nishal and Nicholas Diakopoulos. 2022. From Crowd Ratings to Predictive Models of Newsworthiness to Support Science Journalism. Proceedings of the ACM on Human-Computer Interaction, Vol. 6, CSCW2 (Nov. 2022), 441:1--441:28. https://doi.org/10.1145/3555542

Digital Library

[89]

Jekaterina Novikova, Ondvr ej Duvs ek, and Verena Rieser. 2018. RankME: Reliable Human Ratings for Natural Language Generation. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers). Association for Computational Linguistics, New Orleans, Louisiana, 72--78. https://doi.org/10.18653/v1/N18--2012

[90]

Michael Nu nez. 2023. Letter from the Editor: How Generative AI Is Shaping the Future of Journalism and Our Newsroom. VentureBeat. https://venturebeat.com/ai/letter-from-the-editor-how-generative-ai-is-shaping-the-future-of-journalism-and-our-newsroom/

[91]

Changhoon Oh, Jinhan Choi, Sungwoo Lee, SoHyun Park, Daeryong Kim, Jungwoo Song, Dongwhan Kim, Joonhwan Lee, and Bongwon Suh. 2020. Understanding User Perception of Automated News Generation System. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--13. https://doi.org/10.1145/3313831.3376811

Digital Library

[92]

Andreas L. Opdahl and Bjørnar Tessem. 2021. Ontologies for finding journalistic angles. Software and Systems Modeling, Vol. 20, 1 (Feb. 2021), 71--87. https://doi.org/10.1007/s10270-020-00801-w

Digital Library

[93]

Ivan Oransky. 2022. Journals, Peer Review, and Preprints. In A Tactical Guide to Science Journalism 1 ed.), Deborah Blum, Ashley Smart, and Tom Zeller Jr. (Eds.). Oxford University Press, 21--C3.P38. https://doi.org/10.1093/oso/9780197551509.003.0004

[94]

Wanda J. Orlikowski and Debra C. Gash. 1994. Technological Frames: Making Sense of Information Technology in Organizations. ACM Transactions on Information Systems, Vol. 12, 2 (April 1994), 174--207. https://doi.org/10.1145/196734.196745

Digital Library

[95]

Deokgun Park, Simranjit Sachar, Nicholas Diakopoulos, and Niklas Elmqvist. 2016. Supporting Comment Moderators in Identifying High Quality Online News Comments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 1114--1125. https://doi.org/10.1145/2858036.2858389

Digital Library

[96]

John V. Pavlik. 2000. The Impact of Technology on Journalism. Journalism Studies, Vol. 1 (2000), 229 -- 237.

[97]

Caitlin Petre. 2021. All the news that's fit to click: how metrics are transforming the work of journalists. Princeton University Press, Princeton.

[98]

Savvas Petridis, Nicholas Diakopoulos, Kevin Crowston, Mark Hansen, Keren Henderson, Stan Jastrzebski, Jeffrey V Nickerson, and Lydia B Chilton. 2023. AngleKindling : Supporting Journalistic Angle Ideation with Large Language Models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3544548.3580907

Digital Library

[99]

Kendall Powell. 2015a. What Is Science Journalism Worth ? Part I. The Open Notebook. https://www.theopennotebook.com/2015/01/20/what-is-science-journalism-worth-part-i/

[100]

Kendall Powell. 2015b. What Is Science Journalism Worth? Part II. The Open Notebook. https://www.theopennotebook.com/2015/01/27/what-is-science-journalism-worth-part-ii/

[101]

Ryan Prior. 2022. Science writers should be careful when reporting on preprint studies. The National Association of Science Writers. https://www.nasw.org/article/science-writers-2022-sciwri22-nasw-conference-preprints-covid-best-practices-strategies-journalists-pios

[102]

Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020. Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. ACM, Barcelona Spain, 33--44. https://doi.org/10.1145/3351095.3372873

Digital Library

[103]

Tzipora Rakedzon, Elad Segev, Noam Chapnik, Roy Yosef, and Ayelet Baram-Tsabari. 2017. Automatic jargon identifier for scientists engaging with the public and science communication educators. PLOS ONE, Vol. 12, 8 (Aug. 2017), e0181742. https://doi.org/10.1371/journal.pone.0181742

[104]

Charvi Rastogi, Marco Tulio Ribeiro, Nicholas King, Harsha Nori, and Saleema Amershi. 2023. Supporting Human-AI Collaboration in Auditing LLMs with LLMs. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (AIES '23). Association for Computing Machinery, New York, NY, USA, 913--926. https://doi.org/10.1145/3600211.3604712

Digital Library

[105]

Zvi Reich. 2006. The Process Model of News Initiative: Sources lead first, reporters thereafter. Journalism Studies, Vol. 7, 4 (Aug. 2006), 497--514. https://doi.org/10.1080/14616700600757928

[106]

Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 3980--3990. https://doi.org/10.18653/v1/D19--1410

[107]

Boyce Rensberger. 2009. Science journalism: Too close for comfort. Nature, Vol. 459, 7250 (June 2009), 1055--1056. https://doi.org/10.1038/4591055a

[108]

Laria Reynolds and Kyle McDonell. 2021. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--7. https://doi.org/10.1145/3411763.3451760

Digital Library

[109]

Aimee Rinehart and Ernest Kung. 2022. Artificial Intelligence in Local News : A Survey of US Newsrooms' AI Readiness. Technical Report. Reuters. https://doi.org/10.13140/RG.2.2.16926.82246

[110]

Dean Roper, Teemu Henriksson, Kathrin H"albich, and Ole Martin. 2023. Gauging Generative AI 's Impact on Newsrooms. Technical Report. WAN-IFRA.

[111]

Cristine Russell. 2009. Science Journalism Goes Global. Science, Vol. 324, 5934 (June 2009), 1491--1491. https://doi.org/10.1126/science.1176995

[112]

Mahdi Sadjadi. 2017. arxivscraper. https://doi.org/10.5281/ZENODO.889853

[113]

Advait Sarkar. 2023. Enough With “Human-AI Collaboration ”. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3544549.3582735

Digital Library

[114]

Dietram A Scheufele. 2013. Communicating science in social settings. Proceedings of the National Academy of Sciences, Vol. 110, supplement_3 (2013), 14040--14047.

[115]

Ida Schultz. 2007. The Journalistic Gut Feeling : Journalistic Doxa, News Habitus and Orthodox News Values. Journalism Practice, Vol. 1, 2 (June 2007), 190--207. https://doi.org/10.1080/17512780701275507

[116]

Raz Schwartz, Mor Naaman, and Rannie Teodoro. 2015. Editorial Algorithms: Using Social Media to Discover and Report Local News. Proceedings of the International AAAI Conference on Web and Social Media, Vol. 9, 1 (April 2015), 407--415. https://ojs.aaai.org/index.php/ICWSM/article/view/14633

[117]

Pamela J. Shoemaker, Tim P. Vos, and Stephen D. Reese. 2009. Journalists as Gatekeepers. In The Handbook of Journalism Studies, Karin Wahl-Jorgensen and Thomas Hanitzsch (Eds.). Routledge, New York, NY, 93--107.

[118]

C. Estelle Smith, Xinyi Wang, Raghav Pavan Karumur, and Haiyi Zhu. 2018. [Un ]Breaking News : Design Opportunities for Enhancing Collaboration in Scientific Media Production. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173955

Digital Library

[119]

Petroc Sumner, Solveiga Vivian-Griffiths, Jacky Boivin, Andrew Williams, Lewis Bott, Rachel Adams, Christos A. Venetis, Leanne Whelan, Bethan Hughes, and Christopher D. Chambers. 2016. Exaggerations and Caveats in Press Releases and Health-Related Science News. PLOS ONE, Vol. 11, 12 (Dec. 2016), e0168217. https://doi.org/10.1371/journal.pone.0168217

[120]

Martina Temmerman and Jelle Mast (Eds.). 2021. News Values from an Audience Perspective. Springer International Publishing, Cham. https://doi.org/10.1007/978--3-030--45046--5

[121]

Peter Tolmie, Rob Procter, David William Randall, Mark Rouncefield, Christian Burger, Geraldine Wong Sak Hoi, Arkaitz Zubiaga, and Maria Liakata. 2017. Supporting the Use of User Generated Content in Journalistic Practice. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 3632--3644. https://doi.org/10.1145/3025453.3025892

Digital Library

[122]

Damian Trilling, Petro Tolochko, and Björn Burscher. 2017. From Newsworthiness to Shareworthiness: How to Predict News Sharing Based on Article Characteristics. Journalism & Mass Communication Quarterly, Vol. 94, 1 (March 2017). https://doi.org/10.1177/1077699016654682

[123]

Kristen Vaccaro, Karrie Karahalios, Deirdre K. Mulligan, Daniel Kluttz, and Tad Hirsch. 2019. Contestability in Algorithmic Systems. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. ACM, Austin TX USA, 523--527. https://doi.org/10.1145/3311957.3359435

Digital Library

[124]

Chris van der Lee, Albert Gatt, Emiel van Miltenburg, Sander Wubben, and Emiel Krahmer. 2019. Best practices for the human evaluation of automatically generated text. In Proceedings of the 12th International Conference on Natural Language Generation. Association for Computational Linguistics, Tokyo, Japan, 355--368. https://doi.org/10.18653/v1/W19--8643

[125]

Dan Vergano. 2014. The Gig Economy. The Last Word On Nothing. https://www.lastwordonnothing.com/2014/07/24/the-gig-economy/

[126]

Katharine Viner and Anna Bateson. 2023. The Guardian 's Approach to Generative AI. The Guardian. https://www.theguardian.com/help/insideguardian/2023/jun/16/the-guardians-approach-to-generative-ai

[127]

Daniel Vogler and Mike S Sch"afer. 2020. Growing Influence of University PR on Science News Coverage? A Longitudinal Automated Content Analysis of University Media Releases and Newspaper Coverage in Switzerland, 2003--2017. International Journal of Communication, Vol. 14 (2020), 22. https://doi.org/10.5167/UZH-196282

[128]

Yixue Wang and Nicholas Diakopoulos. 2021. Journalistic Source Discovery: Supporting The Identification of News Sources in User Generated Content. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 447, bibinfonumpages18 pages. https://doi.org/10.1145/3411764.3445266

Digital Library

[129]

Daniel S. Weld and Gagan Bansal. 2019. The Challenge of Crafting Intelligible Intelligence. Commun. ACM, Vol. 62, 6 (June 2019), 70--79. https://doi.org/10.1145/3282486

Digital Library

[130]

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. BERTScore: Evaluating Text Generation with BERT. In International Conference on Learning Representations. https://openreview.net/forum?id=SkeHuCVFDr io

Cited By

McArthur V(2024)Why the HCI Community Should Care About AR JournalismInteractions10.1145/369668131:6(54-58)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3696681
Lim GPerrault SFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Evaluation of an LLM in Identifying Logical Fallacies: A Call for Rigor When Adopting LLMs in HCI ResearchCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681867(303-308)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681867
Cools HDiakopoulos N(2024)Uses of Generative AI in the Newsroom: Mapping Journalists’ Perceptions of Perils and PossibilitiesJournalism Practice10.1080/17512786.2024.2394558(1-19)Online publication date: 26-Aug-2024
https://doi.org/10.1080/17512786.2024.2394558

Index Terms

Understanding Practices around Computational News Discovery Tools in the Domain of Science Journalism
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Towards Understanding and Supporting Journalistic Practices Using Semi-Automated News Discovery Tools
CSCW2

Journalists are routinely challenged with monitoring vast information environments in order to identify what is newsworthy and of interest to report to a wider audience. In a process referred to as computational news discovery, alerts and leads based on ...
From Crowd Ratings to Predictive Models of Newsworthiness to Support Science Journalism
CSCW

The scale of scientific publishing continues to grow, creating overload on science journalists who are inundated with choices for what would be most interesting, important, and newsworthy to cover in their reporting. Our work addresses this problem by ...
Understanding interaction design practices
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

There is an undesirable gap between HCI research aimed at influencing interaction design practice and the practitioners in question. To close this gap, we advocate a theoretical and methodological focus on the day-to-day, lived experience of designers. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 8, Issue CSCW1

CSCW

April 2024

6294 pages

EISSN:2573-0142

DOI:10.1145/3661497

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2024

Published in PACMHCI Volume 8, Issue CSCW1

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
315
Total Downloads

Downloads (Last 12 months)315
Downloads (Last 6 weeks)60

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

McArthur V(2024)Why the HCI Community Should Care About AR JournalismInteractions10.1145/369668131:6(54-58)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3696681
Lim GPerrault SFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Evaluation of an LLM in Identifying Logical Fallacies: A Call for Rigor When Adopting LLMs in HCI ResearchCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681867(303-308)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681867
Cools HDiakopoulos N(2024)Uses of Generative AI in the Newsroom: Mapping Journalists’ Perceptions of Perils and PossibilitiesJournalism Practice10.1080/17512786.2024.2394558(1-19)Online publication date: 26-Aug-2024
https://doi.org/10.1080/17512786.2024.2394558

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents