More Web Proxy on the site http://driver.im/

short-paper

A Benchmark of Visual Storytelling in Social Media

Authors:

Gonçalo Marcelino,

André Mourão,

Joao MagalhaesAuthors Info & Claims

ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval

Pages 324 - 328

https://doi.org/10.1145/3323873.3325047

Published: 05 June 2019 Publication History

Abstract

Media editors in the newsroom are constantly pressed to provide a"like-being there" coverage of live events. Social media provides a disorganised collection of images and videos that media professionals need to grasp before publishing their latest news updated. Automated news visual storyline editing with social media content can be very challenging, as it not only entails the task of finding the right content but also making sure that news content evolves coherently over time. To tackle these issues, this paper proposes a benchmark for assessing social media visual storylines. The SocialStories benchmark, comprised by total of 40 curated stories covering sports and cultural events, provides the experimental setup and introduces novel quantitative metrics to perform a rigorous evaluation of visual storytelling with social media data.

References

[1]

George Awad, Asad Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, David Joy, Andrew Delgado, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Joao Magalhaes, David Semedo, and Saverio Blasi. 2018. TRECVID 2018: Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search. In Proceedings of TRECVID 2018 . NIST, USA.

[2]

Deepayan Chakrabarti and Kunal Punera. 2011. Event Summarization Using Tweets. In International AAAI Conference on Web and Social Media .

[3]

Freddy Chong Tat Chua and Sitaram Asur. 2013. Automatic Summarization of Events from Social Media. In ICWSM, Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, and Ian Soboroff (Eds.). The AAAI Press.

[4]

Diogo Delgado, Joao Magalhaes, and Nuno Correia. 2010. Automated illustration of news stories. In 2010 IEEE Fourth International Conference on Semantic Computing. IEEE, 73--78.

Digital Library

[5]

Erika Doggett and Alejandro Cantarero. 2016. Identifying Eyewitness News-worthy Events on Twitter. In SocialNLP@EMNLP .

[6]

Mengdie Hu, Shixia Liu, Furu Wei, Yingcai Wu, John Stasko, and Kwan-Liu Ma. 2012. Breaking News on Twitter. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12).

Digital Library

[7]

Ting-Hao K. Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Aishwarya Agrawal, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, et almbox. 2016. Visual Storytelling. In 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2016) .

[8]

Gunhee Kim, Seungwhan Moon, and Leonid Sigal. 2015. Ranking and retrieval of image sequences from multiple paragraph queries. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7--12, 2015. IEEE Computer Society, 1993--2001.

[9]

David Laniado and Peter Mika. 2010. Making Sense of Twitter. In Proceedings of the 9th International Semantic Web Conference on The Semantic Web - Volume Part I (ISWC'10). Springer-Verlag, Berlin, Heidelberg, 470--485.

Digital Library

[10]

Flávio Martins, Jo ao Magalh aes, and Jamie Callan. 2016. Barbara Made the News: Mining the Behavior of Crowds for Time-Aware Learning to Rank. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM '16). ACM, New York, NY, USA, 667--676.

Digital Library

[11]

Philip J. McParlane, Andrew James McMinn, and Joemon M. Jose. 2014. "Picture the Scene...";: Visually Summarising Social Media Events. In ACM CIKM .

Digital Library

[12]

Steve Paulussen and Pieter Ugille. 2008. User generated content in the newsroom: Professional and organisational constraints on participatory journalism. Westminster Papers in Communication & Culture, Vol. 5, 2 (2008).

[13]

Takeshi Sakaki, Makoto Okazaki, and Yutaka Matsuo. 2010. Earthquake Shakes Twitter Users: Real-time Event Detection by Social Sensors. In Proceedings of the 19th International Conference on World Wide Web (WWW '10). 10.

Digital Library

[14]

Manos Schinas, Symeon Papadopoulos, Yiannis Kompatsiaris, and Pericles A. Mitkas. 2015. Visual Event Summarization on Social Media using Topic Modelling and Graph-based Ranking Algorithms. In Proceedings of the 5th ACM on International Conference on Multimedia Retrieval - ICMR '15 .

Digital Library

[15]

Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv preprint arXiv:1409.1556 (2014).

[16]

Peter Tolmie, Rob Procter, Dave W. Randall, Mark Rouncefield, Christian Burger, Geraldine Wong Sak Hoi, Arkaitz Zubiaga, and Maria Liakata. 2017. Supporting the Use of User Generated Content in Journalistic Practice. In CHI .

Digital Library

Cited By

Asgari MHurtut T(2024)A Design Language for Prototyping and Storyboarding Data-Driven StoriesApplied Sciences10.3390/app1404138714:4(1387)Online publication date: 8-Feb-2024
https://doi.org/10.3390/app14041387
Barnes S(2023)On the Use of Encapsulation, Parity, and Visual Storytelling in Graphic MedicineHealth Humanities in Application10.1007/978-3-031-08360-0_12(265-286)Online publication date: 23-Feb-2023
https://doi.org/10.1007/978-3-031-08360-0_12
Bartolomeu CNóbrega RSemedo DMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Understanding News Text and Images Connection with Context-enriched Multimodal TransformersProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548430(5821-5832)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548430
Show More Cited By

Index Terms

A Benchmark of Visual Storytelling in Social Media
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Laboratory experiments
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Empowering Storytellers with Social Media
TVX '15: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

From entertainment to news to corporate marketing, social media has infused, informed and revolutionized the way creators are reaching their audience.

In this discussion we will explore the core impact of social media as a storytelling medium, how ...
Social capital, social media, and TV ratings

Motivated by the increasing role of social media in relating to economic outcomes, this paper examines the relationship between social networking sites SNS and television ratings drawing from the social capital theoretical framework of bonding and ...
Uses and gratifications of social networking sites for bridging and bonding social capital

Applying uses and gratifications theory (UGT) and social capital theory, our study examined users of four social networking sites (SNSs) (Facebook, Twitter, Instagram, and Snapchat), and their influence on online bridging and bonding social capital. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval

June 2019

427 pages

ISBN:9781450367653

DOI:10.1145/3323873

General Chairs:
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Alberto Del Bimbo
University of Florence, Italy
,
Zhongfei Zhang
Binghamton University, State University of New York, USA
,
Program Chairs:
Alexander Hauptmann
Carnegie Mellon University, USA
,
K. Selcuk Candan
Arizona State University, USA
,
Marco Bertini
University of Florence, Italy
,
Lexing Xie
Australia National University, Australia
,
Xiao-Yong Wei
Sichuan University, China

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

H2020 LEIT Information and Communication Technologies
Fundação para a Ciência e a Tecnologia

Conference

ICMR '19

Sponsor:

SIGMM

ICMR '19: International Conference on Multimedia Retrieval

June 10 - 13, 2019

Ottawa ON, Canada

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
488
Total Downloads

Downloads (Last 12 months)79
Downloads (Last 6 weeks)6

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Asgari MHurtut T(2024)A Design Language for Prototyping and Storyboarding Data-Driven StoriesApplied Sciences10.3390/app1404138714:4(1387)Online publication date: 8-Feb-2024
https://doi.org/10.3390/app14041387
Barnes S(2023)On the Use of Encapsulation, Parity, and Visual Storytelling in Graphic MedicineHealth Humanities in Application10.1007/978-3-031-08360-0_12(265-286)Online publication date: 23-Feb-2023
https://doi.org/10.1007/978-3-031-08360-0_12
Bartolomeu CNóbrega RSemedo DMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Understanding News Text and Images Connection with Context-enriched Multimodal TransformersProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548430(5821-5832)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548430
Golec JHachaj TSokal G(2021)TIPS: A Framework for Text Summarising with Illustrative PicturesEntropy10.3390/e2312161423:12(1614)Online publication date: 30-Nov-2021
https://doi.org/10.3390/e23121614
Marcelino GSemedo DMourão ABlasi SMagalhães JMrak MShen HZhuang YSmith JYang YCesar PMetze FPrabhakaran B(2021)Assisting News Media Editors with Cohesive Visual StorylinesProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475476(3257-3265)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3474085.3475476
Wang ZLi JJiang Y(2021)Story-driven Video EditingIEEE Transactions on Multimedia10.1109/TMM.2020.303746123(4027-4036)Online publication date: 2021
https://doi.org/10.1109/TMM.2020.3037461
Wang YZannettou SBlackburn JBradlyn BDe Cristofaro EStringhini G(2021)A Multi-Platform Analysis of Political News Discussion and Sharing on Web Communities2021 IEEE International Conference on Big Data (Big Data)10.1109/BigData52589.2021.9671843(1481-1492)Online publication date: 15-Dec-2021
https://doi.org/10.1109/BigData52589.2021.9671843
Mrak MTroncy RLaaksonen J-Tavakoli HNixon LMezaris V(2019)AI Gets CreativeProceedings of the 1st International Workshop on AI for Smart TV Content Production, Access and Delivery10.1145/3347449.3357490(1-2)Online publication date: 21-Oct-2019
https://dl.acm.org/doi/10.1145/3347449.3357490

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents