[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3581783.3613761acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

MetaCast: A Self-Driven Metaverse Announcer Architecture Based on Quality of Experience Evaluation Model

Published: 27 October 2023 Publication History

Abstract

Metaverse provides users with a novel experience through immersive multimedia technologies. Along with the rapid user growth, numerous events bursting in the metaverse necessitate an announcer to help catch and monitor ongoing events. However, systems on the market primarily serve for esports competitions and rely on human directors, making it challenging to provide 24-hour delivery in the metaverse persistent world. To fill the blank, we proposed a three-stage architecture for metaverse announcers, which is designed to identify events, position cameras, and blend between shots. Based on the architecture, we introduced a Metaverse Announcer User Experience (MAUE) model to identify the factors affecting the users' Quality of Experience (QoE) from a human-centered perspective. In addition, we implemented MetaCast, a practical self-driven metaverse announcer in a university campus metaverse prototype, to conduct user studies for MAUE model. The experimental results have effectively achieved satisfactory announcer settings that align with the preferences of most users, encompassing parameters such as video transition rate, repetition rate, importance threshold value, and image composition.

Supplemental Material

MP4 File
Presentation video

References

[1]
D. Arijon. 1991. Grammar of the Film Language. Silman-James Press. https: //books.google.com.tw/books?id=6bQlAQAAIAAJ
[2]
William H Bares, Joël P Grégoire, and James C Lester. 1998. Realtime constraint-based cinematography for complex interactive 3d worlds. In AAAI/IAAI. 1101--1106.
[3]
Wei Cai, Zehua Wang, Jason B. Ernst, Zhen Hong, Chen Feng, and Victor C.M. Leung. 2018. Decentralized Applications: The Blockchain-Empowered Software System. IEEE Access 6 (17 September 2018), 53019--53033. https://doi.org/10. 1109/ACCESS.2018.2870644
[4]
Hongzhou Chen and Wei Cai. 2023. How Information Manipulation on Social Media Influences the NFT Investors' Behavior: A Case Study of Goblintown. Wtf. IEEE Transactions on Computational Social Systems (2023).
[5]
David B Christianson, Sean E Anderson, Li-wei He, David H Salesin, Daniel S Weld, and Michael F Cohen. 1996. Declarative camera control for automatic cinematography. In AAAI/IAAI, Vol. 1. 148--155.
[6]
Edirlei E. S. de Lima, Cesar T. Pozzer, Marcos C. d'Ornellas, Angelo E. M. Ciarlini, Bruno Feijó, and Antonio L. Furtado. 2009. Virtual Cinematography Director for Interactive Storytelling. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE '09). 263--270. https: //doi.org/10.1145/1690388.1690432
[7]
Alexandre De Masi and Katarzyna Wac. 2022. Less annoying: quality of experience of commonly used mobile applications. In Proceedings of the 13th ACM multimedia systems conference. 86--95.
[8]
Hongyang Du, Bohao Ma, Dusit Niyato, and Jiawen Kang. 2022. Rethinking quality of experience for metaverse services: A consumer-based economics perspective. arXiv preprint arXiv:2208.01076 (2022).
[9]
Haihan Duan, Yiwei Huang, Yifan Zhao, Zhen Huang, and Wei Cai. 2022. User-generated content and editors in video games: Survey and vision. In 2022 IEEE conference on games (CoG). IEEE, 536--543.
[10]
Haihan Duan, Jiaye Li, Sizheng Fan, Zhonghao Lin, Xiao Wu, and Wei Cai. 2021. Metaverse for Social Good: A University Campus Prototype. In Proceedings of the 29th ACM International Conference on Multimedia (Virtual Event, China) (MM '21). Association for Computing Machinery, New York, NY, USA, 153--161. https://doi.org/10.1145/3474085.3479238
[11]
Haihan Duan, Zhonghao Lin, Xiao Wu, and Wei Cai. 2023. MetaCube: A Crypto-Based Unique User-Generated Content Editor for Web3 Metaverse. IEEE Communications Magazine (2023).
[12]
Haihan Duan, Xiao Wu, and Wei Cai. 2022. Crypto-dropout: To create unique user-generated content using crypto information in metaverse. In 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP). IEEE, 1--6.
[13]
Ahmad Zainul Fanani, Supeno Mardi Susiki Nugroho, and Mochamad Hariadi. 2016. Virtual Camera Control Based on Cinematographic Rules of Camera Shot and Camera Angle. International Review on Computers and Software (IRECOS) Vol 11 (2016).
[14]
Quentin Galvane, Marc Christie, Rémi Ronfard, Chen-Kim Lim, and Marie-Paule Cani. 2013. Steering behaviors for autonomous cameras. In Proceedings of motion on games. 93--102.
[15]
Quentin Galvane, Rémi Ronfard, Marc Christie, and Nicolas Szilas. 2014. Narrative-driven camera control for cinematic replay of computer games. In Proceedings of the Seventh International Conference on motion in games. 109--117.
[16]
Alex Hall, Amy Pavel, Alyosha Efros, and Maneesh Agrawala. [n.d.]. A-tool-for-computational-analysis-of-Narrative-Film. https://www2.eecs.berkeley.edu/ Pubs/TechRpts/2018/EECS-2018--102.pdf
[17]
Nicolas Halper, Ralf Helbing, and Thomas Strothotte. 2001. A camera engine for computer games: Managing the trade-off between constraint satisfaction and frame coherence. In Computer Graphics Forum, Vol. 20. Wiley Online Library, 174--183.
[18]
Feilin Han, Ying Zhong, and Minxi Zhou. 2022. Evaluating the Effect of Cine-matography on the Viewing Experience in Immersive Environment. In 2022 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.
[19]
Li-wei He, Michael F Cohen, and David H Salesin. 1996. The virtual cinematog-rapher: A paradigm for automatic real-time camera control and directing. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 217--224.
[20]
Timothy Heiderich. [n.d.]. Cinematography Techniques: The Different Types of Shots in Film.
[21]
Hyun-joo Jeon, Ho-chang Youn, Sang-mi Ko, and Tae-heon Kim. 2022. Blockchain and AI Meet in the Metaverse. Advances in the Convergence of Blockchain and Artificial Intelligence 73 (2022).
[22]
George V Kachkovski, Daniil Vasilyev, Michael Kuk, Alan Kingstone, and Chris NH Street. 2019. Exploring the effects of violating the 180-degree rule on film viewing preferences. Communication Research 46, 7 (2019), 948--964.
[23]
Kaveh Kardan and Henri Casanova. 2008. Virtual cinematography of group scenes using hierarchical lines of actions. In Proceedings of the 2008 ACM SIGGRAPH symposium on Video games. 171--178.
[24]
James Kneafsey. 2005. Camerabots: Cinematography for games with non-player characters as camera operators. (2005).
[25]
Yana Knight, Héctor P Martínez, and Georgios N Yannakakis. 2013. Space maze: Experience-driven game camera control. (2013).
[26]
Michael Koliska and Klive (Soo-Kwang) Oh. 2021. Guided by the Grid: Raising Attention with the Rule of Thirds. Journalism Practice 0, 0 (2021), 1--20. https://doi.org/10.1080/17512786.2021.1916402 arXiv:https://doi.org/10.1080/17512786.2021.1916402
[27]
Jiaye Li, Minghao Li, Zikai Alex Wen, and Wei Cai. 2022. Understanding the Challenges of Team-Based Live Streaming for First-person Shooter Games. In 2022 IEEE Games, Entertainment, Media Conference (GEM). 1--6. https://doi.org/ 10.1109/GEM56474.2022.10017960
[28]
Zhonghao Lin, Haihan Duan, Zikai Alex Wen, and Wei Cai. 2022. What Features Influence Impact Feel? A Study of Impact Feedback in Action Games. In 2022 IEEE Games, Entertainment, Media Conference (GEM). 1--6. https://doi.org/10. 1109/GEM56474.2022.10017782
[29]
Christophe Lino and Marc Christie. 2015. Intuitive and efficient camera control with the toric space. ACM Transactions on Graphics (TOG) 34, 4 (2015), 1--12.
[30]
Hugh McCabe and James Kneafsey. 2006. A virtual cinematography system for first person shooter games. In Proceedings of International Digital Games Conference, Vol. 35.
[31]
Thomas Oskam, Robert W Sumner, Nils Thuerey, and Markus Gross. 2009. Visibility transition planning for dynamic camera control. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 55--65.
[32]
Simone Porcu, Alessandro Floris, and Luigi Atzori. 2022. Quality of Experience in the Metaverse: An Initial Analysis on Quality Dimensions and Assessment. In 2022 14th International Conference on Quality of Multimedia Experience (QoMEX). 1--4. https://doi.org/10.1109/QoMEX55416.2022.9900897
[33]
Rémi Ronfard, Gandhi Vineet, and Laurent Boiron. 2013. The prose storyboard language. In AAAI Workshop on Intelligent Cinematography and Editing, Vol. 3.
[34]
Débora Pereira Salgado, Ronan Flynn, Eduardo Lázaro Martins Naves, and Niall Murray. 2022. A questionnaire-based and physiology-inspired quality of experience evaluation of an immersive multisensory wheelchair simulator. In Proceedings of the 13th ACM Multimedia Systems Conference. 1--11.
[35]
Raimund Schatz, Sebastian Egger, and Alexander Platzer. 2011. Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services. In 2011 IEEE International Conference on Communications (ICC). 1--6. https://doi.org/10.1109/icc.2011.5963220
[36]
Raimund Schatz, Andreas Sackl, Christian Timmerer, and Bruno Gardlo. 2017. Towards subjective quality of experience assessment for omnidirectional video streaming. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). 1--6. https://doi.org/10.1109/QoMEX.2017.7965657
[37]
Arthur A Stone and Saul Shiffman. 1994. Ecological momentary assessment (EMA) in behavorial medicine. Annals of behavioral medicine (1994).
[38]
Laurie N. Taylor. 2002. VIDEO GAMES: PERSPECTIVE, POINT-OF-VIEW, AND IMMERSION. https://api.semanticscholar.org/CorpusID:2603188
[39]
Lin Wang, Zhonghao Lin, and Wei Cai. 2021. Heraclitus's Forest: An Interactive Artwork for Oral History. In Proceedings of the 29th ACM International Conference on Multimedia. 1452--1453.
[40]
Shaoxuan Wang and Sujit Dey. 2009. Modeling and Characterizing User Experience in a Cloud Server Based Mobile Gaming Approach. In GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference. 1--7. https://doi.org/10.1109/ GLOCOM.2009.5425784
[41]
Max Watson et al. 2015. A medley of meanings: Insights from an instance of gameplay in League of Legends. Journal of Comparative Research in Anthropology and Sociology 6, 01 (2015), 225--243.

Cited By

View all
  • (2024)Immersion In Metaverse Event Experience: A Grounded TheorySportive10.53025/sportive.15265927:2(288-307)Online publication date: 5-Oct-2024

Index Terms

  1. MetaCast: A Self-Driven Metaverse Announcer Architecture Based on Quality of Experience Evaluation Model

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        MM '23: Proceedings of the 31st ACM International Conference on Multimedia
        October 2023
        9913 pages
        ISBN:9798400701085
        DOI:10.1145/3581783
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 27 October 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. announcer
        2. human-centered computing
        3. metaverse
        4. quality of experience
        5. virtual cinematography

        Qualifiers

        • Research-article

        Funding Sources

        • Shenzhen Science and Technology Program

        Conference

        MM '23
        Sponsor:
        MM '23: The 31st ACM International Conference on Multimedia
        October 29 - November 3, 2023
        Ottawa ON, Canada

        Acceptance Rates

        Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)79
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 11 Dec 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Immersion In Metaverse Event Experience: A Grounded TheorySportive10.53025/sportive.15265927:2(288-307)Online publication date: 5-Oct-2024

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media