research-article

Interactive 360-degree Videos in Ginga-NCL Using Head-Mounted-Displays as Second Screen Devices

Authors:

Glauco Fiorott Amorim,

Alan L. V. Guedes,

Joel dos SantosAuthors Info & Claims

WebMedia '20: Proceedings of the Brazilian Symposium on Multimedia and the Web

Pages 289 - 296

https://doi.org/10.1145/3428658.3430972

Published: 30 November 2020 Publication History

Get Access

Abstract

The recent availability of HMD devices (Head-Mounted Display) spurred advances in Virtual Reality and Augmented Reality. It allowed scenarios of immersion of users in realistic environments, e.g., synthesized 3D environments for games and simulation, and omnidirectional videos, namely 360° videos. These HMD devices are commonly used in conjunction with home computers or in controlled environments (e.g., museums). However, despite these scenarios, current interactive TV systems still focus on using interactive content in two-dimensional layouts. These systems could use HMDs to provide immersive experiences to viewers. This paper, therefore, presents Guaraná, a player for interactive 360° scenes using HMDs as second screen devices. Guaraná controls a 360 scene execution based on external control from a TV set. Thus, it enables its use in conjunction with an intereactive multimedia application.

References

[1]

ABNT. 2018. Televisão digital terrestre - Codificação de dados e especifições de transmissão para radiodifusão digital Parte 11: Ginga CC WebServices - Especificação de WebServices do Ginga Common Core. ABNT NBR 15606-11:2018 standard.

Google Scholar

[2]

Roberto Gerson De Albuquerque Azevedo and Luiz Fernando Gomes Soares. 2012. Embedding 3D objects into NCL multimedia presentations. In Proceedings of the 17th International Conference on 3D Web Technology. 143--151.

Digital Library

Google Scholar

[3]

Fábio Barreto, Eyre Brasil B. Montevecchi, Raphael Abreu, Joel A. F. dos Santos, and Debora C. Muchaluat-Saade. 2019. Providing multi-user in NCL with userAgent and UserProfile. In Anais Estendidos do XXV Simpósio Brasileiro de Sistemas Multimídia e Web. SBC, Porto Alegre, RS, Brasil, 205--206. https://doi.org/10.5753/webmedia_estendido.2019.8168

Crossref

Google Scholar

[4]

Carlos Eduardo CF Batista, Luiz Fernando Gomes Soares, and Guido Lemos de Souza Filho. 2010. Estendendo o uso das classes de dispositivos Ginga-NCL. In Anais Principais do XVI Simpósio Brasileiro de Sistemas Multimídia e Web. SBC, 27--34.

Google Scholar

[5]

Robert Battle and Edward Benson. 2008. Bridging the semantic Web and Web 2.0 with representational state transfer (REST). Journal of Web Semantics 6, 1 (2008), 61--69.

Digital Library

Google Scholar

[6]

Pablo Cesar, Ishan Vaishnavi, Ralf Kernchen, Stefan Meissner, Cristian Hesselman, Matthieu Boussard, Antonietta Spedalieri, Dick C.A. Bulterman, and Bo Gao. 2008. Multimedia Adaptation in Ubiquitous Environments: Benefits of Structured Multimedia Documents. In Proceedings of the Eighth ACM Symposium on Document Engineering. ACM, New York, NY, USA, 275--284. https://doi.org/10.1145/1410140.1410201

Digital Library

Google Scholar

[7]

R. G. d. A. Azevedo, N. Birkbeck, F. De Simone, I. Janatra, B. Adsumilli, and P. Frossard. 2019. Visual Distortions in 360-degree Videos. IEEE Transactions on Circuits and Systems for Video Technology (2019), 1--1.

Google Scholar

[8]

Douglas Paulo de Mattos and Débora C. Muchaluat-Saade. 2018. STEVE: A Hypermedia Authoring Tool Based on the Simple Interactive Multimedia Model. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3209280.3209521

Crossref

Google Scholar

[9]

Gheorghita Ghinea, Christian Timmerer, Weisi Lin, and Stephen R Gulliver. 2014. Mulsemedia: State of the art, perspectives, and challenges. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 11, 1s (2014), 17.

Digital Library

Google Scholar

[10]

Álan L. V. Guedes, Roberto G. de A. Azevedo, Sérgio Colcher, and Simone D. J. Barbosa. 2019. Modeling Multimodal-Multiuser Interactions in Declarative Multimedia Languages. In Proceedings of the ACM Symposium on Document Engineering 2019 (DocEng '19). Association for Computing Machinery, New York, NY, USA, Article 11, 10 pages. https://doi.org/10.1145/3342558.3345400

Crossref

Google Scholar

[11]

Francisco Pedro Luque, Iris Galloso, Claudio Feijoo, Carlos Alberto Martín, and Guillermo Cisneros. 2014. Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System. ACM Trans. Multimedia Comput. Commun. Appl. 11, 1s, Article 16 (Oct. 2014), 22 pages. https://doi.org/10.1145/2617992

Digital Library

Google Scholar

[12]

P. R. C. Mendes, Á. L. V. Guedes, D. d. S. Moraes, R. G. A. Azevedo, and S. Colcher. 2020. An Authoring Model for Interactive 360 Videos. In 2020 IEEE International Conference on Multimedia Expo Workshops (ICMEW). 1--6. https://doi.org/10.1109/ICMEW46912.2020.9105958

Crossref

Google Scholar

[13]

M. Moreno, D.M. Saade, G.S Lemos, R. Kuleza, and A.L.V. Guedes. 2020. A Brief Overview about D-Profile of Ginga DTV Receivers. In 2020 Interactive Media Experiences. Workshop IMX in Latin America. 1--6. https://sites.google.com/ice.ufjf.br/imxlatam

Google Scholar

[14]

Luiz Fernando Gomes Soares. 2009. Nested Context Language 3.0 part 12-support to multiple exhibition devices. Technical Report. Technical Report. Departamento de Informática da PUC-Rio, MCC 03/09.

Google Scholar

Cited By

View all

dos Santos JVieira RJosué MSá Oliveira KMuchaluat Saade D(2024)Multidevice Support in the Next Generation of the Brazilian Terrestrial TV SystemProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672412(34-38)Online publication date: 12-Jun-2024
https://dl.acm.org/doi/10.1145/3672406.3672412
da Silva Klehm Vde Souza Braga Rde Lucena V(2022)A Survey of Digital Television Interactivity TechnologiesSensors10.3390/s2217654222:17(6542)Online publication date: 30-Aug-2022
https://doi.org/10.3390/s22176542

Index Terms

Interactive 360-degree Videos in Ginga-NCL Using Head-Mounted-Displays as Second Screen Devices
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Virtual worlds software

Recommendations

Natural Perspective Projections for Head-Mounted Displays

The display units integrated in today's head-mounted displays (HMDs) provide only a limited field of view (FOV) to the virtual world. In order to present an undistorted view to the virtual environment (VE), the perspective projection used to render the ...
Estimation of virtual interpupillary distances for immersive head-mounted displays
APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization

Head-mounted displays (HMDs) allow users to observe virtual environments (VEs) from an egocentric perspective. In order to present a realistic stereoscopic view, the rendering system has to be adjusted to the characteristics of the HMD, e. g., the ...
A comparison of head-mounted displays vs. large-screen displays for an interactive pedestrian simulator
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

This investigation compared how people performed a complex perception-action task - crossing traffic-filled roadways - in a CAVE vs. an HMD virtual environment. Participants physically crossed a virtual roadway with continuous cross traffic in either a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

WebMedia '20: Proceedings of the Brazilian Symposium on Multimedia and the Web

November 2020

364 pages

ISBN:9781450381963

DOI:10.1145/3428658

General Chair:
Carlos de Salles Soares Neto
UFMA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SBC: Brazilian Computer Society
CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
CGIBR: Comite Gestor da Internet no Brazil
CAPES: Brazilian Higher Education Funding Council

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
Conselho Nacional de Desenvolvimento Científico e Tecnológico

Conference

WebMedia '20

Sponsor:

WebMedia '20: Brazillian Symposium on Multimedia and the Web

November 30 - December 4, 2020

São Luís, Brazil

Acceptance Rates

WebMedia '20 Paper Acceptance Rate 34 of 87 submissions, 39%;

Overall Acceptance Rate 270 of 873 submissions, 31%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
73
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

dos Santos JVieira RJosué MSá Oliveira KMuchaluat Saade D(2024)Multidevice Support in the Next Generation of the Brazilian Terrestrial TV SystemProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672412(34-38)Online publication date: 12-Jun-2024
https://dl.acm.org/doi/10.1145/3672406.3672412
da Silva Klehm Vde Souza Braga Rde Lucena V(2022)A Survey of Digital Television Interactivity TechnologiesSensors10.3390/s2217654222:17(6542)Online publication date: 30-Aug-2022
https://doi.org/10.3390/s22176542

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Natural Perspective Projections for Head-Mounted Displays

Estimation of virtual interpupillary distances for immersive head-mounted displays

A comparison of head-mounted displays vs. large-screen displays for an interactive pedestrian simulator