More Web Proxy on the site http://driver.im/

research-article

Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications

Authors:

Débora Muchaluat-Saade,

Marcelo MorenoAuthors Info & Claims

WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the Web

Pages 45 - 52

https://doi.org/10.1145/3243082.3243098

Published: 16 October 2018 Publication History

Abstract

Nowadays multimedia applications are employed in different fields as entertainment, education, government services, health and e-commerce. Moreover, some applications incorporate sensory effects along with traditional multimedia content, stimulating other human senses beyond sight and hearing to convey information. Those applications are called mulsemedia applications, where the maintenance of synchronization among media objects and sensory effects is a key point for user quality of experience. In order to minimize delays or failures on content reproduction, this paper proposes a new operation on media objects and sensory effects that can be offered to authors of mulsemedia applications. This operation enables the preparation of media object presentation or the preparation of sensory effect rendering, considering device limitations on which the application will be executed. As proof of concept, our proposal is implemented on multimedia applications using the NCL language, through specification of a new NCL event type, named preparation event. Furthermore, a new NCL media property is presented, allowing the control of continuous media reproduction. Finally, three use cases are defined to demonstrate the use of the preparation event in multimedia and mulsemedia applications.

References

[1]

Zhong Su, Qiang Yang, and Hong-Jiang Zhang. A prediction system for multimedia pre-fetching in internet. In Proceedings of the eighth ACM international conference on Multimedia, pages 3--11. ACM, 2000.

Digital Library

[2]

B. D. Davison. Predicting web actions from html content. In Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, pages 159--168. ACM, 2002.

Digital Library

[3]

R. F. Rodrigues and L. F. G. Soares. A framework for prefetching mechanisms in hypermedia presentations. In Multimedia Software Engineering, 2002. Proceedings. Fourth International Symposium on, pages 278--285. IEEE, 2002.

Digital Library

[4]

A. M. Figueroa. Pré-busca de conteúdo em apresentações multimídia, Março 2014.

[5]

E. B. Saleme and C. A. S. Santos. Playsem: a platform for rendering mulsemedia compatible with mpeg-v. In Proceedings of the 21st Brazilian Symposium on Multimedia and the Web - WebMedia'15, pages 145--148. ACM, 2015.

Digital Library

[6]

G. Ghinea, C. Timmerer, W. Lin, and S. R. Gulliver. Mulsemedia: State of the art, perspectives, and challenges. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 11:17, 2014.

Digital Library

[7]

J. Kim, C.G. Lee, Y. Kim, and J. Ryu. Construction of a haptic-enabled broadcasting system based on the mpeg-v standard. Signal Processing: Image Communication, 28(2):151--161, 2013.

Digital Library

[8]

M. Waltl, C. Timmerer, and H. Hellwagner. Improving the quality of multimedia experience through sensory effects. In Quality of Multimedia Experience (QoMEX), 2010 Second International Workshop on, pages 124--129. IEEE, 2010.

[9]

M. F. de Sousa, R. Kulesza, and C. A. G. Ferraz. A model-driven approach for mulsemedia application domain. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web - WebMedia'16, pages 111--118. ACM, 2016.

Digital Library

[10]

M. F. de Sousa, C. A. G. Ferraz, R. Kulesza, I. Ayres, and M. Lima. Mulsemaker: An mdd tool for mulsemedia web application development. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web, pages 317--324. ACM, 2017.

Digital Library

[11]

M. Josue, R. Abreu, F. Barreto, D. P. Mattos, G. Amorim, J. A. F. Dos Santos, and D. C. Muchaluat-Saade. Modeling sensory effects as first-class entities in multimedia applications. In ACM Multimedia Systems Conference, 2018, Amsterdam. MMSys 2018, pages 1--12. ACM, 2018.

Digital Library

[12]

Z. Yuan, T. Bi, G.M. Muntean, and G. Ghinea. Perceived synchronization of mulsemedia services. IEEE Transactions on Multimedia, 17(7):957--966, 2015.

Digital Library

[13]

ITU-Recommendation. Nested context language (ncl) and ginga-ncl for iptv services. April 2009.

[14]

W3C. Html audio/video dom currenttime property, 2018. https://www.w3schools.com/tags/av_prop_currenttime.asp.

[15]

L. F. G. Soares, M. F. Moreno, C. S. S. Neto, and M. F. Moreno. Ginga-ncl: declarative middleware for multimedia iptv services. IEEE Communications Magazine, 48(6):74--81, 2010.

Digital Library

[16]

Britta Meixner and Christoph Einsiedler. Download and cache management for html5 hypervideo players. In Proceedings of the 27th ACM Conference on Hypertext and Social Media, pages 125--136. ACM, 2016.

Digital Library

[17]

W3C. Html5, 2018. https://www.w3schools.com/.

[18]

W3C. Media source extensions. w3c recommendation 17 november 2016, 2016. https://www.w3.org/TR/media-source/.

[19]

Mozilla Firefox. https://www.mozilla.org/pt-br/firefox, 2018.

[20]

Google Chrome. https://www.google.com.br/chrome/, 2018.

[21]

Internet Explorer. https://www.microsoft.com/pt-br/download/internet-explorer.aspx, 2018.

[22]

D. Fisher et al. Link prefetching faq, {online}, 2014. Disponível em: https://developer.mozilla.org/en-US/docs/Web/HTTP/Link_prefetching_FAQ.

[23]

K. Yoon. End-to-end framework for 4-d broadcasting based on mpeg-v standard. Signal Processing: Image Communication, 28(2):127--135, 2013.

Digital Library

[24]

B. Choi, E.S. Lee, and K. Yoon. Streaming media with sensory effect. In Information Science and Applications (ICISA), 2011 International Conference on, pages 1--6. IEEE, 2011.

[25]

Information technology -- Media context and control -- Part 3: Sensory information, 2011.

[26]

Real Time Transport Protocol and User Datagram Protocol. Mpeg-2 ts.

[27]

Roberto Ierusalimschy. Programming in lua. R. Ierusalimschy, 2006.

[28]

ISO/IEC. Information technology - media context and control - part 6: Common types and tools. Technical report, International Organization for Standardization 23005-6., 2013.

Cited By

Moreno MPeters Nde Almeida PPernisa C(2023)Towards a representation model and fog-based device orchestration for audio-centric pervasive storytelling2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335450(1-10)Online publication date: 26-Oct-2023
https://doi.org/10.1109/IEEECONF59510.2023.10335450
Almeida PPernisa Jr CMoreno M(2022)Representation model and cloud-based orchestrator for pervasive storytellingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3558047(339-347)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3558047
Rodrigues Rda Silva Jr. JBrandão Ddos Santos J(2022)An Approach for Sensory Effects Dispersion Simulation with Computational Fluid DynamicsProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3556999(368-376)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3556999
Show More Cited By

Index Terms

Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia content creation

Recommendations

Modeling sensory effects as first-class entities in multimedia applications
MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference

Multimedia applications are usually composed by audiovisual content. Traditional multimedia conceptual models, and consequently declarative multimedia authoring languages, do not support the definition of multiple sensory effects. Multiple sensorial ...
Mulsemedia preparation: a new event type for preparing media object presentation and sensory effect rendering
MMSys '19: Proceedings of the 10th ACM Multimedia Systems Conference

In multimedia applications, a short delay in content delivery may cause synchronization failures among media objects, decreasing the presentation quality and user quality of experience. Moreover, some applications incorporate sensory effects to ...
Automatic preparation of media objects in multimedia applications
WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web

In multimedia applications, spatiotemporal relationships among media objects should be controlled during the execution phase in order to preserve the quality of presentation. When the content that composes the application is delivered over a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the Web

October 2018

437 pages

ISBN:9781450358675

DOI:10.1145/3243082

General Chairs:
Manoel Carvalho Marques Neto
IFBA
,
Renato Lima Novais
IFBA
,
Carlos Ferraz
UFPE
,
Windson Viana
UFC

Copyright © 2018 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
SBC: Brazilian Computer Society
SIGMM: ACM Special Interest Group on Multimedia
CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
CGIBR: Comite Gestor da Internet no Brazil
CAPES: Brazilian Higher Education Funding Council

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WebMedia '18

WebMedia '18: Brazilian Symposium on Multimedia and the Web

October 16 - 19, 2018

BA, Salvador, Brazil

Acceptance Rates

WebMedia '18 Paper Acceptance Rate 37 of 111 submissions, 33%;

Overall Acceptance Rate 270 of 873 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
77
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Moreno MPeters Nde Almeida PPernisa C(2023)Towards a representation model and fog-based device orchestration for audio-centric pervasive storytelling2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335450(1-10)Online publication date: 26-Oct-2023
https://doi.org/10.1109/IEEECONF59510.2023.10335450
Almeida PPernisa Jr CMoreno M(2022)Representation model and cloud-based orchestrator for pervasive storytellingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3558047(339-347)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3558047
Rodrigues Rda Silva Jr. JBrandão Ddos Santos J(2022)An Approach for Sensory Effects Dispersion Simulation with Computational Fluid DynamicsProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3556999(368-376)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3556999
Josue MMoreno MMuchaluat-Saade D(2022)Supporting Targeted Advertising in Integrated Broadcast-Broadband Systems With Automatic Media Content PreparationIEEE Access10.1109/ACCESS.2022.322636710(126845-126857)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3226367
Ivanov MMoreno MMuchaluat-Saade Ddos Santos JMuchaluat Saade Dda Graça C. Pimentel MMacedo A(2019)Automatic preparation of media objects in multimedia applicationsProceedings of the 25th Brazillian Symposium on Multimedia and the Web10.1145/3323503.3360617(289-296)Online publication date: 29-Oct-2019
https://dl.acm.org/doi/10.1145/3323503.3360617
Rodrigues RJosué MAbreu RAmorim GMuchaluat-Saade DSantos Jdos Santos JMuchaluat Saade Dda Graça C. Pimentel MMacedo A(2019)A proposal for supporting sensory effect rendering in ginga-NCLProceedings of the 25th Brazillian Symposium on Multimedia and the Web10.1145/3323503.3349544(273-280)Online publication date: 29-Oct-2019
https://dl.acm.org/doi/10.1145/3323503.3349544

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents