Designing consistent multimedia documents: the RT-LOTOS methodology
Authors: 
Paulo Nazareno Maia Sampaio, Laura Margarita Rodríguez Peralta, Jean-Pierre CourtiatAuthors Info & Claims
Pages 290 - 303
Abstract
Interactive Multimedia Documents (IMDs) are expected to satisfy temporal consistency properties in order to ensure that their synchronization constraints (temporal, logical and causal) can be respected during their presentation. If an inconsistent situation can not be detected previously, the presentation of the document can be lead to undesirable deadlocks (global or partial). In particular, the flexibility of high level authoring models (such as SMIL 2.0) for the edition of complex IMDs can lead authors, in certain cases, to specify inconsistent documents. For this reason, it is necessary to apply a methodology that provides the formal modelling for the dynamic behavior of the document, consistency checking, and the scheduling of the presentation taking into account the temporal non-determinism of these documents. This paper presents the main results of the development of a formal methodology which is based on the Formal Description Technique RT-LOTOS, and which has been successfully applied to support the design of complex SMIL 2.0 documents.
References
[1]
Courtiat, J.-P., de Oliveira, R.C.: Proving temporal consistency in a new multimedia synchronization model. In: Proc. of ACM Multimedia'96, Boston, USA (November 1996).
[2]
Layaïda, N., Sabry-Ismail, L.: Maintaining Temporal Consistency of Multimedia Documents Using Constraints Networks. In: Proceedings of the 1996 Multimedia Computing and Networking, San-José, USA, pp. 124-135 (February 1996).
[3]
Mirbel, I., Pernici, B., Sellis, T., Tserkezoglou, S., Vazirgiannis, M.: Checking temporal integrity of interactive multimedia documents. VLDB Journal 9(2) (2000).
[4]
Buchanan, M.C., Zellweger, P.T.: Automatic Temporal Layout Mechanisms Revisited. ACM Transactions on Multimedia Computing, Communications and Applications 1(1), 60-88 (2005).
[5]
Bulterman, D.C.A., Hardman, L.: Structured Multimedia Authoring. ACM Transactions on Multimedia Computing, Communications and Applications 1(1), 89-109 (2005).
[6]
Rutledge, L.: SMIL: 2.0 - XML for Web Multimedia. IEEE Internet Computing, pp. 78- 84 (September-October 2001).
[7]
Bulterman, D.C.A.: SMIL: 2.0 - Part 1: Overview, Concepts and Structure. IEEE Multimedia, pp. 82-88 (October- December 2001).
[8]
Tae-Hyun, I., et al.: Simple and Consistent SMIL Authoring: No more editing and no more error. In: IEEE Multimedia Computing on the World Wide Web (2000).
[9]
SMIL 2.0 - Synchronized Multimedia Integrated Language. URL: http://www.w3.org/ AudioVideo/.
[10]
Courtiat, J.P., Santos, C.A.S., Lohr, C., Outtaj, B.: Experience with RT-LOTOS, a temporal extension of the LOTOS formal description technique. In: Computer Communications (July 23, 2000).
[11]
GRiNS-SMIL: 2.0 Player Home Page. URL: http://www.oratrix.com/GRiNS/SMIL2.0/
[12]
RealPlayer - Real Networks (2004), URL: http//www.real.com/player/
[13]
Xsmiles - X-Smiles Home Page (Version 0.5). URL: http://www.x-smiles.org/index.html
[14]
RTL - RT-LOTOS Laboratory. http://www.laas.fr/RT-LOTOS
[15]
Santos, C.A.S., Sampaio, P.N.M., Courtiat, J.-P.: Revisiting the concept of hypermedia documents consistency. In: 7th ACM International Conference on Multimedia (ACM Multimedia'99). Orlando, USA (November 1999) (short paper).
[16]
Lohr, C., Courtiat, J.-P.: From the specification to the scheduling of time-dependent systems. In: Damm, W., Olderog, E.-R. (eds.) FTRTFT 2002. LNCS, vol. 2469, pp. 129-145. Springer, Heidelberg (2002).
[17]
Lohr, C.: Contribution à la conception de systèmes temps-réel s'appuyant sur la technique de description formelle RT-LOTOS. PhD Dissertation (in french), Université Paul Sabatier, Toulouse (December 2002).
[18]
Sampaio, P.: Conception formelle de documents multimédia interactifs: une approche s'appuyant sur RT-LOTOS. PhD Dissertation (in french), Université Paul Sabatier, Toulouse (April 2003).
[19]
JAVA - The Source for JAVA Technologies. URL: http://java.sun.com/.
[20]
JMF - Java Media Framework 2.0 API home page. URL: http://java.sun.com/products/ javamedia/jmf/
[21]
Candan, K.S., Prabhakaran, B., Subrahmanian, V.S.: CHIMP: A Framework for Supporting Distributed Multimedia Document Authoring and Presentation. In: Proc. of the ACM Multimedia, Boston, USA, pp. 329-339 (November 1996).
[22]
Jourdan, M., Ladayia, N., Roisin, C., Sabry-Ismail, L.: An Integrated Authoring and Presentation Environment for Interactive Multimedia Documents. In: Proc. of Int. Conf. on MultiMedia Modeling - MMM'97, World Scientific, Singapore (1997).
[23]
Song, J., Ramalingam, G., Miller, R., Yi, B.: Interactive authoring of multimedia documents in a constraint-based authoring system. Multimedia Systems 7, 424-437 (1999).
[24]
Vazirgiannis, M.: Interactive Multimedia Documents. LNCS, vol. 1564. Springer, Heidelberg (1999).
[25]
Bertino, E., Ferrari, E., Stolf, M., MPGS,: An Interactive Tool for the Specification and Generation of Multimedia Presentations. IEEE Transactions on Knowledge Data Enginering 12(1), 102-125 (2000).
[26]
Huadong, M., Shin, K.G.: Checking Consistency in Multimedia Synchronization Constraints. IEEE Transactions on Multimedia 6(4), 565-574 (2004).
[27]
Yoon, K., Berra, P.B.: TOCPN: Interactive Temporal Model for Interactive Multimedia Documents. In: International Workshop on Multimedia Database Management Systems (IW-MMDBMS'98), Dayton, Ohio, USA (1998).
[28]
Schnepf, J., Konstan, J.A., Du, D.: Doing FLIPS: FLexible Interactive Presentation Synchronization. Distributed Multimedia Center, Department of Computer Sciences, University of Minnesota (1996), ftp://ftp.cs.umn.edu/users/du/papers/flips.ps.
[29]
GRiNSComposer - Oratrix Development BV. SMIL 2.0 Evaluation KIT. Online. Available: http://www2.oratrix.nl/W3C/pressRelease2.
[30]
Buchanan, M.C., Zellweger, P.T.: Automatically generating consistent schedules for multimedia documents. Multimedia System Journal 1(2), 55-67 (1993).
[31]
Wirag, S.: Specification and scheduling of adaptative multimedia documents. In: Technical report TR-1999-04, University of Stuttgart (January 1999).
[32]
Hauser, J.: Realization of an extensible multimedia document model. In: Multimedia '99 - Media Convergence: Models, Technologies and Applications, Wien, pp. 113-122. Springer-Verlag, Heidelberg (1999).
[33]
Huang, C.-M., Lin, C.-H., Wang, C.: Specifying and Executing Interactive Multimedia Presentations using the Formal Approach. proceedings of National Science Council 23(4), 495-510 (1999).
[34]
Riviere, N., Bradin-Chezaviel, B., Valette, R.: Propagation de contraintes et ordonnance-ment de documents multimédias. Rapport LAAS No02044. In: 5ème Journée Doctorales Informatique et Réseaux (JDIR'2002), Toulouse (France), pp. 211-218 (Mars 4-6, 2002).
[35]
Jeong, T., Ham, J.W., Kim, S.J.A: Pre-Scheduling Mechanism for Multimedia Presentation Synchronization. In: proceedings of International Conference on Multimedia Computing and Systems (ICMCS'97), Ottawa, Canada, pp. 379-386 (1997).
[36]
Jourdan, M.A: formal semantics of SMIL: a Web standard to describe multimedia documents. Computer Standards and Interfaces 23, 439-455 (2001).
[37]
Chung, S.M., Pereira, A.L.: Time Petri Net Representation of SMIL. In: IEEE Multimedia, pp. 64-72 (January-March 2005).
[38]
Chefrour, D.: Vérification de la cohérence temporelle des documents multimédia SMIL. Rapport DEA, Université Joseph Fourier, Grenoble, France (June 2001).
Recommendations
An integrated environment for the presentation of consistent SMIL 2.0 documents
DocEng '01: Proceedings of the 2001 ACM Symposium on Document engineeringThe utilization of Interactive Multimedia Documents (IMDs) has been largely addressed in several fields such as education, medicine, etc. since these documents can be distributed and accessed over the World-Wide-Web. In this context, the W3C standard ...
Design of Consistent SMIL Documents for Distributed Multimedia Presentation Using Temporal Algebra
ICPADS '05: Proceedings of the 11th International Conference on Parallel and Distributed Systems - Volume 01We aim to develop an intelligent multimedia presentation system that supports the presence of multiple distributed multimedia objects, as well as human-computer interaction. We develop a temporal algebra system as multimedia synchronization model to ...
Automatically generating consistent schedules for multimedia documents
A schedule for a multimedia document indicates when document events should occur. We describe a two-phase algorithm that automatically produces schedules for interactive multimedia documents, which can contain both predictable behavior (such as audio ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 03 October 2007
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 5Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025