JP3558052B2 - Multimedia execution system, multimedia file execution method, and multimedia file structure readable by sequencer - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a multimedia execution system that handles various types of multimedia information such as sounds, images, texts, and the like.
[0002]
[Prior art]
For example, there is software for browsing contents on the Internet (hereinafter referred to as a browser) as one that handles multimedia information in a centralized manner from the viewpoint of a user. By operating this browser on the personal computer screen, the user can handle multimedia information such as sound, image, text, etc. on one screen. Normally, each piece of information is stored in a location defined by a different path in the server, and the browser takes out each piece of information individually and reproduces it on one screen. All such information on the Internet can be handled in HTML (Hyper Text Markup Language) language, and the browser outputs the information by interpreting the HTML language.
[0003]
Further, software that is described in a language different from the HTML language and reproduces sounds and images (especially moving images) in synchronization with each other has been put to practical use on the Internet. The file structure handled by this software integrates sound information and image information, and can be handled as one file.
[0004]
[Problems to be solved by the invention]
However, multimedia information that can be described in the HTML language simply reproduces information stored in a specific location by statically reading out the information, and dynamically reproduces the information synchronously. It does not do. For this reason, it is impossible to delicately control the content of the content, and in particular, to reproduce an image or a sound in perfect synchronization with time.
[0005]
Further, in the conventional apparatus which handles sound information and image information in one file format, since each information is reproduced completely independently from the beginning, jumping in the middle and fine synchronization between information are not performed. There was an inconvenience that could not be taken.
[0006]
SUMMARY OF THE INVENTION An object of the present invention is to provide a multimedia execution system which makes handling of multimedia information extremely easy and enables fine synchronization control between pieces of information.
[0007]
[Means for Solving the Problems]
The present invention is configured as follows in order to solve the above-mentioned problem.
[0008]
(1) A performance sequence track in which performance sequence information is stored, a drawing sequence track in which drawing sequence information is stored, and a sequence operation of each sequence track. At any position Synchronization information of each sequence track for performing control in the time axis direction such as stop, branch, and repetition is stored. Master track And a multimedia file storage unit incorporating the same in the same file,
A sequencer that controls the sequence operation of the multimedia file and the sequence operation based on the synchronization information,
A storage unit of an application program that communicates with the sequencer and performs execution control such as execution start and stop of a multimedia file by receiving information of control of a sequence operation based on the synchronization information,
A program execution unit that executes the application program,
Each of the performance sequence track, the drawing sequence track, and the master track incorporated in the multimedia file in the storage unit is configured by a combination of an event and a duration that specifies a time interval between the events. .
In the multimedia file used in the system of the present invention, synchronization information of each sequence track is recorded together with a plurality of sequence tracks in which a plurality of types of information are recorded. Master track Are included in the same file. this The master track is , A sequence track of the same type as each of the above-mentioned sequence tracks. The plurality of types of information include performance sequence information and drawing sequence information, and can also include audio sequence information. The performance sequence information is usually MIDI or sequence information corresponding to MIDI, and the drawing sequence information can include a text, a binary image, and an arbitrary image. The audio sequence information can be composed of ADPCM (Adaptive Differential Pulse Code Modulation) data. Further, it can be composed of compressed audio data such as TwinVQ (trademark) or MP3.
[0009]
In the multimedia execution system according to the present invention, a storage unit that stores the multimedia file, a sequencer that executes a sequence operation of the multimedia file, and communication start and stop of the multimedia file by communicating with the sequencer. And a program execution unit that executes the application program. As a result, during the sequence operation, the synchronization between the information of each sequence track is obtained by the synchronization information. Therefore, it is possible to finely set the synchronization of the information between the sequence tracks by the description method of the synchronization information. Further, the communication between the sequencer and the application program allows the application program to know the information when the sequence operation is controlled by the synchronization information. Thereby, it becomes possible for the application program to perform various controls related to the synchronization information.
[0010]
(2) The multimedia file is Said It has a master track, and the sequence operation of each sequence track is used as synchronization information. At any position It is characterized by storing control information in the time axis direction such as stop, branch, and repetition.
[0011]
By providing a master track that performs the same sequence operation as each sequence track as the synchronization information storage unit that stores the synchronization information, the description of the synchronization information is facilitated. In addition, by storing control information in the time axis direction such as stopping, branching, and repetition of the sequence operation of each sequence track as synchronization information, arbitrary control can be performed while communicating with the application program during the sequence operation. Becomes possible. For example, if control information for stopping the sequence operation is stored as the synchronization information, it is possible for the application program to perform data input by the user and to transmit / request specific data to the server at this timing. become. This makes it possible to control the sequence operation based on a user input or information from the server during the sequence operation. For example, when information for stopping the sequence operation is stored as the synchronization information, a branch destination can be designated by a user input when the timing comes. Further, when commercial information is recorded on the drawing sequence track, when stop information of the sequence operation is recorded as synchronization information at the timing when the commercial ends, the server can be notified that the commercial has ended. become.
[0012]
(3) The drawing sequence track is configured by describing a display event that specifies a display object and a duration that specifies a time interval between the display events, and the display event uses a plurality of coordinate expression formats of the display object. It can be specified.
[0013]
According to the multimedia file of the present invention, in the drawing sequence track, the coordinate expression format of the display object defined in the display event can be specified from a plurality of coordinate expression formats. Therefore, it is possible to specify an optimum display position for the display device used at that time. If the display format includes at least a layout information specification format that specifies the display position in proportion based on the screen size and the size of the display object, the scale of the display object is automatically determined according to the screen size. You.
[0014]
As described above, by allowing the display event to specify a plurality of coordinate expression formats of the display object, it is possible to specify the optimum display position for the display device used at that time. Thereby, the distribution range of multimedia files (contents) can be expanded.
[0015]
(4) The display event includes a primary block describing display object definition information including a type of a display object, and an auxiliary description describing display modification sequence information for dynamically adding display modification to the content represented by the primary block. And the display modification sequence information includes one or more display modification sequence information arbitrarily selected from a plurality of display modification sequence information that do not affect each other.
According to the present invention, a primary event that defines basic information of a display object and an auxiliary block that includes display modification sequence information for dynamically modifying the content represented by the primary block are described in a display event. It is possible. In this case, since the display modification sequence information is information that does not affect each other, it is possible to easily combine optimal display modification sequence information according to the movement of the display object. If each display modification sequence information is set as information of a simple function expression, a complicated movement of display contents can be easily provided by a combination of simple function expressions. This also facilitates content creation.
[0016]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a hardware configuration diagram of a multimedia execution system according to an embodiment of the present invention. It should be noted that as long as each component as shown in FIG. 1 is provided, various types of hardware including a computer terminal, a mobile terminal, and a mobile phone can be used as hardware of the multimedia execution system.
[0017]
The execution control unit 1 includes a CPU, a ROM, a RAM, and the like, and executes a sequencer (program) and an application program, and controls input / output. A sequencer (program) storage unit 2, an application (program) storage unit 3, and a storage unit 4 storing multimedia files are connected to the execution control unit 1. As will be described later, the multimedia file is a file in which a performance sequence track, a drawing sequence track, an audio sequence track, a master track, and a content information storage unit are incorporated in the same file. It is called a SMAF (Synthetic Music Mobile Application Format) file. The storage unit 4 stores the first to nth SMAF files, and any one of the SMAF files is selected according to input information from the application storage unit 3 or a user.
[0018]
A sound source device 5, a display device 6, and an audio device 7 are connected to the execution control unit 1.
[0019]
Performance sequence information in the SMAF file is input to the tone generator 5, where it is converted into a performance signal. The performance sequence information is MIDI sequence information in the present embodiment, and a MIDI sound source device is used as the sound source device 5.
[0020]
The drawing sequence information in the SMAF file is input to the display device 6. The drawing sequence information is any one of text, binary image, and arbitrary image sequence information as described later, and the display device 6 converts the information into an image signal.
[0021]
The audio device 7 receives the audio sequence information in the SMAF file and converts it into an audio signal. In this embodiment, the audio sequence information is ADPCM information, and the audio device 7 converts the ADPCM information into an analog audio signal.
[0022]
The musical sound / speech output unit 8 outputs the combined output of the sound source device 5 and the audio device 7 from the speaker 8a. The monitor 9 displays an image output from the display device 6 on a display screen.
[0023]
An input unit 10 and a communication unit 11 are further connected to the execution control unit 1. An operation unit 12 including a keyboard, a mouse, and the like is connected to the input unit 10, and the communication unit 11 is connected to a server (not shown) by a wired or wireless communication network such as a computer network such as the Internet or a public line network. ing.
[0024]
FIG. 2 is a configuration diagram of software of the multimedia execution system.
[0025]
Reference numeral 20 denotes a SMAF file. The SMAF file 20 includes a content information storage unit 21, a performance sequence track 22, a drawing sequence track 23, an audio sequence track 24, and a master track 25, and these are integrated into one file.
[0026]
The content information storage unit 21 stores information on the contents of the entire SMAF file 20. The performance sequence track 22 stores performance sequence information, the drawing sequence track 23 stores drawing sequence information, and the audio sequence track 24 stores audio sequence information. The master track 25 stores synchronization information of each of the sequence tracks 22 to 24. The master track 25 stores synchronization information of each of the sequence tracks 22 to 24. The track 25 itself is also a sequence track.
[0027]
The sequencer 26 controls the sequence operation of the performance sequence track 22, drawing sequence track 23, audio sequence track 24, and master track 25. Each sequence track is composed of a combination of an event and a duration, and the duration specifies a time interval between events. Therefore, by accumulating the duration from the beginning of the sequence track, the execution start time of the event can be known. Even if it takes time to process the event itself, it does not affect the passage of time on the sequence data. The passage of time can be expressed by a duration regardless of the event processing. As will be described in detail later, the master track 25 stores control information in the time axis direction such as a pause (stop) event, a branch event, and a repetition event as synchronization information. When these events occur, the master track 25 instructs the sequencer 26 to perform sequence control such as pause, branch, and repetition. For example, when a pause event occurs, the sequence operation of each of the sequence tracks 22 to 25 is temporarily stopped. When a branch event occurs, the sequence operation point of each sequence track branches to a specific position at the same time.
[0028]
The sequence output of the performance sequence track 22 is input to a sound source device 27 and output as a sound. The output of the drawing sequence track 23 is output to the display device 28 and drawn on the display monitor. The output of the audio sequence track 24 is output to the audio device 29 and output as sound.
[0029]
The sequencer 26 is controlled by the application program 30. This application program 30 may be any program as long as it can control the sequencer 26. The application program 30 outputs a start / stop signal and a status read signal to the sequencer 26. The sequencer 26 notifies the application program 30 of the status (state). For example, when a pause event occurs as an event of the master track 25, the sequencer 26 puts the sequence operation into a pause state (pause state) and sends a status notification to the application program 30. Lead. The content of the status in this case is pause (pause). The application program 30 performs a predetermined display to the user via the user interface 31 or waits for an input operation from the user, according to the contents of the status. In addition, it exchanges data with the server via the communication interface 32. When an event that exits the pause state occurs (this event is determined by the application program 30. For example, when there is a user input), the application program 30 instructs the sequencer 26 to restart.
[0030]
Thus, data communication between the sequencer and the application program is performed.
[0031]
FIG. 3 shows the data structure of the sequence track.
[0032]
As described above, the sequence data is expressed by describing the event E and the duration D in combination. The data sequence starts from event E, and EOS, which is sequence end data, is placed at the end of the data. The lifetime indicates the effective length of the event. For example, in the case of performance sequence information, it is the sounding time. Duration D specifies a time interval between events. For this reason, the start time of a specific event can be determined by accumulating the duration value from the beginning of the data. For example, the start time of event 3 is a time obtained by adding the added value of durations 1 and 2 to time 0. To branch from the start time of event 3 to event 1, a value obtained by adding duration 1 and duration 2 is subtracted from the start time of event 3. By such a method, the sequence operation of each sequence track can be arbitrarily controlled. The master track 25 describes this control content, that is, synchronization information of each sequence track. In this embodiment, in the sequence data, the event E and the duration D are described alternately. However, the sequence data does not necessarily have to be described alternately.
[0033]
FIG. 4 shows a schematic operation of the sequencer 26 and the application program 30 in FIG.
[0034]
When the process is started, the sequencer 26 waits for the sequence operation to be started after the initialization (step 100) is performed. When a sequence start command is received from the application program 30 (step 200) (step 101), the sequence operation in the sequencer 26 starts (step 102), and the occurrence of an event on the master track 25 is monitored (step 103). The event of the master track 25 is referred to as a checkpoint event here. When the checkpoint event occurs, the sequencer 26 notifies the application program 30 of the status and transmits the content of the checkpoint event (step 104). In the application program, in step 201, the status is received, and processing according to the content is performed (step 202). For example, if the checkpoint event is a pause event, the application program performs a process of waiting for an input from the user in response to the pause event. Alternatively, specific data is downloaded from the server or specific data is uploaded via the communication interface 32 in response to the pause event. The application program 30 further issues a predetermined instruction to the sequencer 26 in accordance with the processing in step 202. That is, each sequence track is controlled in accordance with the input contents from the user and the data from the server. The sequencer 26 performs processing corresponding to the instruction from the application program 30 in step 105. After performing the above-described processing, the sequencer 26 performs the operation of step 103 and thereafter again when the sequence is not completed, and returns to step 201 again when the program is not completed in the application program 30. .
[0035]
FIG. 5 shows an operation example on the time axis. When the sequence operation starts, the sequence operations of the performance sequence track 22, the drawing sequence track 23, the audio sequence track 24, and the master track 25 simultaneously start from the beginning, and the reproduction according to each sequence content is performed. Now, assuming that the content is composed of music data, images, and audio data, when the pause event PEV1 of the master track 25 occurs, the sequence operation in the sequencer 26 is stopped, and the application program 30 executes the operation from the user interface. Wait for user input. Here, when there is a specific key input, the application program 30 issues a start command, and then the reproduction of the second music data, image 2 and audio data 2 is started.
[0036]
1 and 2, since the SMAF file 20 is independent of the sequencer 26 and the application program 30, the SMAF file 20 can be distributed via an arbitrary storage medium or transmission medium. . Further, since the application program 30 is also a program independent of the sequencer 26, the program can have any function. Therefore, the distribution of contents is high, and the expandability and the degree of freedom of the entire system are extremely large.
[0037]
Note that the checkpoint event of the master track 25 includes a branch event and a repetition event in addition to the pause event as described above. The branch event has a content instructing to branch to an arbitrary position on the time axis, and the repetition event has a content instructing to repeat a certain sequence period. In addition, various pieces of control information in the time axis direction can be stored as checkpoint events.
[0038]
Next, an event description method of the drawing sequence track 23 will be described.
[0039]
As described above, the description of the drawing sequence track 23 is also constituted by an alternate description of an event (display event) and a duration specifying a time interval between the display events.
[0040]
For the display event, it is necessary to specify the display position of the display object. In the present embodiment, this display event allows the coordinate representation format of the display object to be selected from a plurality of formats.
[0041]
FIG. 6 shows a selectable coordinate expression format. FIG. 7A shows a standard coordinate designation, FIG. 7B shows a symmetry coordinate designation, and FIG. 7C shows a layout information coordinate designation expression.
[0042]
In the standard coordinate specification, the coordinate origin is set to the upper left of the display screen, the X axis is set to the right in the positive direction, and the Y axis is set to the lower in the positive direction. Then, the upper left coordinates of the display object G are designated.
[0043]
In the symmetric coordinate designation, the coordinate origin is set to the lower right of the display screen, the X axis is set to the left in the positive direction, and the Y axis is set to the upper direction in the positive direction. Then, the lower right coordinates of the display object G are designated.
[0044]
In the layout information coordinate specification, the position is specified at 100% in both the X direction and the Y direction. In the X direction, 0 is left-justified, 50 is centered, and 100 is right-justified. Further, in the Y direction, 0 is top-filled, 50 is centered, and 100 is bottom-filled. In the example shown in FIG. 6C, the display object G1 is left-justified in the X direction, G2 is centered in the X direction, and G3 is right-justified in the X direction.
[0045]
It should be noted that any one of the coordinate expression formats can be specified independently of the X coordinate and the Y coordinate.
[0046]
By allowing the coordinate expression format to be specified from among a plurality of types, a format suitable for a plurality of types of display monitors can be selected. For example, if a coordinate expression format for specifying layout information coordinates is selected, the same display state can be achieved even when the SMAF file is applied to a system having a different display screen area. In addition, by setting the specification of one object to be applicable to either the standard coordinate specification or the symmetric coordinate specification, it is possible to more easily select the one that can be specified depending on the position of the display object. This leads to an advantage of facilitating creation of sequence data.
[0047]
Further, the coordinate expression format once specified is retained as a default expression format until a new coordinate expression format is next specified. Therefore, it is only necessary to specify a new coordinate expression format when the coordinate expression format has changed, so that the sequence data can be easily viewed and the memory consumption can be reduced.
[0048]
In this system, it is possible to express a complicated movement by devising a display event description method. Hereinafter, this will be described in detail.
[0049]
The display event is composed of a primary block that describes display object definition information including the type, size, and content of the display object, and an auxiliary description that describes display modification sequence information that dynamically modifies the content represented by the primary block. Including blocks.
[0050]
The primary block is essential information for a display event because it includes basic information, and the auxiliary block is a block that can be appropriately selected.
[0051]
The display modification sequence information of the auxiliary block includes one or more pieces of display modification sequence information arbitrarily selected from a plurality of display modification sequence information that do not affect each other.
[0052]
The display object definition information described in the primary block describes the type, size, and content of the display object. Display object types include text, binary images (bitmaps), and arbitrary images (images).
[0053]
The display modification sequence information includes the following.
[0054]
(1) Image conversion sequence (change of display contents)
(A) Color change sequence
For example, the displayed text or the like, such as a karaoke color change, is temporally changed. Flashing of images such as neon signs can also be expressed.
[0055]
(B) Image transformation sequence
Change the image over time.
[0056]
(2) Banner sequence (designation of projection method to display screen)
(A) A character string is poured into a display frame and displayed.
[0057]
(B) A part of the display frame is projected, and the projection position is changed with time and displayed.
[0058]
(3) Movement sequence (change of display position)
(A) The position on the screen where the display frame is displayed is changed with time.
[0059]
(4) Display window change sequence
(A) The size of the display frame is changed with time.
[0060]
(5) Display switching sequence
(A) When a plurality of primary blocks are designated, these blocks are switched.
[0061]
(B) Two display target images (images appearing on the screen) are switched and displayed with time.
[0062]
For example, wipe (switching while wiping an image from left to right), dissolve (wiping operation is performed on each of a plurality of divided block screens), fade (screen switching is performed as if the first screen disappears) )and so on.
[0063]
The above display modification sequence information does not affect each other. Therefore, even if two or more pieces of display modification sequence information are combined, only the effect realized by the individual sequence information is added. Therefore, for example, the following display modification can be performed by combining a plurality of display modification sequence information.
[0064]
(1) Color change + banner
(A) As the telop flows through the display frame, the color of the telop changes on the way.
[0065]
(2) Color change + banner + move
(A) As the telop flows through the display frame, the color of the telop changes along the way, and the position of the display frame moves with time.
[0066]
(3) Color change + banner + move + display window change
(A) As the telop flows through the display frame, the color of the telop changes in the middle, the position of the display frame moves with time, and the display frame becomes smaller with time and disappears or appears again.
[0067]
As described above, each display modification sequence information has a function that does not affect the operation of each other, and any one of the plurality of display modification sequence information can be selected.
[0068]
FIG. 7 shows a general description format of a display event. From the top, an event type, an event size, a lifetime, a coordinate designation, a primary block, and an arbitrary number of auxiliary blocks are described. The auxiliary block is optional, and it is sufficient if there is at least a primary block. However, by describing the auxiliary block, various expressions can be easily realized as described above.
[0069]
In the above embodiment, the synchronization information recording means is a master track. However, the synchronization information may be written in each sequence track.
[0070]
【The invention's effect】
According to the present invention, a multimedia file is constructed by incorporating a plurality of sequence tracks on which a plurality of types of information are recorded and synchronization information recording means for recording synchronization information of each sequence track in the same file. In the meantime, synchronization between the information of each sequence track is achieved by the synchronization information. For this reason, it is possible to finely control the synchronization of information between the sequence tracks by the way of describing the synchronization information.
[0071]
Further, the communication between the sequencer and the application program allows the application program to know the information when the sequence operation is controlled by the synchronization information. Thereby, it becomes possible for the application program to perform various controls related to the synchronization information.
[0072]
Further, by providing a master track that performs the same sequence operation as each sequence track as the synchronization information storage unit that stores the synchronization information, the description of the synchronization information is facilitated.
[0073]
Further, since the display event can specify a plurality of coordinate expression formats of the display object, it is possible to specify an optimum display position for a display device used at that time. As a result, the range of content distribution can be expanded.
[0074]
Further, the display event includes a primary lock that defines basic information of the display object, and display modification sequence information of one or more combinations for dynamically adding display modification to the content represented by the primary lock. Since it can be described with auxiliary blocks and the display modification sequence information is information that does not affect each other, it is easy to combine the optimum display modification sequence information according to the movement of the display object Is possible. If each display modification sequence information is set as information of a simple function expression, a complicated movement of display contents can be easily provided by a combination of simple function expressions. This also has the effect of facilitating content creation.
[Brief description of the drawings]
FIG. 1 is a schematic hardware configuration diagram of a multimedia execution system according to an embodiment of the present invention;
FIG. 2 is a software configuration diagram of the multimedia execution system.
FIG. 3 shows a sequence operation.
FIG. 4 is a flowchart showing a schematic operation of a sequencer and an application program;
FIG. 5 is a diagram illustrating functions of a master track.
FIG. 6 is a diagram showing a coordinate expression format of a display event.
FIG. 7 is a diagram showing general description contents of a display event;

Claims (10)

A performance sequence track in which performance sequence information is stored, a drawing sequence track in which drawing sequence information is stored, and time axis control such as stopping, branching, and repetition at an arbitrary position with respect to a sequence operation of each sequence track. a storage unit of the multimedia file that incorporates the master track, the same in the file synchronization information of each sequence track is stored to perform,
A sequencer that controls the sequence operation of the multimedia file and the sequence operation based on the synchronization information,
A storage unit of an application program that communicates with the sequencer and performs execution control such as execution start and stop of a multimedia file by receiving information of control of a sequence operation based on the synchronization information,
A program execution unit that executes the application program,
The performance sequence track, the drawing sequence track, and the master track incorporated in the multimedia file of the storage unit are each configured by a combination of an event and a duration that specifies a time interval between the events. Multimedia execution system. The multimedia execution system according to claim 1, wherein the multimedia file has an audio sequence track in which audio sequence information is stored. The drawing sequence track is configured by describing a display event specifying a display object and a duration specifying a time interval between the display events, and the display event can specify a plurality of coordinate expression formats of the display object. 3. The multimedia execution system according to claim 1, wherein 4. The multimedia execution system according to claim 3 , wherein the display event includes a layout information designation format for designating a display position by a ratio based on at least a screen size and a size of the display object as a plurality of coordinate expression formats of the display object. 5. . The display event is a primary block describing display object definition information including a type of display object, and an auxiliary block describing display modification sequence information for adding a dynamic display modification to the content represented by the primary block. 4. The multimedia execution system according to claim 3, wherein the display modification sequence information includes one or more display modification sequence information arbitrarily selected from a plurality of display modification sequence information that do not affect each other. . A performance sequence track in which performance sequence information is stored, a drawing sequence track in which drawing sequence information is stored, and a time axis direction control such as stop / branch / repeat at an arbitrary position for a sequence operation of each sequence track. A master track in which synchronization information of each sequence track is stored, wherein the multimedia file includes an event and a track between each of the performance sequence track, the drawing sequence track, and the master track. of are those that are composed of a combination of a duration specifying the time interval, by inputting the multimedia files to the sequencer, the sequence operation based on sequence operation and the synchronization information of each sequence track Run the control,
By performing communication with the sequencer by an application program and receiving information of control of the sequence operation based on the synchronization information, execution of the multimedia file is started, execution control such as execution stop is performed,
A method for executing a multimedia file, wherein the program executing unit executes the application program. 7. The multimedia file execution method according to claim 6, wherein an audio sequence track in which audio sequence information is stored is embedded in the multimedia file, and a sequence operation of the sequence track is also performed based on the synchronization information. The drawing sequence track is configured by describing a display event specifying a display object and a duration specifying a time interval between the display events, and the display event can specify a plurality of coordinate expression formats of the display object. The method of claim 6 or 7 , wherein the multimedia file is executed. 9. The multimedia file according to claim 8 , wherein the display event includes, as a plurality of coordinate expression formats of the display object, a layout information designation format for designating a display position by a ratio based on at least a screen size and a size of the display object. Execution method. The display event is a primary block describing display object definition information including a type of display object, and an auxiliary block describing display modification sequence information for adding a dynamic display modification to the content represented by the primary block. 9. The multimedia file according to claim 8 , wherein the display modification sequence information includes one or more display modification sequence information arbitrarily selected from a plurality of display modification sequence information that do not affect each other. Execution method.

Images