JPH09185543A - Multimedia information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To decrease the number of times of operation for processing multimedia information by displaying/sounding relevant multimedia information and linked multimedia information on a dropped picture. SOLUTION: When any graphic is selected on a base screen 11, the area of attribute of the selected graphic is displayed on a multi-media screen 12 while being emphasized by a processor 1 and when the selected graphic is dropped into any emphasized and displayed area, the information of attribute of the dropped area is processed. In this case, when the selected graphic is dropped into any emphasized and displayed area, a multimedia information processing means 5 corresponding to the dropped area is activated and this activated multimedia information processing means 5 processes the information of attribute of the area. Besides, the multimedia information processing means 5 processes both the information of attribute of the dropped area and the information of attribute previously linked to that attribute together.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia information processing device for processing multimedia information.

[0002]

2. Description of the Related Art Conventionally, a system for processing multimedia information consisting of text data, image data and voice data corresponds to multimedia information when processing various multimedia information corresponding to a graphic displayed on a screen. After selecting the figure, select the processing procedure from the menu etc. to process the multimedia information, or select the multimedia information you want to process after starting each multimedia tool and process the multimedia information. It was

[0003]

Therefore, after selecting a figure corresponding to conventional multimedia information, a method of selecting a procedure to be processed from a menu or the like, or after starting various multimedia tools, processing is performed. In the method of selecting a figure corresponding to desired multimedia information, there are problems that the number of operations is increased in order to process the multimedia information and that thinking is hindered by operating the tool.

In order to solve these problems, it is an object of the present invention to provide an operation / control method that reduces the number of operations for processing multimedia information and does not disturb the thinking.

[0005]

Means for solving the problem will be described with reference to FIG. In FIG. 1, a processing device 1 performs various kinds of processing, and here, is composed of a multimedia information processing means 5 and the like.

The base screen 11 is a screen for displaying an object to be processed in a graphic form. The multimedia screen 12
It is a screen for displaying an area of attributes of multimedia information and highlighting an area corresponding to an attribute of a graphic selected on the base screen 11.

Next, the operation will be described. When the processing apparatus 1 selects a figure on the base screen 11, the area of the attribute of the selected figure is highlighted on the multimedia screen 12, and the selected figure is displayed in any one of the highlighted areas. When the information is dropped on the area, the attribute information of the dropped area is processed.

In these cases, when the selected figure is dropped in any of the highlighted areas, the tool (multimedia information processing means 5) corresponding to the dropped area is activated and this activation is started. The created tool (multimedia information processing means 5) processes the attribute information of the area.

Further, the tool processes the attribute of the dropped area and the attribute information linked in advance to the attribute. Therefore, it is possible to reduce the number of operations for processing multimedia information and provide an operation / control method that does not disturb the thinking.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Next, embodiments and operations of the present invention will be sequentially described in detail with reference to FIGS.

FIG. 1 shows a system configuration diagram of the present invention.
In FIG. 1, a processing device 1 performs various kinds of processing, and here, is composed of a graphic selection means 2, a drag & drop means 3, a processing procedure determination means 4, a multimedia information processing means 5 and the like. It is a thing.

The figure selecting means 2 is for selecting a figure representing an object to be processed, which is displayed on the base screen 11. For example, the mouse cursor is positioned and clicked on the figure representing the object to be processed. In this case, the clicked coordinates (x1, y1) are detected to detect the selected figure (see the description of FIG. 2 described later).

The drag-and-drop means 3 is for dragging a figure selected on the base screen 11 and dropping it on a corresponding area on the multimedia screen 12. The processing procedure determination means 4 determines the processing procedure of the multimedia information corresponding to the graphic when the graphic is dragged and dropped (see the description of FIG. 2 described later).

The multimedia information processing means 5 processes multimedia information. For example, when the multimedia information is text, it is displayed on the screen, when it is a still image, the still image is displayed on the screen, and a moving image is displayed. In the case of, the moving image is displayed on the screen, and in the case of voice, the voice is generated from the speaker 9.

The storage device 6 stores various tables, and stores the tables 61 to 67 shown in the figure. The multimedia attribute table 61 is a table in which multimedia attributes and link information are registered in association with objects (see (b) of FIG. 4 described later).

The object arrangement table 62 is a table in which the coordinates (for example, the upper left coordinate and the lower right coordinate) of the area in which the object is displayed on the base screen 11 are registered in advance.

The multimedia screen table 63 is for displaying the multimedia screen 12, and here, the arrangement coordinates and the processing procedure are associated with the multimedia screen name (for example, text, photograph, moving image, voice). , Flags, etc. are registered in advance (see (c) of FIG. 4 described later).

The text file table 64 is for displaying texts, and here, text file names are registered in advance in association with objects (see (d) of FIG. 4 described later).

The still image file table 65 is for displaying a still image, and here, a still image file name is registered in advance in association with an object ((e) in FIG. 4 described later). reference).

The moving picture file table 66 is for displaying a moving picture, and here, a moving picture file name is registered in advance in association with an object (see (f) of FIG. 4 described later).

The voice file table 67 is for generating a voice, and here, a voice file name is registered in advance in association with an object (see (g) of FIG. 4 described later).

The input device 8 is for inputting data and instructions, and is a mouse, a keyboard or the like here. The speaker 9 produces a voice.

Next, the operation of the configuration of FIG. 1 will be described in detail in the order shown in the flow chart of FIG. 2 with reference to FIGS. 3 and 4. FIG. 2 shows a flowchart for explaining the operation of the present invention.

In FIG. 2, S1 displays the base screen and the multimedia screen in a faint display. As shown in FIG. 3A, which will be described later, for example, these display the object to be processed in a graphic form on the base screen 11 and display the attributes (text, text, etc.) of the multimedia information on the multimedia screen 12. The photo (still image), video, and audio are displayed thin with dotted lines.

At step S2, a figure is selected. This is done by, for example, clicking the left mouse button with the mouse cursor moved and aligned on the target graphic to be processed on the base screen 11 in FIG. The figure “A house” is selected.

S3 is the clicked coordinate (x1, y1)
To get. A step S4 searches for an object corresponding to the coordinates. Based on the coordinates (x1, y1) acquired in S3, the object placement table 62 of FIG. 4A to be described later is searched to find an object having placement coordinates including the coordinates (x1, y1). Find, for example find the object "A Home".

In step S5, multimedia information is acquired based on the object. This is because the information registered in the multimedia attribute (here, the information registered in the multimedia attribute by searching the multimedia information table 61 of FIG. 4B described later based on the object found in S4 (for example, the object “A house”)). , “Text”, “still image”, “voice”), for example.

In step S6, the screen corresponding to the obtained multimedia information is highlighted and a flag is set. This highlights the multimedia information 12 acquired in S5, for example, the multimedia screen 12 of "text", "still image (photograph)", and "voice", and displays it as shown in FIG. . As a result, as shown in FIG.
The screens (areas) of “text”, “still image (photo)”, and “voice” are highlighted on the multimedia screen 12.
The multimedia information registered for the figure (object) selected in S2 will be identified.

In step S7, the object is dragged and dropped on the multimedia screen. This is the figure (object) selected by clicking the mouse button in S2.
Is dragged on the screen as it is and multimedia screen 12
The mouse button is released and dropped while being positioned above any one of "text", "still image (photograph)", and "voice" highlighted in FIG. 3B, for example.

S8 is the dropped coordinate (x2, y2)
To get. In S9, it is determined whether the flag of the multimedia screen corresponding to the coordinates (x2, y2) is true. This is because the flag (1) of the entry (text, still image (photograph), moving image, audio) in which the dropped coordinate (x2, y2) is included in the arrangement coordinate on the multimedia screen table 63 in FIG. 4C. Is set (the flag is set when S6 is highlighted) and it is determined whether or not it exists. In the case of YES, the process proceeds to S10. In the case of NO, since it is found that there is no multimedia information in the dropped area on the multimedia screen 12, the process ends as an error.

In step S10, the file name is extracted using the object name as a key. This is the coordinate (x
The flag is "1" on the multimedia screen 12 of 2, y2)
It was found that the file name exists with the object name (highlighted in S6 and found to exist), and the file name is extracted using the object name as a key (for example, the text file table in FIG. The text file name “A home-text” is extracted from 64.

In step S11, it is determined whether there is link information. This determines whether or not the link information is registered in the link information column of the entry of the corresponding object, for example, the object “A home” in the multimedia attribute table 61 of FIG. 4B described later. In the case of YES, the process proceeds to S12. If NO, the process proceeds to S14.

In S12, since it is determined that the link information is present in the case of YES in S11, it is determined whether or not the processing of the link information is designated. For example, since the link information "voice" is registered in the link information column of the multimedia attribute "text" of the object "A home" in the multimedia attribute table 61 of FIG. 4B, YES is determined. Y
In the case of ES, the file name is extracted with the link information as a key in S13 (for example, with the link information "voice" as a key, the voice file of the object "A-home" is selected from the voice file table 67 of FIG. Take out the name "A house-voice"). Then, the process proceeds to S14. On the other hand, N in S12
In the case of O, the process proceeds to S14.

In step S14, the corresponding process is activated and the file name is passed. This activates the processing procedure for the corresponding entry in the multimedia screen table 63 of FIG. 4C, and passes the file name extracted in S10 and S13.

In step S15, multimedia processing is executed based on the file. For text, display text on the screen, for still images (photos), display still images (photos) on the screen, for videos, display video on the screen, for audio The speaker 9 produces a voice.

As described above, by clicking an arbitrary figure on the base screen 11, the multimedia information of the clicked object is highlighted on the multimedia screen 12, and any one of the highlighted multimedia screens 12 is displayed. When a figure is dragged and dropped, the multimedia information corresponding to the attribute of the dropped multimedia screen 12 is extracted and processed (display / speech) and the linked multimedia information is also processed (display / speech). ) Do. With these operations, the operator can simply click on the graphic to be processed on the base screen 11 and drop it on the highlighted multimedia screen 12, and the target text or static image represented by the desired graphic can be displayed. It is possible to simultaneously display / speak any one of a picture (photograph), a moving picture, and a voice, and one or more of linked text, a still picture (photograph), a moving picture, and a voice.

FIG. 3 shows a display example of the present invention. FIG. 3A shows an example of the screen initially displayed. Here, on the base screen 11, a map showing a house A, a house B and roads is displayed. Further, on the multimedia screen 12, there are attributes such as “text”, “photograph (still image)”, which are possible as multimedia information.
The four windows of "Movie" and "Audio" are displayed in thin lines with dotted lines. As a result, it is possible to determine at a glance the attributes that may exist as multimedia information.

FIG. 3B shows a state in which a figure is clicked and dragged on the base screen 11 and dropped on the highlighted multimedia screen 12. This is because when the mouse cursor is positioned on the figure “A home” on the base screen 11 and the left mouse button is clicked, the coordinates (x1, y1) at the time of clicking belong to FIG.
When the rectangle represented by the arrangement coordinates of (a) is found and the object at that time, here, the object “A house” is found, and this object “A house” is dragged and dropped on the multimedia screen “text” , A rectangle represented by the arrangement coordinates of the multimedia screen table 63 of FIG. 4C to which the coordinates (x2, y2) at the time of dropping belong and the multimedia screen name at that time, for example, "text" I have found it.

FIG. 3C shows the multimedia screen 12
The above shows how the multimedia information is processed. Here, on the multimedia screen “text” which is the multimedia screen 11 found in FIG. 3B, for example, from the text file table 64 of FIG. 4B, the text file name “A” of the object “A home” is displayed. Take out "home-text" and name this text file "A home-text"
It is a state in which the contents of is displayed. At this time, the link information of the entry of the object "A home" in FIG.
Is registered, the voice file name “A home-voice” of the object “A home” is taken out from the voice file table 67 of FIG. 4G, and the content of the voice file name “A home-voice” is extracted. Speak from the speaker.

FIG. 4 shows an example of the table of the present invention. FIG.
(A) shows an example of an object arrangement table. Here, the object placement table 62 is associated with an object (for example, “A house”) as shown in FIG.
The information indicating the rectangular area of the coordinates (upper left, lower right) on the base screen 11 is registered.

FIG. 4B shows an example of the multimedia attribute table. Here, the multimedia attribute table 61, as shown in FIG.
A multimedia attribute (for example, "text") and link information are registered in association with "home". The multimedia attribute is an attribute of an object and is one of text, still image, moving image, and voice. The link information is for registering information to be processed by linking to the attribute of the object.

FIG. 4C shows an example of the multimedia screen table. Here, in the multimedia screen table 63, as shown in the figure, arrangement coordinates (upper left, lower right), processing procedures, and flags are registered in association with multimedia screen names. The multimedia screen name is, for example, "text", "photograph (still image)", "moving image", which is indicated by a dotted line of the multimedia screen 12 in FIG.
It is "voice". The arrangement coordinates are the upper left coordinates and the lower right coordinates of "text", "photograph (still image)", "moving image", and "sound" shown by dotted lines on the multimedia screen 12 of FIG. The processing procedure is a procedure for processing multimedia information, and as shown in the figure, when the multimedia information is "text", a text display tool is started. The flag is S6 of FIG. 2 described above.
Corresponding to one of the multimedia information “text”, “photograph (still image)”, “moving image”, and “audio” which is to be set when the figure is selected on the base screen 11. What you do is set and stored.

FIG. 4D shows an example of a text file table. This is an object (eg "A house")
The text file name (for example, "A house-text") is registered in association with the.

FIG. 4E shows an example of a still image file table. This is a still image file name (for example, "A house-photo") associated with an object (for example, "A house").
Is registered.

FIG. 4F shows an example of a moving image file table. This is a moving image file name (for example, "A house-moving image") registered in association with an object (for example, "A house").

FIG. 4G shows an example of the audio file table. In this case, a voice file name (for example, "A home-voice") is registered in association with an object (for example, "A home").

[0047]

As described above, according to the present invention,
The multimedia screen 1 highlighted on the base screen 11 is selected and dragged to be processed.
The operation to process multimedia information is simple and minimal because it adopts a configuration that drops to any of 2 and displays / speaks the corresponding multimedia information and linked multimedia information on the dropped screen. It is possible to display / speak with a limited number of operations. As a result, the number of operations for processing multimedia information has been reduced, and it has become possible to operate without disturbing thought.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram of the present invention.

FIG. 2 is a flowchart illustrating the operation of the present invention.

FIG. 3 is a display example of the present invention.

FIG. 4 is an example of a table of the present invention.

[Explanation of symbols]

 1: Processing device 2: Graphic selection means 3: Drag & drop means 4: Processing procedure determination means 5: Multimedia information processing means 6: Storage device 61: Multimedia attribute table 62: Object arrangement table 63: Multimedia screen table 64 : Text file table 65: Still image file table 66: Motion file table 67: Audio file table 8: Input device 9: Speaker 11: Base screen 12: Multimedia screen

Claims (3)

[Claims] 1. In a multimedia information processing apparatus for processing multimedia information, a base screen for displaying an object to be processed by a graphic and an area having an attribute of multimedia information are displayed and selected on the base screen. The multimedia screen that highlights the area corresponding to the attribute of the selected graphic and the area corresponding to the attribute of the selected graphic when the graphic is selected on the base screen are highlighted on the multimedia screen. And a means for processing the information of the attribute of the dropped area when the selected figure is dropped in any of the highlighted areas. . 2. When the selected figure is dropped in any of the highlighted areas, a tool corresponding to the dropped area is activated, and the activated tool is set as an attribute of the area. The multimedia information processing apparatus according to claim 1, wherein the multimedia information processing apparatus processes information. 3. The multimedia information processing apparatus according to claim 1, wherein the attribute of the dropped area and the information of the attribute linked in advance to the attribute are processed together.