JPH10200873A - Video telephone system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the need for the troublesome switching operation of a screen by detecting a certain specified area in a master screen, detecting the overlap of the specified area and a slave screen area and preferentially displaying the image of the specified area on a slave screen in the case that the overlap of both is judged. SOLUTION: In the initial state of supplying power or the like, the display address of the slave screen is decided, and when transmission images from a transmission image memory are fetched to transmission image input 21, the transmission images are displayed as the slave screen. A slave screen position is outputted from an initial position address part 22 and inputted through an address updating part 23 to an address comparison part 24. In an overlap judgement part 27, the overlap is judged depending on whether or not the slave screen address is included inside a specified area address, and when it is judged that they are not overlapped, 2-screen display data are outputted to a video output part in a slave screen initial position state. In the case that the slave screen and the specified area inside the master screen overlap, a selection operation is performed beforehand by an operation part.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video telephone device having a two-screen display function, and more particularly, to detecting a specific area in a main screen and, depending on the result, the position of a child screen or a main screen. The present invention relates to a videophone apparatus provided with means for controlling / size / display priority (priority).

[0002]

2. Description of the Related Art In general, a videophone apparatus of this type displays two screens on a single television screen of a partner image received from a partner and a self image captured by a built-in camera for transmission to the partner. , Conducts videophone communications. In particular, the other party's video is displayed on the entire screen on the main screen,
Looking at the other party's appearance expands its use as a videophone.

In a videophone having a two-screen display function,
As shown in FIGS. 10 to 13, the child screen 41 is displayed in each corner (lower right, upper right, upper left, lower left) of the display screen, and the display positions of these display positions are switched according to an instruction of the operator. .

In this case, the size of the child screen 41 as well as the parent screen 42 is constant, and the child screen 41 is displayed at a predetermined position regardless of the contents of the parent screen 42.
In order to see the parent screen 42 below the parent screen 42, the child screen 41 is deleted and the display is changed to the parent screen 42 only.
Had to see.

Japanese Patent Laid-Open Publication No. Hei 7-162831 discloses that a small-screen display area is divided into 1/4 of the entire screen,
There has been proposed a video conference communication device that displays a child screen in an area where the display area of the information specified from the motion vector in the main screen information has the least overlap with the above-mentioned four child screen display areas.

Further, a method has been proposed in which the entire screen is reduced and the other party's screen and the user's own screen are displayed side by side. In this case, however, the size of each screen is reduced, and it is difficult to view the video itself.

[0007]

However, FIG.
In the conventional videophone device described above with reference to FIG. 13 to FIG. 13, the child screen 41 is displayed at a fixed size in each corner of the display screen, so when an important part of the parent screen 42 is below the child screen 41, This important part is the child screen 41
There was a problem that it was hidden behind and could not be seen.
In particular, during a videophone call, the image of the other party is important, and the face area of the other party cannot be seen.
There are many cases where discomfort is felt.

Although the display position of the child screen 41 can be moved, it is necessary for the operator to give an instruction. There is a problem in that a troublesome operation of operating is required.

Further, it is possible to delete the child screen 41 and display only the parent screen 42.
1 cannot be referred to, so that the user cannot confirm his / her own transmission screen.

Further, in the device described in Japanese Patent Application Laid-Open No. Hei 7-162831, it is possible to automatically switch the sub-screen display position, but this is also the most difficult among the predetermined sub-screen display positions. This is to select a small number of positions, not to cancel the overlap of important parts in the parent screen.

Further, when the entire screen is reduced and the other party's screen and the user's own screen are displayed side by side, the screen size is reduced for both the parent and the child. There is a problem that the other party's image is difficult to see, and important contents are overlooked.

The present invention has been made in view of the above points, and detects a specific area important to a receiver, such as the face or character of a partner, in a main screen, and displays a sub-screen in accordance with the result. Position, size, parent screen display position, size,
By automatically changing the display priority (priority), you can avoid missing important parts of the parent screen hidden in the lower part of the child screen, It is an object of the present invention to provide a videophone device which does not require a troublesome and troublesome operation of switching a display position each time.

[0013]

According to a first aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; and a specific area detected by the specific area detecting means. Overlap detection means for detecting the overlap between the area and the sub-screen area, and priority display control means for preferentially displaying an image of the specific area on the sub-screen when it is determined that each of the specific area and the sub-screen area has overlapped. Are provided.

Thus, the specific area detecting means detects the specific area in the received main screen, the overlap detecting means detects the overlap between the specific area and the child screen area, and the priority display control means detects the specific area at the lower part of the child screen. Since such a specific area is preferentially displayed on the child screen, it is possible to perform two-screen display of the parent screen and the child screen with priority given to the important part of the other party's image.

According to a second aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap of the specified area, and reduced display control means for reducing the size of the small screen area so as not to overlap with the specific area when it is determined that each of the small area and the small screen area are provided. It becomes.

Thus, the specific area detecting means detects the specific area in the received main screen, the overlap detecting means detects the overlap between the specific area and the child screen area, and the reduced display control means changes the child screen area. Since the child screen area is reduced and displayed so as not to cover the specific area, a two-screen display of a parent screen and a child screen in which an important part of the other party's video is prioritized can be performed.

According to a third aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detecting means for detecting the overlap of the specified area and the sub-screen area, when it is determined that each of the sub-screen areas is overlapped, moving the sub-screen area to an area other than the specific area so as not to overlap the specific area. And a display control means.

Thus, the specific area detecting means detects the specific area in the received parent screen, the overlap detecting means detects the overlap between the specific area and the child screen area, and the moving display control means changes the child screen area. Since the child screen area is moved and displayed in an area other than the specific area so as not to cover the specific area, a two-screen display of a parent screen and a child screen in which an important part of the other party's video is prioritized can be performed.

According to a fourth aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap of, and reduced display control means for reducing and displaying the entire parent screen area so that the specific area does not overlap with the child screen when it is determined that each of the specific area and the child screen area has overlapped. Are provided.

Thus, the specific area in the received parent screen is detected by the specific area detecting means, the overlap between the specific area and the child screen area is detected by the overlap detecting means, and the specific area is detected by the reduced display control means. Since the entire parent screen area is reduced and displayed so as not to cover the child screen, it is possible to perform two-screen display of the parent screen and the child screen in which an important part of the partner image is prioritized.

According to a fifth aspect of the present invention, there is provided a videophone apparatus, comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap of the specific area, the movement display control means for moving and displaying the parent screen area so that the specific area does not overlap the child screen when it is determined that each of the child screen area overlaps Is provided.

The specific area detecting means detects the specific area in the received parent screen, the overlap detecting means detects the overlap between the specific area and the child screen area, and the moving display control means determines the specific area. Since the entire parent screen area is moved and displayed so as not to cover the child screen, it is possible to perform a two-screen display of the parent screen and the child screen in which an important part of the partner image is prioritized.

According to a sixth aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; And a display prohibition control unit that does not display the sub-screen for a certain period of time when it is determined that the specific area and the sub-screen area overlap each other.

Thus, the specific area detecting means detects a specific area in the received parent screen, the overlap detecting means detects the overlap between the specific area and the child screen area, and the display inhibition control means keeps the child screen constant. Since the time is not displayed, the important part of the other party's image can be displayed preferentially.

According to a seventh aspect of the present invention, there is provided a videophone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap of the display area, display range setting means for setting the display range, the specific area and the small screen area are determined to be overlapped, and even if the small screen is moved within the display range, When it is determined that the child screens overlap each other, a means is provided for moving the child screen to the display range limit and then reducing and displaying the child screen area.

Thus, the specific area detecting means detects the specific area in the received parent screen, and the overlap detecting means detects the overlap between the specific area and the child screen area. Is determined to have overlapped, and if it is determined that the parent screen is still overlapped even after being reduced to the limit reduction rate, the child screen is moved to the display range limit and then the child screen area is reduced and displayed. The visibility of the child screen can be ensured while the important part is displayed with priority.

[0027] The videophone device according to the invention of claim 8 of the present application provides a specific area detecting means for detecting a specific area in a main screen, a specific area detected by the specific area detecting means, and a child screen area. Overlap detection means for detecting the overlap of the display area, display range setting means for setting the display range, the specific area, the child screen area is determined to be overlapped, and even if the parent screen is moved within the display range When it is determined that they overlap, after the parent screen is moved to the limit of the display range, means for reducing and displaying the parent screen area is provided.

Thus, the specific area detecting means detects the specific area in the received main screen, and the overlap detecting means detects the overlap between the specific area and the child screen area. Is determined to have overlapped, and when it is determined that the parent screen moves within the display range and still overlaps, the parent screen is moved to the display range limit, then the parent screen area is reduced and two-screen display is performed. In addition, it is possible to secure the visibility of the child screen while preferentially displaying the important part of the partner image.

According to a ninth aspect of the present invention, there is provided a video telephone apparatus comprising: a specific area detecting means for detecting a specific area in a main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap, limit reduction rate setting means for setting a limit reduction rate, the specific area, it is determined that each of the child screen area,
In addition, when it is determined that the child screens are still overlapped even after being reduced to the limit reduction rate, means is provided for moving the child screen area to an area other than the specific area after reducing the child screen to the limit reduction rate. It is.

Thus, the specific area detecting means detects the specific area in the received parent screen, and the overlap detecting means detects the overlap between the specific area and the child screen area. Are determined to have overlapped, and if it is determined that the child screens are still overlapped even after being reduced to the limit reduction rate, the child screen area is moved to an area other than the specific area after reducing the child screen to the limit reduction rate. Since the two-screen display is performed, it is possible to secure the visibility of the child screen while preferentially displaying the important part of the partner image.

According to a tenth aspect of the present invention, there is provided a videophone device, comprising: a specific area detecting means for detecting a specific area in the main screen; a specific area detected by the specific area detecting means; Overlap detection means for detecting the overlap of, limit reduction rate setting means for setting the limit reduction rate,
If it is determined that the specific area and the child screen area overlap each other, and it is determined that the parent screen is still overlapped even when reduced to the limit reduction rate, the parent screen is reduced to the limit reduction rate, and then the parent screen is reduced. Means is provided for moving and displaying the screen area to an area other than the area overlapping the child screen.

Thus, the specific area detecting means detects a specific area in the received parent screen, and the overlap detecting means detects an overlap between the specific area and the child screen area. Are determined to have overlapped, and if it is determined that the child screens are still overlapped even after being reduced to the limit reduction rate, after reducing the parent screen to the limit reduction rate, the area other than the area where the parent screen area overlaps the child screen , And the two-screen display is performed, so that it is possible to secure the visibility of the child screen while giving priority to the important part of the other party's image.

[0033] In the videophone device according to the invention of claim 11 of the present application, in the videophone device according to any one of claims 1 to 10, the specific area in the parent screen is defined by:
This is a person's face area.

Thus, since the specific area detecting means detects the face area of the person on the other party's parent screen, it is possible to confirm all the expressions of the other party in communication.

A video telephone according to a twelfth aspect of the present invention is the video telephone according to any one of the first to tenth aspects, wherein the specific area in the parent screen is
This is a character area.

Thus, the specific area detecting means detects the specific character area in the parent screen, so that all character information from the communicating partner can be confirmed.

According to a thirteenth aspect of the present invention, in the videophone device according to any one of the first to tenth aspects, a specific area in the parent screen is defined by:
This is a fixed area in the screen specified by the external input means.

[0038] Thus, the specific area detecting means detects a certain area in the other party's parent screen arbitrarily designated by the external input means, so that all the certain area information in the receiving screen from the communicating party is confirmed. It becomes possible.

[0039]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of a video telephone according to an embodiment of the present invention; FIG.

FIG. 1 is a block diagram showing a schematic configuration of a video telephone according to the present embodiment. In FIG. 1, reference numeral 1 denotes a line interface connected to a communication line, 2 denotes a transmission / reception buffer memory, and 3 denotes an image encoding unit. 4, an image processing unit having 4 and an image decoding unit 5, 6 a camera, 7 a video input unit, 8 a transmission image memory, 9 a reception image memory, 10 a two-screen control unit,
11 is a specific area detection unit, 12 is a video output unit, 13 is a monitor, 14 is an operation unit for specifying a specific area described later, 15 is a system control unit, 16 is an audio processing unit, and 17 is a transmitter / receiver. is there.

The operation of transmitting and receiving image data in the present apparatus will be described. First, when transmitting image data, an analog video signal obtained from the camera 6 is subjected to processing such as level adjustment and A / D conversion by the video input unit 7 and then temporarily stored in the transmission image memory 8. Can be The transmission image captured by the transmission image memory 8 is subjected to moving image encoding processing by the image encoding unit 4 in the image processing unit 3, and the transmission / reception buffer memory 2
D / A conversion at line interface 1
Modulation processing and the like are performed and transmitted from the communication line to the partner terminal. Here, the transmission image memory 8 superimposes the image on the partner image by the later-described two-screen control unit 10 and outputs it to the monitor 13 for confirmation of the transmission screen.

On the other hand, when receiving image data, the image data transmitted from the partner terminal is input to the line interface 1 via the communication line, and subjected to demodulation processing, A / D conversion, and other processing. , And is temporarily stored in the transmission / reception buffer memory 2.
The image code data is subjected to a moving image decoding process in an image decoding unit 5 in the image processing unit 3, stored in a reception image memory 9, the transmission image is multiplexed in a two-screen control unit 10, and an image output unit 12 After processing such as D / A conversion and level adjustment,
It is output to the monitor 13 and displayed.

The voice information is input from the transmitting section of the transmitter / receiver 17, processed by the voice processing section 16 such as A / D conversion, and transmitted to the partner terminal via the line interface 1 and the communication line. At the same time, the audio signal from the partner terminal passes through the communication line and the line interface 1, and is processed by the audio processing unit 16 such as D / A conversion, and then reproduced from the receiver of the transmitter / receiver 17.

Here, the two-screen control unit 10 determines whether or not the specific area in the received image data detected by the specific area detection unit 11 overlaps the child screen displayed for transmission confirmation. If there is, the size of the sub-screen is reduced and displayed, the position of the sub-screen is moved and displayed, the part where the sub-screen overlaps with the specific area is erased and displayed,
By reducing and displaying the size of the entire main screen, or by moving and displaying the position of the entire main screen, it is possible to prevent an important area in the partner screen from being hidden below the child screen.

A specific configuration example of the two-screen control unit 10 will be described with reference to the block diagram shown in FIG. In the initial state such as when the power is turned on, the display area address of the sub-screen is determined, and when the transmission image from the transmission image memory 8 is taken into the transmission image input unit 21, the transmission image is displayed as the sub-screen. , The sub-screen position is output from the initial position address section 22 and input to the address comparing section 24 via the address updating section 23.

On the other hand, when the image from the received image memory 9 is fetched into the received image input unit 25, the received image is displayed as a parent screen. The address of the specific area is detected by the address unit 26, input to the address comparing unit 24, and compared with the small screen address from the address updating unit 23.

Next, the overlap judging section 27 makes an overlap judgment based on whether or not the sub-screen address is included in the specific area address. If it is judged that there is no overlap, the two-screen display data is displayed in the sub-screen initial position state. Is output to the video output unit 12, and when it is determined that they overlap, the overlap amount is output from the overlap amount calculation unit 28 as a vector amount.

When the child screen and a specific area in the parent screen overlap, the child screen is reduced in size, the child screen is cut,
Displaying the inset screen for a certain period of time, moving the inset screen,
The selection of moving the parent screen, reducing the size of the parent screen, or combining them is performed by the operation unit 14 in advance. According to the selection result, the correspondence switching unit 2
9 selects a processing method, and the output switching unit 30 selects an output.

When the small screen is displayed in a reduced scale, the small screen reduction ratio calculating unit 31 calculates the minimum reduction ratio from the overlap vector amount, and the small screen reduction unit 32 reduces the small screen based on the reduced ratio. Then, it is output to the two-screen control output unit 33 via the output switching unit 30.

When the small screen is cut, the display of the small screen portion of the overlapping portion is cut by the small screen cut section 34 and is output to the two-screen control output 33 via the output switching section 30. In the case where the child screen is not displayed for a certain period of time, when the overlap determination is made, the child screen is not displayed for a time set in advance by the child screen non-display section 35, and only the parent screen is displayed.

In the case of moving and displaying the child screen, the minimum moving amount is calculated from the overlap vector amount by the moving amount calculating unit 36, and the child screen moving unit 37 moves the display position of the child screen based on the moving amount. Then, it is output to the two-screen control output unit 33 via the output switching unit 30.

Further, the movement and reduction of the parent screen are similarly processed by the parent screen moving unit 38, the parent screen reduction ratio calculation unit 39, and the parent screen reduction unit 40, respectively, based on the overlap vector amount, and the output switching unit. The data is output to the two-screen control output unit 33 via 30. Note that these series of processing operations are controlled by the system control unit 15.

Next, the processing operation for displaying two screens in the present apparatus will be described with reference to the flowchart shown in FIG. When the operation starts (step 1), the process waits for reception of the partner image (step 2). If there is a reception, the receiver performs decoding and reception processing of the partner image (step 3), and detects a specific area in the partner image. , An area such as a face area or a character area which is regarded as important for video communication is extracted (step 4).

Then, it is determined whether or not the specific area detected in step 4 overlaps the currently displayed child screen area (step 5). If there is no overlapping part, the process is terminated (step 19). If there are overlapping parts,
When a specific area of the main screen is overlapped with the sub-screen, a pre-set response method is selected (step 6).

If the corresponding method sets a condition that the sub-screen is not displayed for a certain period of time, the non-display of the sub-screen is performed (step 7), and the image is output as image information in which the sub-screen is not displayed (step 18). (Step 1)
9).

If the corresponding method is screen movement or screen reduction, the amount of overlap is detected as a vector having a magnitude and direction (step 8). When the parent screen is displayed in a reduced scale, the minimum reduction rate of the parent screen is calculated (step 9), the parent screen is reduced (step 10), and then the parent screen is output as reduced image information (step 9). Step 1
8), end the process (step 19).

When the parent screen is moved and displayed, the minimum movement amount of the parent screen is calculated (step 11), the parent screen is moved (step 12), and then the parent screen is output as image information that is moved and displayed. (Step 18), and the process ends (step 19).

When the small screen is displayed in a reduced scale, the minimum reduction ratio of the small screen is calculated (step 13), and the small screen is reduced (step 14). The data is output (step 18), and the process ends (step 19).

To move and display the child screen, the minimum movement amount of the child screen is calculated (step 15), and the child screen is moved (step 16). The data is output (step 18), and the process ends (step 19).

When the overlapping portion of the sub-screen is to be cut, the overlapping portion of the sub-screen is cut based on the overlap detection amount (step 17), and then the sub-screen is output as cut image information (step 17). Step 18), and the process ends (Step 19).

Next, the operation of the specific area detecting section 11 will be described with reference to FIG. The specific area in the parent screen detected by the specific area detection unit 11 can be a face, a character, or the like in the other party's screen. Here, the specific area to be detected will be described as a face area. In FIG. 4, reference numeral 43 denotes a specific face area to be detected, 44 denotes its outline, and 45 denotes a mouse cursor. As a method of face area detection, the original image data is divided into a plurality of area blocks, block differential values, average luminance values, average red difference values, average blue difference values are calculated, and a standard defined as face data is calculated. It is possible to specify the face area 43 by comparing with the vector.

Here, the specific area has been described as a face, but it may be a character area. Operation unit 1
A specific area may be arbitrarily designated by the operator by connecting a mouse to the mouse 4 and operating the mouse cursor 45 on the screen.

A case where the specific area overlapping with the child screen is preferentially displayed on the child screen when the specific area is a face in the partner screen will be described with reference to FIG. When the specific area detection unit 11 determines that the specific face area 43 in the parent screen 2 overlaps the child screen 51, the two-screen control unit 10 converts the child screen 51 into the specific face area 43 as shown in FIG. By setting the display priority of the part overlapping with the specific face area 43 of the child screen 51 to be low again so as not to overlap, it is possible to display all the face parts of the partner image.

Further, a description will be given of a case where the child screen is displayed in a reduced size so that the child screen does not cover the specific area when the specific area is set as a face in the partner screen, with reference to FIG. When the specific area detection unit 11 determines that the specific face area 43 in the parent screen 2 overlaps the child screen 41, the two-screen control unit 10
Now, as shown in FIG.
By reducing the size of the sub-screen 41 and displaying it as the sub-screen 61 so as not to overlap, it is possible to display all the face portions of the partner image.

A case where the child screen is moved to and displayed in an area other than the specific area so that the child screen does not overlap the specific area when the specific area is set as a face in the partner screen will be described with reference to FIG. When the specific area detection unit 11 determines that the specific face area 43 in the parent screen 2 overlaps the child screen 41, the two-screen control unit 10 sets the child screen 41 to the specific face area 43 as shown in FIG. Child screen 4 so that it does not overlap
By moving the display position of No. 1 to the position 71, it becomes possible to display all the face portions of the partner image.

Here, the specific area is divided into area blocks such as the entire face (face + head) and only the face part (skin color part), and weighting is performed for each area block. It may be configured to move to a portion with a small ratio according to the weight.

Next, a case where the entire main screen area is reduced and displayed so that the specific area does not cover the child screen when the specific area is a face in the partner screen will be described with reference to FIG. The specific face area 4 in the parent screen 2 is specified by the specific area detection unit 11.
When it is determined that the child screen 3 overlaps the child screen 41, the two-screen control unit 10 reduces the size of the parent screen 42 so that the child screen 41 does not overlap the specific face area 43 as shown in FIG. By displaying the image as the screen 82, it is possible to display all the face portions of the partner image.

Also, a case where the entire parent screen area is moved and displayed so that the specific area does not cover the child screen when the specific area is a face in the partner screen will be described with reference to FIG. The specific face area 4 in the parent screen 2 is specified by the specific area detection unit 11.
When it is determined that 3 overlaps the child screen 41, the two-screen control unit 10 moves the display position of the parent screen 42 to the position 92 so that the child screen 41 does not overlap the specific face area 43 as shown in FIG. By moving, it becomes possible to display all the face portions of the partner image.

These are automatically switched according to the detection result of the specific area detecting section 11 every time the image is updated, and there is no need to give an operation instruction each time the other party's image is received. It is also possible to control to fix the sub-screen position at a substantially constant position by combining and applying such reduction in size, movement of position, switching of display priority, and the like.

[0070]

According to the first aspect of the present invention, the videophone apparatus according to the first aspect of the present invention detects the specific area in the received main screen by the specific area detection means, and determines the overlap between the specific area and the child screen area by the overlap detection means. Since the overlap is detected and the specific area at the lower part of the sub-screen is preferentially displayed on the sub-screen by the priority display control means, it is possible to perform two-screen display of the main screen and the sub-screen with priority given to the important part of the other party's video it can.

Therefore, important areas such as faces and characters in the main screen can be detected and the display priority for the sub-screen can be automatically switched. Video-telephone communication without overlooking. In addition, since these operations are performed automatically, it is not necessary to perform a troublesome operation of instructing the movement of the child screen position each time in accordance with the partner parent screen image that changes every moment.

In the videophone device according to the second aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Since the small screen area is reduced and displayed by the reduced display control means so that the small screen area does not overlap the specific area, the two-screen display of the parent screen and the child screen giving priority to the important part of the other party's video is performed. Can be.

Therefore, an important area such as a face or a character in the main screen can be detected and the size of the sub-screen can be automatically switched. It is possible to perform videophone communication without the need. In addition, since the size of the main screen is not reduced, the video of the other party is difficult to see, and important content is not overlooked, especially in a case of a meeting for monitoring use or sharing materials.

In the videophone device according to the third aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Detecting and moving and displaying the child screen area to an area other than the specific area so that the child screen area does not overlap the specific area by the moving display control means. Two-screen display can be performed.

Therefore, important areas such as faces and characters in the main screen can be detected and the display position of the sub-screen can be automatically switched.
Videophone communication can be performed without overlooking an important part of the partner screen. In addition, since the size of the main screen is not reduced, the video of the other party is difficult to see, and important content is not overlooked, especially in a case of a meeting for monitoring use or sharing materials.

According to a fourth aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlapping detecting means determines the overlap between the specific area and the child screen area. Since the entire main screen area is reduced and displayed by the reduced display control means so that the specific area does not cover the sub-screen, the two-screen display of the main screen and the sub-screen with priority given to the important part of the video of the other party is performed. Can be.

Therefore, an important area such as a face or a character in the main screen can be detected and the size of the main screen can be automatically changed. It is possible to perform videophone communication without the need. Also, by reducing the size of the main screen, it becomes easy to monitor whether important contents in the transmission image data are being transmitted reliably while receiving the other party's image data transmitted from the other party's terminal via the communication line.

According to a fifth aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Since the whole area of the parent screen is moved and displayed by the movement display control means so that the specific area does not cover the child screen, the two-screen display of the parent screen and the child screen giving priority to the important part of the other party's image is performed. Can be.

Therefore, important areas such as faces and characters in the main screen can be detected, and the display position of the main screen can be automatically switched.
Videophone communication can be performed without overlooking an important part of the partner screen. Further, by moving the parent screen, it becomes easy to monitor whether important contents in the transmission image data are reliably transmitted while receiving the partner image data transmitted from the partner terminal via the communication line.

In the videophone apparatus according to the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Since the detection and the display inhibition control means do not display the child screen for a certain period of time, it is possible to preferentially display an important part of the other party's video.

Therefore, an important area such as a face or a character in the main screen can be detected and the display of the sub-screen can be automatically prohibited for a certain period of time. Will be able to do it.
Also, since the size of the parent screen is not reduced,
In the case of a meeting for monitoring use or sharing of materials, it is difficult to see the video of the other party, and important contents are not overlooked.

In the videophone apparatus according to the present invention, the specific area detecting means detects a specific area in the received parent screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. After detecting the specific area and the child screen area are determined to have overlapped, and when it is determined that the parent screen is still overlapped even when reduced to the limit reduction rate, after moving the child screen to the display range limit, Since the small screen area is displayed in a reduced size, it is possible to secure the visibility of the small screen while giving priority to the important part of the other party's image.

In addition, since the size of the main screen is not reduced, the video of the other party is difficult to see and important contents are not overlooked, especially in the case of a meeting for monitoring use or sharing of materials. At the same time, the transmission screen can be displayed on a small screen as large as possible.

In the videophone apparatus according to the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Detected, the specific area, it is determined that each of the child screen area is overlapped, and, when it is determined that the parent screen is still overlapped even if moved in the display range, after moving the parent screen to the display range limit, Since the main screen area is reduced and the two-screen display is performed, it is possible to secure the visibility of the child screen while giving priority to the important part of the other party's image.

Further, by moving the parent screen, it becomes easy to monitor whether important contents in the transmission image data are reliably transmitted while receiving the other image data transmitted by the communication line from the other terminal. At the same time, the parent screen can be displayed as large as possible.

In the videophone apparatus according to the ninth aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Detected, the specific area, it is determined that each of the child screen areas overlap, and, if it is determined that the child screen is still overlapped even if reduced to the limit reduction rate, after reducing the child screen to the limit reduction rate, Since the small-screen area is moved to an area other than the specific area to perform the two-screen display, it is possible to secure the visibility of the small screen while preferentially displaying an important part of the other party's image.

In addition, since the size of the main screen is not reduced, the video of the other party is difficult to see and important contents are not overlooked, especially in a case of a meeting for monitoring use or sharing of materials. At the same time, the transmission screen can be displayed on a small screen as large as possible.

According to a tenth aspect of the present invention, the specific area detecting means detects a specific area in the received main screen, and the overlap detecting means determines the overlap between the specific area and the child screen area. Detected, the specific area, it is determined that each of the child screen areas overlap, and, if it is determined that the child screen is still overlapped even if reduced to the limit reduction rate, after reducing the parent screen to the limit reduction rate, Since the main screen area is moved to an area other than the area overlapping with the child screen to perform the two-screen display, it is possible to secure the visibility of the child screen while preferentially displaying the important part of the partner video.

Further, by reducing the size of the main screen, it becomes easy to monitor whether important contents in the transmission image data are transmitted reliably while receiving the other-party image data transmitted from the other-party terminal via the communication line. At the same time, the parent screen can be displayed as large as possible.

In the video telephone according to the eleventh aspect of the present invention, the specific area detecting means detects the face area of the person on the other party's parent screen. It is possible to check the expression of the other party and the change of the expression without missing.

In the video telephone according to the twelfth aspect of the present invention, the specific area detection means detects a specific character area in the other party's parent screen. Can be confirmed without leaking.

[0092] In the videophone device according to the thirteenth aspect of the present invention, the specified area in the parent screen is specified by the external input means, and the specified area is detected by the specific area detection means. It is possible to fix the camera and monitor a specific portion in the screen.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a schematic configuration of a videophone device according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a two-screen control unit in one embodiment of the videophone device of the present invention.

FIG. 3 is a flowchart illustrating an operation of a two-screen control unit in the videophone device according to the embodiment of the present invention.

FIG. 4 is an explanatory diagram for explaining an operation of a specific area detection unit in one embodiment of the videophone device of the present invention.

FIG. 5 is an explanatory diagram for explaining a case where a specific face area overlapping with a child screen is preferentially displayed on the child screen in the embodiment of the videophone device of the present invention.

FIG. 6 is an explanatory diagram for explaining a case in which the child screen is reduced and displayed so that the child screen does not cover a specific area in one embodiment of the videophone device of the present invention.

FIG. 7 is an explanatory diagram for explaining a case where the child screen is moved to and displayed in an area other than the specific face area so that the child screen does not cover the specific face area in one embodiment of the videophone device of the present invention.

FIG. 8 is an explanatory diagram for explaining a case where the entire main screen area is reduced and displayed so that a specific face area does not overlap a child screen in one embodiment of the videophone device of the present invention.

FIG. 9 is an explanatory diagram for explaining a case in which the entire parent screen area is moved and displayed so that a specific face area does not overlap a child screen in one embodiment of the videophone device of the present invention.

FIG. 10 is an explanatory diagram showing a two-screen display example in a conventional videophone device.

FIG. 11 is an explanatory diagram showing a two-screen display example in a conventional videophone device.

FIG. 12 is an explanatory diagram showing a two-screen display example in a conventional videophone device.

FIG. 13 is an explanatory diagram showing a two-screen display example in a conventional videophone device.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 line I / f 2 transmission / reception buffer memory 3 image processing unit 4 image encoding unit 5 image decoding unit 6 camera 7 video input unit 8 transmission image memory 9 reception image memory 10 2 screen control unit 11 specific area detection unit 12 video output Unit 13 monitor 14 operation unit 15 system control unit 16 audio processing unit 17 transmitter / receiver 21 transmission image input unit 22 initial position address unit 23 address update unit 24 address comparison unit 25 reception image input unit 26 specific area address unit 27 overlap determination unit 28 Overlap amount calculation unit 29 Corresponding switching unit 30 Output switching unit 31 Small screen reduction ratio calculation unit 32 Small screen reduction unit 33 Two screen control output unit 34 Small screen cut unit 35 Small screen non-display unit 36 Movement amount calculation unit 37 Small screen Moving unit 38 Main screen moving unit 39 Main screen reduction ratio calculating unit 40 Main screen reducing unit

Claims (13)

[Claims] 1. An apparatus according to claim 1, wherein the received image data and the transmitted image data are
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Means for detecting the overlap between the specific area detected by the means and the small screen area; and when it is determined that the specific area and the small screen area each overlap, the image of the specific area has priority over the small screen. A videophone device comprising: priority display control means for displaying. 2. The method according to claim 1, wherein the received image data and the transmitted image data are 1
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Means for detecting an overlap between the specific area detected by the means and the sub-screen area, and when the specific area and the sub-screen area are determined to overlap each other, the sub-screen area does not overlap the specific area. And a reduced display control means for reducing display. 3. The received image data and the transmitted image data are 1
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Means for detecting an overlap between the specific area detected by the means and the sub-screen area, and when the specific area and the sub-screen area are determined to overlap each other, the sub-screen area does not overlap the specific area. And a moving display control means for moving and displaying the moving image in an area other than the specific area. 4. The method according to claim 1, wherein the received image data and the transmitted image data are 1
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Means for detecting the overlap between the specific area and the small screen area detected by the means, and the specific area and the small screen area are each determined to be overlapped with each other so that the specific area does not overlap the small screen. A videophone device comprising a reduced display control means for reducing and displaying the entire main screen area. 5. The method according to claim 1, wherein the received image data and the transmitted image data are 1
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Means for detecting the overlap between the specific area and the small screen area detected by the means, and the specific area and the small screen area are each determined to be overlapped with each other so that the specific area does not overlap the small screen. A videophone device comprising: a moving display control means for moving and displaying a main screen area. 6. The method according to claim 1, wherein the received image data and the transmitted image data
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Overlap detecting means for detecting the overlap between the specific area detected by the means and the small screen area; and display inhibition control means for not displaying the small screen for a certain period of time when it is determined that the specific area and the small screen area overlap each other. A videophone device comprising: 7. The received image data and the transmitted image data are
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Overlap detection means for detecting an overlap between the specific area detected by the means and the small screen area; display range setting means for setting a display range; and the specific area and the small screen area are each determined to have overlapped, and A videophone device provided with means for reducing the size of the sub-screen area after moving the sub-screen to the display range limit when it is determined that the sub-screens still overlap even if the sub-screen is moved within the display range. . 8. The method according to claim 1, wherein the received image data and the transmitted image data
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Overlap detection means for detecting an overlap between the specific area detected by the means and the small screen area; display range setting means for setting a display range; and the specific area and the small screen area are each determined to have overlapped, and A videophone device provided with means for reducing the size of the parent screen area after moving the parent screen to the display range limit when it is determined that the parent screen is still overlapped even when the parent screen is moved within the display range. . 9. The receiving image data and the transmitting image data are set to 1
A videophone apparatus for transmitting and receiving image data via a communication line, comprising means for displaying parent and child two screens on one screen, comprising: a specific area detecting means for detecting a specific area in the main screen; Overlap detection means for detecting the overlap between the specific area detected by the means and the small screen area; limit reduction rate setting means for setting the limit reduction rate; and the specific area and the small screen area are each determined to be overlapped. In addition, when it is determined that the child screens are still overlapped even after being reduced to the limit reduction rate, means is provided for moving the child screen area to an area other than the specific area after reducing the child screen to the limit reduction rate. A video telephone device. 10. A videophone device comprising means for displaying received image data and transmitted image data on a single screen in two parent and child screens, and transmitting and receiving image data via a communication line. Specific area detection means for detecting a specific area; overlap detection means for detecting an overlap between the specific area detected by the specific area detection means and the sub-screen area; limit reduction rate setting means for setting a limit reduction rate; If it is determined that the specific area and the child screen area overlap each other, and it is determined that the parent screen is still overlapped even when reduced to the limit reduction rate, the parent screen is reduced to the limit reduction rate, and then the parent screen is reduced. A videophone device comprising means for moving and displaying a screen area to an area other than an area overlapping a child screen. 11. The videophone device according to claim 1, wherein the certain area in the main screen is a face area of a person. 12. The videophone device according to claim 1, wherein the specific area in the main screen is a text area. 13. The videophone device according to claim 1, wherein the specific area in the main screen is a fixed area in the screen specified by an external input unit. Video phone equipment.