JP2002232857A - Remote face-to-face communication apparatus capable of compositing video of participant and other video and transmitting composite video - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a remote face-to-face communication apparatus capable of compositing the video of a participant with a video obtained by photographing other information such as character and picture in a readable state and transmitting a composite video to an opponent. SOLUTION: This apparatus is provided with a first half mirror 7 arranged on the optical axis of a photographing means, a second half mirror 8 arranged in a position confronted with the first half mirror between an original display means 2 and a light source 3 for original display means and a mirror 9 which is confronted with the first half mirror and installed in the opposite side of the second half mirror. The photographing means 4 optically compositing the video of a user, which passes through the first half mirror, and the video of an original, which is reflected on the second half mirror and the first half mirror and photographs it. The video photographed by a video transmission means 5 is transmitted to other communication equipment. The video received from other communication equipment and is displayed on a first display means is reflected on the mirror and the first half mirror and the user can view it.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a remote face-to-face communication apparatus capable of synthesizing a video of a participant and other video such as characters and pictures and transmitting the video when conducting a video conference or the like.

[0002]

2. Description of the Related Art In a conventional video conference apparatus, a terminal device having a photographing means such as a television camera and a display means such as a television monitor is installed at a plurality of locations connected by a communication line. Are transmitted to each other via a communication line so that a conference can be performed while viewing each other's images on a television monitor or the like. In the conventional device, when there is other information (hereinafter, also referred to as "document") to be transmitted to the other party, the participant displays the subject to be photographed by the television camera. This is to transmit a video shot by switching to a platen such as a board, and it was not possible to transmit a video shot simultaneously with a participant and the original in a legible state to the other party.

Further, in a conventional video conference apparatus, a monitor for displaying an image of the other party and a camera for photographing the user are arranged separately, so that when the user gazes at the monitor, the line of sight is viewed from the optical axis of the camera. In other words, the image of the user looking in another direction is displayed on the other monitor. Further, since the user cannot confirm his / her own expression transmitted to the other party, there is a disadvantage that the conference using the video conference device is far from natural conversation and has no sense of presence. Was.

[0004]

SUMMARY OF THE INVENTION The present invention solves the above-mentioned problems of the prior art, and synthesizes an image of a participant's image and other information such as characters and pictures in a legible state. It is another object of the present invention to provide a remote face-to-face communication device capable of transmitting data to a partner. In addition, the present invention enables a user of a video conference apparatus or the like to match his / her gaze with each other and to confirm his / her own expression transmitted to the other party, thereby enabling a realistic and natural dialogue. It is another object of the present invention to provide a ground-to-face communication device.

[0005]

In order to solve the above-mentioned problems, the present invention has the following arrangement. 1. In a communication device connected to another communication device and used for a communication system for exchanging a video of a user between the communication devices, the communication device includes a document display unit, a light source for the document display unit, and a line of sight of the user. It has a photographing means arranged in, a video transmitting means for transmitting an image photographed by the photographing means to another communication device, a first display means for displaying a video received from another communication device, A first half mirror provided on the optical axis of the photographing means, a second half mirror provided at a position opposed to the first half mirror between the document display means and the light source for the document display means, A mirror provided opposite to the half mirror and provided on the opposite side of the second half mirror, and the image of the user transmitted through the first half mirror, reflected by the second half mirror and the first half mirror. Of the original document The image is optically synthesized by the photographing means and photographed, and the image photographed by the image transmitting means is transmitted to another communication device, and the image received from the other communication device and displayed on the first display means is displayed. A remote face-to-face communication device capable of combining and transmitting a video of a participant and another video, wherein the video is reflected by a mirror and the first half mirror so as to be visible to a user. 2. The remote face-to-face communication device according to claim 1, wherein the light amount of the light source for the document display means is adjustable. 3. 3. The remote-to-face communication device according to 1 or 2, wherein the first half mirror is configured to be able to switch the light transmittance between a half mirror and a normal mirror. 4. The light-transmitting property of the first half mirror is configured to be switchable by interposing a releasable sheet material between two sheet materials having partial light-transmitting properties. The remote location face-to-face communication device according to claim 1. 5. A second display unit for displaying an image captured by the imaging unit, an image transmission unit for distributing and transmitting the image captured by the imaging unit to another communication device and the second display unit, 5. The remote-to-face communication device according to any one of claims 1 to 4, wherein the image displayed on the second display means together with the image displayed on the display means is visible to the user. 6. 6. The remote place-to-face communication according to claim 5, wherein the first display means and the second display means are integrated, and a picture taken by the picture taking means and a picture received from another communication device are combined and displayed. apparatus. 7. 7. The remote-to-face communication device according to 5 or 6, wherein an image photographed by the photographing means and distributed to and transmitted to the second display means is inverted left and right in the image transmitting means and output. 8. 8. A remote location facing device according to any one of 5 to 7, wherein an image photographed by the photographing means and distributed to the second display means and transmitted is displayed on the second display means so as to be able to be switched on / off. Communication device.

[0006]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a remote face-to-face communication apparatus capable of synthesizing a participant's image and another image and transmitting the image according to the present invention. The examples do not limit the invention. 1 and 2 are diagrams showing an example of a remote face-to-face communication device of the present invention. FIG. 1 is a schematic diagram showing a configuration of a device at a certain communication site, and FIG. It is a figure showing the picture transmitted to a participant.

The communication device 1 includes a document display means 2, a light source 3 for the document display means, a photographing means 4 arranged in the line of sight of the user 11, and an image photographed by the photographing means 4 to another communication device. And a first display unit 6 for displaying an image received from another communication device (not shown). In this communication device 1, a first half mirror 7 is arranged on the optical axis of the photographing means 4, and is located at a position facing the first half mirror 7 between the original display means 2 and the light source 3 for the original display means. , A second half mirror 8 is provided. Further, a mirror 9 is arranged on the opposite side of the second half mirror 8 so as to face the first half mirror 7.

In this communication device 1, photographing means (camera)
By capturing an image of the user 11 through the first half mirror 7 disposed on the optical axis of the camera 4, an image of the user 11 looking straight at the camera 4 is obtained. The light from the light source 3 is transmitted through the second half mirror 8 to irradiate the original 12 placed on the original display means 2 with light, so that the image of the original 12 is displayed on the second half mirror 8 and the first half mirror 8. The light is reflected by the half mirror 7 and acquired by the camera 4. At this time, by selecting the size and shape of the document display means 2, the position of the document 12 placed on the document display means 2, and the like, the image of the user 11 and the image of the readable document 12 are synthesized and Can be transmitted to the other device. For example, by using the horizontally long document display means 2 and placing the documents 12 on both sides thereof, it is possible to synthesize an image in which the documents 12 are arranged on both sides of the user 11 as shown in FIG. Also,
It is needless to say that the vertical document display means 2 can be used to appropriately change the image in which the document 12 is arranged above or below the user 11.

As the light source 3 of the communication device 1, it is preferable to use a light source capable of adjusting the light amount, particularly a light source capable of adjusting the light amount by the user 11 by remote control at hand. By using such a light source 3, a user 1 who shoots with a camera 4 and transmits it to another device.
It is possible to switch the content of the composite image of the document 1 and the document 12. That is, when the light amount of the light source 3 is substantially equal to the light amount transmitted from the user 11 through the first half mirror 7 and incident on the camera 4 (hereinafter, referred to as “incident light amount”), it can be seen in FIG. Such a combined image of the user 11 and the document 12 is transmitted to another device. When the light amount of the light source 3 is higher than the incident light amount, an image in which the image of the original 12 is emphasized is transmitted. Can be changed to something that is not visible at all.
When the light source 3 is turned off, an image of only the user 11 who looks straight at the camera 4 is transmitted to another device, and a video conference in which the eyes are matched with each other is performed.

The switching of the image taken by the camera 4 and transmitted to another device can also be performed by using, as the first half mirror 7, a mirror whose light transmittance can be switched between a half mirror and a normal mirror. Can do it. FIG. 3 is a schematic cross-sectional view showing one example of a mirror whose light transmittance can be switched between a half mirror and a normal mirror. This mirror 17
Has a three-layer structure in which a detachable sheet material 19 is inserted between two thin half mirrors 18, 18.

When a reflective sheet such as an aluminum foil is inserted as the sheet material 19, this mirror 17
Will function as a normal mirror. Therefore, the incident light from the user 11 is reflected and does not reach the camera 4, and only the image of the document 12 is photographed by the camera 4,
Sent to another device. On the other hand, when the sheet material 19 is not inserted, or when a transparent sheet is inserted as the sheet material 19, the mirror 17 functions as a half mirror, and the user 11 and the document 12 as shown in FIG. The captured image is captured by the camera 4 and transmitted to another device.

FIGS. 4A and 4B show another example of a mirror which can be switched between a half mirror and a normal mirror. FIG. 4A is a schematic sectional view thereof, and FIG. 4B is a sheet material used for the mirror. FIG. This mirror 27 is a mirror 17 of FIG.
Has a three-layer structure, and has two half mirrors 28, 2
8, a sheet material 29 configured to be windable on both sides is inserted (see FIG. 4A). This sheet material 29 is made of a reflective sheet 29a such as aluminum foil.
And the transparent sheet 29b (FIG. 4B).
reference). Therefore, when the sheet 29 is wound to the left, the transparent sheet 29b is placed between the half mirrors 28, 28.
Exists, and the mirror 27 functions as a half mirror. On the other hand, when the sheet 29 is wound to the right, the reflective sheet 29 is provided between the half mirrors 28, 28.
a is present, the mirror 27 functions as a normal mirror, and the incident light from the user 11 is reflected by the mirror 27, so that the image of the user 11 is not captured by the camera 4.

As described above, in the remote face-to-face communication apparatus of the present invention, the light amount of the light source 3 for the document display means is adjusted or
Alternatively, by using a mirror capable of switching light transmittance as shown in FIGS. 3 and 4 as the first half mirror 7, it is possible to switch an image to be transmitted to another device. Therefore, if one does not want to transmit one's own video to other participants in the video conference, for example, one can use one's own photograph as the original 12 placed on the original display means 2 and transmit a still image. Rich usage is possible.

FIGS. 5 and 6 are diagrams showing another example of the remote face-to-face communication device of the present invention. FIG. 5 is a schematic diagram showing the configuration of the device at a certain communication site, and FIG. It is a figure showing the picture which a user of a device sees. In this communication device 21, an image captured by the camera 4 as an image transmission unit is transmitted to another communication device (not shown) and the second display unit 1.
Video transmission means 15 capable of distributing and transmitting the image data to 0 is used. The other configuration of the communication device 21 is the same as the device of FIG.

In this communication device 21, the user 11 takes an image of himself / herself which is photographed by the camera 4, distributed to the second display means 10 and displayed (the image 1 displayed small at the top of FIG. 6).
1), the images of the other participants 22 and the original document 23 received from another communication device and displayed on the first display means can be simultaneously viewed. The communication device 21 allows the user to check his / her own expression and manuscript transmitted to the other participants, so that the conversation can be made with confidence. In addition, since the dialogue is performed while watching the images of the other party looking directly at each other, it is possible to hold a natural and realistic meeting.

In this example, the second display means 10 is arranged above the first display means 6, and the image displayed on the second display means 10 is reflected by the mirror 9 and the first half mirror 7. Instead, the second display means 10 is arranged directly in the eyes of the user 11, but the second display means 10 is arranged beside the first display means 6, and the first display means 6 and the second display means 10 Both the displayed images are reflected by the mirror 9 and the first half mirror 7,
You may comprise so that it may be in the eyes of the user 11.

FIGS. 7 and 8 are diagrams showing another example of the remote face-to-face communication device of the present invention. FIG. 7 is a schematic diagram showing the configuration of the device at a certain communication site, and FIG. It is a figure showing the picture which a user of a device sees. This device 3
In 1, a first display means and a second display means are integrated to form a display means 16, and a video synthesizing means 13 is provided in a circuit connecting the video transmission means 15 having a video distribution function and the display means 16. Was. Then, the image received from the other communication device and the image of the user 11 distributed by the image transmitting unit 15 are synthesized by the image synthesizing unit 13 and displayed on the display unit 16, and the mirror 9 and the first half mirror 7 are displayed. Then, as shown in FIG. 8, for example, the other participant 22 and its original document 23 and an image obtained by synthesizing the own image 11 are delivered to the user 11.

In this apparatus 31, the video transmitting means 1
5 is connected to the video synthesizing means 13 in a circuit.
And the image of the user 11 displayed on the display means 16 can be switched on and off. The switching operation of the switch 14 can be automatically performed at regular intervals by using, for example, a timer, or the user 11 can perform switching by a remote control switch at hand. Further, the magnitude of the movement of the image of the user 11 is recognized in the image transmission means 15, and when the movement of the image is large, the switch 14 is turned on.
May be closed so that the image of the user 11 is displayed on the display means 16. Since it is not always necessary to always display the image of the user 11 himself / herself displayed on the display means 16, a switch 14 is provided and the user 11
Is displayed, the user 11 can concentrate on the conversation with the other party. This communication device 31
The other configuration is the same as that of the device of FIG.

In the above specific example, an example in which the remote face-to-face communication apparatus of the present invention is applied to a video conference has been described.
The present invention is not limited to these specific examples, and can be used as a device for holding a conference between a plurality of participants, such as a videophone, in addition to a video conference.
Also, when distributing and transmitting the image captured by the image capturing unit 4 by the image transmitting unit, the signal is A / D converted by an A / D converter (not shown) and transmitted as a digital signal. For example, a process may be performed such that the image to be displayed on the screen is inverted left and right and displayed.

[0020]

According to the above configuration, the remote face-to-face communication apparatus of the present invention can provide the following remarkable effects. (1) It is possible to combine a video of a user of the device with a video of another information such as characters and pictures in a legible state and transmit the synthesized video to the other party. (2) The video to be transmitted to the other party can be switched by adjusting the light amount of the light source for the document display means or by switching the light transmittance of the first half mirror. (3) The user of the device can hold a conference while watching a video whose eyes are matched with each other. In addition, since it is possible to confirm the expression and the like of the user transmitted to the other party, it is possible to perform a realistic and natural conversation with confidence.

[Brief description of the drawings]

FIG. 1 is a diagram showing one example of a configuration of a remote location face-to-face communication device of the present invention.

FIG. 2 is a diagram showing an image transmitted to another participant by the apparatus of FIG. 1;

FIG. 3 is a diagram showing an example of a mirror capable of switching light transmittance, which is used in a remote location communication device of the present invention.

FIG. 4 is a diagram showing another example of a mirror capable of switching light transmittance.

FIG. 5 is a schematic diagram showing another example of the configuration of the remote location communication apparatus of the present invention.

FIG. 6 is a diagram showing an image displayed on the device of FIG. 5;

FIG. 7 is a schematic diagram showing another example of the configuration of the remote location communication device of the present invention.

FIG. 8 is a diagram showing an image displayed on the device of FIG. 7;

[Explanation of symbols]

 1, 21, 31 Remote location face-to-face communication device 2 Original display means 3 Light source 4 Imaging means 5, 15 Video transmission means 6 First display means 7 First half mirror 8 Second half mirror 9 Mirror 10 Second display Means 11,22 User 12,23 Document 13 Image synthesis means 14 Switch 16 Display means 17,27 Mirror 18,28 Half mirror 19,29 Sheet material

 ──────────────────────────────────────────────────続 き Continued on front page F term (reference) 2H042 DA02 DA11 DA21 DB01 DD04 DE00 5C022 AA12 AB15 AB68 AC01 AC51 5C064 AA02 AB03 AB04 AC03 AC12

Claims (8)

[Claims] 1. A communication device connected to another communication device and used for a communication system for exchanging a video of a user between the communication devices, the communication device comprising: a document display unit; a light source for the document display unit; It has photographing means arranged in the user's line of sight, image transmitting means for transmitting an image photographed by the photographing means to another communication device, and first display means for displaying an image received from another communication device. A first half mirror provided on the optical axis of the photographing means, and a second half provided at a position facing the first half mirror between the document display means and the light source for the document display means. A mirror, comprising a mirror provided opposite to the first half mirror and provided on the opposite side of the second half mirror, wherein the image of the user transmitted through the first half mirror, the second half mirror and the first Reflected by half mirror The image of the placed document is optically synthesized by the photographing unit and photographed, and the image photographed by the image transmitting unit is transmitted to another communication device and received from the other communication device and displayed on the first display unit. The reflected image is reflected by the mirror and the first half mirror so as to be visible to the user, and a remote place facing the participant's image and another image that can be transmitted. Communication device. 2. The remote face-to-face communication apparatus according to claim 1, wherein the light amount of the light source for the document display means is adjustable. 3. A remote face-to-face communication apparatus according to claim 1, wherein the first half mirror has a light transmittance switchable between a half mirror and a normal mirror. 4. A structure in which the light transmittance of the first half mirror is switchable by interposing a releasable sheet material between two sheet materials having partial light transmittance. 4. The remote face-to-face communication device according to claim 3, wherein: 5. Second display means for displaying an image taken by the photographing means, and image transmitting means for distributing and transmitting the image taken by the photographing means to another communication device and the second display means. The remote place facing according to any one of claims 1 to 4, wherein the image displayed on the second display means together with the image displayed on the first display means can be viewed by a user. Communication device. 6. The display device according to claim 5, wherein the first display means and the second display means are integrated, and a picture taken by the picture taking means and a picture received from another communication device are combined and displayed. 2. The remote face-to-face communication device according to claim 1. 7. The remote place according to claim 5, wherein an image photographed by the photographing means and distributed to the second display means and transmitted is inverted left and right in the image transmitting means. Two-way communication device. 8. An image photographed by the photographing means and distributed to the second display means and transmitted to be displayed on the second display means in an on-off switchable manner.
A remote-to-face communication device according to any one of the above.