JP4481275B2 - 3D video information transmission method - Google Patents

Description

  The present invention relates to a transmission method of 3D video information, and more particularly, a transmission method of 3D video information for transmitting 3D video information using a conventional 2D video transmission path for existing television broadcasting or the like. About.

The present inventors have been able to suppress a contradiction between physiological factors of stereoscopic vision, and can easily display a three-dimensional stereoscopic image without using glasses, and a three-dimensional display device using a DFD (Depth Fused 3D) method. (For example, refer to Patent Documents 1 and 2).
The proposed three-dimensional display device described above displays 2D images on a plurality of display surfaces, and changes the brightness or transparency of the 2D images displayed on the plurality of display surfaces for each display surface. A three-dimensional stereoscopic image is displayed. The display principle of the DFD type three-dimensional display device will be described later.
On the other hand, a parallax stereogram (1903, proposed by FE Ive, USA) has been proposed for a long time as a stereoscopic display method of a display device used for a terminal of a 3D video system (see Non-Patent Document 1). )

As prior art documents related to the invention of the present application, there are the following.
Japanese Patent No. 3022558 Japanese Patent Application No. 2000-124036 Supervised by Takehiro Izumi, edited by NHK Science and Technology Research Laboratories, “Basics of 3D Video”, Ohm, p.145

The aforementioned DFD type 3D display device (for example, a 3D display device having a front display surface and a rear display surface) or a parallax type 3D display device is installed in, for example, a general household. By transmitting 3D video information for displaying a stereoscopic image on the 3D display device using an existing television broadcasting network, a general user can view still images or moving images at home. It is possible to observe a three-dimensional stereoscopic image.
However, when transmitting the above-described 3D video information, 2D video data displayed on the front display surface and 2D video data displayed on the rear display surface, or 2D video data for the right eye and the left eye Therefore, there is a problem that the above-described 3D video information cannot be transmitted using an existing television broadcasting network.

The present invention has been made to solve the above-mentioned problems of the prior art, and an object of the present invention is to utilize 3D video information using a conventional 2D video transmission path such as a television broadcasting network. Another object of the present invention is to provide a method of transmitting 3D video information that can be transmitted in a manner that is
The above and other objects and novel features of the present invention will become apparent from the description of this specification and the accompanying drawings.

Of the inventions disclosed in this application, the outline of typical ones will be briefly described as follows.
The present invention is a transmission method of 3D video information composed of a 2D texture image and depth information added to each pixel of the texture image, wherein the 2D texture image is transmitted on the transmission side. Depth information added for each pixel of the texture image instead of image data continuous to the R, G, B image data for every three lines for every three lines of R, G, B image data Is inserted as data for one line, and the R, G, B image data and the depth information inserted into the R, G, B image data are converted into conventional two-dimensional video for television broadcasting or the like. The depth information is extracted from the received R, G, B image data, and the R, G, B images of the two-dimensional texture image are transmitted. Data and previous Wherein the reconfiguring the depth information is added for each pixel of the texture image.

The invention of the present application is a transmission method of 3D video information composed of a 2D texture image and depth information added for each pixel of the texture image. For every three pixels of R, G, B image data of the texture image , instead of image data continuous to the R, G, B image data of every three pixels , it is added for each pixel of the texture image The depth information is inserted as data for one pixel, and the R, G, and B image data and the depth information inserted in the R, G, and B image data are converted into conventional two for television broadcasting. The two-dimensional texture image R, G, B is extracted from the received R, G, B image data on the receiving side. Previous image data and Wherein the reconfiguring the depth information is added for each pixel of the texture image.

The effects obtained by the representative ones of the inventions disclosed in the present application will be briefly described as follows.
According to the 3D video information transmission method of the present invention, 3D video information can be transmitted using a conventional 2D video transmission path such as a television broadcasting network.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
In all the drawings for explaining the embodiments, parts having the same functions are given the same reference numerals, and repeated explanation thereof is omitted.
[Display principle of the three-dimensional display device as the basis of the present invention]
FIG. 4 is a diagram showing a schematic configuration of a three-dimensional display device that is the basis of the present invention, which is the three-dimensional display device shown in FIG.
The three-dimensional display device shown in FIG. 1 sets a plurality of display surfaces, for example, display surfaces (101, 102) (the display surface 101 is closer to the observer 100 than the display surface 102) on the front surface of the observer 100. In order to display a plurality of two-dimensional images on the display surfaces (101, 102), an optical system 103 is constructed using a two-dimensional display device and various optical elements.
Hereinafter, the display principle of the three-dimensional display device, which is the basis of the present invention, will be described with reference to FIGS.
As shown in FIG. 5, an image (hereinafter referred to as a “2D image”) that is obtained by projecting a three-dimensional object 104 to be presented to the viewer 100 from the viewing direction of both eyes of the viewer 100 onto the display surface (101, 102). Is generated) (105, 106).

As a method for generating the 2D image, for example, a method using a two-dimensional image obtained by photographing the object 104 with a camera from the line-of-sight direction, a method of combining from a plurality of two-dimensional images taken from different directions, or computer graphics There are various methods such as a synthesis technique based on the above and a method using modeling.
Then, as shown in FIG. 4, the 2D image (105, 106) is viewed from one point on the line connecting the right eye and the left eye of the observer 100 on both the display surface 101 and the display surface 102, respectively. Display to overlap.
This can be achieved, for example, by controlling the arrangement of the center position and the gravity center position of each 2D image (105, 106) and the enlargement / reduction of each image.
An important point of the three-dimensional display device that is the basis of the present invention is that the brightness of each of the 2D images (105, 106) is constant in the overall brightness as viewed from the observer 100 on the device having the above-described configuration. It is to change corresponding to the depth position of the three-dimensional object 104.

An example of how to change is described below. Here, since it is a black and white drawing, the higher luminance is shown darkly in the following drawings for easy understanding.
For example, when the three-dimensional object 104 is on the display surface 101, as shown in FIG. 6, the luminance of the 2D image 105 above is made equal to the luminance of the three-dimensional object 104, and 2D on the display surface 102 is displayed. The luminance of the converted image 106 is zero.
Next, for example, when the three-dimensional object 104 is slightly away from the viewer 100 and is slightly closer to the display surface 102 than the display surface 101, the brightness of the 2D image 105 is increased as shown in FIG. Slightly lower the brightness of the 2D image 106 slightly.
Further, for example, when the three-dimensional object 104 is further away from the observer 100 and is further away from the display surface 101 toward the display surface 102, the brightness of the 2D image 105 is further increased as shown in FIG. The brightness of the 2D image 106 is further increased.

Finally, for example, when the three-dimensional object 104 is on the display surface 102, the luminance of the 2D image 106 on the display surface 102 is made equal to the luminance of the three-dimensional object 104 as shown in FIG. The brightness of the 2D image 105 is zero.
By displaying in this way, even if the 2D image (105, 106) is displayed due to the physiological or psychological factors or illusions of the observer (person) 100, it is as if the observer 100 It feels as if the three-dimensional object 104 is located in the middle of the display surface (101, 102).
That is, for example, when a 2D image (105, 106) having substantially equal luminance is displayed on the display surface (101, 102), the three-dimensional object 104 is located near the middle of the depth position of the display surface (101, 102). It feels like there is.
Examples of the two-dimensional display device for displaying a two-dimensional image on the display surface include a CRT, a liquid crystal display, an LED display, an EL display, a plasma display, an FED display, a projection display, a line drawing display, and the like. As the optical element, for example, a lens, a total reflection mirror, a partial reflection mirror, a curved mirror, a prism, a polarization element, a wave plate, or the like is used.

[Example]
In this embodiment, 3D video information is transmitted using an existing television broadcasting network.
FIG. 1 is a schematic diagram for explaining 3D video information transmitted using an existing television broadcasting network in a 3D video information transmission method according to an embodiment of the present invention.
As shown in FIG. 1, in the 3D video information transmission method of the present embodiment, 3D video information transmitted using an existing television broadcasting network is a 2D texture image (R, G, B). Brightness information) and depth information (Z information) added to each pixel of the texture image.
As described above, the important point of the three-dimensional display device that is the basis of the present invention is that the luminance of each of the 2D images (105, 106) is kept constant while maintaining the overall luminance as viewed from the observer 100. It is to change corresponding to the depth position of the three-dimensional object 104.
Therefore, according to the depth information (Z information) transmitted using the existing television broadcasting network, the two-dimensional texture image (R, G, B) transmitted using the existing television broadcasting network is used. The 2D image (105, 106) can be generated by distributing the luminance (or transmissivity) of the luminance information) into two and generating two two-dimensional images.

FIG. 2 is a block diagram showing a three-dimensional display device that displays a three-dimensional stereoscopic image based on the three-dimensional video information transmitted by the transmission method of the present embodiment.
The three-dimensional display device 10 shown in FIG. 2 is installed in a general home, for example, 11 is a video signal decoding unit, 12 is a three-dimensional video signal generation unit, 101 is a front display surface, 102 Is the rear display surface. For the configuration method of the display surfaces (101, 102), refer to the above-mentioned patent documents.
The video signal decoding means 11 is a means for decoding a video signal from a signal received via an antenna or cable, and has a function equivalent to that of a conventional color television.
The 3D video signal generation means 12 is a means for generating 2D images (105, 106) to be displayed on the front display surface 101 and the rear display surface 102.
For example, when the three-dimensional object 104 is in the middle of the depth position of the display surface (101, 102), on the transmission side (for example, a broadcasting station), as the Z information, the intermediate position of the depth position of the display surface (101, 102) Is transmitted to the three-dimensional display device 10.
Based on the Z information, the 3D video signal generation unit 12 of the 3D display device 10 divides the received luminance information on a one-to-one basis, and displays a substantially equal luminance 2D image (105, 105) on the display surface (101, 102). 106) is displayed.
Thereby, the observer observes the three-dimensional stereoscopic image so that the three-dimensional object 104 is near the middle of the depth position of the display surface (101, 102).

As described above, in this embodiment, since the two-dimensional texture image and the depth information are transmitted as the three-dimensional video information to be transmitted, the two-dimensional video data (R, G) displayed on the front display surface is transmitted. , B) and the two-dimensional video data (R, G, B) displayed on the rear display surface, the amount of transmitted data can be reduced to 2/3. .
The depth information (Z information) is based on the distance data obtained by measuring the distance from the camera position to the three-dimensional object 104 with a distance measurement device when the three-dimensional object 104 is photographed with the camera from the viewing direction. Can be generated.
The two-dimensional texture image (R, G, B luminance information) constituting the three-dimensional video information of this embodiment is the same as the R, G, B luminance information transmitted in the existing television broadcasting network. Therefore, this two-dimensional texture image (R, G, B luminance information) can be transmitted using an existing television broadcasting network.
However, the depth information (Z information) constituting the 3D video information of this embodiment cannot be transmitted as it is using the existing television broadcasting network. Therefore, in this embodiment, this depth information (Z information) is inserted into a two-dimensional texture image and transmitted.

Hereinafter, a method for inserting depth information into a two-dimensional texture image will be described.
(1) When the size of R, G, B image data of a two-dimensional texture image is smaller than the size of image data that can be transmitted, the size of R, G, B image data of a two-dimensional texture image Depth information (Z information) is inserted into the margin.
For example, as shown in FIG. 3, image data that can be transmitted is image data having an aspect ratio of 4: 3, and R, G, and B image data of a two-dimensional texture image are included in the image data that can be transmitted. If the image data has an aspect ratio of 16: 9 that falls within the range, margins appear above and below the R, G, and B image data of the two-dimensional texture image, so depth information (Z information) is added to that portion. insert.
When there is no margin in the R, G, B image data of the two-dimensional texture image as in the method (1), the R, G, B image of the two-dimensional texture image is as follows. Depth information (Z information) is inserted into the data.
(2) One line of depth information (Z information) is inserted for every three lines of R, G, B image data of a two-dimensional texture image.
(3) Depth information (Z information) for one pixel is inserted for every three pixels of R, G, and B image data of a two-dimensional texture image. However, in the methods (2) and (3), the image quality is degraded.

(4) Depth information (Z information) is inserted within a blanking period of R, G, B image data of a two-dimensional texture image.
In this embodiment, a two-dimensional texture image (R, G, B luminance information) is converted to an NTSC or HDTV signal and then transmitted via an existing television broadcast network.
Therefore, it is possible to insert and transmit depth information (Z information) within a blanking period in an NTSC or HDTV signal.
Even in the above-described methods (1) to (3), the two-dimensional texture image and the depth information (Z information) inserted into the two-dimensional texture image are NTSC or After being converted into an HDTV signal, it is transmitted via an existing television broadcasting network.
As described above, according to the present embodiment, it is composed of a two-dimensional texture image (R, G, B luminance information) and depth information (Z information) added to each pixel of the texture image. 3D video information can be transmitted using an existing television broadcasting network.

In the above description, the case where the three-dimensional display device 10 includes two display surfaces has been described. However, the three-dimensional display device 10 may have three or more display surfaces.
In the above description, for example, the case where the depth position of the entire three-dimensional object is expressed using a 2D image displayed on the front display surface and the rear display surface is mainly described. The three-dimensional display device 10 shown in FIG. 3 can be used as a device that expresses the depth of the three-dimensional object itself as described in the above-mentioned patent documents.
Similarly, the 3D display device 10 shown in FIG. 2 can also be used when the 3D object itself moves as described in the above-mentioned patent documents.
When the 2D image moves three-dimensionally, the movement in the left / right / up / down direction can be performed by moving image reproduction on the display surface in the same manner as in the case of a normal two-dimensional display device. As described in the above patent documents, a three-dimensional image is obtained by temporally changing the luminance (or transmittance) of the 2D image displayed on the front display surface and the rear display surface. Can be expressed.
Furthermore, the 3D video information transmission method of the present embodiment is also applicable to the case where the 3D display device 10 shown in FIG. 2 is a parallax 3D display device.
As mentioned above, the invention made by the present inventor has been specifically described based on the above embodiments. However, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. Of course.

FIG. 5 is a schematic diagram for explaining 3D video information transmitted using an existing television broadcasting network in the 3D video information transmission method according to the embodiment of the present invention. It is a block diagram which shows the three-dimensional display apparatus which displays a three-dimensional stereoscopic image based on the three-dimensional video information transmitted with the transmission method of a present Example. 3 is a diagram illustrating an example of a method for inserting depth information (Z information) into a two-dimensional texture image (R, G, and B luminance information) in the 3D video information transmission method according to the embodiment of the present invention. FIG. It is a figure which shows schematic structure of the three-dimensional display apparatus used as the basis of this invention. FIG. 4 is a diagram for explaining a method for generating a 2D image to be displayed on each display surface in the three-dimensional display device that is the basis of the present invention. It is a figure for demonstrating the display principle of the three-dimensional display apparatus used as the basis of this invention. It is a figure for demonstrating the display principle of the three-dimensional display apparatus used as the basis of this invention. It is a figure for demonstrating the display principle of the three-dimensional display apparatus used as the basis of this invention. It is a figure for demonstrating the display principle of the three-dimensional display apparatus used as the basis of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 3D display apparatus 11 Image | video signal decoding means 12 3D image signal generation means 100 Viewer 101,102 Display surface 103 Optical system 104 3D object 105,106 2D image

Claims (2)

A method of transmitting 3D video information comprising a 2D texture image and depth information added to each pixel of the texture image,
On the transmission side, instead of the image data continuous to the R, G, and B image data for each three lines , the texture image for each three lines of the R, G, and B image data of the two-dimensional texture image Depth information added for each pixel is inserted as data for one line, and the R, G, B image data and the depth information inserted in the R, G, B image data are Transmit to the receiving side using a conventional 2D video transmission channel such as for John Broadcasting,
On the receiving side, the depth information is extracted from the received R, G, B image data, and is added to each pixel of the R, G, B image data of the two-dimensional texture image and the texture image. 3D video information transmission method, wherein the depth information is reconstructed. A method of transmitting 3D video information comprising a 2D texture image and depth information added to each pixel of the texture image,
On the transmission side, instead of the image data continuous to the R, G, and B image data for each of the three pixels, the texture image is substituted for every three pixels of the R, G, and B image data of the two-dimensional texture image. Depth information added for each pixel is inserted as data for one pixel, and the R, G, B image data and the depth information inserted in the R, G, B image data are Transmit to the receiving side using a conventional 2D video transmission channel such as for John Broadcasting,
On the receiving side, the depth information is extracted from the received R, G, B image data, and is added to each pixel of the R, G, B image data of the two-dimensional texture image and the texture image. 3D video information transmission method, wherein the depth information is reconstructed.

Images