JP2013074381A - Parallax image generating apparatus, parallax image generating method, and control program of parallax image generating apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a parallax image generating apparatus, a parallax image generating method, and a control program of the parallax image generating apparatus, which output right and left parallax image signals as one signal.SOLUTION: A parallax image generating apparatus 10 comprises: a reception unit 11 for receiving an image signal comprising three-dimensional information; a positional data output unit 13 for outputting first positional data for generating a left-eye image and second positional data for generating a right-eye image; and an image signal output unit 12 which outputs a two-dimensional image signal by alternately generating the left-eye image based on the image signal and the first positional data and generating the right-eye image based on the image signal and the second positional data.

Description

  The present invention relates to a parallax image generation device, a parallax image generation method, and a control program for a parallax image generation device.

  In the field of video industry, in recent years, technologies related to creation and display of 3D video have been advanced, such as the sale of televisions (3D TVs) capable of displaying 3D video.

  For example, Patent Document 1 discloses a technique of a stereo viewer that processes and outputs 3D content data for a 2D display device to data for a 3D display device. In this stereo viewer, a right-eye image and a left-eye image are generated by different VRML plug-in drawing engines.

JP 2011-070432 A

  Conventionally, when executing image processing for coordinate conversion such as image enlargement, reduction, movement, and rotation, one circuit for coordinate conversion is required for one output. When creating left and right parallax images for stereoscopic display, one circuit is required for each of the left and right parallax images. Therefore, the circuit scale for creating a parallax image becomes large.

  For example, in Patent Document 1, a drawing engine for generating a right-eye image and a left-eye image is required.

  The present invention has been made to solve such a problem, and a parallax image generation device, a parallax image generation method, and a control program for a parallax image generation device that output right and left parallax image signals as one signal. The purpose is to provide.

  A parallax image generation device according to the present invention includes a receiving unit that receives a video signal, first position data for generating a left-eye image, and second position data for generating a right-eye image. The position data output unit to output, generation of the left-eye image based on the video signal and the first position data, and generation of the right-eye image based on the video signal and the second position data are alternately performed. And an image signal output unit for outputting a two-dimensional image signal.

  The parallax image generation method according to the present invention outputs a step of receiving a video signal, first position data for generating a left-eye image, and second position data for generating a right-eye image. A two-dimensional image obtained by alternately performing a step of generating a left-eye image based on the video signal and the first position data, and a generation of a right-eye image based on the video signal and the second position data. Outputting a signal.

  The parallax image generation device control program according to the present invention includes a step of receiving a video signal, first position data for generating a left-eye image, and second position data for generating a right-eye image. , And generating a left-eye image based on the video signal and the first position data and generating a right-eye image based on the video signal and the second position data are alternately performed. Outputting a two-dimensional image signal to the parallax image generating apparatus.

  According to the present invention, it is possible to provide a parallax image generation device, a parallax image generation method, and a control program for a parallax image generation device that output right and left parallax image signals as one signal.

1 is a diagram illustrating a configuration example of a parallax image generating device according to a first embodiment; It is a figure which shows the structural example of the parallax image generation apparatus concerning Embodiment 2. FIG. It is a figure which shows the example of the virtual camera imaging | photography position used for the camera coordinate transformation concerning Embodiment 2. FIG. It is a figure which shows the process example of the control signal converter etc. concerning Embodiment 2. FIG. FIG. 10 is a diagram illustrating a processing example of an output control unit and the like according to the second embodiment. FIG. 10 is a diagram illustrating a configuration example of a parallax image generating device according to a third embodiment. FIG. 10 is a diagram illustrating an example of a combined output signal according to the fourth embodiment. FIG. 10 is a diagram illustrating an example of a combined output signal according to the fourth embodiment. FIG. 10 is a diagram illustrating an example of a combined output signal according to the fourth embodiment.

Embodiment 1
The parallax image generation device according to the present embodiment alternately outputs a left-eye parallax image signal and a right-eye parallax image signal. In this way, the left-eye parallax image signal and the right-eye parallax image signal can be output as one signal.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall configuration example of a parallax image generating device according to the present embodiment. The parallax image generation device 10 includes a reception unit 11, an image signal output unit 12, and a position data output unit 13. The parallax image generation apparatus 10 is an apparatus that performs image generation / editing such as a production switcher, a video editing machine, or a computer such as a personal computer. The receiving unit 11, the image signal output unit 12, and the position data output unit 13 are appropriately configured by hardware such as an IC (integrated circuit) and / or software.

  The receiving unit 11 receives a video signal from the outside and outputs it to the image signal output unit 12. This video signal is a two-dimensional video signal.

  The image signal output unit 12 generates and outputs a two-dimensional left-eye image and a right-eye image, which are two parallax images, based on the received two-dimensional video signal and the position data received from the position data output unit 13. To do.

  Note that the image signal output unit 12 converts the received two-dimensional video signal into data of the three-dimensional information of the object in the video signal. Various parameters necessary for the conversion may be provided from the outside, or may be provided from a data holding unit (not shown) in the parallax image generation device 10. Then, a left-eye image is generated based on the three-dimensional information data and the three-dimensional first position data. Further, a right-eye image is generated based on the three-dimensional information data and the three-dimensional second position data. In this way, the image signal output unit 12 generates a two-dimensional left-eye image and right-eye image based on the received video signal.

  At this time, the image signal output unit 12 alternately generates a left-eye image and a right-eye image. Accordingly, the image signal output unit 12 alternately outputs the left-eye image signal and the right-eye image signal.

  The position data output unit 13 outputs two types of three-dimensional position data, ie, first position data and second position data, to the image signal output unit 12. This position data is data indicating virtual camera shooting positions of the left-eye image and the right-eye image on, for example, three-dimensional coordinates.

  The position data output unit 13 may output the first position data and the second position data to the image signal output unit 12 only once or a plurality of times. When the position data is output only once, the image signal output unit 12 holds the output position data, and generates a left-eye image and a right-eye image based on the data. When new position data is output from the position data output unit 13, the image signal output unit 12 holds the newly output position data instead of the previous position data, and based on the data, the image for the left eye and the image for the right eye Generate an image.

  Alternatively, the position data output unit 13 may alternately output the first position data and the second position data to the image signal output unit 12. In that case, the image signal output unit 12 generates a left-eye image if the output position data is the first position data, and generates a right-eye image if the output position data is the second position data. To do.

  As described above, the image signal output unit 12 alternately generates the left-eye image and the right-eye image and outputs a two-dimensional image signal. The image signal output unit 12 can output the two-dimensional image signal to be output as one signal by alternately outputting the left-eye image signal and the right-eye image signal. Accordingly, since only one circuit for generating the left-eye image and the right-eye image is required, the circuit scale of the parallax image generation device 10 can be reduced. Further, it is not necessary to prepare one signal line for each of the left-eye image and the right-eye image (two are prepared in total), and the left-eye image and the right-eye image can be combined into one signal line. Also by this, the circuit scale of the parallax image generation device 10 can be reduced.

Embodiment 2
The parallax image generation device according to the present embodiment periodically outputs a parallax image signal for the left eye and a parallax image signal for the right eye based on the clock. In this manner, as in the first embodiment, the left-eye parallax image signal and the right-eye parallax image signal can be output as one signal.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 2 shows an example of the overall configuration of the parallax image generating device according to the present embodiment. The parallax image generation device 20 includes a reception unit 21, a three-dimensional coordinate conversion unit 30, a control signal generator 22, a distance data holding unit 23, a clock generation unit 24, a control signal converter 25, an output control unit 26, and an image signal output unit. 27 and an image signal output unit 28. The three-dimensional coordinate conversion unit 30 corresponds to the image signal output unit 12 described in the first embodiment. The control signal generator 22, the distance data holding unit 23, the clock generation unit 24, and the control signal converter 25 correspond to the position data output unit 13 described in the first embodiment.

  The receiving unit 21 receives a two-dimensional video signal from the outside and outputs it to the three-dimensional coordinate conversion unit 30. This video signal is, for example, a video signal with a screen aspect ratio of 16: 9 used in high vision. Based on this video signal, the parallax image generation device 20 performs coordinate conversion, and generates parallax images of the left-eye image and the right-eye image for stereoscopic viewing.

  The three-dimensional coordinate conversion unit 30 performs three-dimensional coordinate conversion of the input two-dimensional video signal. Specifically, an object displayed in an image of a two-dimensional video signal is defined as an object in a virtual three-dimensional space. Thereafter, the three-dimensional coordinate conversion unit 30 in the three-dimensional space, a two-dimensional image obtained by photographing the object at the virtual first camera photographing position of the left-eye image, and a virtual second of the right-eye image. A two-dimensional image obtained by photographing an object at the camera photographing position is generated and output.

  The three-dimensional coordinate conversion unit 30 includes an enlargement / reduction unit 31, a local coordinate conversion unit 32, a world coordinate conversion unit 33, a camera coordinate conversion unit 34, and a perspective conversion unit 35 for generating a left-eye image and a right-eye image. .

  The enlargement / reduction unit 31 performs processing such as enlargement or reduction of the screen size on the input two-dimensional video signal. The enlargement / reduction unit 31 outputs the processed two-dimensional video signal to the local coordinate conversion unit 32. It should be noted that parameters necessary for processing such as a screen size enlargement or reduction ratio are supplied by a control signal output from the control signal generator 22.

  The local coordinate conversion unit 32 sets information of a three-dimensional coordinate system (local coordinate system) for each object in the received two-dimensional video signal. Thereby, the local coordinate conversion part 32 performs modeling of each object. Information about the set object is output to the world coordinate conversion unit 33. The parameters necessary for setting the local coordinate system are supplied from the control signal generator 22.

  The world coordinate conversion unit 33 arranges each object set by the local coordinate conversion unit 32 in a three-dimensional virtual space (a space defined by world coordinates). Thereby, conversion from the local coordinate system to the world coordinate system is executed. After performing the above conversion, the world coordinate conversion unit 33 outputs the three-dimensional coordinate information of the object viewed in the world coordinate system to the camera coordinate conversion unit 34.

この行列は同次変換行列であり、これによって、オブジェクトのｘ軸方向のサイズがＸｓｉｚｅ倍に拡大され、オブジェクトのｙ軸方向のサイズがＹｓｉｚｅ倍に拡大される。なお、（式１）におけるｘ軸、ｙ軸、ｚ軸は、ワールド座標のｘ軸、ｙ軸、ｚ軸のことである。以下の（式２）〜（式５）も同様である。 At the time of this conversion, enlargement or reduction, rotation, translation, etc. of the object are performed as appropriate. For example, an example of a scaling matrix size representing the enlargement or reduction of an object is as follows.

This matrix is a homogeneous transformation matrix, whereby the size of the object in the x-axis direction is expanded by Xsize and the size of the object in the y-axis direction is expanded by Ysize. Note that the x-axis, y-axis, and z-axis in (Expression 1) are the x-axis, y-axis, and z-axis of world coordinates. The following (Formula 2) to (Formula 5) are the same.

であり、ｘ軸回りの回転を表す回転行列Ｘｒｏｔは

であり、ｙ軸回りの回転を表す回転行列Ｙｒｏｔは

である。（式２）中の角度Ｚ、（式３）中の角度Ｘ、（式４）中の角度Ｙは、それぞれ、ｚ軸回りの回転角、ｘ軸回りの回転角、ｙ軸回りの回転角を示す。（式２）の回転行列Ｚｒｏｔにより、オブジェクトはｚ軸回りに角度Ｚで回転する。（式３）の回転行列Ｙｒｏｔにより、オブジェクトはｙ軸回りに角度Ｙで回転する。（式４）の回転行列Ｘｒｏｔにより、オブジェクトはｘ軸回りに角度Ｘで回転する。 A rotation matrix representing the rotation of the object is as follows. The rotation matrix Zrot representing the rotation around the z axis is

And the rotation matrix Xrot representing the rotation around the x axis is

And the rotation matrix Yrot representing the rotation around the y-axis is

It is. The angle Z in (Expression 2), the angle X in (Expression 3), and the angle Y in (Expression 4) are respectively a rotation angle around the z axis, a rotation angle around the x axis, and a rotation angle around the y axis. Indicates. By the rotation matrix Zrot of (Expression 2), the object rotates around the z axis at an angle Z. By the rotation matrix Yrot of (Equation 3), the object rotates around the y axis at an angle Y. By the rotation matrix Xrot of (Expression 4), the object rotates around the x axis at an angle X.

（式５）の平行移動行列ｐｏｓにより、オブジェクトは、ｘ軸方向にＸｐｏｓ、ｙ軸方向にＹｐｏｓ、ｚ軸方向にＺｐｏｓだけ平行移動する。なお、以上のワールド座標系の設定に必要なパラメータは、制御信号発生器２２から供給される。 A translation matrix pos representing the translation of the object is as follows.

The object is translated by Xpos in the x-axis direction, Ypos in the y-axis direction, and Zpos in the z-axis direction by the translation matrix pos of (Expression 5). The parameters necessary for setting the world coordinate system are supplied from the control signal generator 22.

  The camera coordinate conversion unit 34 converts the world coordinate system into the camera coordinate system in the three-dimensional information of the object received from the world coordinate conversion unit 33. The camera coordinate system is determined based on the parameters of the shooting position and shooting direction of the camera that shoots the object. This parameter is supplied by a control signal output from the control signal converter 25.

  Based on the three-dimensional information of the object and the virtual first camera photographing position for the image for the left eye, the camera coordinate conversion unit 34 is information (three-dimensional coordinates of the object photographed from the first camera photographing position ( 3D information for the left eye image) is generated. Similarly, based on the three-dimensional information of the object and the virtual second camera photographing position for the right-eye image, information on the three-dimensional coordinates of the object photographed from the second camera photographing position (the right-eye image 3D information) is generated. The camera coordinate conversion unit 34 periodically outputs three-dimensional information for the left-eye image and three-dimensional information for the right-eye image to the perspective conversion unit 35. Details of this will be described later.

  The perspective conversion unit 35 performs perspective conversion, and generates a two-dimensional left-eye image from the output three-dimensional information for the left-eye image. Similarly, a two-dimensional right-eye image is generated from the output three-dimensional information for the right-eye image.

ここで、ｒは、カメラから、透視変換に用いる仮想的なスクリーンまでの距離を表す。透視変換により、仮想的なスクリーンに映し出されたオブジェクトの画像を、透視変換部３５は２次元の画像として出力する。透視変換に必要なｒ等のパラメータは、制御信号発生器２２から制御信号により供給される。なお、（式６）におけるｘ軸、ｙ軸、ｚ軸は、カメラ座標系におけるｘ軸、ｙ軸、ｚ軸のことである。 An example of the transformation matrix pers used for perspective transformation is as follows.

Here, r represents the distance from the camera to the virtual screen used for perspective transformation. By the perspective transformation, the perspective transformation unit 35 outputs the image of the object displayed on the virtual screen as a two-dimensional image. Parameters such as r necessary for the perspective transformation are supplied from the control signal generator 22 by a control signal. Note that the x-axis, y-axis, and z-axis in (Expression 6) are the x-axis, y-axis, and z-axis in the camera coordinate system.

  The perspective transformation unit 35 periodically outputs three-dimensional information for the left-eye image and three-dimensional information for the right-eye image from the camera coordinate transformation unit 34. Thereby, the perspective conversion unit 35 outputs the first image signal including only the left-eye image and the second image signal including only the right-eye image separately. Here, the first image signal and the second image signal are output as one output signal. As described above, the three-dimensional coordinate conversion unit 30 outputs the first image signal and the second image signal.

  The control signal generator 22 holds parameters used for conversion such as enlargement, reduction, movement, and rotation. The control signal generator 22 supplies these parameters as control signals to the enlargement / reduction unit 31, the local coordinate conversion unit 32, the world coordinate conversion unit 33, and the perspective conversion unit 35.

  The control signal generator 22 further holds data of the camera reference position, and outputs the data of the reference position as a control signal to the control signal converter 25.

  The distance data holding unit 23 outputs to the control signal converter 25 data of a distance between the first camera photographing position and the camera reference position in the camera coordinate system (hereinafter referred to as a parallax distance) as a parameter. Note that the parallax distance data held by the distance data holding unit 23 is uniquely determined here.

  Here, the control signal converter 25 and the parallax distance will be described with reference to FIG. In FIG. 3, an object (represented as a sphere) as shown in FIG. 3A is photographed by the camera at the photographing position shown in FIG. In FIG. 3B, the reference position of the camera in the camera coordinate system (camera position when stereoscopic viewing is not performed) is C, the position of the left-eye image camera (hereinafter referred to as the first camera) is L, and the right eye. The position of the image camera (hereinafter referred to as a second camera) is R. In this case, the parallax distance d (positive value) indicates the distance between C and L in the x-axis direction or the distance between C and R. That is, the distance between the first camera shooting position and the camera reference position in the camera coordinate system and the distance between the second camera shooting position and the camera reference position are the same. In the example of FIG. 3B, since the parallax distance is d, when C = (x, y, z), L = (x−d, y, z), R = (x + d, y, z) Become.

  In the example of FIG. 3B, the case where the parallax distance of the camera is taken in the x-axis direction is considered, but the y-axis direction may be used.

  The gaze direction of the first camera in FIG. 3B is not parallel to the gaze direction of the camera at the reference position, and the gaze direction is shifted so as to photograph the same object as the camera at the reference position.

  The gaze direction of the second camera in FIG. 3B is not parallel to the gaze direction of the camera at the reference position, and the gaze direction is shifted so as to photograph the same object as the camera at the reference position. The gaze directions of the first camera and the second camera are uniquely determined by the parallax distance d and the gaze point of the camera.

  The gaze direction data of the first camera and the second camera is set so as to change according to the parallax distance. The control signal generator 22 supplies this data to the control signal converter 25.

  Hereinafter, the description returns to the parallax image generation device 20 of FIG. The clock generation unit 24 generates a clock and outputs it to the control signal converter 25.

  The control signal converter 25 converts the control signal passed to the camera coordinate conversion unit 34. Here, the control signal generator 25 outputs the data of the camera reference position and the data of the camera gaze direction as parameters from the control signal generator 22. The distance data holding unit 23 outputs parallax distance data as a parameter, and the clock generation unit 24 outputs a clock.

  Here, details of processing of the camera coordinate conversion unit 34, the control signal generator 22, the distance data holding unit 23, the clock generation unit 24, and the control signal converter 25 of FIG. 2 will be described with reference to FIG. The camera coordinate conversion unit 34 converts the data output from the control signal generator 22 (camera reference position (x, y, z) in FIG. 3) based on the clock generated by the clock generation unit 24. It is carried out. In this conversion method, the parallax distance d is added to or subtracted from the camera position x every clock, and the data of the first camera shooting position (x−d, y, z) and the second camera shooting position (x + d, y). , Z) is output every clock. In this way, the camera reference position is converted to the left and right camera positions for stereoscopic viewing every clock and supplied to the camera coordinate conversion unit 34.

  When data of the first camera shooting position is output, the camera gaze direction corresponding to the camera position is also supplied to the camera coordinate conversion unit 34. The same applies to the gaze direction of the camera corresponding to the second camera shooting position. The control signal generator 22 calculates the gaze direction of the camera based on the direction of the object and the parallax distance held in the distance data holding unit 23 and outputs it to the control signal converter 25.

  In FIG. 4, the parallax distance d is added / subtracted every clock, but the parallax distance d may be added / subtracted every several clocks. As described above, the control signal converter 25 converts the control signal based on the clock timing, and alternately converts the first camera photographing position data and the second camera photographing position data. To the unit 34. Similarly, the camera gaze direction data is alternately output to the camera coordinate conversion unit 34. The camera coordinate conversion unit 34 is a three-dimensional image for the right-eye image based on the first camera shooting position data and the corresponding gaze direction data, the second camera shooting position data and the corresponding gaze direction data. Information and three-dimensional information for the left-eye image are generated alternately.

  Hereinafter, returning to FIG. 2, the description of the parallax image generating device 20 will be continued. The output control unit 26 divides one video signal output from the perspective conversion unit 35 as two signals of a first image signal and a second image signal.

  Here, the details of the processing of the clock generation unit 24, the output control unit 26, and the image signal output units 27 and 28 will be described with reference to FIG. In FIG. 5, the video signal output from the perspective conversion unit 35 is divided into output signals for the right-eye image and the left-eye image for each clock by the output control unit 26.

  In FIG. 5, image signals indicated by 0 to 4 are input to the output control unit 26 every clock. Based on the clock of the clock generation unit 24, the output control unit 26 distributes the video signal output from the perspective conversion unit 35 into an output signal for the left-eye image and an output signal for the right-eye image. In FIG. 5, since image signals 0, 2, and 4 are signals for the left eye image and 1, 3 are signals for the right eye image, the image signals 0, 2, and 4 are sent to the image signal output unit 27. 1 and 3 are input to the image signal output unit 28. As a result, the parallax image generation device 20 generates two video signals having a resolution 1/2 that of the video signal received by the receiving unit 21 for each screen output. Alternatively, it may be said that the parallax image generation device 20 generates two video signals having a resolution that is 1/2 that of the signal for the right eye image and the signal for the left eye image that are generated when there is no clock. From the above, only the even-numbered image signal is output from the image signal output unit 27, and the odd-numbered image signal is not output. On the other hand, only the odd-numbered image signal is output from the image signal output unit 28, and the even-numbered image signal is not output.

  As described above, when the camera coordinate conversion unit 34 performs coordinate conversion in the camera coordinate system in the middle of the three-dimensional coordinate conversion, the control signal converter 25 transmits parallax distance data based on the clock to the camera coordinate conversion unit 34. give. Thereby, the three-dimensional coordinate conversion unit 30 generates parallax images of the right-eye image and the left-eye image.

  In a parallax image generation device such as a video production switcher that performs video production editing, when three-dimensional coordinate transformation such as enlargement, reduction, rotation, and movement is executed, one video that has been converted into one input video is displayed. Are output. Therefore, in a conventional apparatus, in order to generate a right-eye image and a left-eye image for a three-dimensional video, it is necessary to provide a left-eye coordinate conversion circuit and a right-eye coordinate conversion circuit on hardware.

  Specifically, in the conventional parallax image generation device, the clock generation unit 24 and the control signal converter 25 in FIG. 2 are not provided, and two camera coordinate conversion units corresponding to the first camera and the second camera are provided. It was done. The data of the first camera shooting position output from the control signal generator 22 is supplied to one camera coordinate conversion unit, and the data of the second camera shooting position is supplied to the other camera coordinate conversion unit. The two camera coordinate conversion units independently generate three-dimensional information for the left-eye image and three-dimensional information for the right-eye image, and individually output them with one signal line. Then, the three-dimensional information for the left-eye image and the three-dimensional information for the right-eye image are converted into the first image signal and the second image signal by separate perspective conversion units, and one by one as they are. Output as a signal. Therefore, two camera coordinate conversion units and two perspective conversion units are required.

  However, since it is necessary to prepare two coordinate conversion circuits for the left eye and for the right eye, there has been a first problem that the circuit scale in the parallax image generation device is increased. Furthermore, since a total of two left-eye and right-eye signals whose signal resolution does not change compared to before the coordinate conversion are output, there is a second problem that the number of signal lines in the apparatus increases.

  In the parallax image generation device 20 illustrated in FIG. 2, based on the clock signal, the input signal resolution is halved and coordinate conversion is performed to generate an output signal. Therefore, the right-eye image and the left-eye image can be generated by one coordinate conversion circuit, and the circuit scale of the coordinate conversion signal generation device corresponding to stereoscopic vision can be reduced. Further, even in the middle of the coordinate conversion circuit, the total signal band is equivalent to the band for one signal, and only one signal line is required. Therefore, the number of signal lines of the coordinate conversion signal generation apparatus corresponding to stereoscopic vision is reduced. I can do it.

  Furthermore, the output control unit 26 can separately output the first image signal and the second image signal without using another control device or the like by using the clock signal used for the camera coordinate conversion. For this reason, the number of circuits of the coordinate conversion signal generator can be reduced.

Embodiment 3
In the present embodiment, by changing the parallax distance shown in the second embodiment, it is possible to change the stereoscopic effect of the three-dimensional video composed of the right-eye image and the left-eye image.

  The configuration of the parallax image generation device 20 according to the present embodiment will be described with reference to FIG. The parallax image generating device 20 includes a distance data changing unit 29 in addition to the configuration shown in FIG. The other components of the parallax image generation device 20 are the same as those in FIG. The processing operation of the parallax image generation device 20 is the same as that in the second embodiment.

  The distance data changing unit 29 changes the data of the parallax distance held by the distance data holding unit 23 by changing the data of the parallax distance and outputting the data to the distance data holding unit 23. Thereby, the parallax distance data uniquely determined in the second embodiment and the corresponding gaze direction data of the camera can be appropriately changed.

  For example, the distance data changing unit 29 linearly changes the parallax distance from 0 to a value d and supplies the linear distance to the distance data holding unit 23. Accordingly, the parallax distance supplied from the distance data holding unit 23 to the control signal converter 25 is linearly changed from 0 to a value of d. At the initial time, the control signal converter 25 sends L = (x, y, z) as the coordinates of the first camera shooting position and R = ( x, y, z) is output. Thereafter, L = (x−α, y, z) is output as the coordinates of the first camera shooting position, and R = (x + α, y, z) is output as the coordinates of the second camera shooting position. Note that 0 <α <d, and α increases at a constant rate with time. Finally, L = (x−d, y, z) is output as the coordinates of the first camera shooting position, and R = (x + d, y, z) is output as the coordinates of the second camera shooting position.

  The camera coordinate conversion unit 34 generates three-dimensional information for the image for the left eye based on the coordinates of the first camera photographing position and the corresponding gaze direction data, and outputs the three-dimensional information to the perspective conversion unit 35. Similarly, the camera coordinate conversion unit 34 generates three-dimensional information for the right-eye image based on the coordinates of the second camera photographing position and the corresponding gaze direction data, and outputs the three-dimensional information to the perspective conversion unit 35. The perspective conversion unit 35 performs the same processing as in the second embodiment, and generates a right-eye image and a left-eye image. As described above, the parallax image generation device 20 generates the right-eye image and the left-eye image.

  Although the right-eye image and the left-eye image are the same image (an image having the same parallax) at the initial time, the parallax gradually increases as the time elapses. The user who sees the image for the right eye and the image for the left eye can see a 3D image that gradually increases in stereoscopic effect, although the user originally viewed a 2D image that is not stereoscopic. As described above, by changing the parallax distance linearly and changing the coordinates of the first camera photographing position and the coordinates of the second camera photographing position, the above effects can be obtained.

  When the parallax distance is 0, the virtual first camera shooting position of the right-eye image and the virtual second camera shooting position of the left-eye image are the same position. Furthermore, the gaze direction of the camera is the same for the first camera and the second camera. As the parallax distance increases, the direction of change between the gaze direction of the first camera and the gaze direction of the second camera also increases. As described above, the gaze direction of the first camera and the gaze direction of the second camera change according to the parallax distance. For this reason, the control signal generator 22 acquires the data of the changing parallax distance from the distance data changing unit 29 and calculates the gaze direction for each clock. The control signal generator 22 outputs the calculated gaze direction data to the control signal converter 25 as a parameter.

Embodiment 4
In the present embodiment, the right-eye image and the left-eye image output from the parallax image generation device 20 in the second or third embodiment can be output as a specific video signal format by the composite output signal.

  Hereinafter, the configuration of the parallax image generation device 20 according to the present embodiment will be described with reference to FIG. The parallax image generation device 20 includes the signal synthesizer 41 illustrated in FIG. 7 in addition to the configuration illustrated in FIG. The other components of the parallax image generation device 20 are the same as those in FIG. The processing operation of the parallax image generation device 20 is the same as that in the second embodiment.

  The signal synthesizer 41 synthesizes the right eye image signal output from the image signal output unit 27 and the left eye image signal output from the image signal output unit 28 to synthesize a combined output signal. As a result, the right-eye image signal and the left-eye image signal can be output as the same video signal format as the video signal input to the parallax image generation device 20. The signal synthesizer 41 is connected to a display device (not shown) having a screen for displaying an image of the synthesized output signal. This display device can display a three-dimensional image by converting the input right eye image signal and left eye image signal and displaying them on the screen.

  In FIG. 7, the vertical synchronization signal on the screen of the display device is treated as a clock generator, and the top-and-bottom signal is synthesized by synthesizing the right-eye image signal and the left-eye image signal whose resolution is 1/2 in the vertical direction. Outputs the combined output signal of the format. In FIG. 7, image signals 0, 2, and 4 input to the image signal output unit 27 are signals for the left eye image, and image signals 1 and 3 input to the image signal output unit 28 are the signals for the right eye image. Signal. The image signals 0 to 4 are the same as the image signals 0 to 4 shown in FIG.

  The left eye image and right eye image are output in a transmission format in which the left eye image is arranged in the upper half of the image and the right eye image is arranged in the lower half of the single image by the synthesized output signal output from the signal synthesizer 41.

  Conventionally, in order to generate one 3D video signal, a 2D-3D converter that converts two video signals having parallax images into one 3D video signal is required. However, in the present embodiment, it can be converted into one 3D video signal only by using a signal synthesizer.

  Note that other video signal formats can also be output by the signal synthesizer. FIG. 8 shows processing of the signal synthesizer 42 different from the signal synthesizer 41 of FIG. The signal synthesizer 42 treats the horizontal synchronization signal on the screen of the display device as a clock generator, and the signal synthesizer 42 synthesizes the right-eye image signal and the left-eye image signal whose resolution is ½ in the horizontal direction. By doing so, a combined output signal in a side-by-side format is output. In FIG. 8, the image signals 0, 2, and 4 input to the image signal output unit 27 are signals for the left eye image, and the image signals 1 and 3 input to the image signal output unit 28 are the signals for the right eye image. Signal. The image signals 0 to 4 are the same as the image signals 0 to 4 shown in FIG.

  The left-eye image and right-eye image are output in a transmission format in which the left-eye image and the right-eye image are arranged in the left half and the right half of one image by the combined output signal output from the signal synthesizer 42.

  Next, processing of the signal synthesizer 43 different from the signal synthesizer 41 of FIG. 7 and the signal synthesizer 42 of FIG. 8 will be described with reference to FIG. The signal synthesizer 43 treats the horizontal synchronization signal on the screen of the display device as a clock generator, and synthesizes the right-eye image signal and the left-eye image signal that are alternately output for each field or frame, thereby performing frame packing. Outputs the combined output signal of the format. In FIG. 9, image signals 0, 2, and 4 input to the image signal output unit 27 are signals for the left eye image, and image signals 1 and 3 input to the image signal output unit 28 are the signals for the right eye image. Signal. The image signals 0 to 4 are the same as the image signals 0 to 4 shown in FIGS.

  The left-eye image and the right-eye image are output in a transmission format in which the left-eye image and the right-eye image are alternately displayed on the entire image by the combined output signal output from the signal synthesizer 43.

  As shown in FIGS. 7 to 9, by providing a signal synthesizer in the parallax image generation device, output signals corresponding to a plurality of 3D formats can be created. The reason is that it is possible to change the setting of the clock generation unit that is the basis of output signal control. An image in a 3D format such as top-and-bottom or side-by-side has a horizontal or vertical resolution half that of a normal image. Therefore, it is possible to support a plurality of 3D formats by generating or changing the clock generated by the clock generation unit based on the horizontal synchronization or vertical synchronization frequency.

  As described above, the parallax image generation apparatus described in Embodiments 2 to 4 can output a parallax image of a coordinate-converted video in digital video processing.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, in the second embodiment, the process for executing the three-dimensional coordinate transformation is not limited to the method shown in FIG.

  For example, in the second and third embodiments, the distance data holding unit 23 and the control signal converter 25 are not provided, and the control signal generator 22 periodically sets the first camera shooting position and the second camera shooting position. Alternatively, it may be output to the camera coordinate conversion unit 34. Even in such a case, the three-dimensional coordinate conversion unit 30 can generate a left-eye image and a right-eye image. However, there may be a case where a 3D image is created by appropriately changing the parallax distance without changing the reference position of the camera according to user settings. In such a case, as described in the second and third embodiments, it is easier to control the parallax distance parameter separately from the camera shooting position parameter. Specifically, in the same scene, a 3D video for adults and a 3D video for children are created. If the parallax distance can be appropriately changed in this way, it is possible to obtain a video effect that changes from 2D video to 3D video and a video effect that can change the stereoscopic effect linearly.

  In the third embodiment, an example in which the parallax distance is changed linearly is described, but the parallax distance may be changed so that the binocular parallax angle is changed linearly. Whatever method is used to change the parallax distance, it is possible to change the stereoscopic effect of the three-dimensional video composed of the left-eye image and the right-eye image.

  In the fourth embodiment, the two-dimensional image signal output from the three-dimensional coordinate conversion unit 30 is separated into a left-eye image signal and a right-eye image signal by the output control unit 26, and then the image signal output unit 27. , 28 to the signal synthesizer 41. However, the two-dimensional image signal output from the three-dimensional coordinate conversion unit 30 may be input to the signal synthesizer 41 as it is. The signal synthesizer 41 outputs a top-and-bottom synthesized output signal based on the input two-dimensional image signal. A composite output signal in a side-by-side format or a frame packing format can be output in the same manner.

  In the fourth embodiment, the combined output signal output from the signal combiner 43 can be changed as appropriate. For example, a combined output signal in a top-and-bottom format may be output in a transmission format in which a right-eye image is arranged in the upper half of one image and a left-eye image is arranged in the lower half.

  The process of the parallax image generation device shown in Embodiments 1 to 4 can be executed by the parallax image generation device as one of the control methods. For example, the parallax image generation device can be executed as a control program. The control program may be recorded on a program recording medium so as to be readable by the parallax image generating device.

DESCRIPTION OF SYMBOLS 10 Parallax image generation apparatus 11 Reception part 12 Image signal output part 13 Position data output part 20 Parallax image generation apparatus 21 Reception part 22 Control signal generator 23 Distance data holding part 24 Clock generation part 25 Control signal converter 26 Output control part 27 , 28 Image signal output unit 30 Three-dimensional coordinate conversion unit 31 Enlargement / reduction unit 32 Local coordinate conversion unit 33 World coordinate conversion unit 34 Camera coordinate conversion unit 35 Perspective conversion units 41, 42, 43 Signal synthesizer

Claims (10)

A receiver for receiving a video signal;
A position data output unit that outputs first position data for generating a left-eye image and second position data for generating a right-eye image;
A two-dimensional image signal is output by alternately generating a left-eye image based on the video signal and the first position data and generating a right-eye image based on the video signal and the second position data. An image signal output unit;
A parallax image generating device comprising: The parallax image generation device further includes a clock generation unit that generates a clock,
The position data output unit periodically outputs the first position data and the second position data based on the clock.
The parallax image generation device according to claim 1. Based on the clock, the parallax image generation device divides and outputs the two-dimensional image signal into a first image signal including only the left-eye image and a second image signal including only the right-eye image. An output control unit;
The parallax image generation device according to claim 2. The parallax image generation device synthesizes the left-eye image signal and the right-eye image signal using a vertical synchronization signal or a horizontal synchronization signal of a display device that displays a stereoscopic image as a synchronization signal, and a top-and-bottom method A signal synthesizer that outputs to the display device in a side-by-side manner or a frame packing manner,
The parallax image generation device according to any one of claims 1 to 3. The first position data is data of a virtual first camera shooting position of the left-eye image, and the second position data is a virtual second camera shooting position of the right-eye image. Data
The parallax image generation device according to any one of claims 1 to 4. The parallax image generation device includes a reference position data holding unit that holds data of a reference position of a camera, and distance data holding that holds distance data related to a distance between the first camera shooting position and the second camera shooting position. And further comprising
The position data output unit determines the first position data and the second position data based on the reference position data and the distance data.
The parallax image generation device according to claim 5. The parallax image generation device further includes a distance data changing unit that changes the distance data held by the distance data holding unit.
The parallax image generation device according to claim 6. The distance data changing unit linearly changes a distance between the first camera photographing position and the second camera photographing position;
The parallax image generation device according to claim 7. Receiving a video signal;
Outputting first position data for generating a left-eye image and second position data for generating a right-eye image;
A two-dimensional image signal is output by alternately generating a left-eye image based on the video signal and the first position data and generating a right-eye image based on the video signal and the second position data. Steps,
A parallax image generation method comprising: Receiving a video signal;
Outputting first position data for generating a left-eye image and second position data for generating a right-eye image;
A two-dimensional image signal is output by alternately generating a left-eye image based on the video signal and the first position data and generating a right-eye image based on the video signal and the second position data. Steps,
A parallax image generation device control program for causing a parallax image generation device to execute the above.

Images