WO2012176526A1 - 立体画像処理装置、立体画像処理方法、及びプログラム - Google Patents
立体画像処理装置、立体画像処理方法、及びプログラム Download PDFInfo
- Publication number
- WO2012176526A1 WO2012176526A1 PCT/JP2012/058933 JP2012058933W WO2012176526A1 WO 2012176526 A1 WO2012176526 A1 WO 2012176526A1 JP 2012058933 W JP2012058933 W JP 2012058933W WO 2012176526 A1 WO2012176526 A1 WO 2012176526A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- viewpoint
- viewpoint image
- display
- stereoscopic
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
Definitions
- the present invention relates to a stereoscopic image processing apparatus, a stereoscopic image processing method, and a computer-readable program for performing processing for displaying a stereoscopic image from a plurality of viewpoint images.
- the multi-viewpoint stereoscopic image display device performs stereoscopic display using a plurality of images having parallax. Each of the plurality of images is called a viewpoint image.
- stereoscopic display is performed using a left-eye image and a right-eye image.
- the left-eye image and the right-eye image can be referred to as viewpoint images, respectively.
- a method of photographing a stereoscopic image a method of photographing with a multi-lens camera in which a plurality of cameras are arranged on the left and right is known.
- a viewpoint image When an image photographed by each camera of a multi-lens camera is displayed as a viewpoint image on a stereoscopic image display device, a stereoscopic image is observed.
- the parallax is a lateral shift of the coordinates of the subject between the viewpoint images, and varies depending on the distance between the subject and the camera. However, there may be a shift between viewpoint images not only in the horizontal direction but also in the vertical direction.
- Patent Document 2 discloses a display device that corrects luminance.
- the degree of blur may be various differences such as the degree of blur between the viewpoint images.
- the degree of the difference is not always uniform in the image, and in many cases, differs depending on the region.
- the present invention has been made in view of the above situation, and even when there is a difference other than parallax between viewpoint images, the difference is reduced without calculating the degree of the difference, and the observer can It is an object of the present invention to provide a stereoscopic image processing apparatus, a stereoscopic image processing method, and a computer-readable program that can display an image that can be easily viewed stereoscopically.
- a first technical means of the present invention is a stereoscopic image processing apparatus, wherein a reference viewpoint image selection unit that selects one of a plurality of viewpoint images as a reference viewpoint image, and the reference viewpoint A parallax calculation unit that calculates a parallax map between the image and the remaining viewpoint image, and an image generation unit that generates a new remaining viewpoint image corresponding to at least the remaining viewpoint image from the parallax map and the reference viewpoint image; And a display control unit that displays a stereoscopic image having at least the new remaining viewpoint image as a display element.
- the display control unit displays a stereoscopic image having the reference viewpoint image and the new remaining viewpoint image as display elements. is there.
- the image generation unit further generates a new viewpoint image corresponding to the reference viewpoint image from the parallax map and the reference viewpoint image, and the display control unit Is characterized in that a stereoscopic image having the new viewpoint image and the new remaining viewpoint image as display elements is displayed.
- the reference viewpoint image selection unit selects the reference viewpoint image using image feature amounts of the plurality of viewpoint images. It is a feature.
- the fifth technical means is the fourth technical means characterized in that one of the image feature values is a contrast.
- the sixth technical means is the fourth technical means characterized in that one of the image feature amounts is a sharpness.
- Seventh technical means is characterized in that, in the fourth technical means, one of the image feature amounts is the number of skin color pixels in the peripheral portion of the image.
- the reference viewpoint image selection unit selects a viewpoint image of a predetermined viewpoint as the reference viewpoint image. It is.
- each of the plurality of viewpoint images is a frame image constituting a moving image
- the stereoscopic image processing device includes a scene change detection unit.
- the reference viewpoint image selection unit selects a viewpoint image at the same viewpoint as the previous frame image as the reference viewpoint image when the scene change detection unit detects that the scene change is not a scene change. It is what.
- the image generation unit in any one of the first to ninth technical means, the image generation unit generates a parallax when generating the new remaining viewpoint image from the parallax map and the reference viewpoint image. It is characterized by performing the adjustment.
- the image generation unit is configured to determine whether the viewpoint of the new remaining viewpoint image is different from the parallax map and the reference viewpoint image.
- a viewpoint image of a new viewpoint having a new viewpoint is further generated, and the display control unit displays a stereoscopic image including the viewpoint image of the new viewpoint as a display element.
- the reference viewpoint image selection unit selects one of a plurality of viewpoint images as a reference viewpoint image
- the parallax calculation unit includes the reference viewpoint image and the remaining A step of calculating a parallax map with the viewpoint image, a step of generating a new remaining viewpoint image corresponding to at least the remaining viewpoint image from the parallax map and the reference viewpoint image, and a display And a step of displaying a stereoscopic image having at least the new remaining viewpoint image as a display element.
- the thirteenth technical means includes a step of causing the computer to select one of a plurality of viewpoint images as a reference viewpoint image, and a step of calculating a parallax map between the reference viewpoint image and the remaining viewpoint images. Generating a new remaining viewpoint image corresponding to at least the remaining viewpoint image from the parallax map and the reference viewpoint image, and displaying a stereoscopic image using at least the new remaining viewpoint image as a display element And a program for executing the steps.
- the difference is reduced without calculating the degree of the difference, and a stereoscopic image with good image quality and easy for a viewer to stereoscopically view is obtained. Can be displayed.
- FIG. 1 is a block diagram illustrating a schematic configuration example of a stereoscopic image display device according to a first embodiment of the present invention. It is a flowchart for demonstrating the process example of the image generation part in the three-dimensional image display apparatus of FIG. It is a figure for demonstrating the process example of the reference
- FIG. 1 is a block diagram showing a schematic configuration example of a stereoscopic image display apparatus according to the first embodiment of the present invention.
- FIG. 2 is a flowchart for explaining a processing example of the image generation unit in the stereoscopic image display apparatus of FIG. 1, and is a diagram for explaining a procedure of the image generation unit according to the first embodiment.
- the stereoscopic image display apparatus 1 of the present embodiment includes an input unit 11, a reference viewpoint image selection unit 12, a parallax calculation unit 13, an image generation unit 14, an image interpolation unit 15, And a display unit 16.
- the display unit 16 includes a display device and a display control unit that performs control for outputting a stereoscopic image to the display device.
- the input unit 11 inputs a plurality of viewpoint images as input images to the reference viewpoint image selection unit 12.
- the input unit 11 can be acquired by photographing with a camera, can be acquired by receiving a broadcast wave of digital broadcast and subjected to processing such as demodulation, acquired from an external server or the like via a network, What is necessary is just to comprise so that a several viewpoint image can be input by any acquisition method among acquiring from a memory
- the reference viewpoint image selection unit 12 selects one of a plurality of viewpoint images as a reference viewpoint image.
- an input image input through the input unit 11 includes a left-eye image and a right-eye image
- a plurality of viewpoint images are a left-eye image and a right-eye image
- the reference viewpoint image selection unit 12 selects one of the left-eye image and the right-eye image as the reference viewpoint image, and the other as another viewpoint image. Decide.
- the reference viewpoint image is selected based on the contrast of the image.
- the contrast C of each of the left-eye image and the right-eye image is calculated by the equation (1).
- C (Imax ⁇ Imin) / (Imax + Imin) (1)
- Imax and Imin are the maximum value and the minimum value of the luminance of the pixel in the image, respectively. Then, the image with the larger contrast C is determined as the reference viewpoint image, and the image with the smaller contrast C is set as another viewpoint image. If the left eye image and the right eye image have the same value of contrast C, one of the predetermined images is set as a reference viewpoint image, and the other is determined as another viewpoint image. By this processing, it is possible to select a viewpoint image with better image quality as a reference viewpoint image.
- the reference viewpoint image is input to each of the parallax calculation unit 13, the image generation unit 14, and the display unit 16, and the different viewpoint image is input only to the parallax calculation unit 13.
- an image having a higher image sharpness is selected.
- the sharpness is defined by, for example, a sum of absolute values of the difference between adjacent pixels in the horizontal direction and the difference between adjacent pixels in the vertical direction in the luminance value.
- a plurality of image feature amounts such as contrast and sharpness may be combined.
- the combination is performed by, for example, a linear sum of a plurality of feature amounts.
- the reference viewpoint image selection unit 12 may select a reference viewpoint image using image feature amounts of a plurality of viewpoint images.
- an image of a predetermined viewpoint may be selected as the reference viewpoint image. You may select as an image. By fixing the viewpoint image to be selected, the processing amount can be reduced.
- the parallax calculation unit 13 calculates a parallax map between the reference viewpoint image and the remaining viewpoint images, that is, a parallax map of each different viewpoint image with respect to the reference viewpoint image in this example.
- the parallax map describes the difference value of the coordinate in the horizontal direction (horizontal direction) from the corresponding point in the reference viewpoint image in each pixel of the different viewpoint image.
- Various methods using block matching, dynamic programming, graph cut, etc. are known as the parallax map calculation method, and any of them can be used.
- the parallax map is calculated by a robust method.
- the image generation unit 14 generates a new remaining viewpoint image corresponding to at least the remaining viewpoint image from the reference viewpoint image and the parallax map. That is, by reconstructing another viewpoint image from the reference viewpoint image and the parallax map, new remaining viewpoint images (different viewpoint images for display) are generated.
- the reconstruction method for each pixel of the reference viewpoint image, the parallax value of the coordinate is read from the parallax map, and the pixel value is copied to the pixel whose coordinates are moved by the parallax value in the different viewpoint image for display. This process is performed for all the pixels of the reference viewpoint image.
- the pixel value of the pixel having the maximum parallax value in the protruding direction is used based on the z buffer method.
- FIG. 2 is an example when the left-eye image is selected as the reference viewpoint image.
- (X, y) indicates the coordinates in the image.
- the processing is performed in each row, and y is constant.
- F, G, and D indicate a reference viewpoint image, a separate viewpoint image for display, and a parallax map, respectively.
- Z is an array for holding the parallax value of each pixel of the different viewpoint image for display during the process, and is called a z buffer.
- W is the number of pixels in the horizontal direction of the image.
- step S1 the z buffer is initialized with the initial value MIN.
- the parallax value is a positive value in the projection direction and a negative value in the depth direction
- MIN is a value smaller than the minimum parallax value calculated by the parallax calculation unit 13.
- step S2 the parallax value of the parallax map is compared with the z buffer value of the pixel whose coordinates are moved by the parallax value, and it is determined whether or not the parallax value is larger than the z buffer value.
- the process proceeds to step S3, and the pixel value of the reference viewpoint image is assigned to the separate viewpoint image for display. Also, the z buffer value is updated.
- step S4 if the current coordinate is the rightmost pixel, the process ends. If not, the process proceeds to step S5, moves to the right adjacent pixel, and returns to step S2. If the parallax value is equal to or smaller than the z buffer value in step S2, the process proceeds to step S4 without passing through step S3. Perform these steps on every line. Since reconstruction is performed by moving the coordinates only in the horizontal direction by the parallax value, it is possible to generate a separate viewpoint image for display that has no difference other than the parallax from the reference viewpoint image.
- the image interpolation unit 15 performs an interpolation process on pixels for which no pixel value has been assigned by the image generation unit 14 and assigns pixel values to the different viewpoint images for display generated by the image generation unit 14. Interpolation processing is performed using the average value of the pixel values of the pixel to which the pixel value is not assigned on the left side of the pixel to which the nearest pixel value is assigned and the pixel on the right side of the pixel to which the nearest pixel value is assigned.
- This interpolation process is not limited to a method using an average value, and may be another method such as a filter process. As described above, by including the image interpolation unit 15, it is possible to always determine the pixel value by performing interpolation processing on a pixel to which no pixel value is assigned in the generated different viewpoint image.
- the display control unit in the display unit 16 causes the display device to display a stereoscopic image having at least the new remaining viewpoint image (another viewpoint image for display) as a display element.
- the reference viewpoint image is used as it is. That is, the display control unit in the display unit 16 displays on the display device a stereoscopic image having the reference viewpoint image and the new remaining viewpoint image as display elements.
- the display unit 16 includes the display control unit and the display device as described above, but will be described below simply as processing in the display unit 16, including descriptions in other embodiments.
- the reference viewpoint image and one separate viewpoint image for display are input to the display unit 16 to perform the two-viewpoint stereoscopic display.
- the reference viewpoint image is displayed as the left eye image
- the separate viewpoint image for display is displayed as the right eye image.
- the reference viewpoint image is displayed as the right eye image
- the separate viewpoint image for display is displayed as the left eye image.
- the stereoscopic image display apparatus of the present embodiment by reconstructing the other viewpoint image from one viewpoint image, differences (vertical shift, color shift, etc.) other than the parallax are generated between the viewpoint images.
- the difference can be reduced without calculating the degree of the difference, and a stereoscopic image with good image quality and easy for the observer to stereoscopically view can be displayed.
- the difference can be reduced.
- reconstructing an image with high contrast and sharpness as a reference a stereoscopic image with high contrast and sharpness can be displayed.
- FIG. 3 is a diagram for explaining a processing example of the reference viewpoint image selection unit in the stereoscopic image display device according to the second embodiment of the present invention.
- FIG. 1 A schematic configuration example of the stereoscopic image display apparatus in the second embodiment is shown in FIG. 1 as in the first embodiment, but the processing method in the reference viewpoint image selection unit 12 is different.
- the processing method in the reference viewpoint image selection unit 12 is different.
- an image shot with a finger on the lens is detected, and a viewpoint image with a smaller area where the finger is applied is selected as a reference viewpoint image.
- the reference viewpoint image selection unit 12 first converts pixel values of pixels located in a region having a certain width from the left and right ends and the upper and lower ends of each of the left-eye image and the right-eye image into the HSV color space. Next, a pixel having an H value in a predetermined range is regarded as skin color, and the number of skin color pixels is counted for each image. Then, in both the left-eye image and the right-eye image, if the number of skin color pixels is equal to or less than a predetermined threshold, it is determined that the lens is not touched at the time of shooting, and the reference viewpoint is determined in the same manner as in the first embodiment Select an image. When the number of skin color pixels is larger than a predetermined threshold in any of the images, the image with the smaller number of skin color pixels is selected as the reference viewpoint image, and the other is determined as another viewpoint image.
- Image P L shown in FIG. 3, the image P R are each captured image for left eye in a state where the lens took a finger is an example of a right-eye image.
- Left eye image P L, the right eye image P R, the black portion 33a, 34a and hatched portions 33b, 34b denotes a region 33, 34 of the finger reflected in the image, in this example, the left eye image P L finger is reflected in the left end and the right lower corner of the right eye image P R.
- Left eye image P L, the hatched portion in the right eye image P R 31 is a region having a constant width between the left and right ends of the upper and lower ends for use in skin color pixel number detection.
- the black portions 33a and 34a are regions counted in the number of skin color pixels. In this example, the right eye image P R left eye image P L number skin color pixels than (the number of pixels black portion) is small, the left eye image P L is selected to the reference viewpoint image.
- a plurality of image feature amounts such as contrast and sharpness are combined. It may be used.
- the combination is performed by, for example, a linear sum of a plurality of feature amounts.
- the viewpoint image with the smaller area where the finger is applied is used as the reference viewpoint image. Therefore, it is possible to display a stereoscopic image with a small area where a finger is applied.
- FIG. 4 is a block diagram illustrating a schematic configuration example of a stereoscopic image display apparatus according to the third embodiment of the present invention.
- the input image is limited to a moving image, that is, each of the plurality of viewpoint images is a frame image constituting the moving image.
- the stereoscopic image display device 4 includes an input unit 11, a scene change detection unit 17, a storage unit 18, a reference viewpoint image selection unit 19, a parallax calculation unit 13, and an image.
- a generation unit 14, an image interpolation unit 15, and a display unit 16 are included. Components having the same numbers as those in the first embodiment have the same contents, and thus description thereof is omitted.
- each frame of the input image input through the input unit 11 is a two-viewpoint type, it is composed of a left-eye image and a right-eye image and is input to the scene change detection unit 17.
- the scene change detection unit 17 detects whether or not a scene change has occurred by comparing with the previous frame image held in the storage unit 18.
- the scene change detection is performed, for example, by comparing between luminance histogram frames. First, the luminance value of each pixel is calculated for the input frame input through the input unit 11, and a histogram of a predetermined class is created. Next, a luminance histogram is similarly created for the previous frame image read from the storage unit 18.
- the scene change detection unit 17 may detect a scene change from a moving image (sequential frame image) about one viewpoint, but detects a scene change from moving images (sequential frame images) about a plurality of viewpoints. May be.
- a scene change signal may be detected by embedding a scene change signal in at least one viewpoint moving image and detecting the signal.
- the reference viewpoint image selection unit 19 changes the processing contents depending on whether or not a scene change is detected by the scene change detection unit 17.
- the reference viewpoint image is selected by the same process as the reference viewpoint image selection unit 12 of the first embodiment (or the second embodiment). If it is not a scene change, a viewpoint image having the same viewpoint as the viewpoint selected as the reference viewpoint image in the previous frame is selected as the reference viewpoint image. That is, when the left-eye image is selected as the reference viewpoint image in the previous frame image, the left-eye image of the current frame input image is output as the reference viewpoint image to the parallax calculation unit 13, the image generation unit 14, and the display unit 16. The right-eye image is output to the parallax calculation unit 13 as another viewpoint image.
- the stereoscopic image display device of the present embodiment when an input image is a moving image, scene change detection is performed, and an image at the same viewpoint as the previous frame is reconstructed as a reference viewpoint image in a frame that is not a scene change. Therefore, fluctuations between frames of the display image can be suppressed.
- FIG. 5 is a block diagram showing a schematic configuration example of a stereoscopic image display apparatus according to the fourth embodiment of the present invention.
- the fourth embodiment reduces the difference other than the parallax between the viewpoint images in the first to third embodiments, and also adjusts the parallax.
- the stereoscopic image display device 5 in the present embodiment is obtained by adding a parallax distribution conversion unit 20 to the stereoscopic image display device 1 of FIG. 1.
- a schematic configuration example in which the parallax distribution conversion unit 20 is added to the stereoscopic image display device 4 of FIG. 4 may be adopted.
- the image generation unit 14 in the present embodiment adjusts the parallax when generating the new remaining viewpoint image from the parallax map and the reference viewpoint image.
- this parallax adjustment part is separated from the image generation unit 14 and illustrated as a parallax distribution conversion unit 20.
- the parallax distribution conversion unit 20 converts the value of the input parallax map calculated by the parallax calculation unit 13 and outputs the converted parallax map to the image generation unit 14.
- the conversion method is performed by the following equation (2), for example.
- p (x, y) and q (x, y) are an input parallax map and a converted parallax map, respectively, and a and b are constants.
- q (x, y) a ⁇ p (x, y) + b (2)
- the parallax can be adjusted in consideration of the fact that the distance between the image reproduced by the stereoscopic image display device and the observer is proportional to the reciprocal of the parallax.
- the image generation unit 14 uses the post-conversion parallax map and the reference viewpoint image created by the parallax distribution conversion unit 20 for display in the same manner as in the first embodiment (or the second and third embodiments). Another viewpoint image is generated.
- the stereoscopic image display device of the present embodiment it is possible to display a stereoscopic image in which the difference between viewpoint images is reduced and the parallax range is adjusted.
- the fifth embodiment relates to a stereoscopic image display apparatus capable of displaying images with reduced differences between viewpoint images in the case of multi-view stereoscopic display.
- a schematic configuration example of the stereoscopic image display apparatus in the present embodiment is shown in FIG. 1 as in the first embodiment, but the input image input through the input unit 11 is a multi-viewpoint image of three or more.
- N be the number of viewpoints constituting this input multi-viewpoint image.
- the number of viewpoints constituting the multi-view image for display that is, the number of multi-view images for display is also N.
- the reference viewpoint image selection unit 12 selects one of the N viewpoint images as a reference viewpoint image, and determines the remaining N ⁇ 1 images as different viewpoint images. This selection is performed based on the contrast of the image, for example. First, the contrast C of each viewpoint image is calculated by equation (1). Then, the image with the maximum contrast C is determined as a reference viewpoint image, and the remaining viewpoint images are determined as different viewpoint images. The reference viewpoint image is input to each of the parallax calculation unit 13, the image generation unit 14, and the display unit 16, and N ⁇ 1 different viewpoint images are input only to the parallax calculation unit 13. Although only an example based on the contrast of the image has been described for this selection, the same applies to other factors such as sharpness.
- the parallax calculation unit 13 calculates a parallax map of the reference viewpoint image compared with each different viewpoint image.
- the parallax map calculation is performed by a method similar to the method described in the first embodiment, and N ⁇ 1 parallax maps are output to the image generation unit 14.
- the image generation unit 14 generates N ⁇ 1 different display viewpoint images from the reference viewpoint image and each parallax map. Each display-specific viewpoint image is generated in the same manner as in the first embodiment. For each pixel of the reference viewpoint image, the parallax value of the coordinate is read from the parallax map, and the coordinate is moved by the parallax value. The pixel value is copied to the pixel of the viewpoint image.
- the image interpolation unit 15 performs an interpolation process on the pixels to which no pixel value has been assigned, and assigns pixel values to the N ⁇ 1 different viewpoint images for display generated by the image generation unit 14. This interpolation processing is performed by the same method as in the first embodiment.
- the display unit 16 receives the reference viewpoint image and N-1 different viewpoint images for display, and performs multi-viewpoint stereoscopic display. A total of N viewpoint images are arranged and displayed in an appropriate order.
- the stereoscopic image display device of the present embodiment when three or more multi-viewpoint stereoscopic displays are performed, the remaining viewpoint images can be reconstructed from one viewpoint image (reference viewpoint image). A stereoscopic image with reduced difference can be displayed.
- FIG. 6 is a block diagram showing a schematic configuration example of a stereoscopic image display apparatus according to the sixth embodiment of the present invention.
- FIG. 7 is a flowchart for explaining a processing example of the image generation unit in the stereoscopic image display apparatus of FIG. 6, and is a diagram for explaining a procedure of the image generation unit according to the sixth embodiment.
- the stereoscopic image display device 6 includes an input unit 11, a reference viewpoint image selection unit 12, a parallax calculation unit 13, an image generation unit 21, an image interpolation unit 22, and a display. Part 16. Components having the same numbers as those in the first embodiment have the same contents, and thus description thereof is omitted.
- the display unit 16 has been described as displaying a stereoscopic image having the reference viewpoint image and the new remaining viewpoint image as display elements.
- the stereoscopic image of the sixth embodiment is used.
- the image generation unit 21 generates a new viewpoint image for the reference viewpoint image, and uses the new viewpoint image as one of the display elements of the stereoscopic image instead of the existing reference viewpoint image.
- the image generation unit 21 in the present embodiment further generates a new viewpoint image corresponding to the reference viewpoint image from the parallax map and the reference viewpoint image.
- the image generation unit 21 generates a reference viewpoint image for display and another viewpoint image for display from the reference viewpoint image and the parallax map calculated by the parallax calculation unit 13, and outputs them to the image interpolation unit 22.
- new viewpoint images corresponding to all the plurality of input viewpoint images are generated for display.
- FIG. 7 shows an example when the left-eye image is selected as the reference viewpoint image.
- (x, y) indicates the coordinates in the image, but FIG. 7 shows processing in each row, and y is constant.
- F, Ga, Gb, and D indicate a reference viewpoint image, a display reference viewpoint image, a display-specific viewpoint image, and a parallax map, respectively.
- Z and W are the numbers of pixels in the horizontal direction of the z buffer and the image, respectively, as in FIG. Steps S11, S14, and S15 have the same contents as steps S1, S4, and S5 of FIG.
- step S12 the parallax value of the parallax map is compared with the z buffer value of the pixel whose coordinates have been moved by half the parallax value, and it is determined whether or not the parallax value is greater than the z buffer value.
- the process proceeds to step S13, and the pixel value of the reference viewpoint image F is assigned to the reference viewpoint image Ga for display and the separate viewpoint image Gb for display.
- the reference viewpoint image Ga for display and the separate viewpoint image for display Gb are assigned to coordinates that are moved in the opposite direction by half the parallax value from the coordinates (x, y).
- step S14 when the parallax value is equal to or less than the value of the z buffer, the process proceeds to step S14 without passing through step S13.
- the image interpolation unit 22 performs an interpolation process on pixels for which no pixel value is assigned to the reference viewpoint image for display and the separate viewpoint image for display generated by the image generation unit 21, and assigns pixel values.
- the same processing as that of the image interpolation unit 15 of the first embodiment is performed on each of the display reference viewpoint image and the display-specific viewpoint image.
- the display reference viewpoint image in which the pixel values are assigned to all the pixels by interpolation and the display-specific viewpoint image are input to the display unit 16.
- the reference viewpoint image for display and the separate viewpoint image for display are created by moving the image generating unit 21 in the opposite direction by the same distance, so that the number of pixels to be interpolated is the same. Since the interpolation process may cause deterioration such as blurring, if only one viewpoint image is blurred, it can be a cause of a decrease in image quality and ease of stereoscopic viewing. According to this embodiment, by aligning the number of interpolation pixels between viewpoint images, the degree of image quality degradation due to interpolation can be suppressed to the same degree between viewpoint images.
- the display unit 16 generates a stereoscopic image using the new viewpoint image based on the reference viewpoint image and the new remaining viewpoint image based on another viewpoint image generated as described above as display elements. Is displayed.
- the above-described second to fifth embodiments can be applied. Configurations and application examples other than the point of using the reference viewpoint image as it is in the display in the first embodiment, for example, the reference viewpoint image The selection method and the like can be similarly applied.
- the parallax adjustment described in the fourth embodiment may be executed when a new viewpoint image corresponding to the reference viewpoint image is generated. It is also possible to adjust the new viewpoint image and the new remaining viewpoint images so that, for example, the width between the maximum value and the minimum value of parallax is reduced as a whole. Of course, it is possible to adopt an adjustment that does not change only the reference viewpoint image during adjustment.
- the stereoscopic image display device of the present embodiment it is possible to reduce the difference in image quality between viewpoint pixels by generating both viewpoint images from one viewpoint image, and employ interpolation. In this case, it is possible to reduce the difference between the deteriorated viewpoint images caused by the interpolation.
- FIG. 8 is a flowchart for explaining a processing example of the image generation unit in the stereoscopic image display apparatus according to the seventh embodiment of the present invention.
- the stereoscopic image display device is processed so that the number of viewpoint images (multi-viewpoint images for display) used for display on the display unit is larger than the number of viewpoint images input from the input unit.
- the number of viewpoints constituting the input multi-viewpoint image that is, the number of viewpoint images input through the input unit is M ( ⁇ 2)
- the number of viewpoints constituting the display multi-viewpoint image that is, display Let N ( ⁇ 3) be the number of multi-viewpoint images.
- M N.
- the image generation unit 14 generates a viewpoint image having a new viewpoint different from the viewpoints of the new remaining viewpoint images (hereinafter referred to as a viewpoint image of a new viewpoint) from the parallax map and the reference viewpoint image.
- the display unit 16 displays a stereoscopic image including the viewpoint image of the new viewpoint as a display element, that is, a stereoscopic image including the viewpoint image of the new viewpoint as a display element.
- the input unit 11, the reference viewpoint image selection unit 12, and the parallax calculation unit 13 perform processing in the same manner as in the first embodiment. That is, the reference viewpoint image selection unit 12 receives an input image composed of the left-eye image and the right-eye image through the input unit 11 and selects the reference viewpoint image.
- the parallax calculation unit 13 calculates a parallax map for viewpoint images other than the reference viewpoint image.
- the image generation unit 14 generates N ⁇ 1 different viewpoint images for display from the reference viewpoint image and one parallax map calculated by the parallax calculation unit 13, and outputs the N ⁇ 1 different viewpoint images for display to the image interpolation unit 15.
- FIG. 8 is an example when the left-eye image is selected as the reference viewpoint image.
- (x, y) indicates the coordinates in the image, but FIG. 8 shows processing in each row, and y is constant.
- F, G k , and D respectively indicate a reference viewpoint image, a kth display-specific viewpoint image, and a parallax map.
- k is processed for each of 1 to N-1.
- Z and W are the numbers of pixels in the horizontal direction of the z buffer and the image, respectively, as in FIG.
- step S22 the parallax value of the parallax map is compared with the z buffer value of the pixel whose coordinates are moved by k / (N ⁇ 1) times that parallax value, and k / (N ⁇ 1) times the parallax value. Is greater than the value in the z-buffer. If k / (N ⁇ 1) times the parallax value is larger than the value in the z buffer, the process proceeds to step S23, and the pixel value of the reference viewpoint image F is assigned to the kth display-specific viewpoint image Gk. However, it is assigned to a coordinate moved from the coordinate (x, y) by k / (N ⁇ 1) times the parallax value.
- step S24 when k / (N ⁇ 1) times the parallax value is equal to or smaller than the value of the z buffer, the process proceeds to step S24 without passing through step S23.
- one viewpoint image for display can be created. Furthermore, by performing the above-described processing for all k from 1 to N ⁇ 1, N ⁇ 1 different viewpoint images for display can be created.
- the N ⁇ 1 different viewpoint images for display generated are the M ⁇ 1 (in this example, one) new remaining viewpoint images corresponding to the remaining viewpoint images, and the NM (this one) In the example, it is composed of N-2 new viewpoint images.
- the image interpolation unit 15 performs an interpolation process on the pixels to which no pixel value has been assigned, and assigns pixel values to the N ⁇ 1 different viewpoint images for display generated by the image generation unit 14. This performs the same processing as the image interpolation unit 15 of the first embodiment for each.
- the N-1 display-specific viewpoint images and reference viewpoint images in which pixel values are assigned to all the pixels by interpolation are used as inputs to the display unit 16.
- the number M of input images is 3 or more as in the fifth embodiment, one M image is obtained from the reference viewpoint image and the M ⁇ 1 parallax maps calculated by the parallax calculation unit 13 as described above.
- (N-1) / (M-1) different viewpoint images for display are generated for each parallax map, and finally one reference viewpoint image and N-1 different viewpoint images for display are displayed as display elements.
- stereoscopic image display may be performed.
- M ⁇ 3 the same number of display-specific viewpoint images (in this example, (N ⁇ 1) / (M ⁇ 1)) is generated for all parallax maps. It is not necessary to generate different viewpoint images for display for each parallax map.
- the explanation about M ⁇ 3 is based on the premise that the viewpoint interval between the different viewpoint images for display is a constant angle. It is sufficient to perform processing according to the above.
- viewpoint image of the new viewpoint can be said to be an image for interpolating the viewpoint.
- interpolation interpolation is used as a method for generating another viewpoint image for display including the viewpoint image of the new viewpoint for interpolating the viewpoint.
- Extrapolation interpolation may be applied in this process. By applying extrapolation, stereoscopic display with a wider viewpoint than the input image is possible, and the same effect as when parallax is widened when the parallax adjustment described as the fourth embodiment is employed.
- viewpoint image generation processing in the present embodiment is not only applicable to the first and fifth embodiments as described above, but also to the second to sixth embodiments. Applicable.
- a new viewpoint image is generated from a reference viewpoint image as in the sixth embodiment
- M 2
- the generated N different viewpoint images for display are selected as reference viewpoint images.
- M ⁇ 1 that is, one
- NM that is, N -2 new viewpoint images.
- a total of N different viewpoint images for display can be generated by having uniform viewpoints (constant angle viewpoints). Can be displayed as a display element.
- the present embodiment even when processing is performed so that the number of input viewpoint images and the number of viewpoint images used for display are different, the number required for display from one viewpoint image (reference viewpoint image). By generating this viewpoint image, it is possible to display a stereoscopic image in which differences other than parallax are reduced.
- the stereoscopic image display apparatus according to the first to seventh embodiments of the present invention has been described above.
- the present invention also adopts a form as a stereoscopic image processing apparatus in which the display device is removed from such a stereoscopic image display apparatus.
- the display device itself that displays a stereoscopic image may be mounted on the main body of the stereoscopic image processing apparatus according to the present invention or may be connected to the outside.
- Such a stereoscopic image processing apparatus can be incorporated into other video output devices such as various recorders and various recording media reproducing apparatuses in addition to being incorporated into a television apparatus and a monitor apparatus.
- the part corresponding to the stereoscopic image processing apparatus according to the present invention (that is, the display device included in the display unit 16 is excluded).
- the component can be realized by hardware such as a microprocessor (or DSP: Digital Signal Processor), a memory, a bus, an interface, and a peripheral device, and software that can be executed on the hardware.
- Part or all of the hardware can be mounted as an integrated circuit / IC (Integrated Circuit) chip set, and in this case, the software may be stored in the memory.
- all the components of the present invention may be configured by hardware, and in that case as well, part or all of the hardware can be mounted as an integrated circuit / IC chip set. .
- the stereoscopic image processing apparatus is simply a CPU (Central Processing Unit), a RAM (Random Access Memory) as a work area, a ROM (Read Only Memory) or an EEPROM (storage area for a control program). It can also be configured with a storage device such as Electrically (Erasable Programmable ROM).
- the control program includes a later-described stereoscopic image processing program for executing the processing according to the present invention.
- This stereoscopic image processing program can be incorporated in the PC as application software for displaying a stereoscopic image, and the PC can function as a stereoscopic image processing apparatus.
- the stereoscopic image processing apparatus has been mainly described.
- the present invention has a form as a stereoscopic image processing method as exemplified in the flow of control in the stereoscopic image display apparatus including the stereoscopic image processing apparatus. It can be taken.
- a reference viewpoint image selection unit selects one of a plurality of viewpoint images as a reference viewpoint image
- a disparity calculation unit includes a disparity map between the reference viewpoint image and the remaining viewpoint images.
- Other application examples are as described for the stereoscopic image processing apparatus.
- the present invention may also take the form of a stereoscopic image processing program for causing the computer to execute the stereoscopic image processing method. That is, the stereoscopic image processing program causes the computer to select one of a plurality of viewpoint images as a reference viewpoint image, to calculate a disparity map between the reference viewpoint image and the remaining viewpoint images, Generating a new remaining viewpoint image corresponding to at least the remaining viewpoint image from the map and the reference viewpoint image, and displaying a stereoscopic image having at least the new remaining viewpoint image as a display element.
- This is a program to be executed.
- Other application examples are as described for the stereoscopic image display device.
- the computer is not limited to a general-purpose PC, and various forms of computers such as a microcomputer and a programmable general-purpose integrated circuit / chip set can be applied.
- this program is not limited to be distributed via a portable recording medium, but can also be distributed via a network such as the Internet or via a broadcast wave.
- Receiving via a network refers to receiving a program recorded in a storage device of an external server.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
Description
図1及び図2を参照しながら、本発明の第1の実施形態について説明する。図1は、本発明の第1の実施形態に係る立体画像表示装置の概略構成例を示すブロック図である。また、図2は、図1の立体画像表示装置における画像生成部の処理例を説明するためのフロー図で、第1の実施形態に係る画像生成部の手順を説明するための図である。
C=(Imax-Imin)/(Imax+Imin) ・・・(1)
図3を参照しながら、本発明の第2の実施形態について説明する。図3は、本発明の第2の実施形態に係る立体画像表示装置における基準視点画像選択部の処理例を説明するための図である。
図4を参照しながら、本発明の第3の実施形態について説明する。図4は、本発明の第3の実施形態に係る立体画像表示装置の概略構成例を示すブロック図である。第3の実施形態では、入力画像が動画の場合に限ったもの、つまり複数の視点画像のそれぞれは動画を構成するフレーム画像であるものとする。
図5を参照しながら、本発明の第4の実施形態について説明する。図5は、本発明の第4の実施形態に係る立体画像表示装置の概略構成例を示すブロック図である。
q(x,y)=a・p(x,y)+b ・・・(2)
この式によって、画像に含まれる視差の範囲を調節することができる。
1/q(x,y)=a・(1/p(x,y))+b ・・・(3)
この式によると、立体画像表示装置によって再生される像と観察者間の距離が視差の逆数に比例することを考慮して、視差の調整を行うことができる。
図1を再度参照しながら、本発明の第5の実施形態について説明する。第5の実施形態は、多視点式立体表示の場合に、視点画像間の差異を低減して表示することができる立体画像表示装置に関する。本実施形態における立体画像表示装置の概略構成例は、第1の実施形態と同様に図1で示されるが、入力部11を通して入力される入力画像が3以上の多視点画像である。この入力多視点画像を構成する視点数をNとする。本実施形態では表示用の多視点画像を構成する視点数、つまり表示用の多視点画像の枚数もNとなる。
図6及び図7を参照しながら、本発明の第6の実施形態について説明する。図6は、本発明の第6の実施形態に係る立体画像表示装置の概略構成例を示すブロック図である。また、図7は、図6の立体画像表示装置における画像生成部の処理例を説明するためのフロー図で、第6の実施形態に係る画像生成部の手順を説明するための図である。
図8を参照しながら、本発明の第7の実施形態について説明する。図8は、本発明の第7の実施形態に係る立体画像表示装置における画像生成部の処理例を説明するためのフロー図である。
以上、本発明の第1~第7の実施形態に係る立体画像表示装置について説明したが、本発明は、このような立体画像表示装置から表示デバイスを取り除いた立体画像処理装置としての形態も採り得る。つまり、立体画像を表示する表示デバイス自体は、本発明に係る立体画像処理装置の本体に搭載されていても、外部に接続されていてもよい。このような立体画像処理装置は、テレビ装置やモニタ装置に組み込む以外にも、各種レコーダや各種記録メディア再生装置などの他の映像出力機器に組み込むこともできる。
Claims (13)
- 複数の視点画像の中の1枚を基準視点画像として選択する基準視点画像選択部と、
前記基準視点画像と残りの視点画像との視差マップを算出する視差算出部と、
前記視差マップと前記基準視点画像から、少なくとも前記残りの視点画像に対応する新たな残りの視点画像を生成する画像生成部と、
少なくとも前記新たな残りの視点画像を表示要素とする立体画像を表示させる表示制御部と、
を備えたことを特徴とする立体画像処理装置。 - 前記表示制御部は、前記基準視点画像と前記新たな残りの視点画像とを表示要素とする立体画像を表示させることを特徴とする請求項1に記載の立体画像処理装置。
- 前記画像生成部は、前記視差マップと前記基準視点画像から、前記基準視点画像に対応する新たな視点画像をさらに生成し、
前記表示制御部は、前記新たな視点画像と前記新たな残りの視点画像とを表示要素とする立体画像を表示させることを特徴とする請求項1に記載の立体画像処理装置。 - 前記基準視点画像選択部は、前記複数の視点画像の画像特徴量を用いて前記基準視点画像を選択することを特徴とする請求項1~3のいずれか1項に記載の立体画像処理装置。
- 前記画像特徴量の1つがコントラストであることを特徴とする請求項4に記載の立体画像処理装置。
- 前記画像特徴量の1つが鮮鋭度であることを特徴とする請求項4に記載の立体画像処理装置。
- 前記画像特徴量の1つが画像周辺部の肌色画素数であることを特徴とする請求項4に記載の立体画像処理装置。
- 前記基準視点画像選択部は、予め定めた視点の視点画像を前記基準視点画像として選択することを特徴とする請求項1~3のいずれか1項に記載の立体画像処理装置。
- 前記複数の視点画像のそれぞれは、動画を構成するフレーム画像であり、
前記立体画像処理装置は、シーンチェンジ検出部をさらに備え、
前記基準視点画像選択部は、前記シーンチェンジ検出部でシーンチェンジでないと検出された場合には、前のフレーム画像と同じ視点の視点画像を前記基準視点画像として選択することを特徴とする請求項1~8のいずれか1項に記載の立体画像処理装置。 - 前記画像生成部は、前記視差マップと前記基準視点画像から前記新たな残りの視点画像を生成する際に、視差の調整を行うことを特徴とする請求項1~9のいずれか1項に記載の立体画像処理装置。
- 前記画像生成部は、前記視差マップと前記基準視点画像から、前記新たな残りの視点画像の視点とは異なる新たな視点をもつ新視点の視点画像をさらに生成し、
前記表示制御部は、前記新視点の視点画像も表示要素として含む立体画像を表示させることを特徴とする請求項1~10のいずれか1項に記載の立体画像処理装置。 - 基準視点画像選択部が、複数の視点画像の中の1枚を基準視点画像として選択するステップと、
視差算出部が、前記基準視点画像と残りの視点画像との視差マップを算出するステップと、
画像生成部が、前記視差マップと前記基準視点画像から、少なくとも前記残りの視点画像に対応する新たな残りの視点画像を生成するステップと、
表示制御部が、少なくとも前記新たな残りの視点画像を表示要素とする立体画像を表示させるステップと、
を有することを特徴とする立体画像処理方法。 - コンピュータに、
複数の視点画像の中の1枚を基準視点画像として選択するステップと、
前記基準視点画像と残りの視点画像との視差マップを算出するステップと、
前記視差マップと前記基準視点画像から、少なくとも前記残りの視点画像に対応する新たな残りの視点画像を生成するステップと、
少なくとも前記新たな残りの視点画像を表示要素とする立体画像を表示させるステップと、
を実行させるためのプログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013521490A JP5931062B2 (ja) | 2011-06-21 | 2012-04-02 | 立体画像処理装置、立体画像処理方法、及びプログラム |
US14/126,156 US20140092222A1 (en) | 2011-06-21 | 2012-04-02 | Stereoscopic image processing device, stereoscopic image processing method, and recording medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-137324 | 2011-06-21 | ||
JP2011137324 | 2011-06-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012176526A1 true WO2012176526A1 (ja) | 2012-12-27 |
Family
ID=47422373
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/058933 WO2012176526A1 (ja) | 2011-06-21 | 2012-04-02 | 立体画像処理装置、立体画像処理方法、及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US20140092222A1 (ja) |
JP (1) | JP5931062B2 (ja) |
WO (1) | WO2012176526A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102447934A (zh) * | 2011-11-02 | 2012-05-09 | 吉林大学 | 稀疏镜头采集的组合立体图像系统中立体元的合成方法 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014230251A (ja) * | 2013-05-27 | 2014-12-08 | ソニー株式会社 | 画像処理装置、および画像処理方法 |
EP3422711A1 (en) * | 2017-06-29 | 2019-01-02 | Koninklijke Philips N.V. | Apparatus and method for generating an image |
CN113763472B (zh) * | 2021-09-08 | 2024-03-29 | 未来科技(襄阳)有限公司 | 一种视点宽度的确定方法、装置及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004363760A (ja) * | 2003-06-03 | 2004-12-24 | Konica Minolta Photo Imaging Inc | 画像処理方法、撮像装置、画像処理装置及び画像記録装置 |
JP2006115246A (ja) * | 2004-10-15 | 2006-04-27 | Canon Inc | 立体表示のための画像処理プログラム、画像処理装置および立体表示システム |
JP2009139995A (ja) * | 2007-12-03 | 2009-06-25 | National Institute Of Information & Communication Technology | ステレオ画像対における画素のリアルタイムマッチングのための装置及びプログラム |
JP2010128820A (ja) * | 2008-11-27 | 2010-06-10 | Fujifilm Corp | 立体画像処理装置、方法及びプログラム並びに立体撮像装置 |
JP2011055022A (ja) * | 2009-08-31 | 2011-03-17 | Sony Corp | 立体画像表示システム、視差変換装置、視差変換方法およびプログラム |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007034733A (ja) * | 2005-07-27 | 2007-02-08 | Toshiba Corp | 対象物領域検出装置、方法およびプログラム |
US20080170126A1 (en) * | 2006-05-12 | 2008-07-17 | Nokia Corporation | Method and system for image stabilization |
JP4881210B2 (ja) * | 2007-04-09 | 2012-02-22 | キヤノン株式会社 | 撮像装置、画像処理装置及びそれらの制御方法 |
US8077219B2 (en) * | 2009-02-12 | 2011-12-13 | Xilinx, Inc. | Integrated circuit having a circuit for and method of providing intensity correction for a video |
JP4833309B2 (ja) * | 2009-03-06 | 2011-12-07 | 株式会社東芝 | 動画像圧縮符号化装置 |
WO2011014419A1 (en) * | 2009-07-31 | 2011-02-03 | 3Dmedia Corporation | Methods, systems, and computer-readable storage media for creating three-dimensional (3d) images of a scene |
US20110304618A1 (en) * | 2010-06-14 | 2011-12-15 | Qualcomm Incorporated | Calculating disparity for three-dimensional images |
-
2012
- 2012-04-02 WO PCT/JP2012/058933 patent/WO2012176526A1/ja active Application Filing
- 2012-04-02 US US14/126,156 patent/US20140092222A1/en not_active Abandoned
- 2012-04-02 JP JP2013521490A patent/JP5931062B2/ja not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004363760A (ja) * | 2003-06-03 | 2004-12-24 | Konica Minolta Photo Imaging Inc | 画像処理方法、撮像装置、画像処理装置及び画像記録装置 |
JP2006115246A (ja) * | 2004-10-15 | 2006-04-27 | Canon Inc | 立体表示のための画像処理プログラム、画像処理装置および立体表示システム |
JP2009139995A (ja) * | 2007-12-03 | 2009-06-25 | National Institute Of Information & Communication Technology | ステレオ画像対における画素のリアルタイムマッチングのための装置及びプログラム |
JP2010128820A (ja) * | 2008-11-27 | 2010-06-10 | Fujifilm Corp | 立体画像処理装置、方法及びプログラム並びに立体撮像装置 |
JP2011055022A (ja) * | 2009-08-31 | 2011-03-17 | Sony Corp | 立体画像表示システム、視差変換装置、視差変換方法およびプログラム |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102447934A (zh) * | 2011-11-02 | 2012-05-09 | 吉林大学 | 稀疏镜头采集的组合立体图像系统中立体元的合成方法 |
CN102447934B (zh) * | 2011-11-02 | 2013-09-04 | 吉林大学 | 稀疏镜头采集的组合立体图像系统中立体元的合成方法 |
Also Published As
Publication number | Publication date |
---|---|
JP5931062B2 (ja) | 2016-06-08 |
US20140092222A1 (en) | 2014-04-03 |
JPWO2012176526A1 (ja) | 2015-02-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6021541B2 (ja) | 画像処理装置及び方法 | |
US10460459B2 (en) | Stitching frames into a panoramic frame | |
US9407896B2 (en) | Multi-view synthesis in real-time with fallback to 2D from 3D to reduce flicker in low or unstable stereo-matching image regions | |
CN102474644B (zh) | 立体图像显示系统、视差转换装置、视差转换方法 | |
US9445071B2 (en) | Method and apparatus generating multi-view images for three-dimensional display | |
US9277207B2 (en) | Image processing apparatus, image processing method, and program for generating multi-view point image | |
US8798160B2 (en) | Method and apparatus for adjusting parallax in three-dimensional video | |
US9460545B2 (en) | Apparatus and method for generating new viewpoint image | |
US9451232B2 (en) | Representation and coding of multi-view images using tapestry encoding | |
TWI493505B (zh) | 影像處理方法以及影像處理裝置 | |
WO2016172385A1 (en) | Methods for full parallax compressed light field synthesis utilizing depth information | |
KR20110049039A (ko) | 능동 부화소 렌더링 방식 고밀도 다시점 영상 표시 시스템 및 방법 | |
US9154762B2 (en) | Stereoscopic image system utilizing pixel shifting and interpolation | |
US8750600B2 (en) | Apparatus and method for generating three-dimensional (3D) zoom image of stereo camera | |
US20150077521A1 (en) | Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3d cameras | |
JP6148154B2 (ja) | 画像処理装置及び画像処理プログラム | |
US20150003724A1 (en) | Picture processing apparatus, picture processing method, and picture processing program | |
JP5931062B2 (ja) | 立体画像処理装置、立体画像処理方法、及びプログラム | |
US20140198104A1 (en) | Stereoscopic image generating method, stereoscopic image generating device, and display device having same | |
JP5627498B2 (ja) | 立体画像生成装置及び方法 | |
JP2014072809A (ja) | 画像生成装置、画像生成方法、画像生成装置用プログラム | |
KR20110025083A (ko) | 입체 영상 시스템에서 입체 영상 디스플레이 장치 및 방법 | |
JP5488482B2 (ja) | 奥行き推定データ生成装置、奥行き推定データ生成プログラム及び擬似立体画像表示装置 | |
CN115176459B (zh) | 虚拟视点合成方法、电子设备和计算机可读介质 | |
JP5492311B2 (ja) | 視点画像生成装置、視点画像生成方法及び立体画像印画装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12802714 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2013521490 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14126156 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 12802714 Country of ref document: EP Kind code of ref document: A1 |