JP4225768B2 - Stereoscopic image data processing apparatus and stereoscopic image data processing program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention relates to a stereoscopic image data processing apparatus for processing stereoscopic image data.and3D image data processing programToRelated.
[0002]
[Prior art]
Conventionally, various studies have been made on a three-dimensional display (stereoscopic display means) that enables stereoscopic display by displaying different images for the left eye and the right eye. In the old days, by adjusting the position of the lens of the camera, arranging a photo equivalent to what was seen from the left eye of a human and a photo equivalent to that seen from the right eye, and viewing it through a binocular adapter, recently By combining a video camera and a liquid crystal shutter, the right-eye image and the left-eye image are recorded alternately for each frame, and at the time of playback, two liquid crystal shutters are used instead of the left and right binocular lenses, and the liquid crystal is alternately displayed. There is a method for enabling stereoscopic display by turning the shutter on / off.
[0003]
In addition, by attaching a kamaboko-shaped lenticular lens, slits, and vertical stripes to the surface of a normal display, and displaying an image that combines the left eye image and right eye image according to the width of the slits and vertical stripes on the surface, glasses are displayed. A three-dimensional display (three-dimensional display means) technique that enables three-dimensional display without using a screen has also been studied.
[0004]
In order to display a stereoscopic picture on a display capable of displaying three-dimensional images with or without glasses, two images of the left and right eyes can be displayed using a stereoscopic camera or a three-dimensional adapter. Need to shoot. For example, Japanese Patent Laid-Open No. 10-322725 has been proposed as an adapter for stereo photography.
[0005]
Although there is a problem that a stereo adapter is captured in a stereoscopic image shot with a stereo adapter, JP-A-2002-77942 discloses an invention that removes a scatter (shadow) of the captured stereo adapter. There is a number. However, as will be described below, simply removing the stereo adapter scramble does not result in an image that can be viewed stereoscopically.
[0006]
[Patent Document 1]
Japanese Patent Laid-Open No. 10-322725
[Patent Document 2]
JP 2001-320733 A
[Patent Document 3]
JP 2002-77942 A
[0007]
[Problems to be solved by the invention]
When taking a stereo photograph using a stereo adapter or a stereo camera, if the stereo camera is tilted or if the stereo adapter is not positioned correctly, it is difficult to view the stereo even if the images are simply combined. There's a problem. In particular, when a vertical shift occurs in the left and right binocular images, stereoscopic viewing becomes difficult, so that even a slight rotation error causes a problem in the type in which the stereo adapter is retrofitted to the camera.
[0008]
In addition, when a captured stereo pair image is displayed on a three-dimensional display, any point in the stereo image is in the same plane as the three-dimensional display, that is, a point having no amount of parallax (hereinafter referred to as Zero Disparity Plane (ZDP)). However, it is difficult to determine which point in the image is the ZDP.
[0009]
Japanese Patent Laid-Open No. 10-322725 attempts to solve the above problem by providing a guideline on the finder of the video camera. However, in this method, it is necessary for a person to position an object to be photographed according to the guideline when photographing. Therefore, it is not easy to use, cannot be installed in a camera that does not have a liquid crystal finder, stereo images that have already been taken cannot be modified, ZDP is taken with the center of each of the left and right images, so you can shoot with free composition There is a problem that it is not possible.
[0010]
In addition, in order to finally display the actually captured stereo image on the three-dimensional display, it is necessary to perform operations such as image data format conversion and trimming so that the three-dimensional display can display the stereo image. Conventionally, these conversions have been performed manually for the left and right binocular images, and it has been troublesome to repeat the same operation and to arrange the trimming sizes. Japanese Patent Laid-Open No. 2001-320733 provides means for simultaneously editing a stereo pair image, but does not take into account the left-right binocular image shift when a stereo photograph is taken.
[0011]
The present invention has been made in view of such circumstances, and corrects the tilt and misalignment of the left and right binocular images from the left and right binocular images taken in stereo, and simultaneously edits the left and right binocular images. Another object is to provide means for facilitating correction and editing of a stereo image.
[0012]
[Means for Solving the Problems]
  In order to solve the above-described problems, a stereoscopic image data processing apparatus according to the present invention is provided.and3D image data processing programIsThe following means are adopted.
[0013]
  That is, the stereoscopic image data processing device of the present invention includes a reading unit that reads stereoscopic image data composed of captured left and right binocular image data;
  AboveCorrection means for correcting the tilt and misalignment of the left and right binocular images formed from the stereoscopic image data read by the reading means;ZDP setting means for setting a ZDP, which is a point at which binocular parallax disappears when a stereoscopic image is displayed on the left and right binocular images corrected by the correction means, and the ZDP set by the ZDP setting means As a reference pointDisplay stereoscopic images with stereoscopic display meansforStereoscopic display range trimming means for trimming the range of left and right binocular images;AboveImage format conversion means for converting left and right images trimmed by the stereoscopic display range trimming means into an image format for stereoscopic display;Warning means for issuing a warning to the user when the trimming range becomes smaller than a predetermined size when the stereoscopic display range trimming means performs trimming;It is characterized by having.
[0014]
  The stereoscopic image data processing apparatus of the present inventionReading means for reading stereoscopic image data composed of photographed left and right binocular image data; correction means for correcting inclination and positional deviation of left and right binocular images formed from stereoscopic image data read by the reading means; When displaying a stereoscopic image on the stereoscopic display means of the left and right binocular images corrected by the correcting meansZDP setting means for setting ZDP, which is a point at which binocular parallax disappearsA stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image by the stereoscopic display means using the ZDP set by the ZDP setting means as a reference point; and the stereoscopic display range trimming means The stereoscopic effect adjusting means for adjusting the stereoscopic effect of the stereoscopic image displayed on the stereoscopic display means by moving at least one of the specified trimming ranges of the left and right images in the horizontal direction, and the stereoscopic effect trimmed by the stereoscopic display range trimming means. Image format conversion means for converting the left and right images whose stereoscopic effect is adjusted by the feeling adjustment means into an image format for stereoscopic display;It is characterized by having.
[0015]
  The stereoscopic image data processing apparatus of the present inventionThe stereoscopic effect adjusting means is provided with a stereoscopic effect adjusting bar that changes in length according to the size of the set trimming range as a GUI.It is characterized by that.
[0018]
  The stereoscopic image data processing apparatus of the present inventionThe ZDP setting means sets, as the ZDP of the other image, a point similar to the neighboring image of the ZDP set in one image from the other image when the ZDP is set in either one of the left and right binocular imagesIt is characterized by doing.
[0020]
  The stereoscopic image data processing apparatus of the present inventionThe stereoscopic display range trimming means includes:A range in which when trimming one of the left and right binocular images, the size and aspect ratio of the trimmed image from the other image are the same.ToIt is characterized by rimming.
[0023]
In addition, the stereoscopic image data processing apparatus of the present invention includes an image format selection unit that selects an image format corresponding to the type of the stereoscopic display unit.
[0024]
  The stereoscopic image data processing apparatus of the present inventionThe stereoscopic display range trimming means isCorresponds to the image format selected by the image format selection means.TAspect ratio when rimmingTheIt is fixed.
[0027]
  Also, the stereoscopic image data processing apparatus of the present invention can process the left and right images trimmed by the stereoscopic display range trimming means., Parallel method or cross methodIt has a preview means for displaying in such a manner that it can be stereoscopically viewed with the naked eye.
[0033]
  The stereoscopic image data processing apparatus of the present inventionThe preview means includesThe left and right images trimmed by the 3D display range trimming means are combined into stripes and displayed in stripes.RukoAnd features.
[0034]
  The stereoscopic image data processing apparatus of the present inventionAbovePreview meansTrimmed by 3D display range trimming meansLeft and right image,The stripes are displayed alternately in stripes and combined with filters in different colors.RukoAnd features.
[0036]
  A stereoscopic image data processing program executed by the computer of the present invention isReading means for reading stereoscopic image data composed of photographed left and right binocular image data, and correcting means for correcting the inclination and misalignment of the left and right binocular images formed from the stereoscopic image data read by the reading means ZDP setting means for setting ZDP, which is a point at which binocular parallax disappears when the stereoscopic image is displayed on the right and left binocular images corrected by the correction means, and the ZDP setting means Stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image by a stereoscopic display means with ZDP as a reference point, and a right and left image trimmed by the stereoscopic display range trimming means for stereoscopic display When the image format conversion means for converting into a format and the stereoscopic display range trimming means perform trimming To function warning means for issuing a warning to the user as, when the trimming range is smaller than a predetermined magnitudeIt is characterized by that.
[0039]
  Also,The present inventionThe stereoscopic image data processing program executed by the computer is formed from reading means for reading stereoscopic image data composed of photographed left and right binocular image data, and stereoscopic image data read by the reading means. A correction unit that corrects the tilt and positional deviation of the left and right binocular images, and a ZDP that is a point at which binocular parallax disappears when the stereoscopic display unit displays the right and left binocular images corrected by the correction unit. ZDP setting means for performing, a stereoscopic display range trimming means for trimming a range of right and left binocular images for displaying a stereoscopic image on a stereoscopic display means using the ZDP set by the ZDP setting means as a reference point, and the stereoscopic display range Move at least one of the trimming ranges of the left and right images specified by the trimming means in the left-right direction. A stereoscopic effect adjusting means for adjusting the stereoscopic effect of the stereoscopic image displayed by the display means, and an image format for stereoscopic display of the left and right images trimmed by the stereoscopic display range trimming means and adjusted by the stereoscopic effect adjusting means. It is characterized by functioning as an image format conversion means for converting the image format.
[0040]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, a first embodiment of a stereoscopic image data processing apparatus according to the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a stereoscopic image data processing apparatus 100 according to the present invention.
The stereoscopic image data processing apparatus 100 includes a left and right dividing unit 1, a first trimming unit 2 (image range trimming unit), an inclination and position correction unit 3 (correction unit), a ZDP setting unit 4 (ZDP setting unit), and a second trimming unit. 5 (stereoscopic display range trimming means), format converting section 6 (image format converting means), pop-out amount adjusting section 7 (stereoscopic effect adjusting means), preview section 8 (preview means), main control section 9 and user input section 10 It is roughly structured.
[0041]
FIG. 2 is a block diagram showing details of the preview unit 8 of the stereoscopic image data processing apparatus 100 of FIG.
The preview unit 8 is roughly composed of a display information acquisition unit 11, a preview image generation unit 12, a display method selection unit 13, and a preview image display unit 14.
[0042]
FIG. 3 is a flowchart showing the flow of processing in the stereoscopic image data processing apparatus 100.
Note that the stereoscopic image data processing apparatus 100 according to the present embodiment is operated, for example, by a GUI screen operating on a personal computer OS displayed on a display.
Note that the stereoscopic image processing program according to the present invention is installed in a personal computer, for example. A personal computer in which the stereoscopic image processing program according to the present invention is installed operates as the stereoscopic image data processing apparatus 100 of the present embodiment.
[0043]
First, stereoscopic image data composed of left and right binocular image data captured in stereo with a stereo (stereoscopic) camera or a camera equipped with a stereo (stereoscopic) adapter is read (step S1) (reading means).
As shown in FIG. 10, depending on the stereo adapter to be used, the stereo adapter frame 40 (the stereo adapter frame (shadow)) may be reflected in the captured image.
[0044]
Next, the left and right dividing unit 1 divides the image formed from the captured stereoscopic image data into the left and right around the center, and displays them on the display means (for example, on the GUI screen) as the left eye image and the right eye image, respectively. (Step S2).
In addition, when using a stereo camera and a camera equipped with a stereo adapter and performing stereo shooting with two left and right cameras arranged side by side, the left and right binocular images are separate images, and thus the processing in step S2 is omitted. In this case, the left and right binocular image data of the left and right cameras are read.
[0045]
Then, the first trimming unit 2 removes the stereo adapter displacement (shadow) from the left eye image and the right eye image (step S3). FIG. 5 is a diagram showing a GUI screen in step S3. With reference to the lower left of each of the left and right images, the left eye image 20 has a trimming range (correction range) (x1, y1)-(x2, y2), and the right eye image 21 has (x3, y3)- (x4, y4) is a trimming range (correction range). The trimming range may be freely changed with a mouse or a keyboard, or a default value may be set. When trimming, the size and aspect ratio of the trimming range of the left and right binocular images are made constant. this is,
x2-x1 = x4-x3
y2-y1 = y4-y3
If (x1, y1) is changed, (x3, y3) is changed, and (x2, y2) is changed (x4, y4), (x3, y3) is changed. And (x1, y1) are realized by automatically changing (x2, y2) according to the constraint conditions when (x4, y4) is changed. As a result, when one image of the left and right binocular images is trimmed, it is possible to automatically trim a range in which the size and the aspect ratio of the one image are trimmed from the other image.
When the user changes the trimming range, the trimming range is recorded when a series of processing ends, and is newly activated (activation of the stereoscopic image data processing apparatus 100 or activation of the stereoscopic image data processing program). Sometimes, the trimming range may be a default value.
Alternatively, a range obtained by multiplying the vertical and horizontal sizes of the left and right images by a predetermined ratio (for example, 0.8) may be automatically trimmed as a default value.
[0046]
Next, by pressing a “correction start” button 22 shown in FIG. 5, the tilt and position correction unit 3 corrects the tilt and position shift of the left and right binocular images in the correction range (step S <b> 4).
For example, about 100 points with similar colors and textures are selected as feature points from the left and right binocular images, and the rotational and vertical shifts of the left and right binocular images are calculated from each set of feature points. The position of the left and right binocular image at the time of shooting is estimated by estimating the position of the camera when the shot image is shot and moving, rotating, and warping the left and right binocular images based on the estimated camera position. Tilt and misalignment are corrected.
Since the correction process takes calculation time, step S4 may be omitted when correction is unnecessary.
[0047]
Then, an image format (output format) for outputting the corrected stereoscopic image data is selected (step S5). FIG. 6 is a diagram showing a GUI screen in step S5. The image format is selected from previously registered image formats 23 (for example, formatA, formatB, and formatC). In this case, for example, when format A is selected, the image finally output is the image shown in FIG. Here, the image format is device information for finally displaying the image corrected by the correction software. For example, the resolution of the device, the upper limit value of the file that can be handled by the device, the left and right eyes An image storage method and the like are defined.
[0048]
Next, when the finally output image is displayed on the three-dimensional display (stereoscopic display means), the point that does not protrude or retract from the display (the point where the binocular parallax between the left and right binocular images disappears (ZDP)) Setting is performed by the setting unit 4 (step S6).
FIG. 6 is a diagram showing a GUI screen in step S6 (the same screen as in step S5). When a point desired to be ZDP is selected from one of the left and right images in the corrected left and right binocular image display areas 25 and 26, luminance information and the like in the vicinity of the selected point and a similar image area are selected from the other image. The center point of the searched range is set as the other ZDP corresponding to one ZDP. With the lower left of each of the left and right images as a reference, the ZDP coordinates of the left eye image are (zlx, zly), and the ZDP coordinates of the right eye image are (zrx, zry). Then, a warning is issued when the difference in position between the left and right images of (zlx, zly) and (zrx, zry) exceeds a preset value. Similarly, a warning is issued when the other ZDP cannot be searched.
[0049]
Then, the second trimming unit 5 trims the image range finally output from the left and right binocular images with ZDP as a reference point (step S7). When one of the left and right binocular images is trimmed, a range that is the same as the size and aspect ratio of the trimmed range of the one image from the other image is automatically trimmed. this is,
zlx-lx1 = zrx-rx1
zly-ly1 = zry-ry1
zlx-lx2 = zrx-rx2
zly-ly2 = zry-ry2
This is realized by setting the constraint condition. In addition, when the width of the image of the image format selected in step S5 is W and the height is H, the constraint condition is set so that the output image and the aspect ratio (W / H) are constant.
(lx1-lx2) / (ly1-ly2) = W / H
(rx1-rx2) / (ry1-ry2) = W / H
Set.
When the trimming range is set as an initial value with a predetermined size, the initial value is set to a value that satisfies the constraint condition that maximizes the trimming range.
[0050]
Next, the pop-out amount adjustment unit 7 moves the pop-out amount of the stereoscopic image displayed on the stereoscopic display means by moving the pop-out amount adjustment bar 24 (see FIG. 6) in the left-right direction, and at least one image in the trimming range of the left and right images Is moved in the left-right direction to adjust the amount of parallax between the left and right images (step S8).
For example, when shooting a person against the backdrop of a mountain, if you want to specify a ZDP between the person and the mountain, specify the ZDP for the left and right binocular images because there is no image that can be identified as a ZDP. I can't. Therefore, after the person or mountain is designated as ZDP, the pop-out amount adjustment bar 24 is moved, and the trimming range of one image (for example, the right image) is moved by the distance specified by the pop-out amount adjustment bar 24 in the left-right direction. , It becomes possible to make ZDP between people and mountains. Instead of fixing the trimming range of the left image, the trimming range of the right image may be fixed and the trimming range of the left image may be moved. Also good. Further, the process of step S8 may be omitted. The adjustment of the pop-out amount can also be adjusted by the left / right cursor keys of the keyboard or the scroll function of the scroll mouse, and is not limited to the operation of the scroll bar on the GUI screen.
[0051]
When the “preview” button 27 in FIG. 6 is pressed in step S7 or step S8, the left and right images that are the trimming range trimmed by the second trimming unit 5 are displayed as previews on separately provided display means ( Preview part 8). The preview unit 8 displays the final output image on a three-dimensional display (stereoscopic display means) in a pseudo manner on a normal two-dimensional display. Further, this preview process may be omitted.
[0052]
Here, processing in the preview unit 8 will be described.
First, the left and right images that are the trimming range trimmed by the second trimming unit 5 are read into the preview image generating unit 12 (step S20), and then the display method selection unit 13 selects a format for preview display ( Step S21). Then, the display information acquisition unit 11 reads display information to be displayed (step S22). Next, the preview image generating unit 12 generates an image for preview display (step S23). And it displays on the preview image display part 14 (step 24).
[0053]
In the preview display, when the parallel method or the intersection method, which is a display method, is selected, the left and right images 30 and 31 are arranged side by side as shown in FIGS. . Since autostereoscopic viewing is difficult for unaccustomed people, when the left and right images 30 and 31 are displayed for autostereoscopic viewing, the same frame image 32 is added to each of the left and right images 30 and 31 to find corresponding points. It is easy to make stereoscopic viewing easy. This also serves as a ZDP that does not protrude or retract from the screen when viewed with the naked eye.
[0054]
When displaying in the parallel method, as shown in FIG. 9, it is necessary to narrow the interval L between the binocular images when displayed on the screen, rather than the binocular interval d of the user. This is because human eyes can face inward but cannot face outward. When an image having a certain image size is displayed on the preview image display unit 14, the physical size when actually displayed on the display changes depending on the display size and display resolution used for display. The size of the screen for preview display is changed in accordance with the size and display resolution) to avoid the situation (d <L) where stereoscopic viewing becomes impossible when displayed in the parallel method described above. be able to.
[0055]
In addition, by synthesizing the left and right images on stripes and displaying an anaglyph, even a person who is not good at autostereoscopic vision can recognize a stereoscopic image formed from stereoscopic image data that is finally output. . This will be explained by taking FIG. 7C as an example. The image of the mountain in the background is displayed double because the left and right eyes 30 and 31 have parallax, but the human has no parallax. Therefore, when the finally output image is displayed on the 3D display (stereoscopic display means), it can be assumed that the human is displayed on the same plane as the display, and the background mountain is displayed deeper than the display. It can be done.
[0056]
When anaglyph is displayed, the left and right images 30, 31 are respectively subjected to red and blue filter processing, and the displayed red-blue stripe image is stereoscopically viewed by the user wearing red-blue glasses. Will be able to.
[0057]
7 and 8 are diagrams showing examples of preview display screens. In the example of FIG. 7, (a) shows parallel method display, (b) shows cross method display, and (c) shows anaglyph display. In FIG. 7, the switching of the display method is selected from three types of buttons 33. In the example of FIG. 8, parallel method display is shown in (a), and cross method display is shown in (b). The display method is switched by clicking the display switching toggle bar 34 at the bottom of the screen to alternately switch the display between the parallel method and the intersection method. This is because the focus of the eyes is different from normal during autostereoscopic viewing, and it is difficult to operate the GUI in this state, so place the mouse cursor on the display switching toggle bar 34. By clicking on the same place without moving the mouse, it is possible to switch between the intersection method and the parallel method without moving the viewpoint during autostereoscopic viewing. The display may be switched by clicking anywhere on the screen instead of the toggle bar. The preview display in the example of FIG. 8 is more convenient for users who are not used to autostereoscopic viewing.
[0058]
The preview screen is immediately updated according to the pop-out amount adjusted by the pop-out amount adjusting unit 7. The pop-out amount can be adjusted not only by directly moving the pop-out amount adjustment bar 24 in FIG. 6 with the mouse, but also by operating the left and right cursor keys on the keyboard and the scroll button operation of the mouse with the scroll button. It is possible to adjust the amount of pop-up without moving the viewpoint when performing.
[0059]
Then, returning to FIG. 3, it is determined whether or not the image to be finally output is acceptable (step S9). If NO in step S9, the process returns to step S6.
[0060]
Next, in the case of YES in step S9, by pressing the “save” button 28 in FIG. 6, the format conversion unit 6 uses the image format selected in step S5 and the left and right sides of the range trimmed in step S7. The image is finally output as stereoscopic image data (step S10). In the final output image, for example, as shown in FIG. 11, the left and right images are reduced and arranged in half in the horizontal direction. The size of the trimmed range may be different from the size of the finally output image, and is set to a predetermined size by enlarging or reducing the image in the trimmed range. At this time, since the aspect ratio at the time of trimming in step S7 is the same as the output image format, there is no problem that the aspect ratio changes even if the image is enlarged or reduced.
[0061]
Next, a second embodiment of the present invention will be described. The second embodiment is an improvement of the first embodiment, and some or all of the improvements can be added to the first embodiment. In the second embodiment, as in the first embodiment, the left and right dividing unit 1, the first trimming unit 2 (image range trimming unit), the tilt and position correction unit 3 (correction unit), and the ZDP setting unit 4 ( ZDP setting unit), second trimming unit 5 (stereoscopic display range trimming unit), format converting unit 6 (image format converting unit), pop-out amount adjusting unit 7 (stereoscopic effect adjusting unit), preview unit 8 (preview unit), main The control unit 9 and the user input unit 10 are roughly configured. The flow of processing of the second embodiment will be described using the flowchart of FIG.
[0062]
First, in step S31, stereoscopic image data is read in the same manner as in step S1, and in step S32, the read image is divided into right and left at the center, and each is displayed as a left eye image and a right eye image. Display on means. Next, in step S33, an output format is selected as in step S5. In the first embodiment, the output format selection unit 23 is arranged on the GUI for trimming the stereoscopic display range. However, in the second actual example, the output format selection unit 23 is arranged on the GUI for trimming the correction range as shown in FIG. .
[0063]
In step S34, similarly to step S3, the first trimming unit 2 removes the stereo adapter from the left eye image and the right eye image. At this time, as shown in FIG. 14, when the trimming range is equal to or smaller than a predetermined size (for example, the image size of the output format), the user is alerted by changing the color of the frame representing the trimming range. This is because when the trimming range is smaller than the final output size, the image size after the tilt correction processing is also smaller than the output image size, so it is necessary to enlarge the trimming range at the time of output. This is because it deteriorates. In addition to changing the color of the frame, changing the color of the image in the range surrounded by the frame, blinking the frame, displaying 52 with characters at the bottom of the window, etc. has the same effect, combining these functions Also good. Further, when the correction start button 22 is pressed, an alert box 53 may be displayed so that the correction process does not proceed.
[0064]
In step S35, the tilt and position of the captured image are corrected in the same manner as in step S4, but more accurate correction is possible by using the focal length information of the camera when the input image is captured. Therefore, when the focal length information of the lens used at the time of photographing is added to the photographed image, it can be used for correction processing. For example, as an image format for digital cameras, the JPEG-EXIF format that enables recording of shooting conditions in captured images is widely used. Information such as shutter speed and sensitivity at the time of shooting, and the focal length of the lens are stored in the image file. Can be stored. However, due to the effect of adding a stereo adapter to the camera, it is more effective if the user explicitly inputs the focal length information than using the focal length information added to the image file as it is, When using an image format without adding focal length information at the time of shooting as an input image, check on the GUI for trimming the correction range as shown in FIG. 13 so that the user can input the focal length information when executing the program. By providing the box and the focal length input field 51, both methods can be switched and used.
[0065]
In step S36, ZDP is designated as in step S6, and in step S37, the final output range is trimmed in the same manner as in step S7. At this time, when the trimming range becomes equal to or smaller than a predetermined size (for example, the image size of the output format) as in step S34, the user is warned by changing the color of the frame representing the trimming range. This is because when the trimming range is smaller than the final output size, it is necessary to enlarge the trimming range and the image deteriorates, so it is desirable to make the trimming range larger than the output size. . Similar to step S34, in addition to changing the color of the frame, the same effect can be obtained by changing the color of the image in the range surrounded by the frame, blinking the frame, displaying characters in the lower part of the window, etc. These functions may be combined. Further, when the save button 22 is pressed, an alert box may be displayed so that the trimming range cannot be saved.
[0066]
In step S38, as in step S8, the amount of parallax can be adjusted by changing the trimming area, but the adjustable range is determined by the size of the trimming range. Specifically, description will be made assuming that the trimming range of the left image is (lx1, ly1)-(lx2, ly2) and the trimming range of the right image is (rx1, ry1)-(rx2, ry2). When projecting a stereoscopic image to the front as a whole, move the trimming range of the left image to the left and simultaneously move the trimming range of the right image to the right.When retracting the entire image, move the trimming range of the left image to the right. It is necessary to move the trimming range of the right image to the left at the same time.
[0067]
Here, if the size of the original image is width and height, the pop-up amount adjustment range d is
-min (rx1, width-lx2) <d <min (lx1, width-rx2)
Determined by If an attempt is made to change the pop-out amount beyond this limit, the trimming range will protrude from the original image. Therefore, when the maximum length L of the parallax amount adjustment bar 54 displayed on the GUI is L_MAX,
L = L_MAX / (min (x1, width-x4) + min (x1, width-x4) +1)
By changing the length L according to the size of the trimming range and displaying it on the GUI, the range in which the pop-out amount can be changed can be intuitively understood.
[0068]
As shown in FIG. 18, when the width of the trimming range is equal to the width of the original image, the parallax amount adjustment bar has the maximum size L_MAX, and the parallax amount adjustment bar cannot be moved left and right on the GUI. If the trimming range is small as shown in FIG. 15, the parallax amount adjustment bar becomes short and the range that can be moved on the GUI becomes large, so that the pop-out amount can be adjusted largely as shown in FIGS. 16 and 17.
[0069]
When the “preview” button 27 in FIG. 15 is pressed in step S37 or S38, a preview display is made as in the first embodiment. If the trimming range is adjusted and a desired result is obtained, when the save button 28 in FIG. 15 is pressed, the left and right images in the range trimmed in step S37 are converted into the image format selected in step S33 in step S40. The data is converted by the format converter 6 and finally output as stereoscopic image data.
[0070]
【The invention's effect】
As described above, according to the present invention, stereoscopic image data composed of left and right binocular image data photographed by the reading means is read, and left and right binocular images formed from the stereoscopic image data read by the reading means are The correction means corrects the tilt and the positional deviation, the stereoscopic display range trimming means trims the range to be displayed on the stereoscopic display means, and the corrected and trimmed range is then converted into the predetermined stereoscopic display means by the image format conversion means. It is converted into a displayable image format and output as stereoscopic image data. Accordingly, there is an effect that the reading of the stereoscopic image data, the correction of the tilt and the positional deviation of the left and right binocular images, the trimming of the stereoscopic display range, and the conversion to a predetermined image format can be performed by a series of operations.
[0071]
Further, according to the present invention, the ZDP of the left and right binocular images is automatically set. This eliminates the need for the user to set the ZDP, and has the effect of facilitating the ZDP setting.
[0072]
According to the present invention, when the ZDP is set for one of the left and right binocular images, the ZDP of the other image is automatically set. This has the effect of facilitating the setting of the ZDP for the left and right binocular images.
[0075]
According to the present invention, the left and right binocular images are trimmed with ZDP as a reference point. Accordingly, there is an effect that the range of the stereoscopic image displayed by the stereoscopic display means can be set to a range in which ZDP is a reference point.
[0077]
In addition, according to the present invention, when one of the left and right binocular images is trimmed, a range in which the size and aspect ratio of the one image trimmed from the other image are the same is automatically trimmed. The As a result, the range of trimming from the left and right binocular images is not different between the left and right, and there is an effect that the stereoscopic image displayed by the stereoscopic display means can be improved.
[0078]
In addition, according to the present invention, by warning the user when the size of the trimmed range is equal to or less than a predetermined size, it is possible to avoid that the trimming range is too small to perform correction processing, There is an effect of preventing deterioration of image quality when the corrected image is trimmed and stored.
[0080]
According to the present invention, the image format selection means selects an image format corresponding to the type of the stereoscopic display means. Thus, there is an effect that stereoscopic image data corresponding to the type of the stereoscopic display means can be output.
[0081]
In addition, according to the present invention, the aspect ratio when trimming corresponding to the image format selected by the image format selection means is fixed. Accordingly, there is an effect that the range of the left and right binocular images corresponding to the type of the stereoscopic display means can be easily trimmed.
[0082]
According to the present invention, after the ZDP is set by the stereoscopic effect adjusting means, at least one of the trimming ranges of the left and right images specified by the stereoscopic display range trimming means is moved in the left-right direction and displayed by the stereoscopic display means. The stereoscopic effect of the image is adjusted. Thereby, there is an effect that the stereoscopic effect of the stereoscopic image displayed by the stereoscopic display means can be adjusted.
[0083]
In addition, according to the present invention, by using the adjustment bar whose length changes according to the size of the trimming range for adjusting the stereoscopic effect, the effect of presenting the range for adjusting the stereoscopic effect to the user in an easily understandable manner. There is.
[0090]
Further, according to the present invention, the preview unit displays the left and right images alternately in stripes and displayed in stripes. Thus, there is an effect that it is possible to confirm the stereoscopic effect of the stereoscopic image displayed on the stereoscopic display unit before the output of the stereoscopic image data, judging from the size of the part with parallax on the preview screen.
[0091]
Further, according to the present invention, the preview means displays the left and right images in stripes by combining them with filters in different colors alternately. Accordingly, there is an effect that the stereoscopic effect of the stereoscopic image displayed by the stereoscopic display means can be confirmed before the stereoscopic image data is output by the user wearing the glasses corresponding to the filter color. .
[0092]
Further, according to the present invention, the preview means can switch and display one of the parallel method, the intersection method, and the stripe display. As a result, the display method desired by the user can be selected.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a stereoscopic image data processing apparatus according to the present invention.
FIG. 2 is a block diagram illustrating details of a preview unit of the stereoscopic image data processing apparatus of FIG. 1;
FIG. 3 is a flowchart of the first embodiment showing a processing flow of the stereoscopic image data processing apparatus of FIG. 1;
4 is a flowchart showing a flow of processing of a preview unit in FIG. 2. FIG.
FIG. 5 is a diagram illustrating a GUI screen for trimming a correction range according to the first embodiment;
FIG. 6 is a diagram showing a GUI screen for trimming a stereoscopic display range according to the first embodiment.
FIG. 7 is a diagram showing a preview screen.
FIG. 8 is a diagram showing a preview screen.
FIG. 9 is a diagram illustrating a relationship between a width of a preview screen and a binocular interval.
FIG. 10 is a diagram showing a stereo adapter frame.
FIG. 11 is a diagram illustrating an output image.
FIG. 12 is a flowchart illustrating a processing flow according to the second embodiment;
FIG. 13 is a diagram illustrating a GUI screen for trimming a correction range according to the second embodiment;
FIG. 14 is a diagram showing a GUI screen when a warning is issued when the correction range is small in the second embodiment.
FIG. 15 is a diagram illustrating a GUI screen for trimming a stereoscopic display range according to the second embodiment.
FIG. 16 is a diagram showing a GUI screen when the entire trimming range is popped forward when the trimming range is small in the second embodiment.
FIG. 17 is a diagram showing a GUI screen when the entire trimming range is retracted when the trimming range is small in the second embodiment.
FIG. 18 is a diagram showing a GUI screen when the pop-out amount cannot be adjusted when the trimming range is large in the second embodiment.
[Explanation of symbols]
1 Left and right division
2 First trimming section
3 Inclination and position correction unit
4 ZDP setting section
5 Second trimming section
6 Format converter
7 Pop-out amount adjustment section
8 Preview section
9 Main control unit
10 User input section
11 Display information acquisition unit
12 Preview image generator
13 Display method selector
14 Preview image display

Claims (12)

Reading means for reading stereoscopic image data composed of captured left and right binocular image data;
And correcting means for correcting the inclination and positional shift of the left and right eye image to be formed from the stereoscopic image data read by said reading means,
ZDP setting means for setting a ZDP that is a point at which binocular parallax disappears when a stereoscopic image is displayed on the left and right binocular images corrected by the correction means;
Stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image on the stereoscopic display means with the ZDP set by the ZDP setting means as a reference point ;
An image format converting means for converting the trimmed left and right images in the stereoscopic display range trimming means in the image format for three-dimensional display,
Warning means for issuing a warning to the user when the trimming range becomes smaller than a predetermined size when the stereoscopic display range trimming means performs trimming;
A stereoscopic image data processing apparatus characterized by comprising: Reading means for reading stereoscopic image data composed of captured left and right binocular image data;
Correction means for correcting the tilt and misalignment of the left and right binocular images formed from the stereoscopic image data read by the reading means;
ZDP setting means for setting a ZDP that is a point at which binocular parallax disappears when a stereoscopic image is displayed on the left and right binocular images corrected by the correction means ;
Stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image on the stereoscopic display means with the ZDP set by the ZDP setting means as a reference point;
Stereoscopic effect adjusting means for adjusting the stereoscopic effect of the stereoscopic image displayed on the stereoscopic display means by moving at least one of the trimming ranges of the left and right images specified by the stereoscopic display range trimming means in the left-right direction;
Image format conversion means for converting left and right images trimmed by the stereoscopic display range trimming means and having the stereoscopic effect adjusted by the stereoscopic effect adjusting means into an image format for stereoscopic display;
It characterized by having a standing body image data processing apparatus. The stereoscopic image data according to claim 2, wherein the stereoscopic effect adjusting unit includes a stereoscopic effect adjustment bar whose length changes according to the size of the set trimming range as a GUI. Processing equipment. When the ZDP is set for one of the left and right binocular images, the ZDP setting means sets a point similar to the ZDP neighborhood image set for one of the other images as the ZDP of the other image. The three-dimensional image data processing apparatus according to any one of claims 1 to 3. The three-dimensional display range trimming means has a characteristic in that the size and aspect ratio of the range of trimming one of the images from either one of the image when trimming the other image of the left and right eye image to crop a range having the same The stereoscopic image data processing apparatus according to any one of claims 1 to 4. Stereoscopic image data processing apparatus according to any one of claims 1-5, characterized in that it comprises an image format selection means for selecting an image format corresponding to the type of a stereoscopic display device. The stereoscopic image data processing apparatus according to claim 6 , wherein the stereoscopic display range trimming unit fixes an aspect ratio when trimming corresponding to the image format selected by the image format selection unit . The stereoscopic image according to any one of claims 1 to 7 , further comprising preview means for displaying the left and right images trimmed by the stereoscopic display range trimming means so as to enable autostereoscopic viewing by a parallel method or a crossing method. Data processing device. 9. The stereoscopic image data processing apparatus according to claim 8 , wherein the preview unit displays the left and right images trimmed by the stereoscopic display range trimming unit in a stripe shape by alternately synthesizing the left and right images . The preview means, according to cropped left and right images in a stereoscopic display range trimming unit, in claim 8, characterized in that to filter Alternating and separate color stripes synthesized and stripes displayed Stereoscopic image data processing device. Computer
  Reading means for reading stereoscopic image data composed of captured left and right binocular image data;
  Correction means for correcting the tilt and misalignment of the left and right binocular images formed from the stereoscopic image data read by the reading means;
  ZDP setting means for setting a ZDP that is a point at which binocular parallax disappears when a stereoscopic image is displayed on the left and right binocular images corrected by the correction means;
  Stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image on a stereoscopic display means with the ZDP set by the ZDP setting means as a reference point;
  Image format conversion means for converting the left and right images trimmed by the stereoscopic display range trimming means into an image format for stereoscopic display;
  Warning means for issuing a warning to a user when the trimming range becomes smaller than a predetermined size when the stereoscopic display range trimming means performs trimming;
3D image data processing program for functioning as   Computer
  Reading means for reading stereoscopic image data composed of captured left and right binocular image data;
  Correction means for correcting the tilt and misalignment of the left and right binocular images formed from the stereoscopic image data read by the reading means;
  ZDP setting means for setting a ZDP that is a point at which binocular parallax disappears when a stereoscopic image is displayed on the left and right binocular images corrected by the correction means;
  Stereoscopic display range trimming means for trimming a range of left and right binocular images for displaying a stereoscopic image on a stereoscopic display means with the ZDP set by the ZDP setting means as a reference point;
  Stereoscopic effect adjusting means for adjusting the stereoscopic effect of the stereoscopic image displayed on the stereoscopic display means by moving at least one of the trimming ranges of the left and right images specified by the stereoscopic display range trimming means in the left-right direction;
  Image format conversion means for converting left and right images trimmed by the stereoscopic display range trimming means and having the stereoscopic effect adjusted by the stereoscopic effect adjusting means into an image format for stereoscopic display;
3D image data processing program for functioning as

Images