Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/10—Segmentation; Edge detection
  • G06T7/12—Edge-based segmentation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/106—Processing image signals
  • H04N13/15—Processing image signals for colour aspects of image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/189—Recording image signals; Reproducing recorded image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/257—Colour aspects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/363—Image reproducers using image projection screens
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N2013/0074—Stereoscopic image analysis
  • H04N2013/0077—Colour aspects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N2013/0074—Stereoscopic image analysis
  • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N2013/0074—Stereoscopic image analysis
  • H04N2013/0092—Image segmentation from stereoscopic image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N2013/0074—Stereoscopic image analysis
  • H04N2013/0096—Synchronisation or controlling aspects

Definitions

• the present invention relates to a method and an apparatus for converting monoscopic (i.e., two-dimensional) images into stereoscopic (i.e., three-dimensional) images, and more particularly to a method and an apparatus for converting monoscopic images into stereoscopic images which enables to effectively reduce the efforts and cost necessary for producing the data of stereoscopic images by converting the two-dimensional image of anobject into three-dimensional image, and then synthesizing the right eye image of each object and the original two-dimensional image.
• monoscopic i.e., two-dimensional
• stereoscopic i.e., three-dimensional
• the stereoscopic image consists of an image
• the present invention has been made to overcome the above described problems, and accordingly it is an object of the present invention to provide a method and an apparatus for converting monoscopic images into stereoscopic images which enables to effectively reduce the efforts and cost necessary for producing the data of stereoscopic images by converting the two-dimensional image of an object into three-dimensional image, and then synthesizing the right eye image of each object and the original two-dimensional image.
• the present invention provides a method for convertingmonoscopic images to stereoscopic images , said method comprising the steps of: reading a two-dimensional original image to be converted, storing the image data corresponding to the original image, and initializing the construction of the image data; extracting image of each object from the original image, objectifying the extracted image, and storing the objectified image ; adjusting and editing the objectified image according to the depth of each pixel and the object depth thereof; and synthesizing the edited image and the original image, and outputting the synthesized image to a monitor.
• the extracting step comprises; extracting the contour line of the image of each object; calculating the least rectangle containing the extracted contour line; allocating a space for storing the extracted object; initializing the allocated space; comparing pixels within the rectangle to determine which pixel within the rectangle is out of the contour line; drawing some pixel with transparent color in the region corresponding to the arrangement of original object and the arrangement of edit object if the pixels are out of the contour line as a result of said comparison; and duplicating other pixels to the arrangement of original object and the arrangement of edit object, if the other pixels are within the contour line as a result of said comparison, changing the color of the other pixels with transparent color in the region corresponding to the space from which the object is extracted.
• the present invention provides an apparatus for converting monoscopic images to stereoscopic images, said apparatus comprising: original image storing means for storing a two-dimensional original image to be converted; object extracting means for extracting images of each object from the original image, objectifying the extracted image, and storing the objectified image; original object arrangement means for separately storing the image of each object extracted from the object extracting means ; object depth arrangement means for adjusting and editing the extracted object image according to each pixel depth and object depth; edit object arrangement means changing the image of the original object arrangement means according to the depth value of the object depth arrangement means to produce a right eye image of the object, and storing the right eye image; synthesis object arrangement means for synthesizing the images of the original object arrangement means and the edit object arrangement means, and storing the image of each object as seeing a stereoscopic image; and synthesis stereoscopic image means synthesizing the image of the original image storing means and the right eye image of each object stored in the edit object arrangement
• Fig .1 is a schematic block diagram showing the construction and data flowing of an apparatus for converting monoscopic images into stereoscopic images according to the present invention
• Fig. 2 is a flow chart showing in brief the sequential algorithm according to the present invention
• Fig. 3 is a flow chart showing in detail the step for extracting the image from an object and the step for objecting the extracted image in Fig. 2; and Fig.4 shows an example of a stereoscopic image according to the present invention.
• the human brain perceives that the focus positions of the objects are different each other.
• the distance between human's left and right eyes is constant, so that the angle of the image formed on the left eye is different from that formed on the right eye. Therefore when left eye image and right eye image formed on the left eye and right eye are projected on a screen, the difference of the distance between the left eye image and the right eye image is appeared differently according to the distance between the human and the objects. In this reason, the human brain can perceive the distance between the human and the object due to the difference of the distance between the left eye image and the right eye image .
• the new stereoscopic image is made by such method. That is, the stereoscopic image is produced by converting the two-dimensional image of each object into three-dimensional image, and then synthesizing the image formed on the right eye and the original two-dimensional image.
• the stereoscopic image is not made by newly producing the right eye image with considering the original image as the left eye image, and then synthesizing the generated right eye image and the original image.
• the stereoscopic image is made by producing the separate right eye image with considering each object in the original image as a left eye image, and then synthesizing the generated right eye images and left eye images respectively.
• Fig .1 is a schematic block diagram showing the construction and data flowing of an apparatus for converting monoscopic images into stereoscopic images according to the present invention.
• Fig.2 is a flowchart showing in brief the sequential algorithm according to the present invention.
• Fig. 3 is a flow chart showing in detail the step for extracting the image from an object and the step for objecting the extracted image in Fig. 2.
• reference numeral 10 designates an original image storing unit to which a two-dimensional original image to be converted is input.
• the original image is use as a left eye image to get a synthesized stereoscopic image.
• Reference numeral 20 designates an object-extracting unit to which the original image stored in the original storing unit 10 is duplicated.
• the image of each object is extracted from the object-extracting unit 20.
• Reference numeral 30 designates an original object arrangement unit 30 in which the extracted image is stored.
• the extracted image is removed from the object-extracting unit 20.
• Each object corresponds to three data spaces. These data spaces consist of an original object arrangement unit 30, an object depth arrangement unit 40 which stores a depth value of the object that is value determining whether or not each pixel of the obj ect appears to be protruded from the stereoscopic image, and an edit object arrangement unit 50 which stores the right eye image generated by editing the original object image .
• Reference numeral 70 designates a synthesis object arrangement unit that is a region storing the stereoscopic image of each object generated by synthesizing the image of the original object arrangement unit 30 and the image of the edit object arrangement unit 50.
• Reference numeral 60 designates a synthesis stereoscopic image unit that is a region storing the result image to be obtained by synthesizing the image of the original image-storing unit 10 and the right eye image of each object stored in the edit object arrangement unit 50.
• the synthesis of images is realized in real time with editing the object, so that the user can process the synthesis work seeing with eyes.
• each storage space is initialized (step 100) .
• the two-dimensional original image is stored in the original image-storing unit 10, and the object-extracting unit
• the synthesis stereoscopic image unit 60 is also initialized with the original image because the edit is still not practiced.
• Contour line is extracted from the image of the object-extracting unit 20 by using the known algorithm (step 121) . And then it is calculated the size of the minimum rectangle which comprises the extracted contour line (step 122) .
• the size of the space to be allocated to the arrangement units 30, 50, and 70 should be determined to consider a margin. That is, the size of the space should be not determined by the accurate size of the rectangle, but by the size having the added size by the maximum depthat the left andright sides thereof , because it is positioned at a new position horizontally shifted according to the depth of each pixel in the original object image. For example, when the size of the object image is about 140x60 pixels, and the maximum depth is 100, the size of the space to be allocated should be 340 pixels (40+100+100) x60 pixels . Because the object depth arrangement unit 40 is used to store the depth of each pixel, it is unnecessary for the unit 40 to have the spare size as like the original object arrangement unit 30 and the edit object arrangement 50.
• the allocated space is initialized (step 124)
• the original object arrangement unit 30 and the edit object arrangement unit 50 are initialized with transparent color to prevent damage of image.
• All depth values of the object depth arrangement unit 40 are initialized with the value of zero.
• the depth value is zero, the human eyes perceive as the pixel is on the screen of the computer monitor. However when the depth value is positive, the human eyes perceive as the pixel is in the front of the screen.
• the depth value is negative, the human eyes perceive as the pixel is at the rear of the screen. That is, the pixel of which depth value is positive looks like that the pixel is in the front of the screen, and then the pixel of which depth value is negative looks like that the pixel is at the rear of the screen.
• the object depth of the newly extracted image is also initialized with zero.
• object depth' 1 means the value showing how far is an object to the reference position (e.g. screen of the monitor) when a human watches the screen.
• the position of each object in the space is determined by adjusting the value of the object depth.
• the result value of each pixel in the synthesis stereoscopic image 60 is the value obtained by adding the value of the pixel depth to the value of the object depth.
• the newly extracted object image is duplicated to the central position of the following allocation space (step 125 and step 126) .
• the image is also duplicated to the original object arrangement unit 30 and the edit object arrangement unit 50.
• the image of the edit object arrangement unit 50 is the same that of the original object arrangement unit 30 because the image stored in the edit object arrangement unit 50 is the image not to be edited.
• the image stored in the edit object arrangement unit 50 is the right eye image corresponding to the original image that is considered as the left eye image.
• the duplication process for the extracted image is applied to all pixels in the object image stored in the original object arrangement unit 30. If some pixels are in the contour line, the color of pixels in the object-extracting unit 20 is changed into transparent color (step 126) . This enable to remove the new object image extracted from the object extracting unit 20 without affecting to the image of other object to be extracted in the following.
• the original object arrangement unit 30 and the edit object arrangement unit 50 are fill with pixels of transparent color (step 127) .
• the spare space is also filled with pixels of transparent color so as not to damage the image .
• the image to be remained after extracting process is stored as "background object 1 '.
• the background object is also processed as above described. However the object depth of the background object is set at the maximum negative value (-1 x maximum depth) because the background object is part corresponding to the background of the original image, and is the object that looks like the farthest object from the operator.
• the edit of the object means that a pixel depth and an object depth are adjusted.
• the adjustment is achievedby changing the value of each pixel depth into positive or negative value on the basis of zero value.
• the absolute value of each depth is appropriately adjusted according to the extent of the depth.
• the depth of each pixel in the object depth arrangement unit 40 is changed with this process.
• the object depth arrangement unit 40 it is capable producing the right eye image of the object to the edit object arrangement unit 50 from the image stored in the original object arrangement unit 30.
• the right eye image is horizontally shifted to the left from the position of the left eye image.
• the value of the depth is negative
• the right eye image is horizontally shifted to the right from the position of the left eye image.
• the more the absolute value of the depth is large, the more the distance of the shift is large.
• the pixel in the original object arrangement unit 30 is horizontally shifted according to the depth thereof, and then is also duplicated to the corresponding position of the edit object arrangement unit 50.
• the images of the original object arrangement unit 30 and the edit object arrangement unit 50 are synthesized to produce new images in the synthesizing object arrangement 70 (step 160) .
• the user can see the synthesized stereoscopic image in real time.
• the image in the original object arrangement unit 20 is used as the right eye image
• the image in the edit object arrangement 50 is used as the left eye image.
• one line image date is read from the left eye image, and the image data is duplicated to the top line of the buffer for storing the synthesized image.
• one line is read from the right eye image, and the image date is duplicated to the next line of the buffer.
• the right eye image and left eye image are alternately read by one line, and the read image data are written on the buffer in sequential .
• the stereoscopic image synthesized in suchmethod is applicable to the stereo viewer supporting the line blanking method.
• the synthesized object image is stored in the synthesizing object arrangement unit 70. Accordingly, the user can see the image .
• the object images in the edit object arrangement unit 50 are synthesized to the original image stored in the original storing unit 10 as the left eye image. Synthesis of the images is started from the object of which object depth is minimum. That is, background image is synthesized to the original image, and thereafter the result image is synthesized to the object having depth value that is second small.
• the object having a small object depth value is covered with another object having a large object depth value.
• the object is screened by another object, so that the user can see the object as an actual situation.
• a method and an apparatus for converting a monoscopic image to a stereoscopic image are achieved by converting the two-dimensional image of each object into three-dimensional image, and then synthesizing the right eye image of each object and the original two-dimensional image, it is possible to more detailedly realize the stereoscopic image. Furthermore, since the entire image is not formed by editing an image, but is formed by incorporating objects that are independently edited, it is possible to ensure the quality of the stereoscopic image. Furthermore, since the most two-dimensional images are usable according to the present invention, it is possible to effectively reduce the efforts and cost necessary forproducing the data of stereoscopic images .

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Processing Or Creating Images (AREA)
• Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=19564569

Family Applications (1)

Country Status (2)

Cited By (5)

Families Citing this family (9)

Citations (3)

Family Cites Families (1)

• 1998
  • 1998-12-22 KR KR1019980057178A patent/KR100321897B1/ko not_active IP Right Cessation
• 1999
  • 1999-12-22 WO PCT/KR1999/000806 patent/WO2000038434A1/en active Application Filing

Patent Citations (3)

Also Published As

Similar Documents

Legal Events