KR20080026877A - Image processing device and image processing method thereof - Google Patents

Abstract

An image processing device and an image processing method thereof are provided to enlarge or reduce an initial 2D(Two-Dimensional) image signal inputted from the outside suitably for vision conditions or convert the 2D image signal into a 3D image signal, thereby adjusting the focal distance of the image signal to improve the visual recognition properties of a viewer or a user. An image storage unit(103) acquires and decodes an image from the outside and stores macro block data in a frame unit. A plurality of image enlargement/reduction units(105a-105h) reads the macro block data in the frame unit from the image storage unit to realign the read macro block data at a proper ratio. An image selection unit(107) selects at least one image signal from the image enlargement/reduction units. A 3D(Three-Dimensional) image conversion unit(401) converts the image signal into a 3D image signal. A gaze distance adjustment unit(402) adjusts the gaze distance of the 3D image signal. An image output unit(404) displays the 3D image signal from the gaze distance adjustment unit.

Description

Image processing apparatus and its image processing method {IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD THEREOF}

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

2 is a block diagram of an image processing apparatus according to another exemplary embodiment of the present invention.

3 is a flowchart illustrating an image processing method of FIGS. 1 and 2.

4 is a block diagram of an image processing apparatus according to another embodiment of the present invention.

5 is a flowchart illustrating an image processing method of FIG. 4.

Explanation of symbols on the main parts of the drawings

101: video input / restore unit 103: video storage unit

105a to 105h: video magnification / reduction section 107: video selection section

109: data storage 211: mode selection unit

401: 3D image conversion unit 402: Watching distance control unit

403: video output unit

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and an image processing method, and more particularly, to those who wear glasses having near-native vision, such as a television, a personal computer, and a personal digital device. When using glasses, the Liquid Crystal Display Device (PDA) is used to adjust the viewing distance of a 3D image using a distance sensor to secure a safe working distance while wearing glasses, while not wearing glasses. The present invention relates to improving visibility by adjusting the viewing distance of the 3D image and the size of the overall screen or the image of the subject. Here, of course, the mode selection for the adjustment function can be implemented by the user's control or by an automatic system.

In general, the liquid crystal display device is a representative flat panel display device that displays an image by adjusting the transmission amount of the light beam corresponding to the image signal. This is starting with small displays such as notebooks in the early days, and its application range is gradually increasing due to the features such as light weight, thinness, and low power consumption. In particular, as the technology of large-sized panel is accelerated, its application range Now it has gone from LCD monitors to LCD TVs.

Recently, the media environment is also changing to the multimedia era. Of course, the complex functions vary slightly depending on whether it is small or large.However, for example, mobile phones are not only simple phone calls but also camera cameras that function as cameras.DMB phones (Digital multimedia Broadcasting Phone) In the case of a personal computer, including TV, it is possible to watch TV. In addition, in relation to TV, a technology is being developed to use a TV monitor as an eye protection device to protect the eyes, such as determining the possibility of vision deterioration that may be caused by watching TV for a long time and reducing the viewing time. .

However, it can be assumed that the media environment surrounding him may be a little uncomfortable for the near-native eye wearers who have already low vision and the specific people who can wear the glasses in the future. Since the focus of the image is adjusted, when the viewer does not use the concave lens, eye fatigue due to an incorrect viewing distance from the media such as the image focusing behind the retina may be doubled. Above all, this can be even more of a problem, such as for long-term Internet use or for office workers using text editors.

Therefore, in order to improve the above problems, the present invention implements an image suitable for the change of vision of the user so that the display image can be accurately formed on the retinas of the specific people in consideration of the case where the user of the liquid crystal display device wears glasses or not. Its purpose is to adjust the method automatically or to allow it to be adjusted automatically.

And the achievement of this object can be further embodied through the present invention. That is, the image processing apparatus according to the present invention includes image input / restoration means for acquiring and decoding an image from the outside; Image storage means for storing macro block data (Macro-Block Data) from the image input / restore means in units of frames; A plurality of enlargement / reduction means for reading the macroblock data in frame units from the image storing means and rearranging the macroblock data at an appropriate ratio; Image selection means for selecting at least one image signal of the enlargement / reduction means; 3D image converting means for converting the image signal into a 3-dimensional (3D) image signal; Gaze distance adjusting means for adjusting gaze distance of the 3D video signal; And an image output means for implementing the 3D image signal from the viewing distance adjusting means.

In addition, the image processing method according to the present invention includes an image input / restore step of acquiring and decoding an image from the outside; Storing the reconstructed image in memory on a frame basis; Enlarging / reducing the reconstructed image at least once; Storing the enlarged / reduced image in a memory; Selecting the reconstructed image or at least one enlarged / reduced image; Converting the selected image into a 3D image; Adjusting a scanning distance of the 3D image; Outputting the 3D image; And selecting the image selection and the scanning distance control as a mode.

Then, with reference to the drawings with respect to the above configuration will be examined in more detail. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention. As can be seen in the figure, the image input / restoration unit 101 is a moving picture signal transmitted using a compression encoding scheme such as a moving picture expert group (MPEG) input from a TV tuner or an external input terminal. Decode the process. In other words, assuming that MEPG-2, which is designed for the first broadcasting environment, is assumed to use a TV that composes a screen of 352 × 240 pixels in countries using NTSC, such as Korea, the unit The screen is divided into four sub-macroblocks in which macro-blocks of 16 × 16 pixels are divided into 8 × 8 pixels, and a signal is transmitted by performing two-dimensional Discrete Cosine Transform (DCT). The image input / restoration unit 101 receives such a signal and decodes the reverse process.

The image storage unit 103 then stores, in memory, video data corresponding to a unit screen configured in units of macroblocks of 16 × 16 pixels. Usually, a semiconductor memory such as a DRAM (Dynamic Random Access Memory) or the like, and its capacity may vary depending on the number of image enlargement / reduction units associated therewith.

In addition, the plurality of first to eighth image enlargement / reduction units 105a to 105h rearrange the unit screens stored in the image storage unit 103, that is, the image which is enlarged or reduced at an appropriate ratio by rearranging the image data for the frames. The data is generated and stored in the image storage unit 103 again. Herein, the proper ratio of the frame image data means a distance between the liquid crystal display device and the viewer or the user through a distance sensor included in the separate position recognition unit 114, and the enlarged image corresponding to the distance or Indicates a reduced image. However, in the case of a video, it is caused by an image processing process using a motion vector, and thus an enlarged or reduced image may be displayed instead of the background.

On the other hand, since the image selector 107 includes a kind of microprocessor, all information is controlled here. The above-described first to eighth information is based on the information from the position recognition unit 111 mentioned above. The image of the corresponding ratio is read out from the image enlargement / reduction portions 105a to 105h and output. For example, if the user of the desktop monitor selects and implements the image data of the fourth image enlargement / reduction unit 105d based on a safe using distance of 30 cm, the distance between the user and the monitor becomes closer than the reference distance. The image data of the third image enlargement / reduction section 105c which is slightly reduced further, and the fifth image enlargement / reduction section 105e which is slightly enlarged from the present state when the distance between the monitor and the monitor user is farther than the reference distance ) To select and implement the image data. Most of all, during the initial driving of the liquid crystal display, the microprocessor repeatedly reads data from the data storage unit 109 that is interlocked and stores the data in a separate random access memory (RAM).

Of course, the data storage unit 108 here is composed of EEP-ROM (Electrically Erasable Programmable Random Only Memory). Above all, since the EEP-ROM can write data as necessary through an external PC or other equipment, the microprocessor of the image selection unit 107 recognizes the information based on the data. For example, the data storage unit 108 of the present invention stores data representing an enlargement / reduction ratio of an image to a distance.

And the position recognition unit 111 is configured to include a distance sensor and the like already mentioned. More specifically, the location recognition unit 111 may be designed around the microprocessor on the main printed circuit board (PCB) or may be designed by adding a separate device, but above all, the distance sensor is a liquid crystal display device. In order to detect the distance between the user and the user, it is preferable to configure the unit integrally or to add a separate device to the outside of the LCD device.

In addition, the image output unit 113 refers to the liquid crystal display device, and outputs and implements the image data selected by the image selection unit 107.

2 is a block diagram illustrating another embodiment according to the present invention. 1 is different from the position recognition unit 111 is replaced by the user mode selection unit 211, where the mode represents the vision information, such as the degree of glasses, the viewer or user who uses the liquid crystal display device The mode can be selected by operating a separate remote controller or button. For example, if the frame information in units of macroblocks of the first 16 × 16 pixels is set based on a viewer or a user having a visual acuity of 1.5, a viewer or a user having a visual acuity of 1.5 or less selects a corresponding frequency selection item suitable for him or her. At this time, the image selector 107 selects and outputs the image data from the image storage unit 103 according to the data. Of course, as described above, a screen in which only an image of a subject other than a background part is enlarged may appear in the liquid crystal display device.

Next, the image processing method will be briefly described based on FIGS. 1 and 2. First, the image processing apparatus according to the present invention writes data representing a distance or an image enlargement / reduction ratio to a vision presented on a data sheet into the data storage unit 109, and then initially drives the liquid crystal display. It is based on the premise of temporarily storing the Sig data in RAM, which is linked with the microprocessor.

If this process is premised, the image processing apparatus of the present invention performs an image information input / restore step of receiving and decoding an image signal from the outside (S301). Here, as mentioned above, the first 16 × 16 macroblock unit information is divided into four sub macroblocks of 8 × 8 pixel block units to receive a two-dimensional DCT signal, and the signal is converted into 16 × 16 pixel units. The process of restoring the information in macroblock units is performed.

In operation S302, the restored video signal is stored in a memory. Here, the video signal in units of macroblocks of 16x16 pixels is stored in DRAM in units of frames.

Subsequently, the step of enlarging / reducing the reconstructed initial image is continued (S303). In other words, the image information stored in the initial DRAM is enlarged / reduced at a rate corresponding to data such as, for example, vision information by an enlargement / reduction means configured in at least one enlargement / reduction section. Above all, although the object of the enlargement / reduction may be the enlargement / reduction of the entire screen, the present invention preferably considers the enlargement / reduction of the subject except the background.

The enlarged / reduced image information is again stored in the DRAM (S304). Therefore, the total capacity of the DRAM may vary depending on how much to enlarge / reduce the image.

The image information is selected from the first image stored in the DRAM and at least one enlarged / reduced image information according to the mode selection S305a suitable for the vision condition of the viewer or the user of the liquid crystal display (S305). Above all, in such a mode selection S305a, it can be manually selected by a user such as a remote controller, or can be adjusted automatically using a distance sensor.

The selected video signal is output on the screen of the liquid crystal display (S306). Of course, the liquid crystal display device here is meant to include those that are applied to the LCD TV, LCD PC and DMB phone already mentioned.

However, the image signal selected from the image selector 107 of FIGS. 1 and 2 is a 2-dimensional (2D) image in which the image information, which is initially input, is enlarged or reduced. Therefore, even if you do not wear glasses or wear glasses, the position of the user who uses the liquid crystal display is usually fixed to a certain degree. If the focal lengths do not match, the image may not be exactly formed on the user's retina. Will not. For example, assuming that a user views a broadcast using a DMB phone, the focal lengths do not match and eyes are easily tired.

3 is a view illustrating an image processing apparatus for realizing a screen by adjusting a viewing distance of a 3-Dimension (3D) image signal as another embodiment according to the present invention in order to further supplement the above problem. The video signal input to the video selector 107 is the same 2D video signal as the video signal in FIGS. 1 and 2.

As shown in the figure, the 3D image converter 401 converts the 2D image signal into a 3D image signal, for example, classifies objects and sets windows using pixel values of the 2D image signal. In addition, a depth map is generated at the reference point and the horizontal width of each window, and the 2D video signal is parallaxed and converted into a 3D video signal according to the generated depth map.

The gaze distance controller 402 adjusts the gaze distance according to the horizontal parallax code of the subject from the converted 3D image signal. In particular, in the specific operation principle, in the case of a distance-based stereoscopic image rendering technique and an image substrate rendering technique, a function of adjusting the stereoscopic sense of a stereoscopic image at a specific viewpoint along with the user's viewpoint tracking is required. In the present invention, when the image signal output from the gaze distance controller 302 is used as a basic input of an image processing technology for generating a stereoscopic image, it may be more effective.

In addition, although the image output unit 403 refers to the same liquid crystal display device as described above, there is a difference in that the 2D image information selected from the image selection unit 107 described above is output as a 3D image.

5, the overlapping part with the image processing method described above will be briefly described on the basis of FIG. 5, and then only the image processing method related to the additional configuration will be described. In other words, the first image information is received and restored through the decoding process (S301), and the restored image is first stored in the memory (S302). Thereafter, the restored image is enlarged / reduced at an appropriate ratio (S303), and the enlarged / reduced image is stored in the memory again (S304). Then, by the external or automatic mode selection (S305a), the video selection unit selects the corresponding video information (S305) and outputs it from the memory. Of course, this has already been described earlier.

Subsequently, the selected video information is converted into a 3D video (S501). In other words, the video signal stored in the memory (S302 and S304) in the previous step and selected and output (S305) is 2D image information.

Then, the step of adjusting the viewing distance of the 3D image is made (S502). Of course, the viewing distance can be adjusted by the user mode selection or the distance sensor. First of all, the adjustment of the viewing distance here is substantially different in the focal length between the glasses wearer who uses the liquid crystal display device or the user who has low vision but does not wear the glasses. In this case, the focal length is adjusted. This means that the image is protruded or visible on the screen of the liquid crystal display. For example, even when wearing glasses, if the focal length is not appropriate, the distance sensor configured in the mode selector is connected with the user. The distance is detected and the focal length is adjusted by projecting or entering the entire image on the screen of the liquid crystal display device by the difference from the reference distance stored in the data storage unit such as the EEP-ROM.

To summarize once again the most preferred embodiment of the present invention based on the entire contents up to now, when the wearer wearing the glasses to determine the safe distance between the liquid crystal display device and the user first the distance sensor to determine the distance; By judging and comparing the data with the reference distance stored on the EEP-ROM, it is necessary to adjust only the viewing distance of the 3D image by the difference. In this regard, it is expected that the zooming of the original reconstructed image will not be necessary. . However, when the glasses wearer does not wear glasses, it is necessary to adjust the gaze distance of the 3D image by adjusting the distance by the distance sensor and to adjust the overall screen size or the image size of the subject, which requires a relatively extensive change. will be.

As a result of the configuration up to now, the image processing apparatus according to the present invention is able to adjust the viewing distance by enlarging / reducing the first 2D image signal input from the outside to suit the visual acuity condition or converting it into a 3D image signal. As a result, the liquid crystal display device has an effect such as an image projecting outward or entering the inside. As a result, the liquid crystal display device is used at a fixed position due to the effect of moving the liquid crystal display device without moving the liquid crystal display device. The viewer or user whose visual acuity is deteriorated may improve visibility because the focal length is automatically adjusted.

Claims (34)

Image storage means for acquiring and decoding an image from the outside and storing macro block data in frame units; A plurality of image enlargement / reduction means for reading macroblock data in units of frames from the image storage means and rearranging the macroblock data at an appropriate ratio; Image selection means for selecting at least one image signal from the image enlargement / reduction means; 3D image conversion means for converting the video signal into a 3D video signal; Watching distance adjusting means for adjusting the viewing distance of the three-dimensional image signal; And And image output means for implementing a three-dimensional image signal from the viewing distance adjusting means. An image processing apparatus according to claim 1, wherein said image storing means is a memory for image data, such as a dynamic random access memory (DRAM). The image processing apparatus according to claim 1, wherein the image enlargement / reduction means is pixel interpolated. The image processing apparatus according to claim 1, wherein the image selection means is a microprocessor. The image processing apparatus according to claim 1, wherein the image selection means is interlocked with data storage means for providing reference data. The image processing apparatus according to claim 5, wherein the data storage means is an EEP-ROM (Electrically Erasable Programmable Random Only Memory). The image processing apparatus according to claim 1, wherein the image selecting means is linked with a mode selecting means into which sight information or distance information is input. 8. An image processing apparatus according to claim 7, wherein said mode selection means is a remote controller. The image processing apparatus according to claim 7, wherein the mode selection means comprises a distance sensor. The image processing apparatus according to claim 1, wherein the image output means is a liquid crystal display device including a personal digital assistant, an LCD computer, and an LCD TV. An image storage step of acquiring and reconstructing the image from the outside and storing the image in a frame unit; Enlarging / reducing the reconstructed image at least once; Storing the enlarged / reduced image in a memory; Selecting the reconstructed image or at least one enlarged / reduced image; Converting the selected image into a 3D image; Adjusting a scanning distance of the 3D image; Implementing the 3D image; And And selecting the image selection and the viewing distance control as a mode. 12. The image processing method according to claim 11, wherein the memory is a DRAM. 12. The image processing method according to claim 11, wherein the enlargement / reduction of the reconstructed image is performed by pixel interpolation. 12. The image processing method according to claim 11, wherein the image selection is performed by a microprocessor. 12. The image processing method according to claim 11, wherein the mode selection is performed by a remote controller. The image processing apparatus of claim 11, wherein the mode selection is performed by a distance sensor. 12. The image processing method according to claim 11, wherein the image is implemented on a screen of a liquid crystal display device including a personal digital assistant, an LCD computer, and an LCD TV. Image storage means for acquiring and decoding an image from the outside and storing macro block data in frame units; A plurality of image enlargement / reduction means for reading macroblock data in units of frames from the image storage means and rearranging the macroblock data at an appropriate ratio; Image selection means for selecting at least one image signal from the image enlargement / reduction means; And And image output means for implementing the selected image signal. 19. An image processing apparatus according to claim 18, wherein said image storing means is a memory for image data such as DRAM. 19. An image processing apparatus according to claim 18, wherein said image enlargement / reduction means is pixel interpolated. 19. An image processing apparatus according to claim 18, wherein said image selection means is a microprocessor. 19. An image processing apparatus according to claim 18, wherein said image selection means is linked with data storage means for providing reference data. The image processing apparatus according to claim 22, wherein said data storage means is an EEP-ROM. 19. The image processing apparatus according to claim 18, wherein the image selecting means is interlocked with a mode selecting means into which sight information or distance information is input. An image processing apparatus according to claim 24, wherein said mode selection means is a remote controller. An image processing apparatus according to claim 24, wherein said mode selection means comprises a distance sensor. 19. The image processing apparatus according to claim 18, wherein the image output means is a liquid crystal display device including a personal mobile terminal, an LCD computer, and an LCD TV. An image storage step of acquiring and reconstructing the image from the outside and storing the image in a frame unit; Enlarging / reducing the reconstructed image at least once; Storing the enlarged / reduced image in a memory; Selecting the reconstructed image or at least one enlarged / reduced image; And And implementing the selected video signal. 29. The image processing method according to claim 28, wherein the memory is a DRAM. The image processing method according to claim 28, wherein the enlargement / reduction of the reconstructed image is performed by pixel interpolation. 29. The image processing method according to claim 28, wherein the image selection is performed by a microprocessor. 29. The image processing method according to claim 28, wherein the image selection is performed by a remote controller. 29. The image processing apparatus of claim 28, wherein the image selection is performed by a distance sensor. 29. The image processing method according to claim 28, wherein the image realization is performed on a screen of a liquid crystal display device including a personal digital assistant, an LCD computer, and an LCD TV.

Images