KR20100075154A - Method of controlling digital image signal processing apparatus for derterming image blurring, medium of recording the method, digital image signal processing apparatus of applying the method - Google Patents

Abstract

PURPOSE: A method of controlling digital image signal processing apparatus for determining image blurring, a medium of recording the method, a digital image signal processing apparatus of applying the method are provided to confirm the shaking of a photographed image by comparing a reference image to which a focus is adjusted with a feature point and edge information. CONSTITUTION: A reference image to which focus is adjusted is generated(S13), and a photographing image is generated(S17). Image information on the reference image and the each photographed image is deduced(S18). Second image information of the photographed image corresponding to first image information of the reference image are compared to each other(S19). If the first and second image information are different from each other, the photographing image is determined as a blurred image(S20).

Description

Control method of a digital image signal processing apparatus for determining image shake, a recording medium recording the same, and a digital image signal processing apparatus executed by the control method. the method, digital image signal processing apparatus of applying the method}

The present invention relates to a control method of a digital video signal processing apparatus for determining a shaken image, a recording medium recording the same, and a digital video signal processing apparatus employing the above method.

When shooting with a digital camera, there may be a case where a captured image shaken by a user's immaturity or other external influence is obtained. The user may immediately check and immediately take a picture to delete or retake a shaken image. However, the display device employed for the miniaturization of the digital camera also has a small resolution. Therefore, when the photographed image is displayed on the display apparatus when the photographed image is checked, the entirety of the shake may not be distinguished by the naked eye, and it is inconvenient to enlarge and confirm the photographed image. In some cases, the enlargement may be confirmed, but even when enlarged, the display device employed in the digital camera may not be visually identified.

An object of the present invention is to provide a control method capable of effectively determining a shake of a captured image in a digital image signal processing apparatus, a recording medium recording the same, and a digital image signal processing apparatus operating according to the control method.

The present invention provides a method of generating a reference image in focus, generating a captured image, deriving image information of each of the reference image and the captured image, and first image information of the reference image. Comparing the second image information of the captured image corresponding to the second image information, and if the first image information and the second image information are different from each other, determining the captured image as a shaken image. To provide a control method.

 In the control method of the digital image signal processing apparatus according to an embodiment of the present disclosure, the image information may be a feature point for distinguishing a subject. Therefore, the control method of claim 2, wherein at least one feature point of each of the reference image and the captured image is extracted, and the second feature point of the captured image corresponding to the first feature point of the reference image is compared with each other. If the first feature point and the second feature point are different from each other, the captured image may be determined as a shaken image. According to an embodiment, when the number of the first feature points and the second feature points is compared, and when there are a plurality of second feature points corresponding to the first feature points, the captured image may be determined as a shaken image.

In a control method of a digital image signal processing apparatus according to another embodiment of the present invention, the image information may be edge information. In the case of edge information, extracting at least one edge information of each of the reference image and the captured image, comparing the second edge information of the captured image corresponding to the first edge information of the reference image; If the first edge information and the second edge information is different from each other may include determining the captured image as a shaken image. The comparison of the edge information may be comparing data of the first edge information and the second edge information.

Further, the present invention can provide a recording medium on which the above-described control method of the digital video signal processing apparatus is recorded.

In addition, the present invention provides a first image signal processor for generating a reference image and a captured image in focus, a second image signal processor for deriving image information from each of the reference image and the captured image, and the reference image. And a comparison determiner for comparing second image information of the captured image corresponding to first image information, and a controller configured to determine the captured image as a shaken image when the first image information and the second image information are different. Provided is a digital video signal processing apparatus.

In the digital image signal processing apparatus according to the present invention, the second image signal processing unit includes a feature point extracting unit for extracting a feature point for distinguishing a subject from the reference image and the photographed image, and wherein the comparison determining unit is configured to display the reference image. The first feature point and the second feature point of the captured image corresponding to the first feature point may be compared. As an example, the comparison determiner may compare the number of the first feature points and the second feature points.

In the digital image signal processing apparatus according to the present invention, the second image signal processor may include an edge information extractor configured to extract edge information from the reference image and the captured image. In this case, the comparison determiner may compare first edge information of the reference image and second edge information of the captured image corresponding to the first edge information. In particular, the comparison determiner may compare data of the first edge information and the second edge information.

According to the present invention, a control method of a digital image signal processing apparatus capable of easily confirming a shake of a captured image by comparing a focused reference image with a feature point or edge information, a recording medium recording the method, and digitally executed according to the method An image signal processing apparatus can be provided.

A digital camera is described as an embodiment of the digital video signal processing apparatus according to the present invention. However, the digital image signal processing apparatus is not limited to a digital camera, but may be applied to digital devices such as a camera phone, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like with a camera function.

FIG. 1A is a perspective view of a digital camera, and FIG. 1B is a rear view of the digital camera shown in FIG. 1A.

Referring to FIG. 1A, an optical part 11 including a lens, a lens cover, and the like is disposed on a front surface of the digital camera 100, and a flash F is disposed above the optical part 11. In addition, a power button 21 and a shutter button 22 for inputting a shutter-release signal for controlling photographing are disposed on an upper surface of the digital camera 100. According to FIG. 1B, a display window of the AMOLED 60 is disposed on the back of the digital camera 100, and a plurality of function buttons 26 are disposed around the display window.

The internal configuration of such a digital camera 100 will be described with reference to FIG.

The digital camera 100 includes an optical unit 10 for inputting light from a subject, an imaging element 11 and an imaging element 11 for converting an optical signal input through the optical unit 10 into an electrical signal. An input signal processing unit 12 that performs signal processing such as noise reduction processing and digital signal conversion processing on the provided electrical signal is provided. A motor 13 for driving the optical unit 10 and a driver 14 for controlling the operation of the motor 13 are provided. In addition, the digital camera 100 may include a user input unit (UI) 20 for inputting a user's operation signal, an SDRAM 30 for temporarily storing data of an input image, data for arithmetic processing, processing results, and the like. A flash memory 40 for storing algorithms, setting data, and the like necessary for the operation of 100 may be provided, and an SD / CF / SM card 50 may be provided as a recording device for storing an image file. The digital camera 100 is equipped with an organic light emitting display device 60 as a display device. In addition, an audio signal processor 71 for converting a sound into a digital signal or converting a digital signal of a sound source into an analog signal, generating an audio file, a speaker 72 for outputting sound, and a sound It may be provided with a microphone 73 for input. The digital camera 100 includes a processor 80 that controls the operation of the digital camera 100.

Look at each component in more detail.

The optical unit 10 may include a lens for condensing an optical signal, an aperture for adjusting the amount (light quantity) of the optical signal, a shutter for controlling the input of the optical signal, and the like. The lens includes a zoom lens for controlling the angle of view to be narrowed or widened according to a focal length, a focus lens for focusing an object, and the like, although each of these lenses may be composed of one lens, but a plurality of lenses. It may be made up of a group of people. A shutter may be provided with a mechanical shutter that moves the shade up and down. Alternatively, instead of a separate shutter device, the supply of an electrical signal to the imaging device 11 may be controlled to serve as a shutter.

The motor 13 driving the optical unit 10 may drive the position of the lens, opening and closing of the aperture, shutter operation, etc. to perform operations such as auto focus, automatic exposure adjustment, aperture adjustment, zoom, and focus change. Can be.

The motor 13 is controlled by the drive 14. The driver 14 controls the operation of the motor 13 according to a control signal input from the processor 80.

The imaging element 11 receives an optical signal input from the optical unit 10 and forms an image of a subject. As the imaging device 11, a complementary metal oxide semiconductor (CMOS) sensor array, a charge coupled device (CCD) sensor array, or the like may be used.

The input signal processor 12 may further include an A / D converter for digitizing the electrical signal supplied from the CCD as an analog signal. In addition, a circuit for performing signal processing for shaping a gain or shaping a waveform with respect to the electrical signal provided from the imaging element 11 may be provided.

The UI 20 may include a member for performing various settings when the user manipulates or photographs the digital camera 10. For example, it may be implemented in the form of a button, a key, a touch panel, a touch screen, a dial, and the like, and may include power on / off, imaging start / stop, playback start / stop / search, driving the optical system, mode switching, and menu operation. And user control signals such as a selection operation can be input.

The SDRAM 30 may temporarily store RAW data (RGB data) of an image provided from the input signal processing unit 12, and the temporarily stored RAW data may be subjected to predetermined image signal processing in accordance with the operation of the processor 80. It may also be passed on to other necessary components. In addition, the SDRAM 30 may temporarily convert data constituting an algorithm stored in the flash memory 40 into executable data. An operation according to the algorithm may be performed by arithmetic processing by the processor 80 using data stored in the SDRAM 30. In addition, image data obtained by decompressing and converting the image file stored in the flash memory 40 may be temporarily stored. The temporarily stored image data may be transmitted to the OLED 60 to display a predetermined image. The SDRAM 30 may use, for example, various volatile memories that temporarily store data during power supply.

The flash memory 40 may store necessary OS for operating the digital camera 100, an application program, data for executing an algorithm of a control method according to the present invention, and the like. As an example, the flash memory 40 may be used as various nonvolatile memories.

The SD / CF / SM card 50 may record an image file generated by compressing the image data provided from the input signal processor 12. The SD / CF / SM card 50 may use, for example, a hard disk driver (HDD), an optical disk, a magneto-optical disk, a hologram memory, or the like.

The organic light emitting display device (OLED) 60 may implement an image corresponding to the image data provided from the input signal processor 12 in real time, or may restore the image file stored in the flash memory 40 to the image data. The corresponding image may be displayed. Although the organic light emitting display device 60 is illustrated in the present embodiment, the present invention is not limited thereto, and a liquid crystal display device, an electrophoretic display device, or the like may be employed.

In addition, the external monitor 200 may be connected to the processor 80 to display the images on the external monitor 200.

The audio signal processor 71 converts the digital signal of the sound source provided from the processor 80 into sound, amplifies the sound, and transmits the sound to the speaker 72. Alternatively, the sound may be input through the microphone 73, and the sound may be converted into a digital signal and compressed to generate an audio file. The processor 80 may transfer the processor 80 to perform arithmetic processing.

The processor 80 reduces noise with respect to the input image data, gamma correction, color filter array interpolation, color matrix, color correction, and color enhancement. image signal processing such as (color enhancement). The image data may be generated by compressing the image data generated by the image signal processing, or the image data may be restored from the image file. The compressed format of the video may be a reversible format or a non-reversible format. As an example of a suitable format, it is also possible to convert to JPEG (Joint Photographic Experts Group) format, JPEG 2000 format, or the like. The processor 80 can also perform functionally unsharpening, color processing, blur processing, edge emphasis processing, image analysis processing, image recognition processing, image effect processing, and the like. As the image effect processing, a process of generating an enlarged image in which a part of the captured image signal is enlarged or generating a reduced image, a mosaic image / luminosity reversal image / soft focus / partial highlighting / color color conversion of the entire image, etc. Can be done. In addition, the processor 80 may perform display image processing for display on the OLED 60. For example, luminance level adjustment, color correction, contrast adjustment, outline enhancement adjustment, screen division processing, character image generation and the like, and image synthesis processing can be performed. The processor 80 may be connected to the external monitor 200 to perform a predetermined image signal processing to be displayed on the external monitor 200. The processor 80 may transmit the processed image data to transmit the image data. Can be controlled to be displayed.

The processor 80 performs the image signal processing as described above, and can control each component according to the processing result. In addition, each component may be controlled according to a control signal of a user input through the UI 20. The algorithm for performing the image signal processing is stored in the flash memory 40, and converted into executable data for operation processing and stored in the SDRAM 30 to perform the corresponding operation in the processor 80 accordingly. have.

In addition, the processor 80 may perform a control for determining the shaking of the captured image, which will be described in detail with reference to FIG. 3.

According to FIG. 3, the processor 80 performs first image processing for recording and / or reproduction on the image data input from the input signal processing unit 12 to generate a recording and / or storing image. (81), the second image signal processor 82 for deriving the image information with respect to the image generated by the first image signal processor 81, the comparison determination unit 83 for comparing the derived image information, the comparison result image The controller 84 may determine the shaking of the device.

As an embodiment, the processor 80 for determining the shaking of the captured image by using the feature point of the subject as the image information will be described.

Preview images are input in real time during a live-view period, and the user confirms the subject by checking the preview image. You can also check the subject directly through the viewfinder. When the first shutter release signal is input, an autofocusing operation is performed on the input image. The first image signal processor 81 performs an autofocusing operation to generate a focused image as a reference image. Preview images including the reference image may be displayed on the OLED 60. The reference image may be stored in a specific area of the SDRAM 30. Then, a second shutter release signal is input to perform a photographing operation. At this time, the input image is generated by the first image signal processor 81 as a captured image. The first image signal processor 81 may generate a reference image and a captured image by performing image signal processing such as noise reduction processing, gamma correction, color filter array interpolation, color matrix, color correction, and color enhancement on the input image. Can be.

The first shutter release signal may be generated by pressing the shutter button 22 halfway, and the second shutter release signal may be generated by pressing the shutter button 22 completely. Since the focus is preferably taken in a focused state, the same shutter button 22 can be used to minimize the shaking of the digital camera 100 between the focusing operation and the photographing operation.

The second image signal processor 82 extracts feature points of each of the reference image and the captured image. The feature point is for distinguishing a subject and can be extracted from an image through a shift algorithm.

The comparison determiner 83 may compare the feature point of the reference image with the feature point of the captured image. The feature points of the photographed image corresponding to the first feature points of the reference image may be compared. The first feature point, which is a characteristic point of the subject, in the reference image focused on the subject, and the second feature point, which is the characteristic point of the same subject in the captured image, may be compared. The number of first feature points in the reference image and the second feature points in the captured image corresponding to the first feature points may be compared. For example, it may be determined whether there are a plurality of second feature points corresponding to the first feature points in the focused reference image.

When the first feature point and the second feature point are different from each other as a result of the determination by the comparison determiner 84, the controller 84 may determine the captured image as a shaken image and notify the user of the image. The OLED 60 may further display an indication of a shaken image or control to output an alarm through the speaker 72. If it is determined that the first feature point and the second feature point fall within an equivalent range, the controller 84 may determine to determine that the captured image is not a shaken image and store the image.

In another embodiment, whether the captured image is shaken may be determined using edge information as the image information. As described above, the first image signal processor 81 may generate a focused reference image when the first shutter release signal is input, and generate a captured image when the second shutter release signal is input.

The second image signal processor 82 extracts edge information with respect to the reference image and the captured image. The edge information is data about a boundary line of an image, and as edge information, the number of pixels determined as the boundary line and a data value determined as the boundary line may be used.

The comparison determining unit 83 may compare first edge information of the reference image and second edge information of the captured image corresponding to the first edge information. For example, the number of pixels determined as the first boundary line of the reference image, or the data value of the pixels determined as the first boundary line, and the pixel number or data value of the second boundary line corresponding to the first boundary line in the captured image. Can be compared with each other.

When the first edge information and the second edge information are different from each other as a result of the determination by the comparison determination unit 83, the controller 84 determines the captured image as a shaken image and displays a display indicating the determination to the OLED 60. The alarm can be displayed or output to the speaker 72. Alternatively, when the first edge information and the second edge information belong to an equivalent range, the controller may control to store the captured image.

Hereinafter, an embodiment of a control method of a digital image signal processing apparatus of the present invention will be described with reference to the flowchart of FIG. 4.

First, starting from the shooting standby state S11, it is determined whether the first shutter release signal S1 is input (S12). When the first shutter release signal S1 is input, an autofocusing operation is performed to generate a reference image in focus (S13). First image information is derived from the reference image (S14). If the first shutter release signal S1 is not input, the photographing standby state S11 is maintained.

In operation S15, it is determined whether a second shutter-release signal is input. If the second shutter release signal is not input, it is determined whether the first shutter release signal is input again (S16), and if the first shutter release signal is not input, the photographing standby state is maintained and the first shutter release signal is released. If is input, it is determined whether the second shutter release signal is input (S15). When the second shutter-release signal is input, a photographed image is generated (S17). In operation S18, second image information is derived from the captured image.

In operation S19, it is determined whether the first image information is compared with the second image information. When the image information is different from each other, it is notified that the captured image is a shaken image (S20), otherwise, the captured image is stored (S21).

When the image information is a feature point for distinguishing a subject, a description will be given with reference to FIGS. 5A and 5B. 5A is a photograph showing a focused reference image by performing an autofocusing operation. The subject is a photograph of a computer body and an adapter. The upper left corner point X1 of the adapter is one feature point, and the upper right corner point Y1 of the adapter is extracted as another feature point as a point for specifying a subject in the reference image.

5B is a photograph showing a captured image. The feature points corresponding to the corner points X1 and Y1 of the reference image are derived from the captured image. The upper left corner point X1 of the adapter in the reference image is represented by two feature points x1 and x2 in the captured image, and the upper left corner point Y1 of the adapter in the reference image also includes two feature points in the captured image. It can be seen that (y1, y2).

Therefore, a plurality of feature points of the photographed image corresponding to the first feature point in the reference image are derived from the shaken image, and may be notified to the user. Therefore, the user can easily check whether the captured image shakes directly from the digital camera.

As another example, when the image information is edge information, pixel data representing one edge of the computer main body may be compared with the pixel data in the captured image of FIG. 5B in the reference image of FIG. 5A. For example, in the case of an edge, if it is not 1, it is determined as 0 to generate image information, and the data shown in Table 1 below can be obtained for the region L representing one corner of the computer main body from the reference image. have. For the photographed image, data shown in Table 2 below may be obtained when the area 1 representing one corner of the unitary computer body is represented as 1 in the case of an edge and 0 in the case of an edge, compared to an edge determination criterion. Therefore, by comparing the pixel areas of the reference image determined as the edge and those of the captured image, the captured image may be determined to be a shaken image. Even with this method, shake information can be easily obtained for an image photographed directly by a digital camera.

0 0 One One 0 0 0 One One 0 0 One One One 0 0 0 One One 0 0 0 One One 0 0 One One One 0 0 One One One 0 0 0 One One 0 0 0 One One 0 0 0 One One 0

0 0 One 0 0 0 0 One 0 0 0 One One One 0 0 0 0 0 0 0 0 One 0 0 0 One 0 One 0 0 One 0 0 0 0 0 One One 0 0 0 One 0 0 0 0 One 0 0

Meanwhile, the present invention can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which may also be implemented in the form of carrier waves (for example, transmission over the Internet). Include. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will understand that the present invention can be embodied in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown not in the above description but in the claims, and all differences within the scope should be construed as being included in the present invention.

1A is a perspective view of a digital camera as an example of a digital image signal processing apparatus according to the present invention.

FIG. 1B is a rear view of the digital camera shown in FIG. 1A.

FIG. 2 is a block diagram illustrating the digital camera shown in FIG. 1.

3 is a block diagram illustrating a processor of the digital camera of FIG. 2.

4 is a flowchart illustrating a control method of a digital image signal processing apparatus according to an embodiment of the present invention.

5A and 5B are photographs of a reference image and a captured image for explaining a method of controlling a digital image signal processing apparatus according to an embodiment of the present invention.

Claims (13)

Generating a reference image having a focus; Generating a photographed image; Deriving image information of each of the reference image and the captured image; Comparing second image information of the captured image corresponding to first image information of the reference image; And determining the photographed image as a shaken image if the first image information and the second image information are different from each other. The method according to claim 1, wherein the image information is a feature point for distinguishing a subject. The method of claim 2, further comprising: extracting at least one feature point of each of the reference image and the captured image; Comparing second feature points of the captured image corresponding to first feature points of the reference image; And determining the captured image as a shaken image if the first feature point and the second feature point are different from each other. The method of claim 3, further comprising: comparing a number of the first feature points and the second feature points; And determining the captured image as a shaken image when there are a plurality of second feature points corresponding to the first feature point. The method of claim 1, wherein the image information is edge information. The method of claim 5, further comprising: extracting at least one edge information of each of the reference image and the captured image; Comparing second edge information of the captured image corresponding to first edge information of the reference image; And determining the captured image as a shaken image if the first edge information and the second edge information are different from each other. The method of claim 6, wherein the data of the first edge information and the second edge information are compared. The recording medium which recorded the control method of the digital video signal processing apparatus in any one of Claims 1-7. A first image signal processor configured to generate a reference image and a captured image in focus; A second image signal processor configured to derive image information from each of the reference image and the captured image; A comparison determination unit comparing second image information of the captured image corresponding to first image information of the reference image; And And a controller configured to determine the captured image as a shaken image if the first image information and the second image information are different from each other. The display apparatus of claim 9, wherein the second image signal processor comprises a feature point extractor configured to extract a feature point for distinguishing a subject from the reference image and the captured image, And the comparison determining unit compares a first feature point of the reference image with a second feature point of the photographed image corresponding to the first feature point. The apparatus of claim 10, wherein the comparison determiner compares the number of the first feature points and the second feature points. The display apparatus of claim 9, wherein the second image signal processor comprises an edge information extractor configured to extract edge information from the reference image and the captured image. And the comparison determiner compares first edge information of the reference image and second edge information of the captured image corresponding to the first edge information. The digital image signal processing apparatus of claim 12, wherein the comparison determiner compares data of the first edge information and the second edge information.

Images