KR101119971B1 - Image pick up apparatus - Google Patents

Abstract

An object of the present invention is to provide an image pickup device that can easily recognize a blur or shake of a captured image without any special operation. To solve this object, the present invention provides an image pickup device that photoelectrically converts an optical image. An image pickup apparatus for displaying a photographed image on a display means, comprising: temporary storage means for temporarily storing a photographed image, and blurring or shaking detection means for detecting the blurring or shaking of the image stored in the temporary storage means; In the case where the blur or shake of the image stored in the temporary storage means is not detected by the shake detection means, the entire image is displayed on the display means, while when the blur or shake of the image is detected, the blur of the image on the display means Or control means for enlarging and displaying the shake portion. Provide a device.

Description

Image pick-up apparatus {Image pick up apparatus}

1 is a block diagram showing the configuration of a digital camera according to an embodiment of the present invention.

2 is a flowchart showing the operation of the digital camera in the first embodiment of the present invention.

3 is a production process chart showing the blurring shake detection operation of the digital camera.

4 is a diagram showing coefficients of a high pass filter used for blurring shake detection.

It is a figure which shows the micro block which is a unit which evaluates in blurring shaking detection.

6 is a flowchart showing the operation of the digital camera in the second embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

10: digital camera 12: lens

14: motor driver 16: CCD

18: AFE 20: TG

22: AGC 24: ADC

26: SIO / PIO 28: MPU

30: SDRAM 32: card interface

34: memory card 36: image processing

38: video interface 40: TFT

42: JPEG processing section 44: audio interface

46: speaker 48: key interface

50: operation key 52: bus line

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging device for photographing an image using an imaging device such as a charge coupled device (CCD).

If the camera auto-focuses incorrectly, or if the movement of the shooting subject is faster than the shutter speed, "blur" or "shake" occurs in the captured image. Although a digital camera has a great advantage of being able to immediately check a photographed image, a thin film transistor (TFT) liquid crystal display mounted in a digital camera has a low resolution, making it difficult to check an image in which blurring or shaking occurs. For this reason, after displaying an image with a PC or the like after shooting, a blur or shake phenomenon is often found and disappointed.

On the other hand, Japanese Patent Laid-Open No. 11-196301 describes a digital camera that enlarges and displays a focus position, and Japanese Patent Laid-Open No. 2002-187329 describes a printer for notifying a user before printing a failed image. have.

However, in the digital camera described in Japanese Patent Laid-Open No. 11-196301, it is necessary to go through a very cumbersome task in which an image is enlarged and confirmed every time shooting is performed. Further, the printer described in Japanese Laid-Open Patent Publication No. 2002-187329 sets the recording medium on which the photographed image is recorded to the printer to select the failed image before printing, so that the failed image is recorded until the printing after the shooting. It is inconvenient when the capacity of the recording medium remains small.

SUMMARY OF THE INVENTION The present invention has been made to solve various problems including the above problems, and an object thereof is to provide an imaging device that can easily recognize a blur or shake of a captured image without any special operation.

In order to achieve the above object, the image pickup apparatus according to the first embodiment of the present invention is an image pickup apparatus for displaying on a display means an image picked up by an image pickup element that photoelectrically converts optical imaging. Is stored in the temporary storage means by means of the temporary storage means for temporarily storing the information, the blurring or shaking detection means for detecting the blurring or shaking of the image stored in the temporary storage means, and the blurring and shaking detection means. When the blur or shake of the captured image is not detected, the entire image is displayed on the display means. When the blur or shake of the image is detected, the blur or shake portion of the image is enlarged and displayed on the display means. It is provided with a control means.

The imaging device further comprises information notification means for notifying a user when the blurring or shaking of the image stored in the temporary storage means is detected by the blurring / shake detection means, and the control means is blurring? When the blur or shake of the image stored in the temporary storage means is not detected by the shake detecting means, the image is recorded in a predetermined folder on a recording medium, and when the blur or shake of the image is detected. Recording or deleting the image in a folder different from the folder in the recording medium according to a user's operation.

The blurring and shaking detection means further includes sharpening portion detecting means for detecting a clear portion of the picked-up image, and the blurring or shaking of the image is detected. The partial region of the image to be enlarged and displayed is an area including a portion detected by the sharpness detecting unit.

In the imaging device, the sharpness detecting unit detects the sharpest portion of the captured image.

In the imaging device, the sharpness detecting unit extracts a plurality of sharp portions from the captured image, and detects a portion closest to the center of the image from the extracted plurality of portions.

On the other hand, the invention according to the second embodiment of the present invention is an image pickup apparatus for photographing an image by an image pickup element that photoelectrically converts optical imaging, comprising: a recording medium for recording the photographed image, and a recording medium recorded on the recording medium. Blurring and shaking detection means for detecting the blurring or shaking of the image, and information notification means for notifying a user when the blurring or shaking of the image recorded on the recording medium is detected by the blurring and shaking detection means, and the recording medium. Read the images recorded in step S, and when the blur or shake of the image is detected by the blur or shake detection means, move the image to a preset folder or a folder designated by the user, or delete the image. And the blurring or shaking of the image is detected by the information notification means to the user. Comprising a notification control means for, and the blur? Shake detection means, it hayeoseo divided by the reference block of 8 × 8 pixels, and the image pick-up device, characterized in that for detecting the blur or fluctuation of the image for each of the reference block.

In the imaging device, the information notification means is a display device or an audio output device.

EMBODIMENT OF THE INVENTION Hereinafter, with reference to drawings, the digital camera 10 which is an imaging device is demonstrated with reference to the Example of this invention. 1 is a block diagram showing the configuration of the digital camera 10 in the present embodiment. The CCD 16 outputs an electrical signal in accordance with the subject image formed through the lens 12 of the digital camera 10, and the digital data is converted into digital images. It is temporarily stored in the SDRAM (Synchronous Dynamic Random Access Memory) 30 and recorded in the memory card 34 by the user's selection. Here, although the CCD 16 is illustrated as an imaging device in FIG. 1, other imaging devices such as CMOS may be used.

The lens 12 forms an image on the CCD 16. The focus adjustment motor and the zoom motor provided in this lens are driven by the motor driver 14 to adjust the focus and the magnification.

The image light of the subject imaged on the CCD 16 by the lens 12 is photoelectrically converted into an image signal by the CCD 16, and an analog electric signal composed of a signal sequence of pixel signals received at each pixel of the CCD 16 is outputted. do.

The AFE 18 includes a timing generator (TG) 20, an automatic gain control (AGC) 22, and an analog-digital converter (ADC) 24. The TG 20 generates and supplies a timing signal for controlling the CCD 16. The AGC 22 adjusts the sensitivity of each of R (red), G (green), and B (blue) input from the CCD 16. The ADC 24 converts the color components of R, G, and B of the pixel signals input from the AGC 22 into digital signals and outputs them to the bus line 52.

The SIO / PIO (serial input / output / parallel input / output) 26 transmits a control signal to the motor driver 14 and the AFE 18 according to an instruction from the microprocessor unit (MPU) 28.

The MPU 28 has a ROM (Read Only Memory) for storing a control program and constant data, controls each unit in accordance with this control program, and also operates the operation keys 50 from the key interface 48. The signal output to the bus line 52 is detected to control the operation of each unit. The MPU 28 also controls the motor driver 14 and the AFE 18 via the SIO / PIO 26 and performs autofocus and autoexposure control. The automatic focus control performs focusing control by transmitting a signal for driving the focus adjustment motor of the lens 12 to the motor driver 14. Automatic exposure control is performed by controlling the motor driver 14 and the TG 20 to adjust the lens aperture of the lens 12 and the shutter speed of the CCD 16, that is, the charge accumulation time. The MPU 28 temporarily stores the image output from the ADC 24 to the bus line 52 in the SDRAM 30 and performs white balance adjustment. The white balance adjustment corrects the color deviation of the image due to the difference in the light source, and performs level conversion of each color component of R, G, and B of the image output from the ADC 24 so that the white subject is reproduced in white.

The SDRAM 30 not only temporarily stores an image obtained by imaging, but also stores data by the MPU 30 processing.

The image processing 36 performs interpolation, tone correction, edge emphasis, and the like on the image stored in the SDRAM 30. The image which can be displayed by these can be obtained. Interpolation either creates a new pixel between pixels or subtracts the pixel. Thereby, it can also output in image size larger than the image size obtained from the actual pixel count of CCD16. The tone correction obtains an image closer to the impression seen by the human eye, leaving the gradation of the shadow portion caused by the back light or the excessive light, in which the image is easily distorted. Edge enhancement aims to sharpen the image by inserting a suitable filter in the original image. Finally, YC signal processing is performed and the processed image is stored in the SDRAM 30. This YC signal processing generates the luminance signal Y and the chroma signals Cr and Cb.

A JPEG (Joint Pphotographic Expert Group) processing unit 42 compresses an image obtained by imaging.

The card interface 32 writes or reads data on the memory card 34.

The video interface 38 controls the TFT 40. The TFT 40 is a liquid crystal display on which an image obtained by imaging and various kinds of information are displayed.

The operation key 50 consists of a shutter button and a key used for other operations. When the operation key is operated by the user, the corresponding signal from the key interface 48 is output to the bus line 52.

The speaker 46 is controlled by the audio interface 44 and informs the user of the audio output.

Next, the operation of the above-described digital camera 10 will be described. 2 is a flowchart illustrating the operation of the digital camera 10.

When the user presses the shutter button among the operation keys 50 of the digital camera 10, image shooting is performed (step S1). That is, as described above, the MPU 28 performs autofocus control and autoexposure control, and outputs raw data, which is image data that is output from the ADC 24 to the bus line 52 and is not processed in any way. It is stored in the SDRAM 30 (step S2), the above-described white balance adjustment and development processing (step S3) are performed, and stored in the SDRAM 30 (step S4).

Next, blurring and shaking detection are performed (step S5). Here, referring to Fig. 3, the blurring and shaking detection operation will be described in detail. 3 is a flowchart illustrating a blurring and shaking detection operation. First, a Laplacian filter, which is a high-pass filter (HPF), is fitted to the luminance signal Y (Y image) among the images stored in the SDRAM 30 (step S21). This Laplacian filter is a digital filter used for edge detection of an image. This process is performed for each pixel by obtaining a value by calculation from the values of the pixel and its adjacent pixels. 4 shows coefficients used to obtain a value for each pixel. This means that if the coordinate represents the value of the pixel (i, j) as f (i, j), for the pixel whose coordinate is (i, j), the value of that pixel is quadrupled and the coordinate is (i-1, j). -1), (i-1, j + 1), (i + 1, j-1), (i + 1, j + 1), and multiply the values of the pixels by (-1) times, and add these values To calculate the value. That is, f (i, j) × 4 + f (i-1, j-1) × (-1) + f (i-1, j + 1) × (-1) + f (i + 1, j The value of -1) × (-1) + f (i + 1, j + 1) × (-1) is obtained. In addition, some coordinates of 3x3 adjacent pixels do not exist with respect to the coordinates of the end of the screen. In this case, for example, the non-existent portion of 3x3 adjacent pixels is filled with the average value of the existing pixels. Calculate

With respect to the values calculated for all the pixels as described above, as shown in Fig. 5, the microblocks are divided into microblocks of, for example, 8 x 8 pixels. Do it. From step S24 to step S26, the number of blocks in which the image is clear is counted. From step S27 to step S29, the position of the block in which the image is clear is obtained, that is, the sharp part of the image is detected. These specify a small block to be evaluated, for example, a small block of 8x8 pixels (step S23), and are sequentially performed on all blocks.

First, in step S24, the maximum value and the minimum value in the 8x8 pixel are specified, and the difference between the maximum value and the minimum value is calculated. The larger the difference, the more the edges stand firmly and the sharper the image. This calculation result is used for the determination of the blurring / shaking image. In step S25, it is determined whether the value calculated in step S24 is equal to or greater than a predetermined value. If the determination result is "YES", the process proceeds to step S26 and 1 is added to the counter. On the other hand, if the determination result is "NO", the flow proceeds to step S27.

In step S27, an average of absolute values of each 8x8 pixel is calculated. Next, in step S28, it is determined whether the value calculated in step S27 is equal to or greater than a predetermined value. If the determination result is "YES", the process proceeds to step S29 and the coordinates and the average value calculated in step S27 are set as a set and stored in the SDRAM 30. Here, the coordinates use, for example, the coordinates of any one of the four pixels in the center of the 8x8 pixel, for example, the upper left pixel. On the other hand, when the determination result of step S28 is "NO", it progresses to step S30.

In step S30, it is determined whether the block of 8x8 pixels evaluated from step S24 to step S29 is the last block. If there is a block that has not yet been evaluated, the determination result is "NO", and the flow returns to step S23. On the other hand, when evaluation is performed about all the blocks, the determination result becomes "YES", and it progresses to step S31.

In step S31, it is determined whether the value of the counter is equal to or less than a predetermined value. If the determination result is "YES", the flow proceeds to step S33, where it is determined that the image is blurred or shaken. The MPU 28 makes an indication to notify the TFT 40 that the blur or shake is detected through the video interface 38. This notification may be made by the MPU 28 outputting a warning sound indicating that blur or shake was detected from the speaker 46 via the audio interface 44. On the other hand, when the determination result of step S31 is "NO", it progresses to step S32 and it is determined that it is not a blur or shake image.

Returning to Fig. 2, when it is determined that the blurring or shaking image of step S5 described above is a blurring or shaking image, the determination result of step S6 becomes "YES", and the flow advances to step S9. On the other hand, when it is determined in step S5 that the image is not blurred or shaken, the determination result in step S6 becomes "NO", and the flow advances to step S7.

In step S7, the MPU 28 displays the entirety of the image stored in the SDRAM 30 through the video interface 38 on the TFT 40, and in step S8, the MPU 28 stores in the SDRAM 30. The processed image is recorded on the memory card 34 via the card interface 32 to end the process.

In the blurring-shake detection step S29 described with reference to FIG. 3, the coordinates and the average value are stored in the SDRAM 30 as a set. In step S9 of FIG. 2, the coordinates having the maximum average value are selected from these. The block containing this coordinate becomes the clearest part of the image.

The coordinates selected here can also select coordinates closest to the coordinates of the center of the image among the set of coordinates stored in the SDRAM 30 and the average value. The block containing this coordinate becomes the part closest to the center of the image among the plurality of clear portions extracted from the image.

Next, the surrounding area is enlarged and displayed on the TFT 40 including the selected coordinates (step S10). For example, when the number of pixels of the image stored in the SDRAM 30 is 1280x960 pixels, interpolation or the like is performed to the entire area of the TFT 40 by performing interpolation or the like on an area composed of 320x240 pixels having the selected coordinates as the center coordinates. Display.

Next, the MPU 28 displays to select whether or not to record the image displayed on the TFT 40 on the memory card 34, and when the user chooses to record, the determination result of step S11 is " YES ”, the process proceeds to step S8, where the image stored in the SDRAM 30 is recorded in the memory card 34, and the processing ends. In addition, when recording an image to the memory card 34 here, since it distinguished from the image which was not judged to be a blur or shake image in step S6, the folder which records the image judged as a blur or shake image is provided, and the folder You can also write to

On the other hand, when the user chooses not to record, the determination result becomes "NO", and the flow proceeds to step S12, where the image stored in the SDRAM 30 is deleted to end the process.

Next, a second embodiment in the present invention will be described with reference to FIG. This is, for example, after the image is recorded in the memory card 34 without performing the blur or shake detection every time the image is taken, and then the blur and shake detection is collectively performed for all the images recorded in the memory card 34. Fig. 6 is a flowchart showing this collective blurring-shaking image detection operation.

When the user performs an operation for instructing collective detection of a blurred or shaken image by the operation key 50, the MPU 28 detects this operation and acquires card information of the memory card 34, thereby performing a memory card 34 ), How many images are recorded (step S41). If the image is recorded, the determination result of step S42 becomes "YES", and it progresses to step S43. If an image is not recorded, the determination result of step S42 becomes "NO", and a process is complete | finished.

Next, in step S43, one image is read out from the memory card 34. Then, as shown in FIG. The blurring and shaking detection described in Fig. 3 is performed on this image (step S44). If it is determined as a result of the blurring-shaking image as a result of step S44, the determination result of step S45 becomes "YES", and it progresses to step S46. On the other hand, when it is determined that the image is not blurred or shaken, the determination result is "NO", and the flow proceeds to step S47.

In step S46, the blurring-shaking image is moved or deleted, and the user is notified that the blurring or shaking of the image is detected. Here, the user may set in advance whether to move or delete the image, or display the TFT 40 to designate whether to move or delete the image in step S46 so as to comply with the user's specification. In addition, the moving place in the case of moving an image may be set by the user in advance, or may be displayed on the TFT 40 to designate the moving place in step S46 to move to the folder designated by the operation key 50 by the user. have. As a result, images determined to be blurred or shaken images can be collectively moved to a specific folder, thereby reducing the effort for the user to confirm.

Further, the notification that the blur or shake of the image is detected may indicate that the MPU 28 detects the blur or shake in the TFT 40 via the video interface 38, and the MPU 28 may display the audio interface ( 44 may output a warning sound indicating that blur or shake is detected from the speaker 46.

Next, in step S47, it is determined whether the memory card has a next image to be a blurring or shaking detection target. If there is an image without blurring or shaking detection, the determination result of step S47 becomes "YES" and the process returns to step S43. On the other hand, when blurring and shaking detection are performed for all the images of the memory card 34, the determination result becomes "NO" and the processing ends.

According to the present invention, the capacity of the recording medium can be saved by detecting the blurring or shaking of the image at the time of shooting and selecting whether to record on the recording medium such as a memory card. In addition, since blurring or shaking of the image is detected at the time of shooting, re-shooting is possible at the place, and the shooting of important scenes does not fail.

In addition, the user can easily identify the blurring or shaking by automatically detecting and enlarging and displaying a portion of the photographed image that is easy to detect blurring or shaking.

Also, by detecting blurring or shaking of the image at the time of shooting, and storing the detected image and the undetected image in different folders on the recording medium, it becomes easy to check the captured image later.

In addition, by blurring or blurring the plurality of picked-up images after the shooting, the user can reduce the trouble of checking.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. will be. Therefore, the true technical protection scope of the present invention will be defined by the matter described in the appended claims.

Claims (8)

An imaging device for displaying on a display means an image photographed by an imaging device that photoelectrically converts optical imaging, Temporary storage means for temporarily storing the photographed image; Blurring and shaking detection means for detecting the blurring or shaking of the image stored in the temporary storage means; In the case where the blurring or shaking of the image stored in the temporary storage means is not detected by the blurring / shake detection means, the whole of the image is displayed on the display means, while the blurring or shaking of the image is detected. And control means for enlarging and displaying the blurring or shaking portion of the image on the display means. The method of claim 1, Further comprising information informing means for notifying a user when the blurring or shaking of the image stored in the temporary storage means is detected by the blurring / shake detection means; If the blurring or shaking of the image stored in the temporary storage means is not detected by the blurring / shake detection means, the control means records the image in a predetermined folder on a recording medium, And when the blurring or shaking is detected, the image is recorded or deleted in a folder different from the folder on the recording medium according to a user's operation. 3. The method of claim 2, The blurring shake detection means further comprises sharpening portion detecting means for detecting a clear portion of the photographed image, And when a blur or shake of the image is detected, the partial region of the image enlarged and displayed on the display means is an area including a portion detected by the sharpness detecting means. The method of claim 3, And the clearing part detecting means detects the sharpest part of the photographed image. The method of claim 3, And the sharpness detecting unit extracts a plurality of sharp portions from the photographed image, and detects a portion closest to the center of the image from the extracted plurality of portions. An imaging device for photographing an image by an imaging device that photoelectrically converts optical imaging, A recording medium for recording the photographed image; Blurring and shaking detection means for detecting the blurring or shaking of the image recorded on the recording medium; Information notifying means for notifying a user when the blurring or shaking of the image recorded on the recording medium is detected by the blurring shaking means; When the images recorded on the recording medium are read in sequence, and the blurring or shaking of the image is detected by the blurring / shake detection means, the image is moved to a preset folder or a folder designated by the user, or the image is moved. And control means for notifying that the blurring or shaking of the image has been detected by the information notification means to the user, The blurring / shaking detecting means is divided by 8x8 pixel reference blocks to detect blurring or shaking of the image for each of the reference blocks. The method according to any one of claims 2 to 6, And the information notification means is a display device or an audio output device. The method according to any one of claims 2 to 5, The blurring / shaking detecting means is divided by 8x8 pixel reference blocks to detect blurring or shaking of the image for each of the reference blocks.

Images