JP2011211329A - Imaging apparatus and control method thereof, image processing apparatus and control method thereof, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image wherein a purple fringe is eliminated, while reflecting photographer's intention.SOLUTION: One subject is imaged twice; an image A, captured under the photographic condition of following photographer's setting, is obtained; and an image B captured under a photographic condition suitable for eliminating a purple fringe that differs from the photographer's setting. Positions of the image A and B are made to coincide, and a purple fringe region (PF region) in the image A is replaced by the replacement region in the image B, which corresponds to the purple fringe region. A purple fringe in an image intended by the photographer and that includes the purple fringe region is eliminated or reduced, and an image with the purple fringe eliminated or reduced is obtained.

Description

  The present invention relates to an imaging apparatus and a control method thereof. The present invention also relates to an image processing apparatus, a control method thereof, and an image processing program.

  Processing for reducing color blur (false color, purple fringe) included in a processing target image has been proposed (Patent Documents 1, 2, and 3).

  However, in Patent Documents 1 to 3, even if an image from which color blur is removed is obtained, the image may be different from the photographer's intention.

JP 2009-284209 A JP 2007-258923 A JP 2009-268033 A

  An object of the present invention is to make it possible to obtain an image from which color blur has been removed while reflecting the intention of a photographer.

  An image pickup apparatus according to the present invention displays an image of the same subject a plurality of times under different shooting conditions and outputs a plurality of image data obtained by the image pickup, and a plurality of image data output from the image pickup means. Positioning means for aligning the positions of a plurality of images, color blur area detecting means for detecting whether a color blur area is included in an image represented by image data output from the imaging means, and the color blur area In the image represented by the image data in which the color blur area is detected by the area corresponding to the color blur area in the image represented by the image data other than the image data in which the color blur area is detected by the detecting means Color blur removing means for replacing the color blur area is provided.

  The present invention also provides a method invention suitable for controlling the above-described imaging apparatus. In this method, the imaging unit images the same subject a plurality of times under different shooting conditions, outputs a plurality of image data obtained by the imaging, and the alignment unit outputs a plurality of images output from the imaging unit. The positions of a plurality of images represented by the image data are aligned, and the color blur area detection unit detects whether the color blur area is included in the image represented by the image data output from the imaging unit. The color blur area is detected by the area corresponding to the color blur area in the image represented by the image data other than the image data in which the color blur area is detected by the color blur area detecting means. The color blur area in the image represented by the image data is replaced.

  According to the present invention, since a plurality of times of imaging are performed under different shooting conditions, if any of the plurality of images is in accordance with the intention of the user of the shooting apparatus, the remaining images are stored in the shooting apparatus. It will not be in line with the user's intention. It is detected whether a color blur area is included in the image represented by the image data output from the imaging means. If an image that does not include a color blur area among a plurality of images is in accordance with the intention of the photographer (user), there is no need to perform special color blur processing. When an image including a color blur area among a plurality of images is in accordance with the user's intention, the color blur area in the image is different from other images obtained under different shooting conditions. It is replaced by an area corresponding to the color blur area. Assuming that color blur is included in one image, there may be no or little color blur in other images obtained by changing the shooting conditions. Therefore, when the image is replaced by a region corresponding to the color blur region in another image obtained under different shooting conditions, the color blur is eliminated or reduced in the image including the color blur region. Even if an image including a color blur area among a plurality of images is an image that meets the photographer's intention, an image having no color blur or reduced can be obtained.

  In one embodiment, the imaging apparatus includes a motion detection unit that receives a plurality of image data output from the imaging unit and detects a moving portion, and the color blur removal unit is detected by the color blur region detection unit. When the color blur area that has been detected overlaps with the motion part detected by the motion detection means, the color blur area excluding the overlap part is replaced. It is possible to prevent erroneous correction when there is a subject (moving body) that accompanies movement.

  In another embodiment, the imaging device includes optical zoom means for optically zooming, and blur amount data representing the amount of blur corresponding to each zoom position from the wide-angle end to the telephoto end in the optical zoom means. Whether or not there is a zoom position with a smaller blur amount than the zoom position set in the optical zoom means according to the blur amount data stored in the blur amount data storage means. An optical zoom that controls the optical zoom means to be a zoom position when there is a zoom position with less blurring than a zoom position set in the optical zoom means by the determination means; Control means, and after the zoom position is changed by the optical zoom control means, Before zooming represented by the pre-zoom image data output from the imaging unit before the zoom position is changed by the optical zoom control unit by enlarging or reducing the zoomed image represented by the post-zoom image data. An angle of view matching means for matching the angle of view of the image and the image after zooming is further provided.

  Color blur may occur or decrease depending on the zoom position (zoom amount). In this embodiment, blur amount data representing the relationship between the zoom position and the blur amount is used, and imaging is performed after the zoom position is changed so that an image without blur can be obtained. Even if the zoom position set by the photographer is a zoom position where color blur is likely to occur, imaging is performed at the same zoom position where there is less color blur. Even if a color blur area exists in an image obtained by imaging under a zoom position, the image is replaced by an area corresponding to the color blur area in the image captured after the zoom position is changed. Thus, the image obtained by imaging under the zoom position set by the photographer can be made free of or reduced in color blur area.

  In one embodiment, the imaging conditions differ depending on the focal length. This is because color blur is suppressed by making the focal lengths different (shifting the focus).

  In other embodiments, the photographing conditions differ depending on the aperture value. This is because color bleeding is also suppressed by reducing the aperture (increasing the F value).

  Preferably, one of the different shooting conditions is a shooting condition according to a setting by a photographer (user of the imaging apparatus), and the remaining shooting conditions are shooting conditions different from the setting by the photographer. If there is a color blur area in the image obtained under the shooting conditions according to the settings by the photographer, the color blur area is the above in the image obtained under the shooting conditions different from the settings by the photographer. By substituting with the area corresponding to the color blur area, the color blur area can be eliminated or reduced in the image obtained under the shooting conditions set by the photographer.

  According to a second aspect of the present invention, there is provided an imaging apparatus according to a first imaging condition according to a setting by a photographer and a second imaging different from the first imaging condition in which the first imaging condition is changed so that color blur is reduced. Under the conditions, the same subject is imaged twice, the imaging means for outputting the first and second image data obtained by the imaging, and the first image represented by the first image data output from the imaging means Positioning means for aligning the position of the second image represented by the second image data, color blur area detection means for detecting whether the first image includes a color blur area, and the color blur area detection means When a color blur area is detected by the above, color blur removal means is provided for replacing the color blur area in the first image with an area corresponding to the color blur area in the second image. When there is a color blur area in the first image obtained under the first shooting condition according to the setting by the photographer, the color blur area is set to a second shooting condition different from the setting by the user of the imaging apparatus. By substituting with a region corresponding to the color blur region in the second image obtained under the above, the color blur region in the first image can be eliminated or reduced.

  An image pickup apparatus according to a third aspect of the present invention is characterized in that a first shooting condition according to a setting by a photographer and a second shooting condition different from the first shooting condition in which the first shooting condition is changed so that color blur is reduced. Under the third imaging condition, the same subject is imaged three times, imaging means for outputting the first, second and third image data obtained by the imaging, and the first image data output from the imaging means Alignment means for aligning positions of the first image represented by the second image data, the second image represented by the second image data, and the third image represented by the third image data, and a color blur area in the first image The color blur area is detected by the color blur area detecting means for detecting whether or not it is included, the motion detecting means for detecting the moving part using the first, second and third image data, and the color blur area detecting means. If When the color blur area detected by the color blur area detection unit and the motion part detected by the motion detection unit overlap, the color blur in the second or third image is excluded except for the overlap part. Color blur removing means for replacing the color blur area in the first image with an area corresponding to the area is provided. If there is a moving object, it is possible to prevent erroneous correction by preventing color blur from being removed.

  An image pickup apparatus according to a fourth aspect of the invention stores optical zoom means for optically zooming, and blur amount data representing the amount of blur corresponding to each zoom position from the wide-angle end to the telephoto end in the optical zoom means. A blur amount data storage means for determining whether or not there is a zoom position with a blur amount smaller than a zoom position according to a setting by the photographer according to the blur amount data stored in the blur amount data storage means; , An optical zoom control means for controlling the optical zoom means so that the zoom position becomes the zoom position when there is a zoom position where the blur amount is smaller than the zoom position set in the optical zoom means by the judging means. The zoom position according to the setting by the user and the zoom position after the change by the optical zoom control means An imaging means for imaging the same subject twice and outputting first and second image data obtained by imaging, a first image represented by the first image data output from the imaging means, and a second image Position adjusting means for adjusting the position of the image of the second image represented by the data, field angle adjusting means for adjusting the angle of view of the first image and the second image by enlarging or reducing the second image, Corresponding to the color blur area in the second image when the color blur area detection means for detecting whether a color blur area is included in one image and the color blur area detection means detects the color blur area Color blur removing means for replacing the color blur area in the first image by the area to be performed is provided. Even if a color blur region exists in the first image obtained by imaging under the zoom position set by the user, the color blur region in the second image captured after the zoom position is changed By substituting with a region corresponding to, the first image can have no or reduced color blur region.

  An image processing apparatus according to the present invention is received by an image data input unit that receives an input of a plurality of image data obtained by imaging the same subject a plurality of times under different shooting conditions, and the image data input unit. Positioning means for aligning positions of a plurality of images represented by a plurality of image data, color blur area detecting means for detecting whether a color blur area is included in the image represented by the image data, and the color blur In the image represented by the image data in which the color blur area is detected by the area corresponding to the color blur area in the image represented by the image data other than the image data in which the color blur area is detected by the area detection means The color blur removing means for replacing the color blur area is provided.

  In the image processing method according to the present invention, the image data input means accepts input of a plurality of image data obtained by imaging the same subject a plurality of times under different shooting conditions, and the positioning means is the above described A plurality of images represented by the plurality of image data received by the image data input means are aligned, and the color blur area detection means detects whether the image represented by the image data includes a color blur area. Then, the color blur removal unit is configured to detect the color blur region by an area corresponding to the color blur region in the image represented by the image data other than the image data in which the color blur region is detected by the color blur region detection unit. The color blur area in the image represented by the detected image data is replaced.

  The present invention also provides a program for causing a computer to function as the image processing apparatus.

  According to the present invention, when an image including a color blur area among a plurality of images represented by a plurality of received image data is in accordance with the user's intention, the color blur areas in the image are different from each other. It is replaced by a region corresponding to the color blur region in another image obtained under the condition. Color blur is eliminated or reduced in an image including a color blur area that meets the user's intention, and an image with no or reduced color blur can be obtained.

It is a block diagram which shows the electric constitution of the digital still camera of 1st Example. It is a flowchart which shows the procedure of the color blur removal process of 1st Example. (A) shows an image in which color blur (perfull fringe) occurs, and (B) shows an image without color blur. It is a block diagram which shows the electric constitution of the digital still camera of 2nd Example. It is a flowchart which shows the procedure of the color blur removal process of 2nd Example. It is a block diagram which shows the electric constitution of the digital still camera of 3rd Example. It is a flowchart which shows the procedure of the color blur removal process of 3rd Example. 6 is a graph showing color blur amount data for each zoom position. It is a block diagram which shows the electric constitution of the digital still camera of 4th Example. It is a flowchart which shows the procedure of the color blur removal process of 4th Example.

First Embodiment FIG. 1 is a block diagram showing an electrical configuration of a digital still camera 1 according to a first embodiment.

  The digital still camera 1 includes an imaging unit 10, an arithmetic / processing unit 20, and a display unit 30. The imaging unit 10, the arithmetic / processing unit 20, and the display unit 30 are connected to each other via a data bus. Further, a VRAM 41, a memory interface (memory I / F) 42, an external memory interface (external memory I / F) 45, and an imaging condition automatic change control device 47 are connected to the data bus.

  The imaging unit 10 includes a CCD 11, and an optical unit 12 including a zoom lens, an imaging lens, a diaphragm, an infrared cut filter, an optical low pass filter (OLPF), and the like is provided in front of the CCD 11.

  When the power of the digital still camera 1 is turned on and the photographing mode is set, a light beam representing a subject image enters the optical unit 12. The light beam is incident on the light receiving surface of the CCD 11 via the optical unit 12. In the CCD 11, a number of photodiodes (photoelectric conversion elements) are two-dimensionally arranged on the light receiving surface, and the red light is arranged on the light receiving surface with a predetermined arrangement structure (Bayer arrangement, G stripe arrangement, etc.). Color filters of (R), green (G), and blue (B) are provided. A subject image formed by the optical unit 12 is electronically captured by the CCD 11.

  An analog signal representing the subject image output from the CCD 11 is input to the analog signal processing device 13.

  The analog signal processing device 13 includes a correlated double sampling circuit, a signal amplifier, and the like. Correlated double sampling, signal amplification, and the like are performed on the analog signal representing the subject image output from the CCD 11. An analog video signal (analog RGB signal) output from the analog signal processing device 13 is input to an analog / digital conversion circuit (ADC) 14 and converted into digital image data (digital RGB data) after predetermined signal processing. . Further, the RGB data is converted into image data (YUV data) including luminance data (Y data) and color difference data (Cr, Cb data) as necessary.

  The digital image data output from the ADC 14 is subjected to white balance adjustment, gamma correction, and synchronization processing in the digital signal processing unit 15 (complementing the color signal spatial displacement associated with the color filter array of the single-plate CCD to obtain a color signal) Predetermined digital signal processing, such as a process for simultaneously converting Digital image data is temporarily stored in the VRAM 41 via a data bus. The subject image represented by the digital image data read from the VRAM 41 is subjected to predetermined processing in the image reproduction processing device 31, and then encoded by the encoder 32 and given to the display device 33, and displayed on the display screen. The

  A RAM 43 and a ROM 44 are connected to the memory I / F 7. The RAM 43 temporarily stores data and the like used in the color blur removal process described later. The ROM 44 stores a control program executed by the CPU 21 included in the arithmetic / processing unit 20, various data necessary for control, photographer setting information, and various setting information related to the operation of the digital still camera.

  When a zoom button (not shown) is operated, the zoom lens included in the optical unit 12 is driven by the motor drive circuit 16, and the zoom magnification is switched steplessly between the wide angle side and the telephoto side.

  When a shutter release button (not shown) is pressed in the first stage, the motor driving circuit 16 drives the imaging lens of the optical unit 12 to perform focusing. Luminance data is obtained in the digital signal processor 15 based on the image data read from the VRAM 41. Data representing the integrated value of the luminance data is given to the CPU 21 to calculate the exposure amount. The aperture opening of the optical unit 12 is controlled by the motor drive circuit 16 so that the calculated exposure amount is obtained, and the shutter speed of the CCD 11 is controlled by the image sensor drive circuit (not shown).

  When the shutter release button is pressed in the second stage, the digital image data is stored in the RAM 43. Predetermined digital signal processing is performed on the image data read from the RAM 43 in the digital signal processing device 15, and data compression is performed through compression / decompression processing. The compressed image data is recorded on the memory card 46 under the control of the external memory I / F 45.

  When the reproduction mode is set, the compressed image data recorded on the memory card 46 is read. The read compressed image data is decompressed and stored in the VRAM 41, and then the reproduced image is displayed on the display device 33.

  The photographing condition automatic change control device 47 reduces color blurring by photographing conditions set by the photographer (including photographing conditions automatically set by the digital still camera 1 (automatic focusing, automatic exposure, etc.)). This is an apparatus for automatically changing to different shooting conditions. Details of the photographing condition automatic change control device 47 will be described later.

  The arithmetic / processing unit 20 includes an image acquisition circuit 22, a multiple image alignment processing circuit 23, a color blur detection processing circuit 24, and a color blur complement processing circuit 25 in addition to the CPU 21 described above. These circuits are connected to the CPU 21.

  Various circuits included in the arithmetic / processing unit 20 are used to perform the color blur removal process described below.

  FIG. 2 is a flowchart showing a procedure of color blur removal processing of the first embodiment performed by the digital still camera 1.

  As described above, the digital image data is stored in the RAM 43 when the shutter release button is pressed in the second stage. The image data stored in the RAM 43 is the target of color blur removal processing. The color blur removal process is executed when the shutter release button is pressed in the second stage while the color blur removal mode is selected by an operation unit (not shown) provided in the digital still camera 1. Alternatively, it may be executed when the CPU 21 determines that a subject including both a high-luminance subject and a low-luminance subject has been photographed when the subject meets a predetermined condition. .

  In the color blur removal process according to the first embodiment, when the shutter release button is pressed in the second stage, imaging (acquisition of image data) is performed twice.

  The first imaging is an imaging under imaging conditions (focusing, exposure adjustment, etc.) as intended by the photographer. An image obtained under shooting conditions intended by the photographer is hereinafter referred to as “image A”.

  The second imaging is an imaging under imaging conditions focusing on color blur reduction different from the photographer's intention. Color blur (purple fringe) occurs in a sudden luminance change portion in a subject image. Further, color blur is caused by light passing through the peripheral part rather than light passing through the central part of the imaging lens. Therefore, under shooting conditions that focus on color blur reduction, a sudden change in brightness occurs by driving the imaging lens of the optical unit 12 to a position different from the focusing position (shifting the focus position) to generate image blur. The subject is imaged with a gradual change in brightness. Sudden changes in brightness are alleviated, so that color bleeding is less likely to occur. At the same time, the diaphragm included in the optical unit 12 is narrowed (F value is increased). Light that passes through the center of the imaging lens is likely to be used, and this also reduces color blur. Further, when the aperture of the optical unit 12 is reduced, the depth of the subject is increased, so that the effect of reducing the above-mentioned image blur can be obtained. An imaging condition automatic change control device 47 determines an imaging condition focusing on color blur reduction different from the intention of the photographer. Based on an imaging condition change instruction from the imaging condition automatic change control device 47, the motor drive circuit 16 changes the lens position of the imaging lens in the optical unit 12 and the aperture value of the aperture.

  An image obtained under imaging conditions focusing on color blur reduction different from the photographer's intention is hereinafter referred to as “image B”.

  In the color blur removal process of the first embodiment, when the shutter release button is pressed in the second stage, the image A obtained under the photographing conditions as intended by the photographer and the photographer's intention Two images B, which are obtained under imaging conditions focusing on color blur reduction different from the above, are acquired (steps 61 and 62). Both the image data representing the image A and the image data representing the image B are temporarily stored in the RAM 43.

  The image data representing the image A and the image data representing the image B, which are temporarily stored in the RAM 43, are read out by the image acquisition circuit 22 and given to the multiple image alignment circuit 23 via the CPU 21.

  The multiple image alignment circuit 23 aligns the images A and B (step 63). For example, a corresponding point (range) in image B corresponding to a feature point (range) in image A is detected, and a parameter (rotation parameter, movement) for matching the feature point in image A and the corresponding point in image B is detected. Parameters, enlargement / reduction parameters) are calculated. Image A and image B are aligned using this parameter.

  Further, the image data representing the image A is given to the color blur detection processing circuit 24, where the color blur in the image A is detected. The color blur (purple fringe) may be determined for each pixel based on whether the color of the pixel (for example, a color determined based on Cr data and Cb data) is purple or a color close to purple. As described above, since color blur appears in a sudden luminance change portion in the image, a luminance edge in the image A may be detected, and a purple pixel may be found only for pixels around the luminance edge portion. .

  When the color blur is detected, data for specifying the color blur area (position data of the pixel in the image A determined to have color blur) is supplied to the color blur complement processing circuit 25.

  The color blur complement processing circuit 25 performs processing for replacing the image portion of the color blur region in the image A with the image portion of the corresponding region in the image B according to the color blur region data given from the color blur detection processing circuit 24. Perform (step 65). As described above, since the images A and B are registered in advance by the multiple image alignment processing circuit 23, the image portion of the color blur area in the image A is the image portion of the corresponding area in the image B without color blur. Is replaced almost exactly.

  FIG. 3A shows an example of the image A, and shows a state in which color blur (perful fringe) occurs. FIG. 3B shows an image B, which is an image without color blur. The image portion of the color blur generation region (PF generation region) in the image A is replaced with the image portion of the region (replacement region) corresponding to the PF generation region in the image B. Thereby, an image A from which color blur is removed is generated. An image represented by the data representing the image A from which color blur has been removed is displayed on the display device 33, and is stored in the memory card 46 after being subjected to compression processing. It is possible to obtain an image obtained under photographing conditions as intended by the photographer and having no color blur.

Second Embodiment FIG. 4 is a block diagram showing an electrical configuration of a digital still camera 1A according to a second embodiment. This embodiment differs from the digital still camera 1 (FIG. 1) of the first embodiment in that a moving object detection processing circuit 26 is added to the arithmetic / processing unit 20A. The same components and circuits in the digital still camera 1 described in the first embodiment are denoted by the same reference numerals to avoid redundant description. FIG. 5 is a flowchart showing the procedure of color blur removal processing according to the second embodiment. The same processes as those in the flowchart (FIG. 2) of the first embodiment are denoted by the same reference numerals to avoid redundant description.

  In the color blur removal process of the second embodiment, when the shutter release button is pressed in the second stage, the image pickup (acquisition of image data) is performed three times.

  The first imaging and the third imaging are imaging under imaging conditions focusing on color blur reduction different from the above-described intention of the photographer. The first imaging and the third imaging may be imaging under the same imaging conditions, or the imaging conditions may be different from each other. For example, the focus may be shifted forward from the in-focus position in the first imaging, and may be shifted backward from the in-focus position in the third imaging. In any case, the first and third imaging are performed under imaging conditions focusing on color blur reduction (steps 62 and 71). An image obtained by the first imaging is called an image B, and an image obtained by the third imaging is called an image C.

  The second imaging is based on the imaging conditions (focusing, exposure adjustment, etc.) as intended by the photographer (step 61). Image A is obtained.

  The three image data representing the image A, the image B, and the image C are given to the multiple image alignment circuit 23, where the alignment between the three images ABC is performed (step 72).

  Image data representing the three images ABC is then provided to the moving object detection processing circuit 26.

  The moving object detection processing circuit 26 calculates a difference between the three images ABC, and detects a moving object in the subject image (step 73).

  When the moving object detected by the moving object detection processing circuit 26 exists on the color blur area (see FIG. 3A) in the image A, the complement (replacement) process (step 74) is performed while avoiding that area. Is called. As the replacement area, the image B or the image C may be used. The color blur area in which a moving object exists has a low credibility (accuracy) as the color blur area, and therefore the color blur removal process is not performed. Thereby, it is possible to prevent erroneous correction (replacement of a region that cannot be said to be a color blur region) when there is a subject (moving body) that involves movement.

Third Embodiment FIG. 6 is a block diagram showing an electrical configuration of a digital still camera 1B according to a third embodiment. 1 is different from the digital still camera 1 of the first embodiment shown in FIG. 1 in that a color blur reduction zoom position calculation processing circuit 48 and a storage device 51 that stores color blur amount data for each zoom position are added. . The same components and circuits in the digital still camera 1 described in the first embodiment are denoted by the same reference numerals to avoid redundant description. FIG. 7 is a flowchart showing the procedure of the color blur removal process of the third embodiment. The same processes as those in the flowchart (FIG. 2) of the first embodiment are denoted by the same reference numerals to avoid redundant description.

  Some zoom lenses change the degree of color blurring depending on the zoom position. Since there is no fixed law that the color blur according to the zoom position can be reduced by performing a specific operation like an aperture, in the third embodiment, the color blur at each zoom position is stored in the storage device 51 (or ROM 44). The amount data is stored in advance, and the color blur amount data for each zoom position stored in the storage device 51 is used for the color blur removal process.

  FIG. 8 shows an example of color blur amount data (hereinafter referred to as color blur amount data) for each zoom position stored in the storage device 51. The color blur amount data shown in FIG. 8 is used in the color blur removal process in the third embodiment.

  Referring to FIG. 7, when the shutter release button is pressed in the second stage, it is determined whether or not there is a zoom position on the wide-angle side with less color blur than the zoom position intended for shooting (step 81). ).

  Referring to FIG. 8, it is assumed that the zoom position by the zoom operation by the photographer is the zoom position indicated by symbol A. Since a zoom position with less color blur than the zoom position indicated by the symbol A exists on the wide-angle side, in this case, the zoom position A based on the zoom operation by the photographer and the above memory are stored by the color blur reduction zoom position calculation processing circuit 48. Based on the color blur amount data stored in the device 51, it is determined that a zoom position with less color blur than the zoom position A intended for photographing exists on the wide angle side. The process proceeds to the next process (YES in step 81). The same applies when the zoom position by the photographer's zoom operation is the zoom position indicated by symbol B in FIG.

  On the other hand, when the zoom position by the photographer's zoom operation is the zoom position indicated by reference numeral C, there is no zoom position on the wide-angle side that has less color blurring than the zoom position indicated by reference numeral C. In this case, the color blur process is not performed and the process ends (NO in step 81).

  If a zoom position with less color blur than the zoom position intended for shooting exists on the wide-angle side (YES in step 81), image A is taken under the shooting conditions intended by the photographer (step 61), and then shot. The image B is captured under shooting conditions different from the person's intention (step 62). The image B in the third embodiment is a zoom position on the wide-angle side from the zoom position intended by the photographer, and has a zoom position where a blur amount lower than the blur amount corresponding to the zoom position intended by the photographer is obtained. Adopted. The wide-angle color blur reduction zoom position to be adopted is determined by the color blur reduction zoom position calculation processing circuit 48 using the above-mentioned color blur amount data (FIG. 8). The zoom position of the zoom lens in the unit 12 is controlled.

  The image data representing the image A and the image data representing the image B are given to the multiple image alignment circuit 23, where alignment processing and angle-of-view alignment processing are performed (step 82). Since the angle of view of the image A and the angle of view of the image B are different due to the difference in the zoom position, in the angle-of-view adjustment processing, the image B obtained under shooting conditions different from the photographer's intention is enlarged. Processing (affine transformation or the like) is performed.

  The color blur area is detected from the image A, and the image A and the image B subjected to the alignment and the angle of view adjustment are used, and the color blur area of the image A is complemented (replaced) by the replacement area of the image B. This is the same as in the first embodiment.

  In the third embodiment described above, the image B is imaged using the zoom position on the wide angle side with respect to the zoom position intended by the photographer. When the telephoto side is used, the image A is captured as intended by the photographer. This is to prevent the angle of view of the image B used for the color blur removal process from being narrower than the angle of view, and a range wider than the color blur area in the image A from being replaced by the replacement area. Of course, the image B may be an image captured using a zoom position on the telephoto side relative to the zoom position intended by the photographer.

  In addition to the photographing condition change using the zoom position, the focus position shift (focus position shift) and the aperture adjustment described in the first embodiment may be used together.

Fourth Embodiment FIG. 9 is a block diagram showing an electrical configuration of a digital still camera 1C according to a fourth embodiment. FIG. 10 is a flowchart showing the procedure of color blur removal processing performed by the digital still camera 1C of the fourth embodiment. The arithmetic / processing unit 20B of the digital still camera 1C of the fourth embodiment includes the processing circuits described in the first to third embodiments, that is, the image acquisition circuit 22 and the multiple image alignment processing circuit 23. , A color blur detection processing circuit 24, a color blur complement processing circuit 25, and a moving object detection processing circuit 26, and further includes a through image moving object detection processing circuit 27.

  In the fourth embodiment, it is determined which color blur removal process of the first to third embodiments described above is used to remove the color blur, and the determined first to third embodiments are determined. The color blur removal process is executed by one of the color blur removal processes.

  Referring to FIG. 10, first, a through image (an image obtained by imaging before pressing the shutter release button in two stages) is used, and a moving object detection process is performed by the through image detection circuit 27 (step 91).

  When the shutter release button is pressed while a moving object is detected, the color blur removal process described in the second embodiment is executed (step 92). That is, imaging is performed three times, and a complement (replacement) process is performed except for a color blur area where a moving object exists (FIG. 5).

  When the shutter release button is pressed in a state where no moving object is detected, the color blur removal process is performed by the process of either the first embodiment or the third embodiment.

  As described in the third embodiment, it is determined whether or not a zoom position with less color blur than the zoom position intended for shooting exists on the wide-angle side (step 81). If a zoom position with less color blur than the zoom position intended for shooting exists on the wide-angle side (YES in step 81), the processing of the third embodiment, that is, the zoom position on the wide-angle side than the zoom position intended by the photographer Thus, an image B is picked up at a zoom position where a blur amount smaller than the blur amount corresponding to the zoom position according to the photographer's intention is obtained, and color blur removal processing is performed using this image B (FIG. 7).

  On the other hand, if there is no zoom position on the wide-angle side with less color blur than the zoom position intended for shooting (NO in step 81) (including the case where the zoom position is the widest-angle position), the processing of the first embodiment, The image B is picked up while the focus position is shifted and the aperture is reduced, and color blur removal processing is performed using the image B (FIG. 2).

  Among the three color blur removal processes described in the first to third embodiments, an appropriate color blur removal process is selected.

  In the first to fourth embodiments described above, the color blur reduction processing includes multiple image alignment processing circuit 23, color blur detection processing circuit 24, and color blur complement processing circuit of arithmetic / processing units 20, 20A, 20C. Although hardware circuits such as 25 are used, some or all of the processing of these hardware circuits may be executed by a program. In this case, a program for executing the functions of these hardware circuits is stored in the ROM 44, and is executed by the CPU 21, whereby color blur reduction processing is performed.

1,1A, 1B, 1C Digital still camera
11 CCD
12 Optical unit
15 Digital signal processor
20 Arithmetic / Processing Unit
21 CPU
22 Image acquisition circuit
23 Multiple image alignment processing circuit
24 color blur detection processing circuit
25 color blur compensation circuit
26 Motion detection processing circuit
47 Shooting condition automatic change control device
48 color blur zoom position calculation processing circuit
51 Storage device

Claims (16)

Imaging means for imaging the same subject multiple times under different shooting conditions and outputting a plurality of image data obtained by the imaging;
Positioning means for aligning positions of a plurality of images represented by a plurality of image data output from the imaging means;
Color blur area detection means for detecting whether or not a color blur area is included in an image represented by the image data output from the imaging means, and image data other than the image data in which the color blur area is detected by the color blur area detection means Color blur removing means for replacing the color blur area in the image represented by the image data in which the color blur area is detected with an area corresponding to the color blur area in the image represented by the image data;
Imaging device. A plurality of image data output from the imaging means, and a motion detection means for detecting a motion part;
The color blur removal means replaces the color blur area excluding the overlapping portion when the color blur area detected by the color blur area detection means overlaps with the motion part detected by the motion detection means. Do,
The imaging device according to claim 1. Optical zoom means for optically zooming,
Blur amount data storage means for storing blur amount data representing the amount of blur corresponding to each zoom position from the wide-angle end to the telephoto end in the optical zoom means;
Determining means for determining whether or not there is a zoom position where the amount of blur is smaller than the zoom position set in the optical zoom means, according to the blur amount data stored in the blur amount data storage means;
An optical zoom control means for controlling the optical zoom means so that the zoom position becomes the zoom position when there is a zoom position where the blur amount is smaller than the zoom position set in the optical zoom means by the judging means; Before the zoom position is changed by the optical zoom control means by enlarging or reducing the post-zoom image represented by the post-zoom image data output from the imaging means after the zoom position is changed by the optical zoom control means. An angle-of-view adjustment unit that matches the angle of view of the pre-zoom image represented by the pre-zoom image data output from the imaging unit and the post-zoom image;
The imaging device according to claim 1 or 2.   The imaging apparatus according to claim 1, wherein the photographing condition varies depending on a difference in focal length.   The imaging apparatus according to claim 1, wherein the imaging condition varies depending on a difference in aperture value. One of the different shooting conditions is a shooting condition according to the setting by the photographer, and the remaining shooting conditions are shooting conditions different from the setting by the photographer.
The imaging device according to claim 1. The same subject is captured under a first shooting condition according to the setting by the photographer and a second shooting condition that is different from the first shooting condition, and the first shooting condition is changed so that color blur is reduced. Imaging means for imaging twice and outputting first and second image data obtained by imaging;
Alignment means for aligning the positions of the first image represented by the first image data output from the imaging means and the second image represented by the second image data;
Color blur area detecting means for detecting whether or not the color blur area is included in the first image, and the color blur area in the second image when the color blur area is detected by the color blur area detecting means. Color blur removing means for replacing the color blur area in the first image by an area corresponding to
Imaging device. Same as the first shooting condition according to the setting by the photographer and the second and third shooting conditions different from the first shooting condition, wherein the first shooting condition is changed so as to reduce color blur. Imaging means for imaging the subject three times and outputting first, second and third image data obtained by imaging,
A position where the first image represented by the first image data, the second image represented by the second image data, and the third image represented by the third image data output from the imaging means are aligned. Matching means,
Color blur area detecting means for detecting whether the first image includes a color blur area;
Motion detection means for detecting a motion part using the first, second and third image data,
When the color blur area is detected by the color blur area detection means, the color blur area detected by the color blur area detection means and the motion part detected by the motion detection means overlap. Color blur removing means for replacing the color blur area in the first image with an area corresponding to the color blur area in the second or third image except for the portion;
Imaging device. Optical zoom means for optically zooming,
Blur amount data storage means for storing blur amount data representing the amount of blur corresponding to each zoom position from the wide-angle end to the telephoto end in the optical zoom means;
Determining means for determining whether or not there is a zoom position having a smaller amount of blur than a zoom position according to a setting by the photographer, according to the blur amount data stored in the blur amount data storage means;
An optical zoom control means for controlling the optical zoom means so as to be the zoom position when there is a zoom position with less blurring than the zoom position set in the optical zoom means by the judging means;
Imaging that captures the same subject twice and outputs the first and second image data obtained by imaging under the zoom position according to the setting by the photographer and the zoom position after the change by the optical zoom control means means,
Alignment means for aligning the positions of the first image represented by the first image data output from the imaging means and the second image represented by the second image data;
An angle-of-view adjusting means for enlarging or reducing the second image to match the angle of view of the first image and the second image;
Color blur area detecting means for detecting whether or not the color blur area is included in the first image, and the color blur area in the second image when the color blur area is detected by the color blur area detecting means. Color blur removing means for replacing the color blur area in the first image by an area corresponding to
Imaging device. The imaging means images the same subject multiple times under different shooting conditions, and outputs a plurality of image data obtained by the imaging,
The alignment means aligns the positions of a plurality of images represented by the plurality of image data output from the imaging means,
A color blur area detecting unit detects whether a color blur region is included in an image represented by the image data output from the imaging unit;
The color blur removal means detects the color blur area by an area corresponding to the color blur area in the image represented by image data other than the image data from which the color blur area is detected by the color blur area detection means. Replace the color blur area in the image represented by the image data
Control method of imaging apparatus. Under the first shooting condition according to the setting by the photographer and the second shooting condition different from the first shooting condition in which the first shooting condition is changed so that color blur is reduced. Imaging the same subject twice, outputting first and second image data obtained by imaging,
The alignment means aligns the positions of the first image represented by the first image data output from the imaging means and the second image represented by the second image data,
A color blur area detecting means detects whether the first image includes a color blur area;
When the color blur area is detected by the color blur area detection unit, the color blur removal unit replaces the color blur region in the first image with a region corresponding to the color blur region in the second image. Do,
Control method of imaging apparatus. The imaging means has a first imaging condition according to a setting by a photographer, and a second and third imaging condition different from the first imaging condition, wherein the first imaging condition is changed so that color blur is reduced. Below, the same subject is imaged three times, and the first, second and third image data obtained by the imaging are output,
The alignment means outputs a first image represented by the first image data, a second image represented by the second image data, and a third image represented by the third image data, which are output from the imaging means. Align the position of
A color blur area detecting means detects whether the first image includes a color blur area;
A motion detecting means detects a motion part using the first, second and third image data;
When the color blur area is detected by the color blur area detection means, the color blur area detected by the color blur area detection means overlaps with the motion part detected by the motion detection means. The color blur area in the first image is replaced by an area corresponding to the color blur area in the second or third image, except for the overlapping portion.
Control method of imaging apparatus. A method for controlling an image pickup apparatus including an optical zoom means for optically zooming,
Whether or not there is a zoom position in which the blur amount is smaller than the zoom position according to the setting by the photographer is stored in the blur data storage unit from the wide-angle end to the telephoto end in the optical zoom unit. Therefore, it is determined to store blur amount data representing the amount of blur corresponding to each zoom position, and
The optical zoom control means controls the optical zoom means so as to be the zoom position when there is a zoom position where the blur amount is smaller than the zoom position set in the optical zoom means by the judging means,
First and second image data obtained by imaging the same subject twice, under the zoom position according to the setting by the photographer and the zoom position after the change by the optical zoom control means. Is output,
The alignment means aligns the positions of the first image represented by the first image data output from the imaging means and the second image represented by the second image data,
The angle of view matching means enlarges or reduces the second image to match the angles of view of the first image and the second image,
A color blur area detecting means detects whether the first image includes a color blur area;
When the color blur area is detected by the color blur area detection unit, the color blur removal unit replaces the color blur region in the first image with a region corresponding to the color blur region in the second image. Do,
Control method of imaging apparatus. Image data input means for receiving input of a plurality of image data obtained by imaging the same subject a plurality of times under different shooting conditions,
Positioning means for aligning positions of a plurality of images represented by a plurality of image data received by the image data input means;
Color blur area detecting means for detecting whether or not a color blur area is included in the image represented by the image data; and image data other than the image data in which the color blur area is detected by the color blur area detecting means. Color blur removing means for replacing the color blur area in the image represented by the image data in which the color blur area is detected by an area corresponding to the color blur area in the image.
Image processing device. Image data input means accepts input of a plurality of image data obtained by imaging the same subject a plurality of times under different shooting conditions,
An alignment unit aligns a plurality of images represented by the plurality of image data received by the image data input unit;
A color blur area detecting means detects whether a color blur area is included in the image represented by the image data;
The color blur removal means detects the color blur area by an area corresponding to the color blur area in the image represented by image data other than the image data from which the color blur area is detected by the color blur area detection means. Replace the color blur area in the image represented by the image data
Image processing method. Computer
Image data input means for receiving input of a plurality of image data obtained by imaging the same subject a plurality of times under different shooting conditions,
Positioning means for aligning positions of a plurality of images represented by a plurality of image data received by the image data input means;
Color blur area detecting means for detecting whether or not a color blur area is included in the image represented by the image data; and image data other than the image data in which the color blur area is detected by the color blur area detecting means. Color blur removing means for replacing the color blur area in the image represented by the image data in which the color blur area is detected by an area corresponding to the color blur area in the image.
Program to function as.

Images