JP4840731B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program, and more particularly, to an imaging apparatus, an imaging method, and a program that correct image blur.

  As an image blur prevention technique for correcting an image blur by using both an electronic blur correction and a mechanical shake correction, for example, a technique described in Patent Document 1 (hereinafter referred to as a first conventional technique) is used. Are known. In the first prior art, an angular velocity sensor that detects the angular velocity of the camera body is provided as a shake detection unit, and a shake (image shake or image shake) of a captured image is further generated based on a shake detection signal output from the shake detection unit. Two shake correction means for correcting camera shake are also provided.

  The first shake correction means electronically corrects the image shake by controlling the picked-up image cut-out position of an image pickup device such as a CCD (hereinafter, the first shake correction means is referred to as “electronic shake correction means”). The second shake correction unit is a device that mechanically or optically corrects the image blur by adjusting the optical axis of the photographing lens (hereinafter referred to as the second shake correction unit). This will be referred to as “mechanical shake correction means”. In this first prior art, the operations of these two shake correction means (electronic shake correction means and mechanical shake correction means) in conjunction with electronic zoom (where the zoom effect is obtained by image processing). The distribution is going to change.

  In the first prior art, the electronic shake correcting means and the mechanical shake correcting means share one “shake detecting means”. As described above, this shake detection means is constituted by “an angular velocity sensor (also referred to as a gyro sensor) for detecting the angular velocity of the camera body”, and this angular velocity sensor uses, for example, a crystal resonator or a piezoelectric ceramic element. Since the angular velocity is detected, it can be referred to as a mechanical sensor for convenience. Therefore, the shake detecting means using the angular velocity sensor is hereinafter referred to as “mechanical shake detecting means”.

  As the shake detection means, not only the above-mentioned “mechanical shake detection means” but also “electronic shake detection means” that electronically detects image shake is known. For example, the following Patent Document 2 (hereinafter referred to as “second conventional technique”) describes what detects electronic shake electronically by comparing images between successive frames imaged by an image sensor. Hereinafter, this is referred to as “electronic shake detection means”.

As described above, according to the prior art, two means for “detecting” a shake and two means for “correcting” the shake are known as follows.
(1) Shake detection means / mechanical shake detection means: detecting shake by a gyro sensor or the like.
Electronic shake detection means: detecting shake by image comparison between a plurality of consecutive frames.
(2) Shake correction means / mechanical shake correction means: a means for correcting shake by adjusting the optical axis of the taking lens.
Electronic shake correction means: a means for correcting shake by changing the image cutout position of the image sensor.

JP 2002-182260 A JP 2006-33462 A

  By the way, in the first prior art, only a combination of “mechanical shake detection means” and “mechanical shake correction means” and a combination of “mechanical shake detection means” and “electronic shake correction means” are disclosed. In the second prior art, the combination of “mechanical shake detection means” and “mechanical shake correction means”, and “electronic shake detection means” and “electronic shake correction means” In addition, in any of the conventional techniques, the above combination is adaptively changed according to the optical zoom operation (that is, the angle of view changing operation by the zoom lens). This idea is not disclosed at all.

  Here, when the two shake detection means are compared in terms of power consumption, “mechanical shake detection means” <“electronic shake detection means”. That is, in the case of the “mechanical shake detection means”, only a very small amount of power is consumed by the sensor, whereas in the case of the “electronic shake detection means”, a considerable amount of power is required for image processing or memory access. It is because it consumes. Therefore, it can be said that “mechanical shake detecting means” should be used from the viewpoint of power saving.

  However, in consideration of shake detection accuracy when using the optical zoom, there may be a situation where the use of the “mechanical shake detection means” is not necessarily appropriate. In other words, when the optical zoom magnification is large (telephoto side: when the angle of view of the taking lens is narrow), if shake detection is performed by the “mechanical shake detection means”, the shake detection accuracy decreases. There is an inconvenience. This is because, when the angle of view is narrow, the influence of the shake on the angle of view increases even if the shake is very slight.

  Accordingly, an object of the present invention is to prevent a reduction in shake detection accuracy.

An imaging apparatus according to the present invention includes an imaging unit that converts a subject image formed on an imaging surface through an imaging lens into an image signal, and an image blur correction unit that corrects an image blur of the image signal based on a specified correction amount. A first correction amount calculating means for calculating a correction amount to be applied to the image blur correcting means based on a motion detection of the image pickup apparatus main body including the photographing lens, and detection of movement of the subject image through the photographing lens with respect to the image pickup surface. And a second correction amount calculating unit that calculates a correction amount to be given to the image blur correcting unit, and the first correction amount calculating unit when correcting the image blur by the image blur correcting unit. A determination means for determining whether to use the correction amount calculated by the second correction amount calculation means, and whether to give priority to low power consumption or image blur correction accuracy. And a determination unit that determines that the correction amount by the first correction amount calculation unit is used more when the specification unit specifies that low power consumption is given priority. When it is specified by the specifying unit that priority is given to image blur correction accuracy, it is determined that the correction amount calculated by the second correction amount calculating unit is used more.
An imaging method according to the present invention includes an imaging step of converting a subject image formed on an imaging surface through an imaging lens into an image signal, and an image blur correction step of correcting image blur of the image signal based on a specified correction amount. A first correction amount calculating step for calculating a correction amount to be applied to the image blur correcting step based on a motion detection of the imaging apparatus main body including the photographing lens, and a movement detection of the subject image through the photographing lens with respect to the imaging surface. And a second correction amount calculating step for calculating a correction amount to be given to the image blur correcting step, and an image blur correction by the image blur correcting step. A determination step for determining whether to use the correction amount calculated in the second correction amount calculation step, and whether to give priority to low power consumption or image blur correction accuracy. And the determination step determines that the correction amount by the first correction amount calculation step is used more when it is specified by the specification step that priority is given to low power consumption, When it is designated in the designation step that priority is given to image blur correction accuracy, it is determined that the correction amount calculated in the second correction amount calculation step is used more.
According to the present invention, there is provided a computer-readable recording medium that converts a subject image imaged on an imaging surface through a photographing lens into an image signal and an image blur correction that corrects an image blur of the image signal based on a specified correction amount. A first correction amount calculating unit that calculates a correction amount to be applied to the image blur correcting unit based on motion detection of the imaging apparatus main body including the photographing lens, and an imaging surface of the subject image that passes through the photographing lens. A second correction amount calculating unit that calculates a correction amount to be applied to the image blur correcting unit based on the movement detection; and the first correction amount calculating unit when correcting the image blur by the image blur correcting unit. A determination unit that determines whether to use the calculated correction amount or the correction amount calculated by the second correction amount calculation unit, and which of low power consumption and image blur correction accuracy are superior? And a program for causing the determination means to function as the first correction amount calculation means when the designation means designates low power consumption as a priority. When it is determined that the correction amount according to the above is used more and the designation means prioritizes the image blur correction accuracy, the correction amount calculated by the second correction amount calculation means is used more. It is characterized by determining to.

In the present invention, the two shake correction amounts calculated by the “first correction amount calculating means” corresponding to the mechanical shake detecting means and the “second correction amount calculating means” corresponding to the electronic shake detecting means. When it is determined which image blur correction unit is to use to correct image blur, if it is specified that low power consumption is given priority over image blur correction accuracy, the first correction amount calculation unit When it is determined that the correction amount is used more and it is specified that the image blur correction accuracy is prioritized over the low power consumption, the correction amount calculated by the second correction amount calculation unit is used more. Therefore, it is possible to prevent the shake detection accuracy from decreasing and to save power when the accuracy does not decrease.

  An embodiment of the present invention will be described with reference to the drawings, taking as an example application to an imaging apparatus having an image blur prevention function, for example, a digital camera. It should be noted that the specific details or examples in the following description and the illustrations of numerical values, character strings, and other symbols are only for reference in order to clarify the idea of the present invention, and the present invention may be used in whole or in part. Obviously, the idea of the invention is not limited. In addition, a well-known technique, a well-known procedure, a well-known architecture, a well-known circuit configuration, and the like (hereinafter, “well-known matter”) are not described in detail, but this is also to simplify the description. Not all or part of the matter is intentionally excluded. Such well-known matters are known to those skilled in the art at the time of filing of the present invention, and are naturally included in the following description.

  FIG. 1 is a configuration diagram of a digital camera 10 according to the present embodiment. In this figure, a digital camera 10 includes a photographing lens unit 11, a lens driving unit 12, an image sensor 13, an ADC circuit 14, a TG circuit 15, an image sensor driving circuit 16, a bus 17, an image processing unit 18, a JPEG conversion unit 19, MPEG conversion unit 20, inter-image motion detection unit 21, shake correction unit 22, video unit 23, video signal input / output terminal 24, display unit 25, external memory I / F 26, external memory 27, SDRAM 28, flash memory 29, gyro sensor 30, an amplification unit 31, an analog-digital conversion unit 32, a key operation input unit 33, an audio unit 34, an audio signal input / output terminal 35, an I / O port 36, a digital data input / output terminal 37, a control unit 38, and a not-illustrated Power supply unit.

  The photographing lens unit 11 includes an AF (autofocus), a diaphragm mechanism, a zoom mechanism, and an optical image blur correction mechanism. Since the AF and the aperture mechanism are well-known configurations, illustration is omitted, but the zoom mechanism changes the angle of view α at an arbitrary zoom magnification from the tele end (telephoto end) to the wide end (wide angle end). The photographic lens group 11a that can be used is configured as a main element. Further, the image blur correction mechanism adjusts the optical axis 11b of the photographing lens group 11a as necessary to finely adjust an image blur correction lens (also referred to as a camera shake correction lens) 11c. It is configured as the main element. The photographing lens unit 11 having these configurations is controlled by the lens driving unit 12 which is appropriately controlled by the control unit 38, and the operations of AF, aperture, zoom, and image blur are controlled.

  The image sensor 13 is composed of, for example, a two-dimensional photoelectric conversion element such as a CCD or a CMOS that converts an object image that has passed through the photographing lens unit 11 into an image signal and outputs the image signal. It is controlled by the element drive circuit 16. The ADC circuit 14 performs correlated double sampling and amplification on the imaging signal output from the imaging element 13, converts the amplified imaging signal into a digital signal, and converts the amplified imaging signal into a digital signal via the TG circuit 15 and the bus 17. Output to.

  In addition to the TG circuit 15 and the image processing unit 18, the external memory I / F 26, SDRAM 28, flash memory 29, control unit 38, and the like are connected to the bus 17. Necessary image processing is executed while receiving control of the control unit 38 via the bus 17.

  The control unit 38 is configured with a one-chip microcomputer (hereinafter simply referred to as a microcomputer or a computer) as a main element, and software resources such as an OS (operating system) and various control programs stored in the flash memory 29 in advance. Are loaded into the SDRAM 28 and the software resources are executed to control the operation of each unit of the digital camera 10 including the image processing unit 18.

  Specifically, the control unit 38 outputs an imaging signal periodically extracted from the imaging device 13 (for example, extracted at a period of several tens of frames per second) to the display unit 25 configured by a liquid crystal panel or the like. Thus, a process of providing a finder image for composition confirmation (also referred to as a through image) to the user is executed. In addition, the control unit 38 executes a process of detecting “half-press” of the shutter button 33a by the user and controlling AF and an aperture of the photographing lens unit 11. Further, when the control unit 38 detects “full press” of the shutter button 33a by the user, the control unit 38 converts the imaging signal from the imaging device 13 into the JPEG conversion unit 19 (in the case of still image recording) and the MPEG conversion unit 20 (moving image recording). In this case, the compressed image is recorded in the external memory 27 via the external memory I / F 26. Further, when the user operates the playback button 33b, the control unit 38 reads a recorded image from the external memory 27 via the external memory I / F 26, and a JPEG conversion unit 19 (in the case of reading a still image) or an MPEG conversion unit. After the decompression process at 20 (in the case of moving image reading), the decompressed image is output to the display unit 25 and reproduced and displayed. In addition, the control unit 38 outputs an image read from the external memory 27 via the external memory I / F 26 to the outside via the I / O port 36 and the digital data input / output terminal 37 as necessary, or externally. A process of saving an image taken in from the external memory 27 via the external memory I / F 26 is executed. Further, the control unit 38 outputs a through image or a reproduced image to the outside through the video unit 23, the video signal input / output terminal 24, the audio unit 34, and the audio signal input / output terminal 35 as necessary, or A process of outputting a video signal or an audio signal captured from the outside to the display unit 25 for reproduction display is executed. When the user performs a zoom operation (operation on the tele side or operation on the wide side) of the zoom button 33c by the user, the control unit 38 generates a zoom signal corresponding to the operation, and the zoom signal is converted into the lens. A process of outputting to the drive unit 12 and changing the angle of view α of the photographic lens unit 11 is executed.

  In addition, the control unit 38 performs a process of detecting image blur of the digital camera 10. Here, the digital camera 10 of the present embodiment includes two image blur detection units. One is performed based on the detection signal of the gyro sensor 30, and the other is performed by the inter-image motion amount detection unit 21 of the image processing unit 18. Hereinafter, the former will be referred to as “mechanical shake detection means” and the latter as “electronic shake detection means”.

  FIG. 2 is a conceptual diagram of mechanical shake detection means and electronic shake detection means in the present embodiment. First, as shown in (a), the mechanical shake detection means detects the angular velocity or angular acceleration applied to the main body 10a of the digital camera 10 with the gyro sensor 30, and determines the direction and magnitude of the shake. It is. The gyro sensor 30 preferably detects three-axis acceleration (angular velocity or angular acceleration) in the X, Y, and Z directions. When image blur occurs, the value of the acceleration corresponding to the direction of image blur among the X, Y, and Z accelerations changes greatly.

  The electronic shake detection means determines the direction and magnitude of the shake based on the amount of motion of the image between two consecutive frames 39 and 40 imaged by the image sensor 13 as shown in FIG. Is. For example, in this figure, the same subject 41 is shown in two frames 39, 40, but the subject 41 in the right frame 40 taken later in time is compared to the same subject 41 in the left frame 39. , The position is slightly shifted (here, shifted to the left). Image blur can be determined from the direction and size of this “deviation”. A subject 41a indicated by a broken line in the right frame 40 is the original subject 41 for comparison.

  Here, when the mechanical shake detection means and the electronic shake detection means are compared, the mechanical shake detection means is superior in that only a pure image shake component is detected. This is because the electronic shake detection means detects not only a pure image shake component but also a movement of the subject (that is, a subject shake) since the shake is detected from the movement of the image. Further, the mechanical shake detection means is superior in terms of power saving. While the gyro sensor 30 of the mechanical shake detection means consumes little power, the electronic shake detection means uses a considerable amount of power (operating power of the image processing unit 18 and memory access such as the SDRAM 28) for image processing. This is because the power consumed by the power consumption is consumed.

  In this way, although it is a mechanical shake detection means that detects only a pure image shake component and has an advantage of low power consumption, it is electronic under certain conditions, for example, when the zoom magnification is high. There is a disadvantage that the accuracy of shake detection is inferior to that of the automatic shake detection means.

  FIG. 3 is a diagram showing the detection accuracy of the mechanical shake detection means when the zoom magnification is changed. In this figure, θ1 and θ2 are wide-angle side and telephoto side shake amounts (angle formed by the optical axis 11b) detected by mechanical shake detection means (gyro sensor 30). When θ1 = θ2, the image blur correction amounts L1 and L2 on the imaging surface 13a of the imaging element 13 are “L1 <L2”.

  FIG. 4 is a diagram illustrating the shake width of an image when the shake amount is the same (θ1 = θ2). In this figure, (a) is an image on the wide angle side (for example, 1 ×), and (b) is an image on the telephoto side (for example, 3 ×). As shown in this figure, the shake amount of L pixels in a 1 × image is 3 × L pixels in a 3 × image. Therefore, if the detection resolution of the mechanical shake detection means is A pixel at the same magnification, the shake resolution of the electronic shake detection means is B pixel, and the magnification of the optical zoom is Z, the relationship of “A × Z> B” is established. When this happens, the detection resolution of the mechanical shake detection means exceeds the resolution of the electronic shake detection means, and the resolution of the electronic shake detection means becomes more dominant.

  FIG. 5 is a conceptual diagram of selection of mechanical shake detection means and electronic shake detection means. In this figure, the vertical axis represents the shake amount detection resolution, and the horizontal axis represents the optical zoom magnification. As shown in the figure, the resolution characteristic line 42 of the electronic shake detection unit is constant regardless of the magnification of the optical zoom, but the resolution characteristic line 43 of the mechanical shake detection unit is linear according to the magnification of the optical zoom. It changes and falls below the resolution characteristic line 42 of the electronic shake detection means at a certain point (hereinafter referred to as a cross point). This cross point corresponds to the above relationship (A × Z> B), and the mechanical shake detecting means is advantageous in the left side area (wide angle side) of this cross point, and the right side area (telephoto side) of this cross point. Thus, electronic shake detection means is advantageous.

  Therefore, when the magnification of the optical zoom enters the region on the right side (telephoto side) from the cross point, the gyro sensor 30 (mechanical shake) can be obtained by switching from the mechanical shake detection means to the electronic shake detection means. The shake correction can be performed with a finer resolution than the shake correction amount based on the detection result of the detection means), and the accuracy of shake detection and shake correction can be improved. On the other hand, if the magnification of the optical zoom enters the region on the left side (wide angle side) from the cross point, switching from the electronic shake detection means to the mechanical shake detection means will result in this mechanical shake detection means. Since it consumes less power, it can save power.

  The control unit 38 selectively uses these two shake detection means (mechanical shake detection means and electronic shake detection means) to “detect” image blur, and two image shake correction means described below. Image correction is “corrected” using either one of the mechanical shake correction means and the electronic shake correction means.

  The mechanical shake correction means corrects the image shake optically or mechanically using the image shake correction lens 11 c provided in the photographing lens unit 11. The electronic shake correction means is the image processing unit 18. This is electronically performed by the shake correction unit 22. In the present embodiment, any of these correction means may be used. In other words, which correction unit is used may be determined appropriately from the viewpoint of correction accuracy and power consumption, and naturally, the correction unit that is not used need not be incorporated in the digital camera 10.

  FIG. 6 is a conceptual diagram of mechanical shake correction means and electronic shake correction means in the present embodiment. The mechanical shake correction means corrects the image blur by adjusting the optical axis 11b of the photographing lens group 11a with the image blur correction lens 11c as shown in FIG. Further, as shown in (b), the electronic shake correction means shifts the cutout position of the image of the image pickup device 13 (the cutout position where the range 13b indicated by the wavy line on the image pickup surface 13a is shifted). The image blur is corrected. Any one of the correction means may be incorporated in the digital camera 10. In the present embodiment, it is assumed that these two correction units are incorporated in the digital camera 10 for convenience of explanation.

  That is, the digital camera of this embodiment includes two shake detection means (mechanical shake detection means / electronic shake detection means) and two shake correction means (mechanical shake correction means / electronic shake correction means). It is intended to perform “detection” and “correction” of shake by selectively combining them, but the important point is that two shake detection means (mechanical shake detection means / electronic shake detection means) ) Is to be used selectively.

  FIG. 7 is a diagram showing a combination of shake detection means and shake correction means. As described above, the digital camera 10 according to the present embodiment includes two shake detection and shake correction units, so that the number of combinations is 2 × 2 = 4. Numbers M1 to M4 are given to each combination. M1 is a combination of mechanical shake detection means and mechanical shake correction means, M2 is a combination of electronic shake detection means and mechanical shake correction means, M3 is a combination of mechanical shake detection means and electronic shake correction means, and M4 is This is a combination of electronic shake detection means and electronic shake correction means.

  As described above, the important point in the present embodiment is that two shake detection means (mechanical shake detection means / electronic shake detection means) are selectively used. The point is to select either “mechanical” (M1, M3) or “electronic” (M2, M4) of the means, and any of the shake correction means may be combined. That is, M1 and M3, M2 and M4 are equivalent in terms of the invention, and either M1 and M3 or M2 and M4 may be selected.

  FIG. 8 is a diagram showing a processing flow of shake detection and shake correction in the present embodiment executed by the control unit 38. In this flow, first, it is determined whether or not a shooting scene (mode) is instructed by the user (step S11). A shooting scene refers to an auto shooting mode in which shooting conditions such as AF, exposure, and shutter speed are programmed for a predetermined shooting style, such as a snap shot of a landscape or a person.

  FIG. 9 is a list of shooting scenes. This list is stored in advance in the flash memory 29 and is selected by the user as necessary. Shooting scenes are, for example, “landscape shooting”, “person snap shooting”, “football game shooting”, and so on. In general, in the case of landscape photography, the aperture is reduced to increase the depth of field. In addition, in snapshot shooting of a person, the background and the entire view are blurred, and the aperture is opened to focus on the subject (in this case, a person). In addition, when shooting a subject with movement as in shooting a soccer game, an early shutter speed is selected.

  Although not shown in the list of shooting scenes, the shooting conditions such as the aperture and shutter speed are stored for each scene, and as shown in the figure, an index indicating the complexity of the movement of the subject (hereinafter referred to as the subject). A motion complexity index or simply a complexity index is stored for each scene. For example, “0” as the complexity index of “landscape photography” with little movement, “10” as the complexity index of “snap photography of people” with some movement, “photographing soccer game” with considerable movement "80" is stored as the complexity index. Of course, these complexity index values are only examples.

  By the way, “landscape photography” is considered to be “landscape photography” not only when it is intentionally specified by the user, but also when there is no moving object within the angle of view when automatic judgment is instructed. It has become. Similarly, when automatic determination is instructed, a small number (for example, one) of moving bodies that occupy a certain ratio (for example, 10%) of the total angle of view is moving at a low speed (for example, a speed of 5 pixels per second). In such a case, it is regarded as “snap shot of a person”, and many (for example, about 15) moving bodies that occupy a small area (for example, 5%) within the angle of view are faster (for example, a speed of 20 pixels per second). If you are moving with, it is considered as "shooting soccer game".

  If the determination result in step S11 is “YES”, that is, if a shooting scene (mode) is instructed by the user, the complexity index corresponding to the shooting scene is referred to with reference to the list of shooting scenes in FIG. (Step S12). If the determination result in step S11 is “NO”, that is, if the shooting scene (mode) is not instructed by the user, then whether or not subject automatic determination is instructed. Is determined (step S13). When the automatic subject determination is instructed, the state (photographing scene) of the subject is automatically determined based on the image data obtained by sequentially capturing images for monitor display at the stage before the start of recording. Specifically, the motion vector of each part in the image is obtained by comparing the image data before and after, and the continuous region having the same motion vector is grouped into one to divide the image into a plurality of regions. Is considered as a moving object in the background and other areas. Then, the area of each region corresponding to the moving object and the movement with respect to the background portion are specified, and the state of the specified subject is compared with the automatic determination condition in the list of shooting scenes in FIG. A corresponding complexity index is estimated (step S15). If automatic subject determination is not instructed, a predetermined complexity index is set (step S14).

  When the estimation or setting of the complexity index is completed in this way, next, the current zoom magnification (zoom magnification of the photographing lens unit 11) is acquired (step S16), and the zoom magnification and the previous complexity index are determined. A predetermined determination table (hereinafter referred to as “M1” or “M3” and “M2” or “M4” in FIG. 7) having high detection accuracy (hereinafter referred to as M1 or M3) is applied. The determination is made with reference to the shake detection means switching determination table (step S17). The predetermined table will be described later.

  Next, the shake detection means is switched in accordance with the determination result in step S17 (step S18), and it waits until the shutter button is half-pressed (step S19). When the shutter button is half-pressed, the shake detection means (switched in step S18) ( The shake detection is started using a mechanical shake detection means or an electronic shake detection means). At this time, when the mechanical shake detection means is selected, the angle is output as a shake detection result, for example, “5 °”. When the electronic shake detection means is selected, the number of pixels is output as a shake detection result, for example, “10 dots”. Further, according to this detection result, shake correction is started using either of the two shake correction means (mechanical shake correction means / electronic shake correction means). At this time, if an electronic shake correction unit is used, the adjustment value of the cutout position of the captured image needs to be given by the number of pixels. Therefore, if an angle is output as a shake detection result, this angle is set. Convert to number of pixels. Note that this conversion processing can be obtained by calculation even in the case of an arbitrary zoom magnification, for example, by previously storing the correspondence between the angle and the number of pixels when the zoom magnification is 1. Similarly, in the case of using mechanical shake correction means, it is necessary to give the adjustment value of the tilt of the optical axis of the lens as an angle. Therefore, when the number of pixels is output as the shake detection result, Convert the number of pixels to an angle. Note that this conversion process may be performed in reverse to the conversion from the angle to the number of pixels (step S20). Then, the process waits until the shutter button is fully pressed (step S21). When the shutter button is fully pressed, a process of starting shooting (step S23) is executed.

  FIG. 10 is a conceptual diagram of a shake detection means switching determination table. In this figure, (a) is a diagram showing the correspondence between the zoom magnification and the detection accuracy of the two shake detection means, and (b) is the complexity index of the movement of the subject and the detection accuracy of the two shake detection means. It is a figure which shows the correspondence of these.

  The vertical axis of (a) is the shake detection accuracy, and the horizontal axis is the zoom magnification. The current zoom magnification acquired in step S16 is applied to the horizontal axis, and the zoom magnification and the detection accuracy characteristic line 44 of the mechanical shake detection means. The shake detection means showing the highest accuracy among the values of the vertical axis (detection accuracy) corresponding to the intersections with the detection accuracy characteristic lines 45 and 46 of the electronic shake detection means is the shake detection means suitable for the zoom magnification. It judges with being. However, the detection accuracy characteristic line 45 corresponds to the complexity index “50” of the subject movement, and the detection accuracy characteristic line 46 corresponds to the complexity index “0” of the subject movement.

  The vertical axis of (b) is shake detection accuracy, and the horizontal axis is the complexity index. The complexity index estimated or set in step S12, step S14 or step S15 is applied to the horizontal axis, and the complexity index and electronic The shake detection means showing the highest accuracy among the values of the vertical axis (detection accuracy) corresponding to each intersection of the detection accuracy characteristic line 47 of the shake detection means and the detection accuracy characteristic lines 48 and 49 of the mechanical shake detection means, It is determined that the shake detection means is suitable for the complexity index. However, the detection accuracy characteristic line 48 corresponds to a zoom magnification of 3 times, and the detection accuracy characteristic line 49 corresponds to a zoom magnification of 1 time.

  The shake detection means switching determination table shown in (a) and (b) is set according to the following concept.

  When viewed separately from shake detection processing and shake correction processing, in the correction processing, the electronic shake correction means consumes less power than the mechanical shake correction means. The shake detection means consumes less power. In this way, in terms of power saving, it should be a combination of mechanical shake detection means and electronic shake correction means (M3 in FIG. 7), but this is not necessarily true depending on the magnification of the optical zoom. . This is because the mechanical shake detection means may reduce the shake detection accuracy at a high magnification. Therefore, when the zoom magnification is low, the mechanical shake detection means is selected (M1 or M3 in FIG. 7), while when the zoom magnification is high, the electronic shake detection means is selected (M2 or M4 in FIG. 7). As a result, both power saving and improvement in shake correction accuracy can be achieved.

  Further, the electronic shake detection means has a drawback that the shake detection accuracy is lowered due to the presence of a moving subject. Therefore, in practice, the mechanical shake detection means and the electronic shake detection means should be switched not only according to the zoom magnification but also depending on the presence or absence of the moving subject. The shake detection means switching determination table in FIG. 9 is set according to such a concept.

  In addition, the optical zoom magnification when the shake detection accuracy of the mechanical shake detection unit and the shake detection accuracy of the electronic shake detection unit are balanced is not generally determined, and varies depending on the performance of the device, the shooting situation, and the like. For this reason, by setting the threshold value of the optical zoom magnification for switching the shake detection means dynamically based on information stored in advance (data of a change curve of detection accuracy according to the situation) Even in a situation, it is possible to prevent the shake correction accuracy from changing greatly.

  In addition, the user may arbitrarily designate which of low power consumption and shake correction accuracy is prioritized. By changing the threshold value for switching the optical zoom magnification according to this designation, low power consumption and improvement in shake correction accuracy can be set in a balanced manner according to the situation.

Further, when priority is given to low power consumption, a step may be provided for the priority.
FIG. 11 is a diagram showing a low power consumption priority stage table. As shown in this figure, the switching point P1 when the power consumption priority is low, the switching point P2 when the power consumption priority is standard, and the power consumption priority is high with respect to the zoom magnification. Switching point P3 is provided, and a switching point (any one of P1 to P3) corresponding to the power consumption priority (low / standard / high) designated by the user is selected, and the electronic shake detecting means and mechanical shake are selected. The detection means may be switched.

  In the above description, the shake correction means includes two of the optical shake correction means and the electronic shake correction means. However, the correction means may be either “mechanical” or “electronic”. One of them may be provided. That is, the essence of the present invention is to switch between two shake detection means (mechanical shake detection means / electronic shake detection means) based on the optical zoom magnification and the complexity index of the movement of the subject. This is because “correction” after detection may be performed using either “mechanical” or “electronic”.

  The main functions of the present embodiment are functionally realized by organic coupling of hardware assets including a microcomputer (control unit 38) and software assets such as an OS and various programs stored in the flash memory 29. However, since hardware assets and OSs can be used for general purposes, the essential items indispensable to the present invention are substantially the above-mentioned “flow detection and shake correction processing flow” (see FIG. 8) and the “shake detection means switching determination table” (see FIG. 10). Therefore, the present invention relates to all or a part of these processing programs and tables, as well as a recording medium (such as a floppy (registered trademark) disk, MO, CD, hard disk, or semiconductor memory) storing them. In addition to those on the distribution channel, it also includes those on the network that provide only the recorded contents).

1 is a configuration diagram of a digital camera 10 according to the present embodiment. It is a conceptual diagram of the mechanical shake detection means and the electronic shake detection means in this embodiment. It is a figure which shows the detection accuracy of the mechanical shake detection means at the time of changing zoom magnification. It is a figure which shows the shake width of an image when the shake amount is the same (θ1 = θ2). It is a selection conceptual diagram of a mechanical shake detection means and an electronic shake detection means. It is a conceptual diagram of the mechanical shake correcting means and the electronic shake correcting means in the present embodiment. It is a figure which shows the combination of a shake detection means and a shake correction means. It is a figure which shows the processing flow of shake detection and shake correction in this embodiment performed by the control part. It is a list figure of a photography scene. It is a conceptual diagram of a shake detection means switching determination table. It is a figure which shows the low power consumption priority stage table.

Explanation of symbols

10 Digital camera (imaging device)
10a body (imaging device body)
11 Shooting lens (shooting lens)
11c Image stabilization lens (image stabilization means)
13 Imaging device (imaging means)
13a Imaging surface 21 Inter-image motion detection unit (second correction amount calculating means)
22 Shake correction unit (image shake correction means)
30 Gyro sensor (first correction amount calculating means)
38 Control unit (control means)
S17 step (determination means)

Claims (12)

Imaging means for converting an object image formed on the imaging surface into an image signal through a camera lens,
Image blur correction means for correcting image blur of the image signal based on a specified correction amount;
First correction amount calculation means for calculating a correction amount to be given to the image blur correction means based on motion detection of the imaging apparatus main body including the photographing lens;
Second correction amount calculation means for calculating a correction amount to be applied to the image blur correction means based on detection of movement of the subject image through the photographing lens relative to the imaging surface;
When the image blur correction is performed by the image blur correction unit, either the correction amount calculated by the first correction amount calculation unit or the correction amount calculated by the second correction amount calculation unit is used. Determining means for determining whether or not
A designation means for arbitrarily designating whether to prioritize low power consumption or image stabilization accuracy,
With
The determination unit determines that the correction amount by the first correction amount calculation unit is used more when the specification unit specifies that low power consumption is to be prioritized, and the image correction correction accuracy is determined by the specification unit. When it is designated that priority is given to the image pickup apparatus, an image pickup apparatus is characterized in that a determination is made so that the correction amount calculated by the second correction amount calculation means is used more . Optical zoom means for changing the magnification of the optical zoom,
The determination unit further determines that the correction amount by the first correction amount calculation unit is used more when the magnification of the optical zoom is low, and the second when the magnification of the optical zoom is high. The imaging apparatus according to claim 1, wherein a determination is made so that the correction amount calculated by the correction amount calculation unit is more used. 3. The imaging apparatus according to claim 1, wherein the first correction amount calculation unit detects a motion of the imaging apparatus main body including the imaging lens based on an angular velocity or an angular acceleration output from the gyro sensor. The second correction amount calculating means detects movement of the subject image through the photographing lens with respect to the imaging surface based on comparison of a plurality of image signals continuously captured by the imaging means. The imaging device according to claim 1 . 5. The image blur correction unit according to claim 1 , further comprising a mechanical shake correction unit that corrects an image blur by adjusting an optical axis of the photographing lens based on a specified correction amount . The imaging device according to any one of the above. The image shake correction unit includes an electronic shake correction unit that corrects an image shake by moving a cutout position of an image of an image signal output from the imaging unit based on a specified correction amount. An imaging apparatus according to any one of claims 1 to 5 . The determination means includes an accuracy indicating an error and reliability of the correction amount calculated by the first correction amount calculation means, and an accuracy indicating an error and reliability of the correction amount calculated by the second correction amount calculation means. Which of the correction amount calculated by the first correction amount calculation unit and the correction amount calculated by the second correction amount calculation unit is used with the optical zoom magnification having a predetermined relationship as a reference? imaging device according to any one of claims 1 to 6, wherein the determining. In the determination unit, the calculation accuracy of the correction amount by the first correction amount calculation unit, which decreases as the magnification of the optical zoom increases, is lower than the calculation accuracy of the correction amount by the second correction amount calculation unit. case, the second correction amount imaging apparatus according to claim 7, wherein the determining to use the correction amount calculated by the calculating means. In the determination unit, the calculation accuracy of the correction amount by the second correction amount calculation unit, which decreases as the complexity of the movement of the subject increases, is lower than the calculation accuracy of the correction amount by the first correction amount calculation unit. 9. The imaging apparatus according to claim 7 , wherein the image pickup apparatus determines to use the correction amount calculated by the first correction amount calculation unit. The imaging apparatus according to claim 7 , wherein the determination unit changes a magnification of an optical zoom serving as a reference for the determination in accordance with a priority for reducing power consumption. An imaging step for converting an object image formed on the imaging surface into an image signal through a camera lens,
An image blur correction process for correcting image blur of the image signal based on a specified correction amount;
A first correction amount calculating step for calculating a correction amount to be given to the image blur correction step based on motion detection of the imaging apparatus main body including the photographing lens;
A second correction amount calculating step for calculating a correction amount to be applied to the image blur correction step based on detection of movement of the subject image through the photographing lens with respect to the imaging surface;
When image blur correction is performed in the image blur correction step, either the correction amount calculated in the first correction amount calculation step or the correction amount calculated in the second correction amount calculation step is used. A determination step for determining whether or not
A specification process that arbitrarily specifies whether to prioritize low power consumption or image stabilization accuracy,
Including
The determination step determines that the correction amount in the first correction amount calculation step is used more when low-power consumption is specified in the specification step, and the image correction accuracy is determined in the specification step. An imaging method characterized by determining that the correction amount calculated by the second correction amount calculation step is used more when it is specified that priority is given . Computer
Imaging means for converting an object image formed on the imaging surface into an image signal through a camera lens,
Image blur correction means for correcting image blur of the image signal based on a specified correction amount;
First correction amount calculation means for calculating a correction amount to be given to the image blur correction means based on motion detection of the imaging apparatus main body including the photographing lens;
Second correction amount calculation means for calculating a correction amount to be applied to the image blur correction means based on detection of movement of the subject image through the photographing lens relative to the imaging surface;
When the image blur correction is performed by the image blur correction unit, either the correction amount calculated by the first correction amount calculation unit or the correction amount calculated by the second correction amount calculation unit is used. Determining means for determining whether or not
A designation means for arbitrarily designating whether to prioritize low power consumption or image stabilization accuracy,
Is a program for functioning as
The determination unit determines that the correction amount by the first correction amount calculation unit is used more when the specification unit specifies that low power consumption is to be prioritized, and the image correction correction accuracy is determined by the specification unit. A program for determining that the correction amount calculated by the second correction amount calculation means is used more when it is specified that priority is given .

Images