JP5931619B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus capable of zoom exposure during exposure.

  Conventionally, during-exposure zoom shooting is known as one of shooting methods for shooting a moving subject. The inter-exposure zoom shooting is a shooting method in which zoom driving is performed during exposure of the imaging apparatus. In such an inter-exposure zoom shooting, an image with a special effect in which the periphery of the subject flows radially is obtained, and thus a powerful image in which the movement of the subject is emphasized can be obtained. For example, Japanese Patent Application Laid-Open No. 2004-151867 has proposed an image pickup apparatus that enables such during-exposure zoom shooting. In this patent document 1, a zooming speed during zooming during exposure is set based on a focal length, zooming direction, and shutter speed during zooming during exposure.

Japanese Patent Laid-Open No. 6-201971

  In the case of the conventional inter-exposure zoom shooting disclosed in Patent Document 1 or the like, the inter-exposure zoom shooting is performed using an optical zoom. Here, it is known that camera shake is more likely to occur on the tele (telephoto) side than on the wide (wide angle) side. Therefore, camera shake tends to occur when the zoom lens is driven to the tele side during zoom exposure during exposure. Furthermore, since the ratio of the subject in the angle of view tends to be large on the tele side, the possibility that the subject will deviate from the angle of view due to the occurrence of camera shake is greater than that on the wide side.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an imaging apparatus that can capture a subject reliably and perform inter-exposure zoom shooting even when camera shake occurs.

  In order to achieve the above object, an imaging apparatus according to an aspect of the present invention includes an imaging unit that exposes a subject a plurality of times to obtain image data related to the subject, and a zoom lens that adjusts an angle of view. A photographing lens that forms an image of light from the subject on the imaging unit and a change in the size of the subject on the image data are detected, and each of the exposure times is determined according to the detected change in the size of the subject. A zoom driving amount calculating unit that calculates a driving amount of the zoom lens, an electronic zoom processing unit that applies electronic zoom processing with a magnification corresponding to the driving amount of the zoom lens to the image data, and the zoom driving amount. It is determined whether the corresponding optical zoom can be performed for each exposure, and the zoom driving amount is performed while performing the exposure by the imaging unit at the exposure time when it is determined that the optical zoom can be performed. Accordingly, the electronic zoom processing by the electronic zoom processing unit is performed on the image data obtained by executing the exposure by the imaging unit at the time of exposure in which the zoom lens is driven and it is determined that the optical zoom is not executable. A control unit that performs shooting control so as to perform the above, image data obtained at the time of exposure determined that the optical zoom can be performed, and an image obtained at the time of exposure determined that the optical zoom cannot be performed And a synthesizing unit that synthesizes the data.

  According to the present invention, it is possible to provide an imaging apparatus capable of capturing a subject reliably and performing zooming during exposure even if camera shake occurs.

1 is a block diagram illustrating a configuration of a digital camera as an example of an imaging apparatus according to an embodiment of the present invention. It is a figure which shows the example of the menu screen for the setting of zoom mode. It is a figure which shows the outline | summary of operation | movement of zoom photography between exposures. It is a flowchart which shows the flow of a process in zoom mode between optical exposures. It is a figure which shows the transition of the screen displayed on a display part at the time of zoom modes between optical exposures. It is a flowchart which shows the flow of a process in automatic zoom mode between exposures. It is a figure which shows the transition of the screen displayed on a display part in the zoom mode between automatic exposure. It is a figure which shows the outline | summary of operation | movement of the zoom mode between automatic exposure. It is a flowchart which shows the flow of a process in the zoom mode between super-automatic exposure. It is a figure which shows the transition of the screen displayed on a display part at the time of super auto exposure zoom mode.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration of a digital camera as an example of an imaging apparatus according to an embodiment of the present invention. A digital camera (hereinafter referred to as a camera) 1 shown in FIG. 1 has a configuration of a lens interchangeable camera. Therefore, the camera 1 has the interchangeable lens 100 and the camera body 200. The camera 1 does not necessarily need to be a lens interchangeable type, and a photographing lens may be provided in the camera body.

  The interchangeable lens 100 includes a photographing lens 102, a lens driving unit 104, a lens position detection unit 106, a diaphragm 108, a diaphragm driving unit 110, a lens information storage unit 112, a lens control unit 114, and a communication unit 116. have.

  The photographing lens 102 is a lens group having a plurality of lenses such as a focus lens 102a and a zoom lens 102b. The photographing lens 102 forms an image of light from a subject (not shown) on an image sensor 202 provided in the camera body 200. The focus lens 102 a is a lens for adjusting the focus of the photographing lens 102, and the zoom lens 102 b is a lens for adjusting the angle of view of the photographing lens 102.

  The lens driving unit 104 drives the focus lens 102a and the zoom lens 102b of the photographing lens 102 according to control by the lens control unit 114. The lens driving unit 104 includes a motor for driving each lens included in the photographing lens 102 and a driving circuit for driving these motors. The lens position detection unit 106 detects the driving positions of the focus lens 102a and the zoom lens 102b. The lens position detection unit 106 is configured by an encoder, for example.

  The diaphragm 108 is configured to be openable and closable, and adjusts the amount of light imaged on the image sensor 202 via the photographing lens 102. The degree of blurring of the subject image formed on the image sensor 202 is also adjusted by the opening amount of the diaphragm 108.

  The aperture driving unit 110 drives the aperture 108 according to the control by the lens control unit 114. The aperture driving unit 110 includes a motor for driving the aperture and a driving circuit for the motor.

  The lens information storage unit 112 stores lens information of the photographing lens 102 such as the focal length, F number, and aberration information of the photographing lens 102.

  The lens control unit 114 is communicatively connected to the control unit 216 of the camera body 200 via the communication unit 116. The lens control unit 114 controls the lens driving unit 104 and the aperture driving unit 110 according to the control of the control unit 216. The lens control unit 114 also transmits the positions of the focus lens 102a and the zoom lens 102b detected by the lens position detection unit 106 as the lens is driven and the lens information stored in the lens information storage unit 112 to the communication unit 116. It is also transmitted to the camera body 200 via

  The communication unit 116 is an interface on the interchangeable lens 100 side for communication between the lens control unit 114 and the control unit 216.

  The camera body 200 includes an image sensor 202, an A / D conversion unit 204, an image processing unit 206, a display unit 208, a recording unit 210, an operation unit 212, a touch operation unit 214, and a control unit 216. And a communication unit 218 and an acceleration sensor 220.

  The imaging element 202 has a light receiving surface on which photoelectric conversion elements as pixels are two-dimensionally arranged. Each pixel converts an image of a subject formed through the photographing lens 102 into an electric signal (image signal). The imaging operation of the imaging element 202 is controlled by a control unit 216 having a function as an imaging control unit. Here, as the image sensor 202, for example, a CCD element and a CMOS element are known, but in this embodiment, it is not necessary to use an image sensor having a specific structure.

  The A / D conversion unit 204 converts the image signal obtained by the image sensor 202 into image data as a digital signal.

  Here, the imaging element 202 and the A / D conversion unit 204 function as an imaging unit.

  The image processing unit 206 performs image processing on the image data. The image processing performed by the image processing unit 206 includes various types of processing necessary for displaying or recording an image corresponding to image data such as white balance correction processing and γ correction processing on the display unit 208, compression processing, Expansion processing and the like are included. The image processing unit 206 has an electronic zoom processing unit 206a. The electronic zoom processing unit 206a performs an electronic zoom process on the image data. Specifically, the electronic zoom processing unit 206a cuts out the subject portion in the image data, and enlarges or reduces the image data of the cut out subject portion. The enlargement process is performed by supplementing pixels between adjacent pixels by, for example, an interpolation process. The reduction process is performed by thinning out pixels, for example. Further, the image processing unit 206 includes a synthesis unit 206b. The synthesizing unit 206b synthesizes image data of a plurality of frames obtained during zooming during exposure.

  The display unit 208 displays various images such as an image based on the image data processed by the image processing unit 206. The display unit 208 is configured by, for example, a liquid crystal display.

  The recording unit 210 records an image file generated from the image data compressed by the image processing unit 206. The recording unit 210 is configured by a memory card that is detachable from the camera body 200, for example. The recording unit 210 may be built in the camera body 200.

  The operation unit 212 is configured to include a plurality of operation members for the photographer to perform various operations of the photographing apparatus 1. The operation members include a release button, a mode dial, a power button, and the like. The release button is an operation member for the photographer to instruct the camera body 200 to start photographing. The mode dial is an operation member for the photographer to instruct the camera body 200 to set an operation mode or the like. The power button is an operation member for the photographer to instruct the camera body 200 to turn on or off the power.

  The touch operation unit 214 is formed on the display screen of the display unit 208, for example. The touch operation unit 214 is, for example, a capacitive touch operation unit, and detects a contact position when there is a contact with the display screen of the display unit 208 such as a photographer's finger. The touch operation unit 214 detects a touch operation by the photographer.

  The control unit 216 controls the operation of each block of the camera body 200. For example, the control unit 216 controls the lens control unit 114 to control the autofocus (hereinafter referred to as AF) operation of the photographing lens 102. As the AF method, various methods such as a known contrast method and phase difference method can be used.

  The control unit 216 has a function as the imaging control unit 216a and controls the imaging operation of the imaging element 202. The control unit 216 has a function as an exposure condition setting unit 216b, and sets the exposure time TV and the image sensor sensitivity SV of the image sensor 202 and the aperture value AV of the diaphragm 108 during the image capturing operation of the image sensor 202. Calculated as exposure conditions.

  The control unit 216 has a function as the zoom drive amount calculation unit 216c, and calculates the drive amount of the zoom lens 102b in the between-exposure zoom mode.

  The control unit 216 also has a function as the touch operation identification unit 216d. When the touch operation unit 214 is operated by the photographer, the control unit 216 also identifies the content of the operation. Further, the control unit 216 controls the display operation of the display unit 208, generates an image file from the image data, and records the generated image file in the recording unit 210. Further, the control unit 216 executes optical zoom during exposure according to the calculated driving amount of the zoom lens 102b (zoom position of the zoom lens 102b) in the later-automatic exposure zoom mode or the super-automatic exposure zoom mode described later. Whether to perform the electronic zoom process or not.

  The communication unit 218 is an interface on the camera body 200 side for communication between the lens control unit 114 and the control unit 216.

  The acceleration sensor 220 detects accelerations in the three axial directions of the camera body 200 in the horizontal direction, vertical direction, and optical axis direction (direction parallel to the optical axis of the photographing lens). This acceleration sensor 220 also detects camera shake occurring in the camera body 200.

  Next, zoom exposure during exposure in the present embodiment will be described. The zoom exposure during exposure in this embodiment has “optical exposure zoom mode”, “automatic exposure zoom mode”, and “super-automatic exposure zoom mode” as zoom modes. The optical inter-exposure zoom mode is a zoom mode in which the optical zoom is performed only by the optical zoom, that is, only by driving the zoom lens 102b. The left-to-exposure zoom mode is a mode in which during-exposure zoom shooting is performed so that the subject is automatically tracked by using both optical zoom and electronic zoom processing. The ultra-left-to-exposure zoom mode is a zoom mode in which the prior setting in the left-to-exposure zoom mode is simplified and the during-exposure zoom shooting is performed. Details of these during-exposure zoom photography will be described later.

  For example, the photographer touches a desired menu item among the menu items 302, 304, and 306 displayed on the menu screen for setting the zoom mode between exposures displayed on the display unit 208 as shown in FIG. The selection is made via the unit 214. Of course, the selection by the touch operation unit 214 is not essential, and the selection may be made by the operation unit 212.

  The zoom exposure during exposure in the present embodiment can be applied even when the camera 1 (photographer) is stationary and the subject 2 moves as shown in FIG. As shown in b), the present invention can be applied even when the subject 2 is stationary and the camera 1 (photographer) moves. In any case, the zoom drive amount during the inter-exposure zoom shooting is calculated until the size of the subject 2 with respect to the angle of view becomes the size desired by the photographer or the subject distance becomes the distance desired by the photographer. Is done. Then, when the size of the subject 2 with respect to the angle of view becomes the size desired by the photographer, or the subject distance becomes the distance desired by the photographer, the during-exposure zoom shooting is performed according to the previously calculated zoom drive amount. .

  FIG. 4 is a flowchart showing the flow of processing in the zoom mode between optical exposures. FIG. 5 is a diagram showing transition of a screen displayed on the display unit 208 in the zoom mode between optical exposures. Here, in the zoom mode between optical exposures, it is assumed that the photographer holds the camera body 200 so as to capture the subject 2 at the center of the angle of view.

  When the optical exposure zoom mode 302 is selected on the menu screen shown in FIG. 2, the control unit 216 displays a mode setting screen for the optical exposure zoom mode superimposed on the through image (step S101). FIG. 5A is a diagram illustrating a display example of the mode setting screen. For example, on the mode setting screen shown in FIG. 5A, the photographer sets conditions for starting zoom shooting during optical exposure. For this setting, the control unit 216 causes the distance designation button 402, the size designation button 404, and the return button 406 to be superimposed and displayed on the through image as a mode setting screen.

  After displaying the mode setting screen, the control unit 216 determines, for example, from the output of the touch operation unit 214 whether or not the distance designation button 402 or the size designation button 404 has been selected by the photographer (step S102). For example, as shown in FIG. 5B, when the photographer's finger F is touched at the position of the distance designation button 402, it is determined that the distance designation button 402 has been selected. If the photographer's finger F is touched at the position of the size designation button 404, it is determined that the size designation button 404 has been selected. Further, although detailed description is omitted, when the photographer's finger F is touched at the position of the return button 406, the menu screen shown in FIG. If the photographer's finger F is not touched at any button position, the determination in step S102 is continued.

  If it is determined in step S102 that the distance designation button 402 has been selected, the control unit 216 displays a distance designation screen (step S103). FIG. 5C is a diagram illustrating a display example of a distance designation screen. In the distance designation screen shown in FIG. 5C, the photographer designates the photographing start distance of the optical inter-exposure zoom photographing. For this purpose, the control unit 216 displays a distance display 408, an up / down button 410, and an OK button 412. The distance display 408 displays the currently specified distance value.

  After the display of the distance designation screen, the control unit 216 waits for the distance designation by the photographer (step S104). On the distance designation screen shown in FIG. 5C, the photographer selects the up / down button 410 to change the value of the distance display 408. Instead of operating the up / down button 410, the distance value may be directly input. After inputting the distance, the photographer selects an OK button 412. Upon receiving this selection, the control unit 216 determines the distance value.

  If it is determined in step S102 that the size designation button 404 has been selected, the control unit 216 displays a size designation screen (step S105). On the size designation screen, the photographer designates the size of the subject frame when starting zoom photography during optical exposure. Note that illustration of an example of the size designation screen is omitted.

  After the size designation screen is displayed, the control unit 216 waits for the frame size designation by the photographer (step S106).

  After the distance designation or size designation is made, the control unit 216 displays a shooting standby screen (step S107). FIG. 5D shows a display example of the shooting standby screen. On the shooting standby screen, the control unit 216 superimposes the subject frame 414 on the through image. When the size is designated, the control unit 216 displays the subject frame 414 having the designated size. Further, when the size is not designated, the control unit 216 displays a subject frame 414 having a predetermined fixed size. Thereafter, the subject frame 414 is displayed so as to follow the subject 2.

  After the shooting standby screen is displayed, the control unit 216 calculates an exposure time TV, an image sensor sensitivity SV, and an aperture value AV, which are exposure conditions during zoom shooting during optical exposure (step S108). In calculating the exposure conditions, the control unit 216 calculates the exposure time TV, the image sensor sensitivity SV, and the aperture value AV so that the exposure of the subject frame 414 is optimized. Here, it is preferable that the exposure time during zoom exposure during exposure is longer than the exposure time during normal still image shooting. The amount of exposure overexposure by increasing the exposure time is adjusted by, for example, reducing the aperture 108.

  In addition, the optical inter-exposure zoom mode is different from the auto-exposure inter-exposure zoom mode and the super-auto-exposure inter-exposure zoom, and the number of exposures may be one. Of course, the number of exposures may be multiple.

  During the calculation of the exposure condition, the AF operation may be performed so that the subject 2 in the subject frame 414 is focused.

After calculating the exposure conditions, the control unit 216 calculates the relative speed (the amount of change in the subject distance per time) between the camera 1 and the subject 2 (step S109).
Assuming that the subject 2 or the camera 1 is moving at a constant linear velocity, the moving speed of the subject 2 can be calculated as shown in the following (Equation 1), for example.
v _s = (L ₁ −L ₂ ) / S (Formula 1)
Here, L ₁ in (Expression 1) is the subject distance in the temporally previous frame among the two consecutive frames during live view display. Further, L ₂ is the subject distance in temporally subsequent frame. Furthermore, S is a time interval (sampling interval) of two consecutive frames during live view display.
Further, the moving speed v _c in the optical axis direction of the camera 1 can be calculated by integrating the acceleration of the optical axis of the acceleration sensor 220. Therefore, the relative speed v can be calculated as shown in (Formula 2) below.
v = v _s + v _c (Formula 2)
After calculating the relative speed v between the camera 1 and the subject 2, the control unit 216 calculates the drive amount of the zoom lens 102b to be driven during the exposure time from the relative speed v (step S110). In zoom exposure during exposure according to the present embodiment, zooming by the zoom lens 102b is performed so that there is no change in the size of the subject image on the image data associated with the movement of the subject 2 or the camera 1, for example.

As a technique for this, in the present embodiment, for example, the driving amount of the zoom lens 102b is changed according to the relative speed v (that is, the amount of change in the subject distance per unit time). For example, the size of the object image on the image data is changed with the horizontal and vertical to the L ₂ / L ₁ × while the zoom position is changed from the object distance L ₁ to L ₂ at a constant. Therefore, it is possible to make the size of the object image on the image data is constant by driving the zoom lens 102b to the angle of view L ₁ / L _2-fold. Actually, the change amount of the subject distance during the exposure time T is vT. Therefore, the driving amount of the zoom lens 102b is calculated so as to have a magnification according to the change in the subject distance of vT. For this purpose, for example, the value of the zoom drive speed X for a plurality of relative speeds v is obtained in advance, and the relationship between the relative speed v and the zoom drive speed X is stored in the lens information storage unit 112. In step S110, the control unit 216 reads the necessary zoom drive speed X from v calculated in step S109. Then, the control unit 216 calculates the zoom drive amount Z during the exposure time T according to the following (Equation 3).
Z = Z ₂ −Z ₁ = X × T (Formula 3)
Here, the exposure time T is 1/2 ^TV (seconds). Z ₁ indicates the current zoom position, and Z ₂ indicates the target zoom position.

  In the above-described example, the zoom drive amount is calculated by calculating the size change of the subject on the image data from the relative speed between the subject 2 and the camera 1, but the subject image on the image data is directly calculated. The zoom drive amount may be calculated by detecting a change in size.

  After calculating the zoom drive amount, the control unit 216 determines the zoom drive direction (step S111). The zoom drive direction is the wide direction (from the tele side to the wide side) when the subject distance is short (when the subject 2 and the camera 1 are close to each other). When the subject distance is long (when the subject 2 and the camera 1 are away from each other), the zoom drive direction is set to the tele direction (from the wide side to the tele side).

After determining the zoom drive amount and zoom drive direction, the control unit 216 determines whether or not the zoom position can be moved to the target zoom position (step S112). For example, if the relative velocity v exceeds the range of drivable zoom driving speed of the zoom lens 102b, when the target zoom position Z ₂ exceeds the driving range of the zoom lens 102b, inability to move the zoom position It is determined that In addition, it is determined that the zoom position cannot be moved even when the specified subject distance is too close to the zoom drive amount, or when the size of the specified subject frame is too large compared to the zoom drive amount. To do.

If it is determined in step S112 that the zoom position can be moved, the control unit 216 advances the processing to step S117. If it is determined in step S112 that the zoom position cannot be moved, it is determined whether or not the zoom position of the zoom lens 102b can be adjusted (step S113). By changing the current zoom position Z _1, and the zoom driving to the zoom position Z ₂ of the target is possible, it is possible to adjust the zoom position is determined.

In step S113, if it is determined that it is possible to zoom driving to the zoom position Z ₂ of the target by adjusting the zoom position, the control unit 216 controls the lens control unit 114, the zoom up the zoom position Z ₂ The zoom lens 102b is moved to a zoom position where driving is possible (step S114). Thereafter, the control unit 216 shifts the process to step S117.

Further, in step S113, when it is determined that it is not possible to zoom driving to the zoom position Z ₂ of the target by adjusting the zoom position, the control unit 216 displays the automatic photographing setting change instruction screen (step S115). In the automatic shooting setting change instruction screen, the control unit 216 displays a button for selecting whether or not to reset the zoom mode between optical exposures. Subsequently, the control unit 216 determines whether or not to perform resetting (step S116).

  If it is determined in step S116 that resetting is to be performed, the control unit 216 returns the processing to step S101 to display the zoom mode setting screen during optical exposure. In this case, the photographer resets the frame size or the shooting start distance. For example, the resetting is performed when the frame size is too large or the shooting start distance is too close. Further, when it is determined in step S116 that the resetting is not performed, the control unit 216 ends the process of FIG. In this case, zoom shooting during optical exposure is not performed.

Also, when it becomes possible to zoom driving to the zoom position Z _2, the control unit 216 determines whether the object 2 has reached the exposure start position (step S117). In this determination, when the size is designated, the control unit 216 determines the subject when the size of the subject 2 on the image data becomes the size of the subject frame 414 as shown in FIG. 2 is determined to have reached the exposure start position. When the distance is designated, the control unit 216 determines that the subject 2 has reached the exposure start position when the distance from the camera 1 to the subject 2 is the designated distance.

  If it is determined in step S117 that the subject 2 has not reached the exposure start position, the control unit 216 returns the process to step S109. If it is determined in step S117 that the subject 2 has reached the exposure start position, the control unit 216 starts the exposure operation of the image sensor 202 (step S118). At this time, the control unit 216 starts the exposure operation of the image sensor 202 according to the exposure time TV and the image sensor sensitivity SV calculated in step S108. At the same time, the control unit 216 controls the lens control unit 114 to adjust the aperture amount of the aperture 108 according to the aperture value AV calculated in step S108. Subsequently, the control unit 216 controls the lens control unit 114 to start driving the zoom lens 102b according to the drive amount calculated in step S110 and the drive direction determined in step S111 (step S119).

  After the exposure operation of the image sensor 202 and the start of the zoom lens 102b, the control unit 216 waits until the exposure time T seconds elapses. Then, after the exposure time T seconds elapses, the control unit 216 finishes the photographing operation and the zoom driving of the zoom lens 102b (step S120). As the photographing operation end process, the control unit 216 performs image processing on the image data obtained as a result of the exposure operation by the image processing unit 206, and records the image processed image data in the recording unit 210 as an image file.

  After the photographing operation is completed, the control unit 216 controls the display unit 208 to perform REC view display (step S121). Thereafter, the control unit 216 ends the process of FIG. In the REC view display, the control unit 216 reproduces the image data recorded in the recording unit 210 on the display unit 208 as shown in FIG.

  In the optical inter-exposure zoom mode as described above, during-exposure zoom photography is performed only by driving the zoom lens 102b. At this time, exposure is automatically started according to the subject distance and the size of the subject on the image data, and then optical zoom is performed so that the size of the subject on the image data does not change. The photographer can easily perform zooming between exposures.

  FIG. 6 is a flowchart showing a flow of processing in the auto-exposure zoom mode. FIG. 7 is a diagram illustrating transition of a screen displayed on the display unit 208 in the automatic zoom mode between exposures.

  When the auto-exposure zoom mode 304 is selected on the menu screen shown in FIG. 2, the control unit 216 superimposes and displays a mode setting screen for the auto-exposure zoom mode on the through image (step S201). FIG. 7A is a diagram illustrating a display example of the mode setting screen. For example, on the mode setting screen shown in FIG. 7A, the photographer sets conditions for starting zoom shooting during automatic exposure. For this setting, the control unit 216 displays a size designation screen. FIG. 7A is a diagram illustrating a display example of the size designation screen. On the size designation screen shown in FIG. 7A, the photographer designates the size of the subject frame. For this purpose, the control unit 216 displays a subject frame 502 and an OK button 504.

  After the size designation screen is displayed, the control unit 216 waits for the photographer to designate the subject frame size (step S202). In the size designation screen shown in FIG. 7A, the photographer changes the size of the subject frame 502 by, for example, a drag operation. After specifying the size of the subject frame, the photographer selects an OK button 504. Upon receiving this selection, the control unit 216 determines the size of the subject frame.

  Here, the size designation screen is displayed. However, as in the zoom mode between optical exposures, the photographer may be able to select between the size designation screen and the distance designation screen.

  After the size is designated, the control unit 216 displays a shooting standby screen (step S203). FIG. 7B and FIG. 7C show display examples of the shooting standby screen. On the shooting standby screen, the control unit 216 superimposes the subject frame 506 on the through image. When the photographer's finger F is touched at the position of the return button 508, the screen returns to the menu screen shown in FIG.

  After the shooting standby screen is displayed, the control unit 216 calculates an exposure time TV, an image sensor sensitivity SV, and an aperture value AV, which are exposure conditions during automatic zoom shooting during automatic exposure (step S204). In calculating the exposure conditions, the control unit 216 calculates the exposure time TV, the image sensor sensitivity SV, and the aperture value AV so that the exposure of the subject frame 414 is optimized. Here, the auto-exposure zoom mode performs a plurality of exposures, and the exposure time TV is an exposure time required for each exposure. The number of exposures is basically a fixed value. However, when the speed of the subject 2 or the camera 1 is high, it is desirable to shorten the exposure time TV. In this case, the number of exposures may be increased. Of course, the photographer may be able to set the number of exposures.

  After calculating the exposure conditions, the control unit 216 calculates the relative speed (the amount of change in the subject distance per time) between the camera 1 and the subject 2 (step S205). The relative speed v can be calculated in the same manner as in FIG.

  After calculating the relative speed v between the camera 1 and the subject 2, the control unit 216 calculates the drive amount of the zoom lens 102b to be driven during the exposure time from the relative speed v (step S206). The method for calculating the zoom drive amount may be the same as in FIG.

  After calculating the zoom drive amount, the control unit 216 determines the zoom drive direction (step S207). The zoom drive direction is the wide direction (from the tele side to the wide side) when the subject distance is short (when the subject 2 and the camera 1 are close to each other). When the subject distance is long (when the subject 2 and the camera 1 are away from each other), the zoom drive direction is set to the tele direction (from the wide side to the tele side).

  After determining the zoom drive amount and zoom drive direction, the control unit 216 determines whether or not the zoom position can be moved to the target zoom position (step S208). The determination in step S208 may be the same as the determination in step S112 in FIG.

  If it is determined in step S208 that the zoom position can be moved, the control unit 216 advances the process to step S213. If it is determined in step S208 that the zoom position cannot be moved, it is determined whether or not the zoom position of the zoom lens 102b can be adjusted (step S209). The determination in step S209 may be the same as the determination in step S113 in FIG.

  If it is determined in step S209 that zoom driving to the target zoom position is possible by adjusting the zoom position, the control unit 216 controls the lens control unit 114 to perform zoom driving to the target zoom position. The zoom lens 102b is moved to a possible zoom position (step S210). Thereafter, the control unit 216 shifts the processing to step S213.

  If it is determined in step S209 that zoom driving to the target zoom position is not possible even by adjusting the zoom position, the control unit 216 displays an automatic shooting setting change instruction screen (step S211). In the automatic shooting setting change instruction screen, the control unit 216 displays a button for selecting whether or not to reset the automatic zoom mode between automatic exposures. Subsequently, the control unit 216 determines whether to perform resetting (step S212).

  If it is determined in step S212 that resetting is to be performed, the control unit 216 returns the processing to step S201 to display the automatic exposure zoom mode setting screen. In this case, the photographer resets the frame size. In step S212, when it is determined that resetting is not performed, the control unit 216 ends the process of FIG. In this case, zoom shooting during automatic exposure is not performed.

  When the zoom drive to the target zoom position becomes possible, the control unit 216 determines whether or not the subject 2 has reached the exposure start position (step S213). In this determination, the control unit 216 determines that the subject 2 has reached the exposure start position when the size of the subject 2 on the image data 2 becomes the size of the subject frame 506 as shown in FIG. judge.

  If it is determined in step S213 that the subject 2 has not reached the exposure start position, the control unit 216 returns the process to step S205. If it is determined in step S213 that the subject 2 has reached the exposure start position, the control unit 216 starts the exposure operation of the image sensor 202 (step S214). At this time, the control unit 216 starts the exposure operation of the image sensor 202 according to the exposure time TV and the image sensor sensitivity SV calculated in step S204. At the same time, the control unit 216 controls the lens control unit 114 to adjust the aperture amount of the aperture 108 according to the aperture value AV calculated in step S204.

  Subsequently, the control unit 216 takes image data obtained by the exposure operation of the image sensor 202 into the image processing unit 206 (step S215). Then, the control unit 216 sets electronic zoom processing for the subject portion in the image data in order to perform electronic zoom processing on the captured image data (step S216). The magnification of the electronic zoom process is a magnification according to the zoom drive amount calculated in step S206. Note that at the time of step S216, the actual electronic zoom processing is not performed.

After setting the electronic zoom process, the control unit 216 determines whether or not the magnification can be adjusted by the optical zoom without using the electronic zoom process (step S217). For example, when the influence of camera shake occurring in the camera body 200 is large, it is determined that the magnification cannot be adjusted by the optical zoom. And when the influence of camera shake is large, for example, the zoom position Z ₂ of the target is the case in the telephoto side of the predetermined position. In general, when camera shake occurs, it is difficult to keep the subject at the center of the angle of view. In such a case, the subject is aligned using electronic zoom processing. On the other hand, when the influence of camera shake is small and electronic zoom processing is unnecessary, optical zoom is used.

  If it is determined in step S217 that the magnification can be adjusted by the optical zoom, the control unit 216 controls the lens control unit 114, and the drive amount calculated in step S206 and the drive determined in step S207. The driving of the zoom lens 102b is started according to the direction (step S218). Then, after the zoom drive of the drive amount calculated in step S206 is completed (that is, after the exposure time T has elapsed), the control unit 216 ends the zoom drive of the zoom lens 102b (step S219).

  After the exposure time T has elapsed, the control unit 216 determines whether or not to end the shooting operation (step S220). In this determination, the control unit 216 determines to end the photographing operation when an exposure operation is performed for a preset number of exposures.

  If it is determined in step S220 that the photographing operation is not terminated, the control unit 216 returns the process to step S215. Then, the control unit 216 performs the next exposure operation. If it is determined in step S220 that the photographing operation is to be terminated, the control unit 216 electronically converts each image data obtained as a result of the multiple exposure operations by the electronic zoom processing unit 206a of the image processing unit 206. Zoom processing (enlargement / reduction processing) is performed (step S221). In step S221, an electronic zoom process is executed according to the setting made in step S216. However, electronic zoom processing is not performed on image data on which optical zoom is performed.

  After the electronic zoom process, the control unit 216 combines the images by the combining unit 206b of the image processing unit 206. Thereafter, the combined image data is subjected to image processing similar to the zoom mode between optical exposures, and the image data subjected to image processing is recorded in the recording unit 210 as an image file.

  Subsequently, the control unit 216 controls the display unit 208 to perform REC view display (step S224). Thereafter, the control unit 216 ends the process of FIG. In the REC view display, the control unit 216 reproduces the image data recorded in the recording unit 210 on the display unit 208 as shown in FIG.

  FIG. 8 shows an outline of operation in the auto-exposure zoom mode. FIG. 8 shows an operation example when the subject 2 moves so as to approach the camera 1. When the subject 2 moves closer to the camera 1 and the zoom position is the same, the proportion of the subject image on the image data increases as the subject moves. Therefore, by setting the zoom drive direction to the wide direction (from the tele side to the wide side), the size of the subject image on the image data is made constant.

  Generally, on the tele side, the influence of camera shake is large and the angle of view is narrow, so that the position of the subject is likely to deviate from the center of the angle of view. Therefore, while the zoom position is on the tele side, image data is recorded using electronic zoom processing. That is, image data of only the subject portion 606 in the image recording range 604 set in advance for the entire shooting range 602 of the image sensor 202 is cut out, and the image data of the subject portion 606 is enlarged and used for composition. And On the other hand, when the zoom position is on the wide side, the image is enlarged using optical zoom, and the image data in the image recording range 604 is used as image data for synthesis. Note that the number of exposures during optical zoom may be one, as in the zoom mode between optical exposures. By combining the image data obtained by the electronic zoom processing and the image data obtained as a result of the optical zoom, it is possible to combine after aligning the position of the subject in each image data. It is possible to obtain image data with the effect of flowing only.

  In the auto-exposure zoom mode described above, even if the photographer does not keep the subject at the center of the angle of view, or even if the subject is out of the center of the angle of view due to camera shake or the like, the zoom between exposures is taken. Can be continued.

  FIG. 9 is a flowchart showing a flow of processing in the super-auto exposure zoom mode. FIG. 10 is a diagram illustrating transition of a screen displayed on the display unit 208 in the super-automatic exposure zoom mode.

  When the super-automatic exposure zoom mode 306 is selected on the menu screen shown in FIG. 2, the control unit 216 displays a shooting standby screen (step S301). FIG. 10A shows a display example of the shooting standby screen. A return button 702 is displayed on the shooting standby screen in the super-automatic exposure zoom mode. Although a detailed description is omitted, when the photographer's finger F is touched at the position of the return button 702, the menu screen shown in FIG.

  After the shooting standby screen is displayed, the control unit 216 calculates the exposure time TV, the image sensor sensitivity SV, and the aperture value AV, which are exposure conditions during zoom shooting during ultra-automatic exposure (step S302). The exposure condition calculation method in the super-auto exposure zoom mode may be the same as the exposure condition calculation method in the auto-exposure zoom mode.

  After calculating the exposure conditions, the control unit 216 determines whether or not the photographer has selected a subject to be subjected to the during-exposure zoom shooting, that is, the photographer has selected the position of any subject displayed on the display unit 208. It is determined whether or not the finger F is touched (step S303). The control unit 216 repeats the determination in step S303 until it is determined that the finger F has been touched.

  If it is determined in step S303 that the finger F has been touched, the control unit 216 displays a subject frame 704 so as to surround the subject selected as shown in FIG. Subsequently, the control unit 216 calculates the amount of change in the size (horizontal or vertical) of the subject of the frame before and after the frame determined to have been touched by the finger F (step S304). As described above, the zoom magnification at the time of optical zoom or electronic zoom processing can be calculated from the reciprocal of the amount of change in size.

  After setting the size of the subject, the control unit 216 starts the exposure operation of the image sensor 202 (step S305). At this time, the control unit 216 starts the exposure operation of the image sensor 202 according to the exposure time TV and the image sensor sensitivity SV calculated in step S302. At the same time, the control unit 216 controls the lens control unit 114 to adjust the aperture amount of the aperture 108 according to the aperture value AV calculated in step S302.

  Subsequently, the control unit 216 takes in the image data obtained by the exposure operation of the image sensor 202 into the image processing unit 206 (step S306). Then, the control unit 216 sets electronic zoom processing for the subject portion in the image data in order to perform electronic zoom processing on the captured image data (step S307). The magnification of the electronic zoom process is set according to the change amount of the subject size calculated in step S304. Note that at the time of step S307, the actual electronic zoom processing is not performed.

After setting the electronic zoom processing, the control unit 216 determines whether or not the magnification can be adjusted by optical zoom without using the electronic zoom processing (step S308). This determination, as in step S217, determines for example the target zoom position Z ₂ is capable of magnification of the adjustment by the optical zoom when in the wide side than a predetermined position.

  If it is determined in step S308 that the magnification can be adjusted by optical zoom, the control unit 216 controls the lens control unit 114 to start driving the zoom lens 102b (step S309). Then, after the end of zoom driving (that is, after the exposure time T has elapsed), the control unit 216 ends the zoom driving of the zoom lens 102b (step S310).

  After the exposure time T has elapsed, the control unit 216 determines whether or not to end the shooting operation (step S311). In this determination, the control unit 216 determines to end the photographing operation when an exposure operation is performed for a preset number of exposures.

  If it is determined in step S311 that the shooting operation is not terminated, the control unit 216 returns the process to step S306. Then, the control unit 216 performs the next exposure operation. If it is determined in step S311 that the shooting operation is to be terminated, the control unit 216 electronically converts each image data obtained as a result of the multiple exposure operations by the electronic zoom processing unit 206a of the image processing unit 206. Zoom processing (enlargement / reduction processing) is performed (step S312). In step S312, electronic zoom processing is executed in accordance with the setting made in step S307. However, electronic zoom processing is not performed on image data on which optical zoom is performed.

  After the electronic zoom process, the control unit 216 combines the images by the combining unit 206b of the image processing unit 206. Thereafter, the combined image data is subjected to image processing similar to the zoom mode between optical exposures, and the image data subjected to image processing is recorded in the recording unit 210 as an image file.

  Subsequently, the control unit 216 controls the display unit 208 to perform REC view display (step S314). Thereafter, the control unit 216 ends the process of FIG. In the REC view display, the control unit 216 reproduces the image data recorded in the recording unit 210 on the display unit 208 as shown in FIG.

  In the super-automatic exposure zoom mode described above, the photographer can select an object in the display screen and perform appropriate exposure zoom photography for the object.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention. Further, in the description of each operation flowchart described above, the operation is described using “first”, “next”, and the like for convenience, but this does not mean that it is essential to perform the operations in this order. Absent. For example, if the order of the processes in steps S216 and S217 in FIG. 6 is reversed and it is determined that adjustment by optical zoom is impossible, the electronic zoom process may be executed immediately after the exposure is completed. good.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

  DESCRIPTION OF SYMBOLS 100 ... Interchangeable lens, 102 ... Shooting lens, 102a ... Focus lens, 102b ... Zoom lens, 104 ... Lens drive part, 106 ... Lens position detection part, 108 ... Diaphragm, 110 ... Diaphragm drive part, 112 ... Lens information storage part, DESCRIPTION OF SYMBOLS 114 ... Lens control part, 116 ... Communication part, 200 ... Camera body, 202 ... Image pick-up element, 204 ... A / D conversion part, 206 ... Image processing part, 206a ... Electronic zoom processing part, 206b ... Composition part, 208 ... Display , 210 ... recording unit, 212 ... operation unit, 214 ... touch operation unit, 216 ... control unit, 216a ... imaging control unit, 216b ... exposure condition setting unit, 216c ... zoom drive amount calculation unit, 216d ... touch operation identification unit 218 Communication unit 220 Acceleration sensor

Claims (5)

An imaging unit that exposes a subject multiple times to obtain image data relating to the subject;
A zoom lens that adjusts an angle of view, and a photographing lens that forms an image of light from the subject on the imaging unit;
A zoom driving amount calculating unit that detects a change in the size of the subject on the image data and calculates a driving amount of the zoom lens at each exposure according to the detected change in the size of the subject; ,
An electronic zoom processing unit for performing an electronic zoom process at a magnification according to the driving amount of the zoom lens on the image data;
Whether or not optical zoom according to the zoom drive amount can be executed is determined for each exposure, and when the optical zoom is determined to be executable, the zoom is performed while performing exposure by the imaging unit. The zoom lens is driven according to the drive amount, and at the time of exposure determined that optical zoom is not executable, the electronic zoom processing unit performs the image data obtained by performing exposure by the imaging unit. A control unit for performing shooting control so as to perform electronic zoom processing;
A synthesizing unit that synthesizes image data obtained at the time of exposure determined that the optical zoom is executable and image data obtained at the time of exposure determined that the optical zoom is not executable;
An imaging apparatus comprising:   The control unit determines that the optical zoom is not executable when the zoom drive amount is a drive amount that moves the zoom position of the zoom lens to a tele side from a predetermined position. The imaging apparatus according to 1.   The zoom drive amount calculation unit calculates the drive amount of the zoom lens so that the size of the subject on the image data is constant between the exposures. Imaging device.   The control unit performs the photographing control when a size of a subject on the image data becomes a predetermined size or when a distance from the imaging device to the subject becomes a predetermined distance. Item 4. The imaging device according to any one of Items 1 to 3. A display unit for displaying an image corresponding to the image data obtained by the imaging unit;
A touch operation unit for selecting a subject in the image displayed on the display unit;
Further comprising
The imaging apparatus according to claim 1, wherein the control unit performs the shooting control when the subject is selected by the touch operation unit.

Images