JP5015121B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus, and more particularly to screen display control for performing enlarged display of a specified area.

Conventionally, as in Patent Document 1, an imaging apparatus capable of enlarging and displaying a part of a through image has been proposed. The enlarged display makes it possible to visually recognize a point of particular interest as compared with the case of viewing the normal display screen before the enlargement.
Japanese Patent Laid-Open No. 11-298791

  However, the area to be enlarged (enlarged display target area) is limited to those designated from a plurality of preset areas. For this reason, it is difficult to appropriately enlarge and display an object to be enlarged and displayed.

  Accordingly, an object of the present invention is to provide an imaging apparatus that appropriately enlarges and displays an arbitrary region on a through image.

  An imaging apparatus according to the present invention includes a display unit that displays a first through image based on image data obtained by imaging, an operation unit that is used to designate a first position on the first through image, and a display. And a control unit that displays a second through image obtained by enlarging the image of the enlarged display target area including the first position on a part of the first through image. The operation unit includes the second through image. Used to designate a second position on the image, and when the second position is designated, the control unit changes the first position to a position corresponding to the second position on the first through image; The enlarged display target area is updated according to the change in the first position, and the second through image is displayed in a state where the enlarged display target area is narrowed and the enlargement magnification is increased.

  The user can specify the position (second position) to be enlarged and displayed while viewing the second through image. For this reason, the user can easily and accurately specify the position to be enlarged and displayed, and can appropriately enlarge and display an image in an arbitrary area according to the user's intention. Become.

  Preferably, the image processing apparatus further includes a detection unit having a face detection function for detecting a face area in the image of the enlarged display target area, and the control unit reads the image of the enlarged display target area whose position is adjusted based on the detection result of the face area. And displayed as a second through image.

  By moving the enlarged display target area based on the detection result of the face recognition function, it is possible to maintain an enlarged display of an image of an arbitrary area (an image including the specific target object SF1).

  More preferably, when the detection unit detects one face area, the control unit uses an image of the enlarged display target area whose position is adjusted so that the one face area is the center as the second through image. Display.

  More preferably, the detection unit tracks one face area based on at least one of the binarized information and the luminance pattern and the face detection function, and the control unit is based on the result of tracking the one face area. The image of the enlargement display target area whose position is adjusted is displayed as the second through image.

  Preferably, when the detection unit detects a plurality of face regions, the control unit displays the image of the enlarged display target region as the second through image without changing the position.

  Preferably, when the detection unit does not detect the face region, the control unit displays the image of the enlarged display target region as the second through image without changing the position.

  Preferably, the detection unit tracks the shape pattern of the image of the enlarged display target region based on at least one of the binarization information and the luminance pattern, and the control unit performs positioning based on the result of tracking the shape pattern. The image of the enlarged display target area in which is adjusted is displayed as the second through image.

  Preferably, the control unit adjusts a position for displaying the second through image in the first through image in accordance with the position of the enlarged display target region.

  As described above, according to the present invention, it is possible to provide an imaging apparatus that appropriately enlarges and displays an arbitrary region on a through image.

  Hereinafter, the first embodiment will be described with reference to the drawings. The imaging device 1 is a digital camera. The image capturing apparatus 1 includes an operation unit 10, a release button 13, a control unit 30 that controls each unit, a lens driving unit 45, an exposure control unit 47, a lens 51, an image sensor 53 such as a CCD, an AFE (analog front). End) 55, a DSP (video signal processing circuit) 60, a recording unit 70, and a display unit 90 (see FIG. 1).

  The subject image is captured by the image sensor 53 as an optical image via the lens 51. Image data obtained by imaging is converted from an analog signal to a digital signal by the AFE 55, and image processing is performed by the DSP 60. Such an operation is performed at regular time intervals (based on a frame rate or the like, about 1/30 second), and the first through image S1 is displayed on the display unit 90 based on the image data (live view display, see FIG. 2). ). In the first embodiment, a second through image S2 described later is displayed on a part of the first through image S1.

  The operation unit 10 includes a direction key 10a used for moving the cursor 11 on the first through image in the vertical and horizontal directions, and a determination key 10b used for determining the movement position of the cursor 11. This is used to designate a first position P1 on the first through image S1 and a second position P2 on the second through image S2, which will be described later. The operation unit 10 also has an end key 10c that is used to end the display of the second through image S2.

  When the release button 13 is pressed halfway, a photometric switch (not shown) is turned on, and photometry, distance measurement by the lens driving unit 45, and focusing operation based on the distance measurement result are performed. Photometry is performed based on image data obtained by imaging with the image sensor 53. Specifically, the DSP 60 obtains a luminance value in the photometric area (information on the brightness of the subject) from the luminance signal generated in the image processing, calculates an appropriate exposure based on the luminance information, and calculates exposure time, aperture information, and the like. The control unit 30 is notified. Further, when the release button 13 is fully pressed, a release switch (not shown) is turned on, and the control unit 30 performs exposure control so that shooting is performed with the exposure time and aperture information calculated by the DSP 60. The unit 47 is controlled to perform imaging. An image corresponding to the image data obtained by imaging is displayed on the display unit 90, and the image data is recorded in the recording unit 70. However, an outline frame of an enlarged display target area (first to fourth areas CA1 to CA4) to be described later and the second through image S2 are not recorded. These are used for confirmation of composition and are not recorded in image data obtained by actual imaging.

  When the user operates the direction key 10a while the first through image S1 is displayed, the cursor 11 is displayed (see FIG. 3). When the determination key 10b is operated after the cursor 11 is moved to an arbitrary position on the first through image S1, the control unit 30 centers on the position of the cursor 11 (first position P1) in the first through image S1. The obtained image of the first area CA1 is acquired, enlarged using an electronic zoom, and displayed as a second through image S2 (see FIG. 4). The size of the first area CA1 when the second through image S2 is first displayed is set to about 0.6 times the size of the second through image S2. In addition, the outer frame of the first area CA1 is displayed on the first through image S1 (see the solid line in FIG. 4).

  When the cursor 11 is moved in the first through image S1 and the new position (first position P1) is determined in the state where the second through image S2 is displayed, the control unit 30 sets the first set first. The image of the first area CA1 centered on the position P1 is enlarged using an electronic zoom and displayed as a second through image S2 (not shown). In this case, the size of the area to be enlarged (enlarged display target area) does not vary.

  When the cursor 11 is moved in the second through image S2 and a new position (second position P2) is determined, the control unit 30 causes the first through image corresponding to the second position P2 on the second through image S2. A position on S1 (first position P1) is newly calculated, and the image of the second area CA2 centered on the newly calculated first position P1 is enlarged using an electronic zoom to obtain a second through image S2. Display (see FIG. 5). The second area CA2 is smaller than the first area CA1, and is set to about 0.4 times the size of the second through image S2, for example. For this reason, when the second area CA2 is displayed as the second through image S2, it is displayed in a state in which the enlargement magnification is increased as compared with the enlarged display of the first area CA1. In addition, the outer frame of the second area CA2 is displayed on the first through image S1 (see the solid line in FIG. 5).

  Further, when the cursor 11 is moved in the second through image S2 and a new position (second position P2) is determined, the control unit 30 sets the first position corresponding to the second position P2 on the second through image S2. A position on the through image S1 (first position P1) is newly calculated, the image of the third area CA3 centered on the newly calculated first position P1 is enlarged using the electronic zoom, and the second through image is displayed. Displayed as S2 (see FIG. 6). The third area CA3 is smaller than the second area CA2, and is set to, for example, about 0.2 times the size of the second through image S2. For this reason, when the third area CA3 is displayed in the second through image S2, it is displayed in a state in which the enlargement magnification is increased as compared with the enlarged display of the second area CA2. If the position of the cursor 11 is not moved from the time of the enlarged display of the second area CA2, the second position P2 does not change, so the first position P1 does not change and only the enlarged display target area is the second. The region CA2 is narrowed to the third region CA3. In addition, the outer frame of the third area CA3 is displayed on the first through image S1 (see the solid line in FIG. 6).

  Further, when the cursor 11 is moved in the second through image S2 and a new position (second position P2) is determined, the control unit 30 sets the first position corresponding to the second position P2 on the second through image S2. A position on the through image S1 (first position P1) is newly calculated, and the image of the fourth area CA4 centered on the newly calculated first position P1 is enlarged using the electronic zoom, and the second through image is displayed. Displayed as S2 (see FIG. 7). The fourth area CA4 is smaller than the third area CA3, and is set to about 0.04 times the size of the second through image S2, for example. For this reason, when the fourth area CA4 is displayed as the second through image S2, it is displayed in a state in which the enlargement magnification is increased as compared with the enlarged display of the third area CA3. If the position of the cursor 11 is not moved from the time of the enlarged display of the third area CA3, the second position P2 does not change, so the first position P1 does not change, and only the enlarged display target area is the third area. The region CA3 is narrowed to the fourth region CA4. In addition, the outer frame of the fourth area CA4 is displayed on the first through image S1 (see the solid line in FIG. 7).

  The operation unit 10 may be a touch panel provided on the display unit 90. In this case, when a user's finger or the like touches an arbitrary place on the first through image S1, the first position P1 is designated at the touched position, and the user is placed at an arbitrary place on the second through image S2. The second position P2 is designated as the touched position by touching the finger or the like.

  The user can move the cursor 11 and specify the position (second position) to be enlarged and viewed while viewing the second through image S2. The enlargement magnification of the second through image S2 is gradually increased according to the number of operations of the enter key 10b. For this reason, the user can easily and accurately specify the position to be enlarged and displayed, and can appropriately perform the enlarged display according to the user's intention.

  When the control unit 30 recognizes that the end key 10c is pressed while the second through image S2 is displayed, the control unit 30 ends the display of the second through image S2.

  Next, a second embodiment will be described. In the first embodiment, the form of displaying the second through image S2 in which the image of the enlarged display target area including the positions (first and second positions P1, P2) designated by the user is displayed has been described. In the second embodiment, detection processing such as face detection is further performed, the specific object SF1 is specified, the first position P1 is corrected, and the position of the enlarged display target region is corrected, and the second through image S2 is displayed. . Details of the second embodiment will be described below.

  The imaging device 1 in the second embodiment further includes a detection unit 63 (see FIG. 8). The detection unit 63 has a face detection function and other detection processing functions using binarized information and a luminance pattern. The control unit 30 outputs information (image information, coordinates, etc.) of the first area CA1 to the detection unit 63. The detection unit 63 performs face detection and other detection processing using binarized information and a luminance pattern, and specifies an area that can be the specific object SF1 in the first area CA1 and in the vicinity of the first area CA1. To do. Here, the case where the enlarged display target area is the first area CA1 will be described, but the same applies to the case where the target is the second to fourth areas CA2 to CA4.

  The specific object SF1 is a preset shape pattern such as a face or an eye, and the face is detected by a face detection function or other detection processing. The other shape such as the eye is binarized information or a luminance pattern. Detected by other detection processes using. When the face detection function detects the face area, the detection unit 63 performs not only the face recognition function but also other detection processing using the binarized information and the luminance pattern from the next frame image after detection. Based on this, the movement (change in shape and size) of the specific object SF1 including the face area is tracked. The shape and size of the target object to be tracked as the specific target object SF1 may vary, and even if it becomes difficult to specify the specific target object SF1 with one recognition function, it is specified with another recognition function. Then, the tracking of the specific object SF1 is continued. For example, when the face recognition function cannot determine that it is a face area, such as when the face facing the front faces sideways, based on other detection processing using binarized information and luminance pattern, The specific object SF1 is specified. Also, if the ratio of the face to the entire screen is large, such as in portrait photography, and the face detection function cannot identify the face within the enlargement display target area, other detection processing using binarization information or luminance patterns can be used. For example, the area including the eyes is set as the specific object SF1, and the position of the specific object SF1 is specified based on the shape pattern of the specific object SF1 (first area CA1).

  When specifying the specific object SF1 in the first area CA1, the detection process is prioritized, and detection is performed every predetermined time (based on a frame rate, about 1/30 second) in the priority order. For example, when face recognition is set to the first position in the priority order of detection processing, when the face area is detected in the first area CA1 and the face area can be detected, the detection unit 63 detects The face area is set to the specific object SF1. When the face area cannot be detected, the entire first area CA1 is detected as a shape pattern in the detection process from the second highest priority. If the specific object SF1 can be detected by any of the detection processes, the specific object SF1 can be continuously specified for each frame, that is, tracking can be performed.

  When the specific object SF1 once specified cannot be specified around the enlarged display target area, that is, when the tracking of the specific object SF1 becomes impossible, the control unit 30 ends the specification of the specific object SF1. Let Accordingly, the display of the second through image S2 is also ended.

  When the detection unit 63 detects only one face region in the first region CA1 centered on the first position P1 indicated by the cursor 11 by face recognition, the control unit 30 detects the detected face. The region is set to the specific object SF1, the first position P1 is corrected to the search origin P1a centered on the specific object SF1, and the first area centered on the corrected first position P1 (search origin P1a) CA1a is calculated. The control unit 30 enlarges and displays the newly calculated image of the first area CA1a as the second through image S2 (see FIG. 9). In addition, on the first through image S1, an outer frame of a new first area CA1 (CA1a) is displayed (see the solid line in FIG. 9).

  When the detection unit 63 detects a plurality of face areas (first to third face areas SF11 to SF13) in the first area CA1 centered on the first position P1 indicated by the cursor 11 based on face recognition. The controller 30 does not correct the first position P1. The control unit 30 enlarges and displays the image of the first area CA1 centered on the first position P1 as the second through image S2 (see FIG. 11). In this case, the control unit 30 sets the entire first area CA1a including the first to third face areas SF11 to SF13 as the specific object SF1. In addition, the outer frame of the first area CA1 is displayed on the first through image S1 (see the solid line in FIG. 11).

  If the detection unit 63 does not detect a face area in the first area CA1 centered on the first position P1 indicated by the cursor 11 based on the face recognition, the control unit 30 sets the first position P1. Is not corrected. The controller 30 enlarges and displays the image of the first area CA1 centered on the first position P1 as the second through image S2 (not shown). In this case, the control unit 30 sets the entire first area CA1a as the specific object SF1. In addition, the outer frame of the first area CA1 is displayed on the first through image S1.

  For the next frame image in which the first detection is performed, that is, the frame image after a certain time has elapsed since the first detection was performed (after about 1/30 seconds have elapsed), the control unit 30 performs 2 The detection unit 63 is caused to perform the second detection.

  When only one face area is detected in the first detection (see FIG. 9), the detection unit 63 uses the first area centered on the first position P1 (search origin P1a) set in the first detection. For CA1a and its surroundings, an area similar to the specific object SF1 set in the first detection (specific object SF1 ′) is searched (see FIG. 10). In this case, the search is performed using not only the face recognition function but also other detection processing using the binarized information and the luminance pattern. When the detection unit 63 detects the specific object SF1 ′ by face detection or other detection processing, the control unit 30 changes the first position P1 from the search origin P1a to a new center that is the center of the specific object SF1 ′. Is corrected to a new search origin P1b, and a new first area CA1b around the new first position P1 (search origin P1b) is calculated. That is, the first area CA1 is centered on the first position P1 (search origin P1a) set at the time of the first detection, and the first position P1 (search origin P1b) newly set at the time of the second detection. ). The control unit 30 enlarges and displays the image of the first area CA1b as the second through image S2. Note that the vicinity of the first area CA1a refers to, for example, an area enlarged by a certain amount of the first area CA1a (see the search range on the lower left in FIG. 13). In addition, on the first through image S1, an outer frame of a new first area CA1 (CA1b) is displayed (see a solid line in FIG. 10). The newly set first position P1 and the like are also used for adjusting the display position of the second through image S2, which will be described later.

  When a plurality of face areas (first to third face areas SF11 to SF13) are detected in the first detection (see FIG. 11), the detection unit 63 sets the first position P1 ( For the first area CA1a centered on the search origin P1a) and its periphery, an area (specific object SF1 ′) similar to the shape pattern of the specific object SF1 set in the first detection is searched (see FIG. 12). ). When the detection unit 63 detects the specific object SF1 ', the control unit 30 sets the region (specific object SF1') as a new first region CA1b. That is, the first area CA1 is corrected to the new first area CA1b from the first area CA1a set at the time of the first detection. The control unit 30 enlarges and displays the image of the first area CA1b as the second through image S2. In addition, the control unit 30 calculates the center (search origin P1b) of the new first area CA1b as the new first position P1, detects the specific object SF1 in the next frame image, and detects the second through image S2. Used to adjust the display position. In addition, an outline frame of a new first area CA1 (CA1b) is displayed on the first through image S1 (see the solid line in FIG. 12).

  Note that the detection unit 63 uses a region similar to the shape pattern of the specific object SF1 (specific object SF1) as a region including a portion that matches the shape pattern of the first region CA1a at the time of the first detection by a certain amount or more. '). Specifically, the determination is made based on a comparison between the digitized shape pattern of the first area CA1a at the time of the first detection and the digitized shape pattern of the comparison area. For example, in the case of binarized information, the number of pixels is the number of pixels that are 0, and in the case of luminance information, the number of pixels that indicate a protruding luminance value (a bright portion with high luminance). Or the number of pixels in a dark part). As a result of the search, if there is no region where it can be determined that the shape patterns match, the specific object SF1 'cannot be specified by the search.

  If the face area is not detected in the first detection, the same processing as when the plurality of face areas are detected is performed. That is, the detection unit 63 forms the shape of the specific object SF1 set in the first detection with respect to the first area CA1a centered on the first position P1 (search origin P1a) set in the first detection and the periphery thereof. An area similar to the pattern (specific object SF1 ′) is searched. When the detection unit 63 detects the specific object SF1 ', the control unit 30 sets the region (specific object SF1') as a new first region CA1b. That is, the first area CA1 is corrected to the new first area CA1b from the first area CA1a set at the time of the first detection. The control unit 30 enlarges and displays the image of the first area CA1b as the second through image S2. In addition, the control unit 30 calculates the center (search origin P1b) of the new first area CA1b as the new first position P1, detects the specific object SF1 in the next frame image, and detects the second through image S2. Used to adjust the display position. In addition, on the first through image S1, a new outer frame of the first area CA1 (CA1b) is displayed.

  By repeating the second detection operation every time a frame image is obtained, the control unit 30 changes the position of the first area CA1 so that the specific object SF1 is included in the first area CA1. Thereby, the display of the second through image S2 can stably display the enlarged image of the first area CA1 including the specific object SF1.

  As a first example, detection and tracking of one face region (specific target object SF1) will be described with the holding posture of the imaging apparatus 1 being the same (see FIG. 13).

  Upon receiving an instruction from the control unit 30, the detection unit 63 detects one face region in the first region CA1 centered on the first position P1 (first detection, see the upper left in FIG. 13). Next, the control unit 30 sets the detected face region to the specific object SF1, corrects the first position P1 to the search origin P1a centered on the specific object SF1, and sets the first position P1a centered on the search origin P1a. One area CA1a is calculated. As the first detection result, the image of the first area CA1a is enlarged and displayed as the second through image S2 (see the upper right in FIG. 13).

  Next, the detection unit 63 specifies the first area CA1a around the first position P1 (search origin P1a) and its periphery (second detection, refer to the search range on the lower left in FIG. 13) in the next frame image. Search for the object SF1 ′. In the first example, the specific object SF1 'that has moved to the left is detected. The control unit 30 corrects the first position P1 (search origin P1a) at the time of the first detection to a new search origin P1b around the newly detected specific object SF1 ′, and at the time of the first detection. The first area CA1a is corrected to the first area CA1b centered on the new first position P1 (search origin P1b), and the image of the new first area CA1b is enlarged and displayed as the second through image S2 ( (See the lower right in FIG. 13). From the third time onward, the same operation as the second detection is repeated.

  As a second example, detection and tracking of the shape pattern of the specific object SF1 including the first to third face regions SF11 to SF13 while the holding posture of the imaging device 1 is the same will be described (see FIG. 14).

  Receiving the instruction from the control unit 30, the detection unit 63 detects the first to third face regions SF11 to SF13 in the first region CA1 centered on the first position P1 (first detection, FIG. 14 upper left). Next, the control unit 30 sets the first area CA1a centered on the first position P1 (search origin P1a) as the shape pattern of the specific object SF1, and sets the image of the first area CA1a as the first detection result. Is enlarged and displayed as the second through image S2 (see the upper right in FIG. 13).

  Next, the detection unit 63 forms the shape pattern of the specific object SF1 in the next frame image with respect to the first area CA1a centered on the search origin P1a and its periphery (second detection, refer to the search range on the lower left in FIG. 14). A search is made for a region similar to (specific object SF1 ′). In the second example, the region moved to the lower right is detected as the specific object SF1 '. The control unit 30 corrects the first position P1 (search origin P1a) at the time of the first detection to a new search origin P1b centered on the newly detected specific object SF1 ′, and at the time of the first detection. The first area CA1a is corrected to the first area CA1b centered on the new first position P1 (search origin P1b), and the image of the new first area CA1b is enlarged and displayed as the second through image S2 ( (See the lower right in FIG. 14). From the third time onward, the same operation as the second detection is repeated.

  Therefore, when an enlarged image including a plurality of face areas is displayed as the second through image S2, the position of the first area CA1 is maintained so as to maintain an enlarged display of the image including the plurality of face areas. Is adjusted. When the second position P2 is designated in this state, an image of a new enlarged display target area (for example, the second area CA2) narrowed from the current enlarged display target area (for example, the first area CA1) is displayed in the second through state. Displayed as image S2. If the number of face areas included in the enlarged image becomes one by designating the second position P2, the position of the second area CA2 is adjusted so as to maintain the enlarged display of the image including one face area. .

  However, when the specific object SF1 deviates from the first through image S1, that is, when the specific object SF1 deviates from the imaging region of the image sensor 53, or the shape of the specific object SF1 changes greatly, the detection unit 63 causes the specific object SF1. Is in a state where it cannot be specified, information to that effect is output to the control unit 30, and the control unit 30 ends the display of the second through image S2. Specifically, in the second and subsequent frame images, when the detection unit 63 cannot detect one face area (specific object SF1) or an area similar to the shape pattern of the specific object SF1, The control unit 30 ends the display of the second through image S2 on the assumption that the tracking of the specific object SF1 cannot be performed.

  Further, the control unit 30 controls the second through image S2 so that the second through image S2 does not overlap with the enlarged display target region (any one of the first to fourth regions CA1 to CA4) according to the movement of the first position P1. The position for displaying the through image S2 is adjusted. When the first area CA1 moves in accordance with the movement of the first position P1, the first area CA1 on the first through image S1 and the second through image S2 overlap, and the first area on the first through image S1. It may happen that CA1 is hidden under the second through image S2 and cannot be seen. For this reason, in the second embodiment, the control unit 30 divides the first through image S1 into four equal parts and further divides the first through image S1 into five areas (first to fifth areas AR1 to AR5) provided with one range at the center. The movement history of the first position P1 is recorded in correspondence with the area that has passed. For example, from the state where the first position P1 is in the third area AR3 (see FIG. 15), the first area CA1 moves and the first position P1 moves from the third area AR3 → the fifth area AR5 → the second area AR2. In this case, the second through image S2 is moved to the third area AR3 (see FIG. 16). When the first position P1 is in the third area AR3 (see FIG. 15) and the image moves and the first position P1 moves from the third area AR3 → the fourth area AR4 → the second area AR2, The second through image S2 is moved to the first area AR1 (not shown). In this way, the display location of the second through image S2 is moved to the optimum position from the history of movement of the first position P1. The movement history is recorded using a circular recording method such as a ring buffer, and the oldest information is rewritten to the latest information, and only some latest information is recorded.

  When the control unit 30 recognizes that the end key 10c is pressed while the second through image S2 is displayed and the detection unit 63 is detecting the specific object SF1 or the like, the second through image S2 is detected. Is terminated, and all processes of the detection work such as the detection unit 63 are initialized and terminated.

  Next, the procedure for enlarging and displaying the second through image S2 will be described with reference to the flowchart of FIG. When the power of the imaging apparatus 1 is turned on, in step S10, imaging by the imaging element 53, image processing by the DSP 60, and exposure calculation are performed, and the first through image S1 is displayed on the display unit 90 based on the image data. Is displayed. The display of the first through image S1 in step S10 is performed at regular intervals. However, the operation is interrupted until the release button 13 is fully pressed and the actual photographing is completed.

  In step S11, it is confirmed whether the end key 10c of the operation unit 10 has been pressed. Since the end will be described later, the process proceeds to step S12 in a situation where it is not pressed here.

  In step S <b> 12, the control unit 30 determines whether the first position P <b> 1 is designated by the operation unit 10. If no designation has been made, the process returns to step S10. If the first position P1 is designated, the process proceeds to step S13. In step S13, the control unit 30 selects a procedure to be performed next based on the situation in which the first position P1 is designated. Specifically, when the first position P1 is specified for the first time in a state in which the second through image S2 is not displayed, or in the state in which the second through image S2 has already been displayed, If a change to the location is made, the process proceeds to step S14. If the first position P1 has already been designated and has not been changed, the process proceeds to step S15. When the second position P2 is designated by the second through image S2, the process proceeds to step S16.

  In step S14, the detection unit 63 specifies the specific object SF1 in the first area CA1 centered on the first position P1. When one face area is detected in the first area CA1, the control unit 30 sets the detected face area as the specific object SF1, and sets the first position P1 as the center of the specific object SF1 (search origin P1a). Further, the first area CA1 is corrected so that the first position P1 is at the center. When a plurality of face areas are detected in the first area CA1, and when no face area can be detected, the control unit 30 sets the entire first area CA1 as the specific object SF1. At this time, the positions of the first position P1 and the first area CA1 are not corrected. Information on the first position P1 (search origin P1a), the size and position of the enlarged display target area (here, the first area CA1), and the specific target object SF1 is temporarily recorded in the control unit 30, and specified in the next frame image. It is used for specifying the object SF1 and adjusting the display position of the second through image S2.

  In step S15, the detection unit 63 determines the first position P1 (search origin P1a) derived in step S14 or the previous step S15 or step S16 and temporarily recorded in the control unit 30, information on the enlarged display target region, and the identification. Based on the information related to the object SF1, the specific object SF1 is identified, that is, the specific object SF1 is detected, or a region having a similar shape pattern of the specific object SF1 is detected.

Specifically, the detection unit 63 includes the first area CA1a centered on the first position P1 (search origin P1a) set in the previous detection and the surrounding area with the specific object SF1 set in the previous detection. A similar area (specific object SF1 ′) is searched. When the specific object SF1 ′ cannot be detected, the detection unit 63 outputs information indicating that the specific target object SF1 ′ to the control unit 30.
When the specific target object SF1 ′ is detected, the detection unit 63 outputs related information to the control unit 30, and the control unit 30 sets the specific target object SF1 ′ as a new specific target object SF1. Also, a new first position P1 (search origin P1b) and a new first area CA1 (CA1b) are set. In the next step S15, the first region CA1b centered on the first position P1 (search origin P1b) set in the current detection and its surroundings are similar to the specific object SF1 set in the current detection ( The specific object SF1 ′) is searched.

  In step S16, the control unit 30 specifies a position on the first through image S1 corresponding to the second position P2, and changes the first position P1 to the specified position. The control unit 30 changes the enlargement display target area to a position centered on the changed first position P1 and reduces the size by one (for example, changes from the first area CA1 to the second area CA2). To do. The detection unit 63 specifies the specific object SF1 in the new enlarged display target area that is set to be smaller by one. When one face area is detected in the second area CA1, the control unit 30 sets the detected face area as the specific object SF1, and sets the first position P1 to the center of the specific object SF1 (search origin P1a). Further, the second area CA2 is corrected so that the first position P1 is at the center. When a plurality of face areas are detected in the second area CA2 and when no face area can be detected, the control unit 30 sets the entire second area CA2 as the specific object SF1. At this time, the positions of the first position P1 and the second area CA2 are not corrected. Information on the first position P1 (search origin P1a), the size and position of the enlarged display target area (here, the second area CA2), and the specific target object SF1 is temporarily recorded in the control unit 30 and specified in the next frame image. It is used for specifying the object SF1 and adjusting the display position of the second through image S2.

  In step S <b> 17, the control unit 30 determines whether or not the specific object SF <b> 1 is specified based on the information output from the detection unit 63. If not, the process returns to step S10. In this case, information used to specify the specific object SF1 such as information on the designated first position P1 is erased (reset), that is, all processes related to specifying the specific object SF1 are initialized. . Further, when the outline frame of the enlarged display target area (any one of the first to fourth areas CA1 to CA4) on the first through image S1 or the second through image S2 is displayed, these displays are ended. . If the specific object SF1 has been specified, the process proceeds to step S18.

  In step S <b> 18, the control unit 30 temporarily stores the image data of the enlarged display target area based on the information output from the detection unit 63. In step S19, it is determined from the movement history of the first position P1 whether the position where the second through image S2 is currently displayed overlaps with the enlargement display target area. If it is determined that they overlap, in step S20, the position where the second through image S2 is displayed is changed to a position that does not overlap with the enlarged display target area. Further, when the second through image S2 is not displayed at the time of step S19, that is, when the second through image S2 is displayed first, the position at which the second through image S2 is displayed in step S20, Set to a position that does not overlap with the enlarged display target area. If it is determined that there is no overlap, the process proceeds to step S21. In step S21, the second through image S2 is displayed, and the process returns to step S10, and the display operation of the next first through image S1 is performed. By repeating steps S10 to S21 at regular intervals, the first through image S1 and the second through image S2 are repeatedly displayed at regular intervals. Thereby, the second through image S2 can also be displayed as a live view in the same manner as the first through image S1.

  The control unit 30 confirms that the end key is pressed in step S11 after performing step S10 for displaying the first through image S1. If pressed, if the second through image S2 is being displayed, the display is terminated and all the processes related to the display of the second through image S2 are initialized. Thereafter, the process returns to step S10, and the display operation of the first through image S1 is performed as it is.

  In the second embodiment, an image of a small area (enlarged display target area: first to fourth areas CA1 to CA4) is enlarged and displayed on the second through image S2 with respect to the entire first through image S1. The details of the image in the region can be easily visually confirmed. In addition, in order to track the specific object SF1 included in the enlarged display target area initially designated by the face recognition function or the like, the enlarged display target area is moved in accordance with the movement of the specific target object SF1, and the specific target object SF1 is moved. The enlarged display of the image including it can be maintained.

  For example, when taking a landscape photo, the first position P1 is designated near a portion of particular interest, and the entire subject is viewed while viewing the enlarged display image (second through image S2) of the enlarged display target region including the portion. It is possible to confirm the first through image S1 indicating When taking a group photo, the first position P1 is specified near the face of a person, the face of the person is specified as the specific object SF1, and the enlarged display target area including the face of the person is enlarged. While viewing the image (second through image S2), the first through image S1 showing the entire subject can be confirmed. Further, in macro photography, a first position P1 is specified near a portion of particular interest, and the first subject indicating the entire subject is viewed while viewing the enlarged display image (second through image S2) of the enlarged display target region including the portion. It is possible to confirm the through image S1. For example, when a flower is an object and it is desired to pay attention to the stamen, the first position P1 and the second position P2 are specified so that the stamen is specified as the specific object SF1 (see FIG. 18). Even if the stamens fluctuate due to wind or the like, the specific object SF1 is tracked, so that the enlarged display target area including the point of interest (specific object SF1) is stably enlarged and displayed as the second through image S2. I can do it. Further, when shooting a subject including many animals, the first position P1 is specified near a certain animal, the enlarged display target region including the animal is recognized as the specific target SF1, and the enlarged display of the animal (the first display) The first through image S1 showing the entire subject can be confirmed while viewing the 2 through image S2).

  Further, when the specific object SF1 is specified, since the approximate position is specified by the user's manual input, it is specified only by detecting the periphery (enlarged display target region) of the specified first position P1. The object SF1 can be specified. For this reason, compared with the form which specifies specific target object SF1 from the whole screen, it becomes possible to specify the target object which a user intends as specific target object SF1 with a short detection time.

  In the display of the second through image S2, there is a possibility that an area corresponding to the user's intention may not be displayed. For example, if the target specific object SF1 is a face and there are a plurality of faces around it, the intended face may not be specified as the specific object SF1. In the second embodiment, the detection unit 63 specifies an enlarged display target region (for example, the first region CA1) including a plurality of face regions as the specific object SF1, and the control unit 30 images the enlarged display target region. Is enlarged and displayed on the second through image S2. By specifying the position (second position P2) again on the second through image S2, it is possible to further narrow down and change the position of the enlarged display target area. As a result, it is possible to accurately enlarge and display a region in accordance with the user's intention.

  Specifically, when the second position P2 on the second through image S2 is designated using the operation unit 10, the control unit 30 sets the first position P1 on the first through image S1. Change to a location corresponding to 2 position P2. Thereafter, based on the changed first position P1, identification of the specific object SF1 by the detection unit 63, enlargement display by the control unit 30, and the like are performed. Considering step S13 in FIG. 17, when the second position P2 is designated on the already displayed second through image S2 by the operation unit 10, the process proceeds to step S16, and the enlargement display target area is reduced by one. The specific object SF1 is specified in the enlarged display target area that has been changed to the reduced area.

  There may also be a situation in which the designated first position P1 is changed without changing the size of the enlarged display target area. In the second embodiment, the position of the enlarged display target region is changed by designating the position (first position P1) again on the first through image S1. This makes it possible to newly designate a position away from the position already designated as the first position P1 as the first position P1.

  Specifically, when the first position P1 on the first through image S1 is designated using the operation unit 10, the control unit 30 changes the first position P1 to a newly designated location. To do. Thereafter, based on the changed first position P1, identification of the specific object SF1 by the detection unit 63, enlargement display by the control unit 30, and the like are performed. Considering step S13 in FIG. 17, when the first position P1 is designated on the first through image S1 already displayed by the operation unit 10, the process proceeds to step S14, and the position of the enlarged display target region is changed. Then, the specific object SF1 in the new enlarged display target area is specified.

  In the present embodiment, the imaging apparatus 1 is described as a digital camera. However, a digital video camera may be used.

It is a block diagram of the imaging device in 1st Embodiment. It is a figure which shows the display part of the state in which the 1st through image was displayed. It is a figure which shows the display part of the state which moves a cursor on a 1st through image and designates a 1st position. It is a figure which shows the positional relationship of the 1st position on a 1st through image, a 1st area | region, and a 2nd through image. It is a figure which shows the positional relationship of the 1st position on a 1st through image, a 1st area | region, a 2nd area | region, and a 2nd through image. It is a figure which shows the positional relationship of the 1st position on a 1st through image, a 2nd area | region, a 3rd area | region, and a 2nd through image. It is a figure which shows the positional relationship of the 1st position on a 1st through image, a 3rd area | region, a 4th area | region, and a 2nd through image. It is a block diagram of the imaging device in 2nd Embodiment. It is a figure which shows the 1st position before and behind correction | amendment on the 1st through image, and the 1st area | region before and after correction | amendment in the case of detecting one face area | region in the 1st detection. It is a figure which shows the 1st position before and behind correction | amendment on the 1st through image, and the 1st area | region before and behind correction | amendment on the 1st through image at the time of detecting one face area | region after a movement in the 2nd detection. It is a figure which shows the 1st position and 1st area | region on a 1st through image at the time of detecting a several face area | region in the 1st detection. It is a figure which shows the 1st position before and behind amendment on the 1st through picture, and the 1st field before and after amendment on the 1st through picture at the time of specifying the shape pattern containing a plurality of face areas after movement in the second detection. It is a figure which shows the positional relationship of the search range in the 1st area | region when detecting one face area | region, and the 2nd detection. It is a figure which shows the positional relationship of the search range in the 1st area | region and the 2nd detection when a several face area | region is detected. It is a figure which shows the positional relationship of the 1st-5th area, 1st area | region, and 2nd through image on a 1st through image. It is a figure which shows the positional relationship of the 1st-5th area on a 1st through image, a 1st area | region, and the 2nd through image before and behind a movement. It is a flowchart which shows the display procedure of a 2nd through image. It is a figure which shows the 1st through image and 2nd through image at the time of making a flower into a to-be-photographed object.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 10 Operation part 13 Release button 30 Control part 45 Lens drive part 47 Exposure control part 51 Lens 53 Image pick-up element 55 AFE
60 DSP
63 Detection unit 70 Recording unit 90 Display unit

Claims (8)

A display unit for displaying a first through image based on image data obtained by imaging;
An operation unit used for designating a first position on the first through image;
A control unit that causes the display unit to display a second through image obtained by enlarging an image of the enlarged display target region including the first position on a part of the first through image;
The operation unit is used to designate a second position on the second through image,
When the second position is designated, the control unit changes the first position to a position corresponding to the second position on the first through image, and the enlarged display target area is changed to the first display area. An image pickup apparatus, wherein the second through image is displayed in a state where the second display image is updated in accordance with a change in one position and the enlargement display target area is narrowed and the enlargement magnification is increased. A detection unit having a face detection function for detecting a face region in the image of the enlarged display target region;
The imaging apparatus according to claim 1, wherein the control unit displays an image of the enlarged display target region, the position of which is adjusted based on the detection result of the face region, as the second through image.   When the detection unit detects one face area, the control unit converts the image of the enlarged display target area whose position is adjusted so that the one face area is the center into the second through image. The image pickup apparatus according to claim 2, wherein the image pickup apparatus is displayed as. The detection unit tracks the one face area based on at least one of the binarization information and the luminance pattern and the face detection function,
The said control part displays the image of the said enlarged display object area | region where the position was adjusted based on the result of tracking the said one face area as said 2nd through image. Imaging device.   The said control part displays the image of the said enlarged display object area | region as a said 2nd through image, without changing a position, when the said detection part detects several face area | regions. The imaging device described in 1.   The control unit displays an image of the enlarged display target region as the second through image without changing the position when the detection unit does not detect a face region. The imaging device described in 1. The detection unit tracks the shape pattern of the image of the enlarged display target region based on at least one of the binarization information and the luminance pattern,
The said control part displays the image of the said enlarged display object area | region where the position was adjusted based on the result of tracking the said shape pattern as said 2nd through image, It is characterized by the above-mentioned. The imaging device described.   The imaging apparatus according to claim 1, wherein the control unit adjusts a position where the second through image is displayed in the first through image according to a position of the enlarged display target region.

Images