JP2009124565A - Imaging apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To appropriately perform the imaging of a subject by reducing the time to lose the sight of the subject. <P>SOLUTION: An imaging apparatus 100, which includes an imaging section 1 for continuously imaging the subject and generating a plurality of image frames including a main subject, comprises a CPU 71 which carries out processing for tracking the main subject between neighboring image frames in the plurality of image frames produced by the imaging section 1, processing for determining whether an instruction for setting a tracking mode for tracking the main subject is input or not, processing for setting the tracking mode in a case where it is determined that the setting instruction for the tracking mode is input, and processing for controlling image capturing of the subject by the imaging section 1 based on the main subject to be tracked after the tracking mode is set. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and a program for imaging a subject.

In a general digital still camera, a photometric value is obtained by average photometry, center-weighted photometry, etc., and automatic exposure control is performed using the obtained photometric value. When the automatic exposure control is finished, automatic focusing control is performed.
However, when a desired subject such as a person does not exist in the center of the shooting range, accurate automatic exposure control and automatic focusing control may not be performed. For this purpose, an object that detects an object such as a face and performs automatic exposure control (for example, see Patent Document 1), an object that performs automatic focusing control (for example, see Patent Document 2), automatic exposure control and automatic focusing There is one that performs both of the controls (for example, see Patent Document 3). Furthermore, there is also a technique for detecting a face by performing photographing a plurality of times while changing the exposure amount in order to ensure the detection of the face (for example, see Patent Document 4).
JP 2003-107555 A JP 2003-107335 A JP 2003-344891 A JP 2007-5966 A

  However, in the case of Patent Documents 1 to 4 and the like, the detection performance is guaranteed only to a certain angle from the “front face” to the “side face” of the person who is the subject. That is, for example, when a person is completely turned sideways, the face cannot be detected and the subject is lost ("lost" state). Also, for example, if the subject moves naturally without being conscious of the camera, the subject may turn down, turn up, or look deep in the eyes. Face detection fails.

With the recent improvement in face detection technology, the guaranteed values of the upper, lower, left and right angles of the face have improved year by year, so that even if the face is facing sideways, the face can be detected successfully. However, in the current situation, face detection cannot be performed properly if the face is completely turned sideways or turned downward.
As described above, when face detection fails, there is a problem that a desired subject is lost and the subject cannot be properly imaged.

  Therefore, an object of the present invention is to provide an imaging apparatus and a program that can reduce the time for losing sight of a subject and appropriately capture the subject.

The imaging device of the invention according to claim 1
Imaging means for continuously imaging a subject and generating a plurality of image frames including the main subject;
Main subject tracking means for tracking the main subject between adjacent image frames of the plurality of image frames generated by the imaging means;
Setting instruction determination means for determining whether or not a setting instruction for a tracking mode for tracking the main subject is input by the main subject tracking means;
Tracking mode setting means for setting the tracking mode when it is determined that the setting instruction for the tracking mode is input by the setting instruction determination means;
An imaging control unit configured to control imaging of the subject by the imaging unit based on the main subject tracked by the main subject tracking unit after being set to the tracking mode by the tracking mode setting unit;
It is characterized by having.

The invention according to claim 2 is the imaging apparatus according to claim 1,
Face detection means for detecting a face in the subject from the plurality of image frames generated by the imaging means;
A face detection mode setting means for setting a face detection mode for detecting a face by the face detection means,
The tracking mode setting means includes
A mode for switching from the face detection mode to the tracking mode when the setting instruction determining unit determines that the setting instruction for the tracking mode has been input in a state where the face detection mode is set by the face detection mode setting unit. It is characterized by comprising switching means.

The invention according to claim 3 is the imaging apparatus according to claim 2,
Comprising face detection determination means for determining whether a face detection state or a non-detection state according to a result of the face detection by the face detection means;
The main subject tracking unit is configured to track a face corresponding unit corresponding to the face as the main subject when the face detection determining unit determines that the face is detected.

The invention according to claim 4 is the imaging apparatus according to claim 2 or 3,
Face detection determination means for determining whether a face is detected or not detected according to a result of the face detection by the face detection means;
Focusing processing mode setting means for setting a focusing processing mode of automatic focusing processing for adjusting a focusing position of an imaging lens provided in the imaging means,
The main subject tracking means includes
When the face detection determination unit determines that the face is in a non-detection state, the imaging target in the in-focus location corresponding to the focus processing mode set by the focus processing mode setting unit is the main image. It is characterized by being tracked as a subject.

Invention of Claim 5 is an imaging device as described in any one of Claims 1-4,
Has a shutter button that can perform half-press and full-press operation,
The setting instruction determination unit determines that the tracking mode setting instruction is input based on the half-press operation of the shutter button.

Invention of Claim 6 is an imaging device as described in any one of Claims 2-4,
Face image registration means for registering a face image;
Face registration determination means for determining whether or not the face detected by the face detection means matches the face image registered in the face image registration means,
The setting instruction determination unit determines that the tracking mode setting instruction is input when the face registration determination unit determines that they match.

The program of the invention described in claim 7 is:
In an imaging apparatus comprising imaging means for continuously imaging a subject and generating a plurality of image frames including the main subject,
A function of tracking the main subject between adjacent image frames of the plurality of image frames generated by the imaging means;
A function of determining whether or not an instruction to set a tracking mode for tracking the main subject is input;
A function of setting the tracking mode when it is determined that an instruction to set the tracking mode is input;
A function of controlling imaging of the subject by the imaging means based on the main subject to be tracked after being set to the tracking mode;
It is characterized by realizing.

  According to the present invention, it is possible to reduce the time for which the main subject is chased for a longer time and lose sight of the main subject, and as a result, it is possible to appropriately control the image capturing and appropriately capture the subject.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
When an instruction to set a tracking mode for tracking the main subject in the subject is input by a predetermined operation, the imaging apparatus 100 according to the first embodiment sets the shooting mode to the tracking mode and tracks the main subject by moving body analysis. Based on the main subject tracked by the analysis, imaging control of the subject image is performed.
Specifically, for example, as illustrated in FIG. 1, the imaging apparatus 100 includes an imaging unit 1, an imaging auxiliary unit 2, a display unit 3, an operation unit 4, a recording medium 5, a USB terminal 6, and a control. The unit 7 is provided.

  The imaging unit 1, as an imaging unit, continuously captures a subject and generates a plurality of image frames G (see FIG. 2 and the like). Specifically, the imaging unit 1 includes an imaging lens group 11, an electronic imaging unit 12, a video signal processing unit 13, an image memory 14, a shooting control unit 15, and the like.

The imaging lens group 11 includes a plurality of imaging lenses.
The electronic imaging unit 12 includes a CCD (Charge Coupled Device) that converts a subject image that has passed through the imaging lens group 11 into a two-dimensional image signal, a CMOS (Complementary Metal-oxide Semiconductor), and the like.
The video signal processing unit 13 performs predetermined image processing on the image signal output from the electronic imaging unit 12.
The image memory 14 temporarily stores the image signal after image processing.

  The imaging control unit 15 controls the electronic imaging unit 12 and the video signal processing unit 13 under the control of the CPU 71. Specifically, the imaging control unit 15 causes the electronic imaging unit 12 to image a subject with a predetermined exposure time, and reads an image signal (image frame G) from the imaging area of the electronic imaging unit 12 at a predetermined frame rate. Control the execution of

  The imaging auxiliary unit 2 is driven when the subject is imaged by the imaging unit 1, and includes, for example, a focus driving unit 21, a zoom driving unit 22, a strobe light emitting unit 23, a strobe driving unit 24, and the like. .

The focus drive unit 21 drives a focus mechanism unit (not shown) connected to the imaging lens group 11.
The zoom drive unit 22 drives a zoom mechanism unit (not shown) connected to the imaging lens group 11.
The strobe driving unit 24 causes the strobe light emitting unit 23 to emit light.
The focus driving unit 21, zoom driving unit 22, and strobe driving unit 24 are connected to the shooting control unit 15 and are driven under the control of the shooting control unit 15.

  The display unit 3 displays an image captured by the imaging unit 1, and includes, for example, a display control unit 31, an image display unit 32, and the like.

  The display control unit 31 includes a video memory (not shown) that temporarily stores display data appropriately output from the CPU 71.

The image display unit 32 includes a liquid crystal monitor that displays a predetermined image such as an image (see FIG. 2 and the like) captured by the imaging unit 1 based on an output signal from the display control unit 31.
The image display unit 32 displays a face detection frame A1 (see FIG. 2 and the like) superimposed on the face image detected in the face detection process (described later). Specifically, for example, when imaging a person H wearing a soap bubble, the image display unit 32 moves the soap bubble creating instrument in a predetermined direction as shown in FIGS. A plurality of image frames G related to the state are sequentially displayed. At this time, if the face F is detected by the face detection process (see FIGS. 2 and 3), or if the face F is detected again after losing sight of the face corresponding part C in the main subject tracking process (described later). (See FIG. 6), the image display unit 32 displays a substantially rectangular face detection frame A1 superimposed on the face F.

Furthermore, the image display unit 32 displays the tracking frame A2 (see FIG. 4) so as to be superimposed on the main subject tracked in the main subject tracking process. Specifically, when the execution of the main subject tracking process is instructed based on the half-pressing operation of the shutter button 41a during the detection of the face F in the face detection process, the image display unit 32 performs the main subject tracking process. A substantially rectangular tracking frame A2 is displayed so as to be superimposed on the face corresponding portion C as the main subject to be tracked.
If the face corresponding unit C is lost while the face corresponding unit C is being tracked in the main subject tracking process, the image display unit 32 stops superimposing the tracking frame A2 on the captured image (see FIG. 5). ).

  Further, the image display unit 32 displays the AF area A4 (see FIG. 7) so as to be superimposed on the image captured by the imaging unit 1.

  Although the face detection frame A1 and the tracking frame A2 are illustrated as having a substantially rectangular shape, the frame shape is not limited to this, and any shape can be used as long as it can be associated with the face F or the main subject. It may be a shape. Further, the face detection frame A1 and the tracking frame A2 may be distinguished by changing the color instead of changing the line type.

  The operation unit 4 is for performing a predetermined operation of the imaging apparatus 100. For example, an operation input unit 41 including a shutter button 41a, a face detection mode setting button 41b, an AF mode setting button 41c, and the like, and an input circuit 42 Etc.

  The shutter button 41a instructs the imaging unit 1 to image the subject. The shutter button 41a is configured to be capable of two-stage pressing operation, for example, a half-pressing operation and a full-pressing operation, and outputs a predetermined operation signal corresponding to each operation stage. Specifically, the shutter button 41a outputs a tracking mode setting instruction for tracking the face F in the main subject tracking process when the shutter button 41a is pressed halfway by the user, and when the shutter button 41a is fully pressed by the user, An instruction to execute automatic focusing processing (AF), automatic exposure processing (AE), and imaging of the main image (recorded image) by the imaging unit 1 under the control of the control unit 7 is output.

The face detection mode setting button 41b is for setting the photographing mode to a face detection mode for detecting the face F in the face detection process. Specifically, when the user performs a predetermined operation on the face detection mode setting button 41b, a face detection mode setting instruction is output to the CPU 71 via the input circuit. When the setting instruction is input, the CPU 71 controls each unit to set the photographing mode to the face detection mode.
Here, the face detection mode setting button 41b and the CPU 71 function as face detection mode setting means.

The AF mode setting button 41c is for setting a focusing process mode of the automatic focusing process. Specifically, when the user operates the AF mode setting button 41c for a predetermined operation, for example, a “spot” (see FIG. 7) that performs AF at the approximate center of the angle of view, or an appropriate AF area from a plurality of AF areas is selected. When an AF mode such as “multi” which automatically detects and AF is selected, a setting instruction for the mode is output to the CPU 71 via the input circuit 42. When a setting instruction is input, the CPU 71 controls each unit to set a predetermined AF mode.
Here, the AF mode setting button 41c and the CPU 71 function as a focusing process mode setting unit.

  The input circuit 42 is for inputting the operation signal input from the operation input unit 41 to the CPU 71.

  The recording medium 5 is configured by, for example, a card-type nonvolatile memory (flash memory), a hard disk, or the like, and stores a plurality of image files G of images captured by the imaging unit 1.

  The USB terminal 6 is a terminal for connection with an external device, and transmits and receives data via a USB cable (not shown).

  The control unit 7 controls each unit of the imaging apparatus 100, and includes, for example, a CPU 71, a program memory 72, a data memory 73, and the like.

  The CPU 71 performs various control operations according to various processing programs for the imaging apparatus 100 stored in the program memory 72.

The data memory 73 is composed of, for example, a flash memory and temporarily stores data processed by the CPU 71.
Specifically, the data memory 73 stores the coordinates of the face F (face coordinates) acquired in the first coordinate acquisition process (described later) and the coordinates of the subject acquired in the second coordinate acquisition process (described later). (Main subject coordinates) is stored.

  The program memory 72 stores various programs and data necessary for the operation of the CPU 71. Specifically, the program memory 72 includes a face detection program 72a, a first coordinate acquisition program 72b, a setting instruction determination program 72c, a tracking mode setting program 72d, a face detection determination program 72e, a main subject tracking program 72f, and a second subject tracking program 72f. A coordinate acquisition program 72g, a focusing control program 72h, an exposure condition adjustment program 72i, an imaging control program 72j, and the like are stored.

The face detection program 72a causes the CPU 71 to function as face detection means. That is, the face detection program 72a is a program for causing the CPU 71 to realize a function related to execution of face detection processing for sequentially detecting the face F of the subject from each of the plurality of image frames G,... Generated by the imaging unit 1. is there.
Specifically, based on the execution of the face detection program 72a by the CPU 71, the face image search range R1 is set for one image frame G (for example, image frame G _n-1 ) among the plurality of image frames G,. The face image search frame A3 (see FIG. 8) is scanned as a whole image in a predetermined direction to identify feature portions (face parts) corresponding to eyes, nose, and b, and the face F is determined from the positional relationship of each face part. If the face F is determined, the search frame region is regarded as the face F. When the face F is detected in the predetermined image frame G, as shown in FIG. 9, the predetermined area near the detected face F in the next image frame G (for example, the image frame G _n ). Is detected as the face image search range R1.
When the face F is detected, the image display unit 32 displays the face detection frame A1 so as to be superimposed on the face F (see FIG. 2).

If the main subject is lost in the main subject tracking process (described later) and the face detection mode is set, the second coordinate acquisition process (described later) is performed based on the execution of the face detection program 72a by the CPU 71. The face is detected based on the coordinates of the main subject acquired by (see FIG. 6).
That is, when the main subject is lost in the main subject tracking process, the CPU 71 searches the face image search range R1 for a predetermined area near the main subject coordinates in the image frame G based on the main subject coordinates stored in the data memory 73. The face F is detected again.

The first coordinate acquisition program 72b causes the CPU 71 to function as first coordinate acquisition means. That is, the first coordinate acquisition program 72b is a program for causing the CPU 71 to realize a function related to the first coordinate acquisition process for acquiring the coordinates (face coordinates) of the face F detected in the face detection process.
Specifically, the CPU 71 executes the first coordinate acquisition program 72b, so that each corner of the face detection frame A1 displayed on the image display unit 32 is superimposed on the face F detected by the face detection process. The coordinates (x ₁ , y ₁ ), (x ₁ , y ₂ ), (x ₂ , y ₁ ), and (x ₂ , y ₂ ) are acquired (see FIG. 10).

The setting instruction determination program 72c causes the CPU 71 to function as setting instruction determination means. That is, the setting instruction determination program 72c is a program for causing the CPU 71 to realize a function related to a process for determining whether or not a tracking mode setting instruction for tracking a main subject is input in the main subject tracking process.
Specifically, the CPU 71 executes the setting instruction determination program 72c to determine whether or not the user has pressed the shutter button 41a halfway to input a tracking mode setting instruction (setting instruction determination process).

The tracking mode setting program 72d causes the CPU 71 to function as tracking mode setting means. That is, the tracking mode setting program 72d is a program for causing the CPU 71 to realize a function related to the processing for setting the tracking mode when it is determined in the setting instruction determination processing that the tracking mode setting instruction is input.
Specifically, the CPU 71 executes the tracking mode setting program 72d, and sets the face detection mode according to a predetermined operation of the face detection mode setting button 41b, based on a half-press operation of the shutter button 41a by the user. If it is determined in the setting instruction determination process that a tracking mode setting instruction has been input, a process of switching from the face detection mode to the tracking mode is performed. Here, the CPU 71 functions as mode switching means for switching from the face detection mode to the tracking mode.

  The face detection determination program 72e causes the CPU 71 to function as face detection determination means. That is, the CPU 71 executes the face detection determination program 72e to determine whether the face F is detected or not detected according to the result of the face detection process (face detection determination process).

The main subject tracking program 72f causes the CPU 71 to function as main subject tracking means. In other words, the main subject tracking program 72f is configured such that the adjacent image frames (for example, the image frame G _{n + m−1} (not shown) and the image frame G _{n + m} ) among the plurality of image frames G,. Thus, the CPU 71 is a program for causing the CPU 71 to realize a function related to the process of tracking the main subject by moving body analysis.
Specifically, when the CPU 71 executes the main subject tracking program 72f and determines that the face F is detected in the face detection determination process, the CPU 71 displays the face corresponding unit C corresponding to the face F. On the other hand, when it is determined that the face F is in the non-detected state as the main subject, the imaging target in the AF area (focused position) corresponding to the AF mode (for example, in the case of the spot AF mode, the angle of view) In the case of multi-AF, the imaging target in the AF area A4 at the substantially center of (2) is tracked as the main subject.

  The second coordinate acquisition program 72g causes the CPU 71 to function as second coordinate acquisition means. That is, the CPU 71 executes the second coordinate acquisition program 72g to acquire the coordinates of the main subject tracked in the main subject tracking process.

Here, the moving body analysis will be described in detail.
First, when the tracking mode is set, the CPU 71 determines whether the face F is detected or not detected in the face detection determination process by executing the face detection determination program 72e. When it is determined that the face F is detected, the CPU 71 executes the main subject tracking program 72f to acquire the face coordinates stored in the data memory 73 and is surrounded by the face coordinates. The imaging target (face corresponding part C) in the area is specified as the main subject. On the other hand, when it is determined that the face F is in the non-detected state, the imaging target in the AF area (focused position) corresponding to the AF mode is specified as the main subject.
Thereafter, using the image information such as luminance information and color information of the main subject as a template, the next image frame G (for example, image frame G _{n + m} ) is scanned in a predetermined moving object search range R2 near the face coordinates in a predetermined direction. The matching is performed, and the portion with the highest approximation is set as the main subject (see FIG. 11).
Then, the edge of the main subject determined to have the highest approximation is set as the tracking frame A2, and the coordinates (main subject coordinates) of each corner of the tracking frame A2 are based on the execution of the second coordinate acquisition program 72g by the CPU 71. ) Is updated, the face coordinates stored in the data memory 73 are updated with the main subject coordinates (second coordinate acquisition process). Furthermore, image information such as luminance information and color information of the main subject in the tracking frame A2 is updated as a template.
The template used for matching is updated by sequentially executing the above processing on each of the continuous image frames G,... Generated by the imaging unit 1. Therefore, even if the subject changes with time, it is possible to track the main subject (face corresponding part C or the like) as a moving object.

The focusing control program 72h is a program for causing the CPU 71 to realize a function related to the automatic focusing process for adjusting the focusing position of the imaging lens group 11 of the imaging unit 1.
Specifically, the CPU 71 executes the focusing control program 72h, so that the focusing of the imaging lens group 11 is performed using the face detection frame A1 and the tracking frame A2 as the AF area based on the half-pressing operation of the shutter button 41a by the user. The position is adjusted by moving the imaging lens group 11 in the optical axis direction by the focus driving unit 21.
Note that the focusing position of the imaging lens group 11 may be adjusted by moving the CCD or CMOS of the electronic imaging unit 12 in the optical axis direction.

  The exposure condition adjustment program 72i is based on the full pressing operation of the shutter button 41a by the user, and the exposure conditions (for example, shutter speed, aperture, etc.) at the time of imaging by the imaging unit 1 with the face detection frame A1 and the tracking frame A2 as the AE area. ) Is a program for causing the CPU 71 to realize a function related to automatic exposure (AE) processing.

  The imaging control program 72j causes the CPU 71 to function as imaging control means. That is, when the user presses the shutter button 41a fully at the time of imaging of the subject by the imaging unit 1, the imaging control program 72j is performed by the imaging unit 1 based on the main subject tracked by the main subject tracking process. This is a program for causing the CPU 71 to realize functions related to the subject imaging control process.

Next, imaging processing will be described with reference to FIG.
FIG. 12 is a flowchart illustrating an example of an operation related to the imaging process.
In the following imaging process, it is assumed that one person H is captured as an object at an angle of view. Further, it is assumed that a predetermined AF mode is selected and set in advance based on a predetermined operation of the AF mode setting button 41c by the user.

As shown in FIG. 12, when imaging of the subject by the imaging unit 1 is started, first, the CPU 71 executes a predetermined determination program (not shown) and based on a predetermined operation of the face detection mode setting button 41b by the user. Then, it is determined whether or not the shooting mode is set to the face detection mode (step S1).
Here, if it is determined that the face detection mode is set (step S1; YES), the CPU 71 executes the face detection program 72a in the program memory 72 to generate a plurality of images generated by the imaging unit 1. A face F is detected by scanning the face image search frame A3 using the face image search range R1 as a whole image for one image frame G (for example, image frame G _n-1 ; see FIG. 8) of the frames G,. An operation (face detection operation) is performed (step S2). When the face F is detected, the CPU 71 executes the first coordinate acquisition program 72b in the program memory 72 to acquire the coordinates (face coordinates) of the face F detected in the face detection process. It is recorded in the data memory 73. Further, the CPU 71 controls the image display unit 32 to display the face detection frame A1 superimposed on the face F.

When the face detection operation ends or when it is determined in step S1 that the face detection mode is not set (step S1; NO), the CPU 71 executes the setting instruction determination program 72c in the program memory 72. Then, it is determined whether or not the user has pressed the shutter button 41a halfway (step S3).
If it is determined that the shutter button 41a is half-pressed (step S3; YES), the CPU 71 determines that a tracking mode setting instruction has been input, and the tracking mode setting program in the program memory 72 is determined. After executing 72d and setting the shooting mode to the tracking mode (step S4), the face detection determination program 72e in the program memory 72 is executed to determine whether or not the face F is detected (step S5). ).
If it is determined in step S3 that the shutter button 41a is not half-pressed (step S3; NO), the process returns to step S1.

If it is determined in step S5 that the face F is detected (detected state) (step S5; YES), the CPU 71 executes the main subject tracking program 72f in the program memory 72 to cope with the face F. A process for tracking the face corresponding portion C to be performed as a main subject by moving body analysis is performed (step S6). Specifically, first, the CPU 71 acquires the face coordinates stored in the data memory 73, and specifies the imaging target (face corresponding part C) in the area surrounded by the face coordinates as the main subject. Subsequently, the CPU 71 scans in a predetermined direction within a predetermined moving object search range R2 near the face coordinates in the next image frame G using the image information such as luminance information and color information of the face corresponding unit C as a template, and performs matching. And the portion with the highest approximation is designated as the face corresponding portion C. Then, the CPU 71 controls the image display unit 32 to display the tracking frame A2 so as to be superimposed on the edge of the face corresponding unit C. Thereafter, the CPU 71 executes the second coordinate acquisition program 72g in the program memory 72 to acquire the coordinates (main subject coordinates) of each corner of the tracking frame A2, and then stores them in the data memory 73 using the main subject coordinates. Update the stored face coordinates. Furthermore, image information such as luminance information and color information of the face corresponding portion C in the tracking frame A2 is updated as a template.
The moving body analysis described above is sequentially performed on each of the continuous image frames G,... Generated by the imaging unit 1 to track the face corresponding unit C (main subject) as a moving body.

  On the other hand, if it is determined in step S5 that the face F is not detected (non-detected state) (step S5; NO), the CPU 71 executes the main subject tracking program 72f in the program memory 72 to perform AF. An imaging target in the area (for example, in the spot AF mode, an imaging target in the AF area A4 at the approximate center of the angle of view) is specified as the main subject and is tracked by moving body analysis (step S7). The tracking process based on the moving object analysis of the imaging target in the AF area is almost the same as that of the face corresponding unit C described above, and a detailed description thereof is omitted.

  Next, the CPU 71 executes a predetermined determination program (not shown) to determine whether or not the main subject (face corresponding part C or the like) is being tracked (step S8). Here, if it is determined that the main subject is being tracked (step S8; YES), the CPU 71 executes a predetermined determination program (not shown), and whether or not the shutter button 41a is fully pressed by the user. Is determined (step S9).

If it is determined in step S9 that the shutter button 41a is fully pressed (step S9; YES), the CPU 71 executes the focusing control program 72h in the program memory 72, and sets the tracking frame A2 to AF. The automatic focusing process is performed as an area, and the exposure condition adjustment program 72i in the program memory 72 is executed to perform the automatic exposure process with the tracking frame A2 as the AE area (step S10).
Subsequently, the CPU 71 executes the imaging control program 72j in the program memory 72, and controls the execution of imaging processing that causes the imaging unit 1 to capture the main image (recorded image) (step S11).

On the other hand, if it is determined in step S9 that the shutter button 41a has not been fully pressed (step S9; NO), the CPU 71 executes a predetermined determination program (not shown), and the user presses the shutter button 41a halfway. It is determined whether or not the pressing operation has been released (step S12).
If it is determined that the half-press operation has been released (step S12; YES), the process returns to step S8. On the other hand, if it is determined that the half-press operation has not been released (step S12; NO) ), The process returns to step S1.
If it is determined in step S8 that the main subject has not been tracked (step S8; NO), the process returns to step S1.

As described above, according to the imaging apparatus 100 of the first embodiment, it is determined whether a tracking mode setting instruction for tracking a main subject in a subject is input, and it is determined that a tracking mode setting instruction is input. In this case, the shooting mode can be set to the tracking mode.
Here, even when the shooting mode is set to the face detection mode, if the tracking mode setting instruction is input, the shooting mode is switched from the face detection mode to the tracking mode. Can be done. Further, since it is determined whether or not a tracking mode setting instruction has been input based on whether or not the shutter button 41a is half-pressed, the user can easily set the tracking mode only by half-pressing the shutter button 41a. Can do. In particular, when the shooting mode is set to the face detection mode, the shooting mode can be easily set by switching from the face detection mode to the tracking mode only by half-pressing the shutter button 41a.
As a result, the user sets the face detected by the face detection process as the main subject, and chases it by moving body analysis, so even if the main subject faces sideways or down and the face is hidden, the face is chased for a longer time. As a result, it is possible to reduce the time for losing sight of the main subject. It is possible to appropriately capture the subject by appropriately performing the imaging control. Specifically, when the face F is in the detection state when the shutter button is half-pressed, the face corresponding unit C corresponding to the face F can be tracked as the main subject. The subject can be properly imaged. On the other hand, when the face F is not detected when the shutter button is half-pressed, the imaging target in the AF area corresponding to the AF mode can be tracked as the main subject. The subject can be appropriately imaged on the imaging target.

  In the first embodiment, it is determined whether or not to switch to the tracking mode only by whether or not the user presses the shutter button 41a halfway. However, the present invention is not limited to this. When the mode is set to the face detection mode, the mode is switched to the tracking mode only when it is determined that the face F is detected after the user half-presses the shutter button 41a (step S5; YES). The face corresponding part C may be tracked as a main subject. That is, for example, when a landscape photograph as shown in FIG. 7 is taken, the subject to be photographed does not move so as to deviate greatly within the angle of view, and therefore it is not always necessary to switch to the tracking mode when the face F is not detected. .

  Furthermore, in the first embodiment, since the tracking mode is set after the shutter button 41a is half-pressed, after that, NO is determined in step S1 and face detection is not performed. Since the face F, which is the main subject, is hidden behind the obstacle or moved to a dark place at a moment, the face F may be temporarily lost. If the face F is detected in the face detection process, the main subject may be switched to the face corresponding unit C. Thereby, the possibility that the face corresponding part C is set as a tracking target can be further increased.

[Embodiment 2]
Below, the imaging device 200 of Embodiment 2 is demonstrated with reference to FIGS.
Here, FIG. 13 is a block diagram illustrating a schematic configuration of the imaging apparatus 200 according to the second embodiment to which the present invention is applied. FIG. 14 is a diagram illustrating an example of the face image registration table T.
The imaging apparatus 200 according to the second embodiment is substantially the same as the first embodiment except for the configuration related to the input determination of the tracking mode setting instruction. Description is omitted.

As illustrated in FIGS. 13 and 14, in the imaging apparatus 200 according to the second embodiment, the face F detected in the face detection process matches the face image registered in the face image registration table T (see FIG. 14). A face registration determination process is performed, and when it is determined that the detected face F matches the face image registered in the face image registration table T as a result of the determination, a tracking mode setting instruction A setting instruction determination process is performed to determine that is input.
That is, the program memory 72 includes a face detection program 72a, a first coordinate acquisition program 72b, a setting instruction determination program 72c, a tracking mode setting program 72d, a face detection determination program 72e, a main subject tracking program 72f, and a second coordinate acquisition. In addition to the program 72g, the focusing control program 72h, the exposure condition adjustment program 72i, and the imaging control program 72j, a face registration determination program 72k and a face image registration table T (see FIG. 14) are stored.

  The face registration determination program 72k causes the CPU 71 to function as face registration determination means. That is, whether the face registration determination program 72k matches the face image registered in the face image registration table T with the face F detected by the face detection process by referring to the face image registration table T It is a program for causing the CPU 71 to realize a function related to face registration determination processing for determining whether or not. As a result of the determination, if it is determined that they match, the CPU 71 recognizes the person of the face F detected by the face detection process.

Here, the face image registration table T registers face images as face image registration means. Specifically, as shown in FIG. 14, the face image registration table T registers a group name, a registered name, a priority, and face image data in association with each other in order. For example, the registration number 1 will be described as an example. The group name “family”, the registration name “mother”, tracking priority “1” by moving body analysis, and face image data “N0001.JPG” are associated with each other. ing. Similarly, the registration number 2 is associated with the group name “family”, the registration name “A-chan”, the priority “1”, and the face image data “N0002.JPG”. The group name “family”, the registered name “dad”, the priority “3”, and the face image data “N0003.JPG” are associated with each other, and the registration number 4 is the group name “friend” and the registered name. “Mr. B”, priority “2”, and face image data “N0004.JPG” are associated with each other, and the registration number 5 is a group name “friend”, a registered name “Mr. C”, and a priority. “1” is associated with face image data “N0005.JPG”, and the registration number 6 is a group name “friend”, a registered name “D”, a priority “2”, and face image data. “N0006.JPG” is associated.
Note that the face image registration table T illustrated in FIG. 14 is an example and is not limited to this. The group name, registration name, priority, and contents of the face image data and the like are arbitrarily changed as appropriate. be able to.

  Then, the CPU 71 executes the setting instruction determination program 72c to determine whether or not the tracking mode setting instruction is input, so that the face F detected in the face detection process is registered in the face image registration table T. If it is determined that the face image matches the detected face image, that is, if the person of the face F detected in the face detection process is recognized, a process for determining that a tracking mode setting instruction is input is performed.

Next, imaging processing will be described with reference to FIG. 15. Here, FIG. 15 is a flowchart illustrating an example of operation related to imaging processing.

  As shown in FIG. 15, when imaging of the subject by the imaging unit 1 is started, the CPU 71 determines whether or not the imaging mode is set to the face detection mode, as in the imaging process of the first embodiment ( If it is determined in step S1) that the face detection mode is set (step S1; YES), the CPU 71 executes the face detection program 72a in the program memory 72 to detect the face F (face detection). Operation) (step S2). When the face F is detected, the CPU 71 executes the first coordinate acquisition program 72b in the program memory 72 to acquire the coordinates (face coordinates) of the face F detected in the face detection process. The data is recorded in the data memory 73, and the image display unit 32 is controlled to superimpose on the face F to display the face detection frame A1.

When the face detection operation ends or when it is determined in step S1 that the face detection mode is not set (step S1; NO), the CPU 71 executes the face registration determination program 72k in the program memory 72. Then, it is determined whether or not the face F detected by the face detection process matches the face image registered in the face image registration table T, and a person registered in the face image registration table T is detected. It is determined whether or not it has been done (step S23).
Here, it is determined that the face F detected in the face detection process matches the face image registered in the face image registration table T, that is, a person registered in the face image registration table T is detected. If so (step S23; YES), the CPU 71 determines that the tracking mode setting instruction has been input, executes the tracking mode setting program 72d in the program memory 72, and sets the shooting mode to the tracking mode ( Step S4).
If it is determined in step S23 that no person registered in the face image registration table T has been detected (step S23; NO), the process returns to step S1.

  Subsequently, the CPU 71 executes the main subject tracking program 72f in the program memory 72, and performs a process of tracking the face corresponding unit C corresponding to the detected face F as a main subject by moving body analysis (step S6). Here, a plurality of faces F are detected in the face detection process in step S1, and a plurality of persons (for example, “A” and “dad”) are registered in the face image registration table T in step S23. If it is determined that the face image registered in the face image registration table T has the highest priority (for example, the face of “A”) as a tracking target (main subject) by moving body analysis. You may make it do.

Thereafter, as in the imaging process of the first embodiment, the CPU 71 determines whether or not the main subject is being tracked (step S8), and determines whether or not the shutter button 41a is fully pressed (step S9). The automatic focusing process using the tracking frame A2 as the AF area, the automatic exposure process using the tracking frame A2 as the AE area (step S10), and the imaging process of the main image (step S11) are controlled.
If it is determined in step S9 that the shutter button 41a is not fully depressed (step S9; NO), the process returns to step S6.

  As described above, according to the imaging apparatus 200 of the second embodiment, the face registration for determining whether the face F detected by the face detection process matches the face image registered in the face image registration table T. When it is determined that the face F detected in the face registration determination process matches the face image registered in the face image registration table T, the tracking mode setting instruction is input. Since the determination is made, the tracking mode can be easily set without requiring a special operation such as a half-press operation of the shutter button 41a by the user.

  In the second embodiment, the automatic focusing process, the automatic exposure process, and the main image are processed based on the fact that the user fully presses the shutter button 41a while the face corresponding part C is being tracked. Although the imaging process is performed, the present invention is not limited to this, and the automatic focusing process and the automatic exposure process are performed by half-pressing the shutter button 41a, and the imaging process of the main image is performed by the subsequent full-pressing operation. Anyway.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the first and second embodiments, the shooting mode is switched from the state set to the face detection mode to the tracking mode. However, the shooting mode before switching to the tracking mode is limited to the face detection mode. It is not a thing. That is, even in a state in which one of the shooting modes is set, it is only necessary that the tracking mode is set based on the input of the tracking mode setting instruction, and the face detection mode is necessarily provided. There is no.

  In addition, in the first embodiment, whether or not the tracking mode setting instruction is input is determined based on the presence or absence of the half-press operation of the shutter button 41a. The determination is made based on whether or not the registered face and the face image registered in the face image registration table T match each other. Is not limited to this.

  Furthermore, the configurations of the imaging apparatuses 100 and 200 are merely examples as illustrated in the above-described embodiment, and are not limited thereto.

  In addition, in the above embodiment, main subject tracking means, setting instruction determination means, tracking mode setting means, imaging control means, face detection means, face detection mode setting means, mode switching means, face detection determination means, focus processing mode The functions as the setting unit and the face registration determination unit are realized by executing a predetermined program or the like by the CPU 71. However, the present invention is not limited to this. For example, logic for realizing various functions You may comprise from a circuit etc.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure which shows typically an example of the image displayed on the display part of the imaging device of FIG. It is a figure for demonstrating the face detection process by the imaging device of FIG. It is a figure for demonstrating the face detection process by the imaging device of FIG. It is a figure for demonstrating the 1st coordinate acquisition process by the imaging device of FIG. It is a figure for demonstrating the main subject tracking process by the imaging device of FIG. 3 is a flowchart illustrating an example of an operation related to an imaging process by the imaging apparatus of FIG. 1. It is a block diagram which shows schematic structure of the imaging device of Embodiment 2 to which this invention is applied. It is a figure which shows an example of the face image registration table recorded on the imaging device of FIG. 14 is a flowchart illustrating an example of an operation related to an imaging process by the imaging device of FIG. 13.

Explanation of symbols

100 Imaging device 1 Imaging unit (imaging means)
3 Display 41a Shutter button (face detection mode setting means, focusing processing mode setting means)
71 CPU (main subject tracking means, setting instruction determination means, tracking mode setting means, imaging control means, face detection means, face detection mode setting means, mode switching means, face detection determination means, focus processing mode setting means, face registration Judgment means)
A1 Face detection frame A2 Tracking frame C Face correspondence part F Face T Face image registration table (face image registration means)

Claims (7)

Imaging means for continuously imaging a subject and generating a plurality of image frames including the main subject;
Main subject tracking means for tracking the main subject between adjacent image frames of the plurality of image frames generated by the imaging means;
Setting instruction determination means for determining whether or not a setting instruction for a tracking mode for tracking the main subject is input by the main subject tracking means;
Tracking mode setting means for setting the tracking mode when it is determined that the setting instruction for the tracking mode is input by the setting instruction determination means;
An imaging control unit configured to control imaging of the subject by the imaging unit based on the main subject tracked by the main subject tracking unit after being set to the tracking mode by the tracking mode setting unit;
An imaging apparatus comprising: Face detection means for detecting a face in the subject from the plurality of image frames generated by the imaging means;
A face detection mode setting means for setting a face detection mode for detecting a face by the face detection means,
The tracking mode setting means includes
A mode for switching from the face detection mode to the tracking mode when the setting instruction determining unit determines that the setting instruction for the tracking mode has been input in a state where the face detection mode is set by the face detection mode setting unit. The imaging apparatus according to claim 1, further comprising a switching unit. Comprising face detection determination means for determining whether a face detection state or a non-detection state according to a result of the face detection by the face detection means;
3. The main subject tracking unit tracks a face corresponding unit corresponding to the face as the main subject when the face detection determining unit determines that the face is detected. The imaging device described. Face detection determination means for determining whether a face is detected or not detected according to a result of the face detection by the face detection means;
Focusing processing mode setting means for setting a focusing processing mode of automatic focusing processing for adjusting a focusing position of an imaging lens provided in the imaging means,
The main subject tracking means includes
When the face detection determination unit determines that the face is in a non-detection state, the imaging target in the in-focus location corresponding to the focus processing mode set by the focus processing mode setting unit is the main image. The imaging apparatus according to claim 2, wherein the imaging apparatus is tracked as a subject. Has a shutter button that can perform half-press and full-press operation,
5. The imaging according to claim 1, wherein the setting instruction determination unit determines that the setting instruction for the tracking mode is input based on the half-press operation of the shutter button. apparatus. Face image registration means for registering a face image;
Face registration determination means for determining whether or not the face detected by the face detection means matches the face image registered in the face image registration means,
The said setting instruction | indication determination means determines with the setting instruction | indication of the said tracking mode being input, when it determines with the said face registration determination means being in agreement, The Claims 2-4 characterized by the above-mentioned. Imaging device. In an imaging apparatus comprising imaging means for continuously imaging a subject and generating a plurality of image frames including the main subject,
A function of tracking the main subject between adjacent image frames of the plurality of image frames generated by the imaging means;
A function of determining whether or not an instruction to set a tracking mode for tracking the main subject is input;
A function of setting the tracking mode when it is determined that an instruction to set the tracking mode is input;
A function of controlling imaging of the subject by the imaging means based on the main subject to be tracked after being set to the tracking mode;
A program characterized by realizing.

Images