JP5447579B2 - Tracking device, focus adjustment device, and photographing device - Google Patents

Description

The present invention relates to a tracking device , a focus adjustment device, and an imaging device.

An image tracking device that stores an image to be focused as a reference image (template image), detects an image that matches the reference image from images repeatedly shot by template matching processing, and tracks the target is known. (For example, refer to Patent Document 1).
Prior art documents related to the invention of this application include the following.

JP 2006-058431 A

  However, when the background of the target to be focused is similar to the target color information, other parts such as a background different from the target may be mistakenly mistaken.

A tracking device according to a first aspect of the present invention includes an imaging unit that captures a first image at a first time and captures a second image at a second time after the first time, and a tracking target among the first images. By calculating a correlation between a storage unit that stores reference information corresponding to a part of the image to be obtained, the reference information stored by the storage unit, and a partial image included in a predetermined range of the second image A tracking calculation unit that performs a calculation for tracking the tracking target; and a determination unit that determines a position of the tracking target based on a calculation result of the tracking calculation unit. The calculation is performed so that the correlation with the reference information is higher when the partial image is closer to the focus detection area than when the partial image is far from the focus detection area.
According to a third aspect of the present invention, there is provided a focus adjustment device that captures a first image at a first time and captures a second image at a second time after the first time, and a tracking of the first image. Calculating a correlation between a storage unit that stores reference information corresponding to a part of the target image, the reference information stored by the storage unit, and a partial image included in a predetermined range of the second image; Are set in the screen by the imaging optical system, a tracking calculation unit that performs calculation for tracking the tracking target, a determination unit that determines the position of the tracking target based on the calculation result of the tracking calculation unit A focus detection unit that detects a focus adjustment state of the imaging optical system with respect to a plurality of focus detection positions; a position of the tracking target determined by the determination unit; and a focus adjustment state detected by the focus detection unit; Based on the plurality of focal points A selection unit that selects at least one focus detection position from the output positions, and a focus that performs focus adjustment control of the imaging optical system based on a focus adjustment state of the focus detection position selected by the selection unit An adjustment control unit, wherein the tracking calculation unit has a higher correlation with the reference information when the partial image is in the center of the predetermined range than when the partial image is in the vicinity of the predetermined range. It is characterized in that the operation is performed .
According to a fifth aspect of the present invention, there is provided a focus adjustment device that captures a first image at a first time, captures a second image at a second time after the first time, and tracks the first image. Calculating a correlation between a storage unit that stores reference information corresponding to a part of the target image, the reference information stored by the storage unit, and a partial image included in a predetermined range of the second image; Are set in the screen by the imaging optical system, a tracking calculation unit that performs calculation for tracking the tracking target, a determination unit that determines the position of the tracking target based on the calculation result of the tracking calculation unit A focus detection unit that detects a focus adjustment state of the imaging optical system with respect to a plurality of focus detection positions; a position of the tracking target determined by the determination unit; and a focus adjustment state detected by the focus detection unit; Based on the plurality of focal points A selection unit that selects at least one focus detection position from the output positions, and a focus that performs focus adjustment control of the imaging optical system based on a focus adjustment state of the focus detection position selected by the selection unit The tracking control unit has a higher correlation with the reference information when the partial image is in the center of the second image than when the partial image is not in the center of the second image. The calculation is performed so that
According to a seventh aspect of the present invention, there is provided a photographing apparatus including the focus adjustment apparatus according to any one of the second to sixth aspects .

  According to the present invention, it is possible to make it difficult to erroneously recognize backgrounds other than the target.

1 is a diagram illustrating a configuration of an imaging device including an image recognition device according to an embodiment. The figure which shows the detailed structure of a body drive control apparatus Front view showing a detailed configuration of the second image sensor Detailed view of pixels of second image sensor Diagram showing the arrangement of focus detection areas in the shooting screen The figure explaining the subject tracking method of one embodiment The figure explaining the subject tracking method of one embodiment Flowchart showing subject tracking operation of one embodiment The flowchart which shows the initial processing of the tracking control of one embodiment The flowchart which shows the tracking calculation processing of one embodiment

  The focus adjustment state of the photographic lens (in this embodiment, the defocus amount) is detected in a plurality of focus detection areas set in the photographic screen, and the photographic lens is focused based on the defocus amount in one of the areas. The automatic focus adjustment (AF) function to be driven and the image of the subject to be tracked in the photographed image are stored as a template image (reference image). An image pickup apparatus (single-lens) having an image tracking function for tracking a subject to be tracked while searching for a position (template matching) and tracking an object while driving a photographing lens with an AF function and an image tracking function An embodiment of a reflex digital still camera will be described.

  FIG. 1 shows a configuration of an imaging apparatus (single-lens reflex digital still camera) 1 including an image recognition apparatus according to an embodiment. In FIG. 1, illustration and description of camera devices and circuits not directly related to the present invention are omitted. In a camera 1 according to an embodiment, an interchangeable lens 3 is attached to a camera body 2 in a replaceable manner. The camera body 2 is provided with a first image sensor 4 for capturing a subject image and recording the image. The first image sensor 4 can be constituted by a CCD, a CMOS, or the like. At the time of photographing, the quick return mirror 5 and the sub mirror 6 are retracted to a position outside the photographing optical path indicated by a solid line, the shutter 7 is opened, and a subject image is formed on the light receiving surface of the first image sensor 4 by the photographing lens 8.

  At the bottom of the camera body 2, a focus detection optical system 9 and a distance measuring element 10 for detecting the focus adjustment state of the photographing lens 8 are provided. In this embodiment, an example is shown in which a focus detection method based on a pupil division type phase difference detection method is employed. The focus detection optical system 9 guides the pair of focus detection light fluxes that have passed through the photographing lens 8 to the light receiving surface of the distance measuring element 10 and forms a pair of optical images. The distance measuring element 10 includes, for example, a pair of CCD line sensors, and outputs a focus detection signal corresponding to the pair of optical images. Before shooting, the quick return mirror 5 and the sub mirror 6 are set at positions in the shooting optical path as indicated by broken lines, and the pair of focus detection light beams from the shooting lens 8 are transmitted through the half mirror portion of the quick return mirror 5. Then, the light is reflected by the sub mirror 6 and guided to the focus detection optical system 9 and the distance measuring element 10.

  A finder optical system is provided on the upper part of the camera body 2. Before shooting, the quick return mirror 5 and the sub mirror 6 are in positions indicated by broken lines, and subject light from the shooting lens 8 is reflected by the quick return mirror 5 and guided to the focusing screen 11, and the subject image is displayed on the focusing screen 11. Form an image. The liquid crystal display element 12 superimposes and displays information such as a focus detection area mark on the subject image formed on the focusing screen 11 and displays various photographing information such as an exposure value at a position outside the subject image. The subject image on the focusing screen 11 is guided to the eyepiece window 15 via the penta roof prism 13 and the eyepiece lens 14 so that the photographer can visually recognize the subject image.

The finder optical system at the top of the camera body 2 is provided with a second image sensor 16 that captures a subject image for subject tracking and photometry. The subject image formed on the focusing screen 11 is re-imaged on the light receiving surface of the second image sensor 16 via the penta roof prism 13, the prism 17 and the imaging lens 18. The second image sensor 16 outputs an image signal corresponding to the subject image. The subject image formed on the focusing screen 11 before photographing is guided to the second image sensor 16 via the penta roof prism 13, the prism 17 and the imaging lens 18, and the subject image is formed on the light receiving surface of the second image sensor 16. Is re-imaged. As will be described in detail later, tracking control and exposure calculation are performed based on the subject image captured by the second image sensor 16.

  The camera body 2 is also provided with a body drive control device 19 and an operation member 20. The body drive control device 19 is constituted by peripheral components such as a microcomputer, a memory, and an A / D converter, the details of which will be described later, and performs various controls and calculations of the camera 1. The operation member 20 includes a switch and a selector for operating the camera 1 such as a shutter button, a focus detection area selection switch, and a shooting mode selection switch.

  The interchangeable lens 3 is provided with a zooming lens 8a, a focusing lens 8b, a diaphragm 21, a lens drive control device 22, and the like. In this embodiment, the photographic lens 8 is represented by a zoom lens 8a, a focusing lens 8b, and a diaphragm 21, but the configuration of the photographic lens 8 is not limited to the configuration shown in FIG. The lens drive control device 22 includes a microcomputer (not shown) and peripheral components such as a memory, a drive circuit, and an actuator, and performs drive control of the lenses 8a and 8b and the diaphragm 21 and detection of their set positions. Information such as a focal length and an open aperture value of the interchangeable lens 3 is stored in a memory built in the lens drive control device 22.

  The body drive control device 19 and the lens drive control device 22 communicate via the contact 23 of the lens mount, and transmit information such as a lens drive amount and an aperture value from the body drive control device 19 to the lens drive control device 22. Lens information and aperture information are transmitted from the lens drive control device 22 to the body drive control device 19.

  FIG. 2 shows a detailed configuration of the body drive control device 19. Note that illustration and description of control functions not directly related to the present invention are omitted. The body drive control device 19 includes an element control circuit 19a, an A / D converter 19b, a microcomputer 19c, a memory 19d, and the like. The element control circuit 19 a controls charge accumulation and reading of the second image sensor 16. The A / D converter 19b converts the analog image signal output from the second image sensor 16 into a digital image signal. The microcomputer 19c constitutes a tracking control unit 19e, an exposure control unit 19f, a focus detection calculation unit 19g, and a lens drive amount calculation unit 19h according to a software form. The memory 19d stores information such as a template image for image tracking and a defocus amount, or lens information such as a focal length, an open F value, an aperture value, and a conversion coefficient from an image shift amount to a defocus amount. To do.

The tracking control unit 19e generates a template image (reference image) of the subject image captured by the second image sensor 16 and corresponding to the tracking target position manually specified by the photographer or the tracking target position automatically set by the camera 1. Image) is stored in the memory 19d, and the position of the target is recognized by searching for an image area that matches or is similar to the template image from images repeatedly photographed thereafter. The exposure calculation unit 19f calculates an exposure value based on the image signal captured by the second image sensor 16.

The focus detection calculation unit 19g detects the focus adjustment state of the photographing lens 8, here the defocus amount, based on the focus detection signal corresponding to the pair of optical images output from the distance measuring element 10. Although details will be described later, a plurality of focus detection areas are set in the shooting screen of the shooting lens 8, and the distance measuring element 10 outputs a focus detection signal corresponding to a pair of optical images for each focus detection area. Then, the focus detection calculation unit 19g detects the defocus amount based on the focus detection signal corresponding to the pair of optical images for each focus detection area. The lens driving amount calculation unit 19h converts the detected defocus amount into a lens driving amount.

  FIG. 3 is a front view showing a detailed configuration of the second image sensor 16. The second imaging element 16 includes a plurality of pixels (photoelectric conversion elements) 26 (here, horizontal 16 × vertical 12 = 192) arranged in a matrix. As shown in FIG. 4, each pixel 26 is divided into three portions 26a, 26b, and 26c, and primary color filters of red R, green G, and blue B are provided in these portions 26a, 26b, and 26c, respectively. . Thereby, the RGB signal of the subject image can be output for each pixel 26.

  Next, a subject tracking operation according to an embodiment will be described. 5 to 7 are diagrams for explaining a subject tracking method according to the embodiment, and FIGS. 8 to 10 are flowcharts illustrating subject tracking processing according to the embodiment. The quick return mirror 5 is set in the photographing optical path shown by the broken line in FIG. 1 except when the shutter button is fully pressed to shoot, and the subject light incident from the photographing lens 8 forms an image on the focusing screen 11. Is done. The subject image on the focusing screen 11 is guided to the second image sensor 16 via the penta roof prism 13, the prism 17 and the imaging lens 18, and the subject image signal is repeatedly output from the second image sensor 16.

  A plurality of focus detection areas are set on the shooting screen of the shooting lens 8, and an area mark is superimposed on the subject image on the focusing screen 11 by the liquid crystal display element 12 to display the position of each focus detection area. In this embodiment, as shown in FIG. 5, an example is shown in which focus detection areas 45a to 45g are set at seven locations in the shooting screen. When an arbitrary area is selected by the focus detection area selection switch of the operation member 20, the mark of the area is lit up.

  As shown in FIG. 5, when the focus detection area 45b is selected by the focus detection area selection switch of the operation member 20, and the shutter button of the operation member 20 is half-pressed in this state, the focus detection area 45b is stored as the first AF area. 19d. Thereby, a tracking symmetrical subject is designated. In this example, the photographer selects the first AF area and manually specifies the subject to be tracked. However, for example, in a camera having a function of automatically recognizing a subject, the first time is determined based on the subject recognition result. An AF area and a tracking target subject may be set.

In step 1, an initial tracking image (an image acquired first after starting the image tracking process) is acquired by the second image sensor 16. This initial tracking image is represented by RGB values for each pixel.
R [x, y], G [x, y], B [x, y] (1)
Based on the RGB values for each pixel, the luminance information L is calculated from the color information RG and BG of each pixel, the exposure time T when the image is acquired, the gain Gain, and the color synthesis coefficients Kr, Kg, and Kb.
RG [x, y] = Log ₂ (R [x, y]) − Log ₂ (G [x, y]),
BG [x, y] = Log ₂ (B [x, y]) − Log ₂ (G [x, y]),
L [x, y] = Log ₂ (Kr × R [x, y] + Kg × G [x, y] + Kb × B [x, y]) − Log ₂ (T) −Log ₂ (Gain) (2)

  In the subsequent step 2, the tracking control initial process shown in FIG. 9 is executed. In step 101 of FIG. 9, an image at a position corresponding to the position of the focus detection area 45b in the tracking initial image acquired by the second image sensor 16 is stored as subject color information. In step 102, as shown in FIG. 6A, the same color information area showing the same color information as the subject color information is detected in the position peripheral portion of the focus detection area 45b (see FIG. 5) in the tracking initial image. In step 103, the same color information area is set as the initial tracking subject area 47.

Here, an example in which the tracking subject area 47 is determined based on the subject color information is shown, but in order to simplify the processing, the size of the tracking subject area is uniformly set to 3 × 3 pixels, The size of the subject area may be determined according to the distance information of the photographing lens 8.

In step 104, the image of the tracking subject area 47 in the tracking initial image is stored in the memory 19d as a template image 48 (see FIG. 6B) used for the image tracking process. For example, when the starting point position of the tracking subject region 47 is (x, y) = (4, 5) as shown in FIG. 6A, the color information of the template image 48 is expressed as follows.
RGref [rx, ry] = RG [x, y],
BGref [rx, ry] = BG [x, y],
Lref [rx, ry] = L [x, y] (rx, ry = 1 to 3, x = 4 to 6, y = 5 to 7) (3)

  Next, in step 105, an area enlarged by predetermined pixels (here, two pixels) around the tracking subject area 47 is set as the search area 49. In the example shown in FIG. 6A, the search area 49 is an area where x = 2 to 8 and y = 3 to 9.

When the initial processing of the tracking control is completed, the process proceeds to step 3 in FIG. 8 to check whether or not the shutter button of the operation member 20 has been fully pressed, that is, whether or not the shutter release operation has been performed. If there is no shutter release operation, the process proceeds to step 4 to obtain a tracking next image from the second image sensor 16, and color information RG [x, y], BG [x, y] and luminance information are obtained in the same manner as the process in step 1. L [x, y] is calculated and stored in the memory 19d. At the same time, the focus detection signal corresponding to the pair of optical images for focus detection is acquired by the distance measuring element 10 for each of the focus detection areas 45a to 45g.

In step 5, the tracking calculation process shown in FIG. 10 is executed. In step 201 in FIG. 10, a region having the same size as the template image 48 is sequentially cut out from the search region 49 in the tracking next image, and a color information difference Diff is calculated for each corresponding pixel in the cut-out image and the template image 48. . As shown by a thick broken line in FIG. 7A, a color information difference Diff from the template image 48 is calculated while shifting the region by one pixel in the search region 49.

Now, assuming that the starting point position of the search area 49 is (scx, scy) = (2, 3) as shown in FIG. 7A, the calculation of the difference Diff is performed as follows.
Diff [dx, dy] = ΣΣ {ABS (RG [scx + dx−1 + rx, scy + dy−1 + r
y] -RGref [rx, ry]) + ABS (BG [scx + dx-1 + rx, scy + dy-1 + ry] -BGref [rx, ry]) + ABS (L [scx + dx-1 + rx, scy + dy-1 + ry] -Lref [rx, ry]) } (4)
In the equation (4), dx, dy = 1 to 5, rx, ry = 1 to 3, scx = 2, scy = 3, and ΣΣ is a sum operation of rx = 1 to 3 and ry = 1 to 3.

Next, the difference Diff calculated in step 202 is weighted. In this embodiment, weight tables Wt [dx, dy] corresponding to the number of differences Diff [dx, dy] (dx, dy = 1 to 5) (25 in this example) are preset, and the weight table Wt A value obtained by multiplying by a weight coefficient Kw is used as a weight.
Wt [dx, dy] = {(2, 2, 2, 2, 2)
(2,1,1,1,2)
(2,1,0,1,2)
(2,1,1,1,2)
(2, 2, 2, 2, 2)},
Diff '[dx, dy] = (Kw × Wt [dx, dy]) + Diff [dx, dy] (dx, dy
= 1-5) (5)

The weight table Wt shown in the equation (5) is a weight pattern that minimizes the weight for the difference Diff of the region cut out from the center of the search region 49 and increases the weight for the difference Diff of the cut-out region toward the periphery of the search region 49. By using this weight table Wt, priority is given to the position of the focus detection area employed for performing focus adjustment of the photographing lens 8 at the time of previous focus adjustment. Usually, in automatic focus adjustment that is repeatedly performed, it is considered that there is a high probability of capturing a tracking target in or near the focus detection area that is adopted as an area for performing focus adjustment of the photographing lens 8 at the time of previous focus adjustment. A minimum weight is assigned to the difference Diff for the region cut out from the adopted area position during focus adjustment.

The single AF mode in which the photographer performs focus detection in the focus detection area selected by the focus detection area selection switch of the operation member 20 and adjusts the focus of the photographing lens 8 based on the focus detection result, and the photographer operates the operation member. While performing focus detection and focus adjustment in the focus detection area selected by the 20 focus detection area selection switch, even when the subject deviates from the selected focus detection area, backup is performed based on the focus detection results of other focus detection areas. When an AF mode is set that captures the subject in the selected focus detection area, such as a dynamic AF mode that performs focus detection and keeps track of the moving subject, it starts from the position of the selected focus detection area. A minimum weight is assigned to the difference Diff for the region to be cut out. As a result, the tracking target can be reliably captured.

  By setting the weight table Wt as shown in the equation (5), even when the tracking target does not have color information having a clear difference with respect to other parts such as the background, To prevent the part of the image tracking from moving to various positions such as the background and other different parts even though the positional relationship between the camera and the tracking target has not changed, The tracking operation can be stabilized.

  On the other hand, the weighting coefficient Kw in the equation (5) is a coefficient for adjusting the operational effect by the weighting table Wt. The smaller the difference between the color information of the tracking target and the color information of the other parts such as the background, the larger the value of the weighting coefficient Kw and the effect of the weight table Wt are increased. To stabilize. On the other hand, when the difference between the color information to be tracked and the color information of other parts such as the background is relatively large, the value of the weighting factor Kw is reduced to suppress unnecessary effects due to the weight table Wt.

  In step 203, the smallest difference among the weighted differences Diff ′ [dx, dy] is searched, and the cutout area when the smallest difference is calculated in the search area 49 is determined as the new tracking subject area 47. To do. Here, as shown in FIG. 7B, a cut-out area whose start point position is (x, y) = (5, 6) is set as a new tracking subject area 47.

Here, a process of updating the image information of the template image 48 using the image information newly determined for the subject region 47 may be added. In that case, for example, by adding 20% of the image information of the new subject area 47 to the image information of 80% of the original template image 48, the latest image information is updated little by little with respect to the information of the template image. It becomes easy to follow the change of. In this case, the update may not be performed every time the tracking calculation is performed, but may be updated only when the difference Diff ′ of the position determined as the tracking subject region 47 is smaller than a certain threshold value. .

In step 204, an area enlarged by predetermined pixels (here, two pixels) around the new tracking subject area 47 is set as a new search area 49. Here, as shown in FIG. 7B, an area of x = 3 to 9 and y = 4 to 10 is set as a new search area 49. after that,
Return to Step 6 in FIG.

  In step 6 of FIG. 8 after the return, the focus adjustment state of the photographing lens 8 in each of the selected focus detection areas 45a to 45g, that is, the defocus amount is detected based on the focus detection signal acquired in step 4. In the subsequent step 7, a focus detection area showing a defocus amount similar to the defocus amount of the focus detection area employed in the previous focus adjustment is searched from among the defocus amounts of all focus detection areas.

  In step 8, an area for focus adjustment is determined based on the new tracking subject area of the image tracking result in step 5 and the focus detection area of the area search result in steps 6-7. In this embodiment, the focus detection area corresponding to the new tracking subject area 47 of the image tracking result is compared with the focus detection area of the area search result, and the focus detection area common to the image tracking result and the area search result is compared. Are determined as areas for focus adjustment (hereinafter referred to as focus adjustment areas). In step 9, the defocus amount detected in the focus adjustment area is converted into a lens drive amount, and the lens drive control device 22 drives the focusing lens 8b to perform focus adjustment.

  Confirm that the release button is fully pressed in step 3 after adjusting the focus. While the shutter button is half-pressed, the processes in steps 4 to 9 are repeatedly executed. When the shutter button is fully pressed, the process proceeds to step 10 to execute the photographing process.

As described above, according to the embodiment, the second imaging element 16 that captures an image formed by the photographing lens 8 and outputs color information, and the reference color information (the color of the template image) about the image to be tracked. A memory 19d for storing information), calculating the difference Diff between the color information of the image and the reference color information while shifting the comparison position between the image and the target image, and weighting each difference Diff. The position where the difference Diff ′ is minimized is determined as a new tracking target position. As a result, even if the tracking target does not have color information with a clear difference with respect to other parts such as the background, other parts such as the background different from the target are misidentified as the target, and tracking can be performed. Even if the positional relationship with the tracking target has not changed, the position of the image tracking result can be prevented from changing to various positions such as the background and other different parts, the tracking target can be captured correctly, and the tracking operation is stable It can be made.

According to one embodiment, the weight of the difference Diff corresponding to the position determined as the tracking target position in the previous image tracking is minimized, and the tracking target position is determined from the position determined in the previous image tracking. Since the weight for the difference Diff is increased as the distance increases, the probability of capturing the tracking target increases.

  In the above-described embodiment, an example of the weight pattern that prioritizes the position of the focus detection area used for performing the focus adjustment at the time of the previous focus adjustment is shown, but the weight pattern of the weight table Wt is the one described above. The pattern is not limited to the embodiment.

In the above-described embodiment, the example in which the difference Diff of the color information calculated in the search area is weighted has been described. However, the difference Diff of the color information is applied to the entire range of images on the shooting screen. The new tracking subject area may be set by weighting the difference Diff calculated over the entire range of the shooting screen. When searching the tracking subject area from the entire range of the shooting screen, the weight of the difference Diff corresponding to the center of the shooting screen of the shooting lens 8 is minimized, and the weight for the difference Diff is increased as the distance from the center of the shooting screen of the shooting lens 8 increases. To do. Usually, since there is a high probability of capturing the main subject in the center of the shooting screen, there is a high probability of capturing the tracking target in repeated image tracking.

Further, the maximum value and the minimum value of the color information difference Diff are extracted, the weight coefficient Wk is set according to the difference between the maximum value and the minimum value, and the effect of the weight table Wt is optimized. Good. When the difference between the maximum value and the minimum value is small, and the image in the search area or in the shooting screen is a nearly uniform color with no noticeable color, the value of the weighting factor Kw is increased to increase the effect of the weight table Wt. To prevent misidentification of the background and stabilize the tracking operation. On the contrary, when the difference between the maximum value and the minimum value is relatively large and the difference between the color information to be tracked and the color information of other parts such as the background is relatively large, the value of the weighting factor Kw is decreased. Unnecessary action by the weight table Wt is suppressed.

  Furthermore, the weighting factor Wk may be set according to the photographing mode so that the effect of the weight table Wt is optimized. For example, in a shooting mode that tracks a fast-moving subject such as a sports mode or a pet mode, the value of the weighting factor Wk is reduced to suppress unnecessary action by the weight table Wt and to easily follow the movement of the subject. Conversely, when shooting a subject with small movement, such as a portrait mode, since the possibility that the subject suddenly moves far is low, the weighting factor Kw is increased to increase the effect of the weight table Wt. Make it difficult for the tracking target to switch to other parts such as the background.

8 Shooting Lens 10 Ranging Element 16 Second Image Sensor 19 Body Drive Control Device 19d Memory 22 Lens Drive Control Device

Claims (9)

An imaging unit that captures a first image at a first time and captures a second image at a second time after the first time;
A storage unit that stores reference information corresponding to a part of the image to be tracked in the first image;
A tracking calculation unit for calculating the tracking target by calculating a correlation between the reference information stored in the storage unit and a partial image included in a predetermined range of the second image;
A determination unit that determines a position of the tracking target based on a calculation result of the tracking calculation unit;
The tracking calculation unit performs the calculation so that the correlation with the reference information is higher when the partial image is closer to the focus detection area than when the partial image is far from the focus detection area. apparatus. A tracking device according to claim 1 ;
A focus detection unit for detecting a focus adjustment state of the imaging optical system with respect to a plurality of focus detection positions set in a screen by the imaging optical system;
A selection unit that selects at least one focus detection position from the plurality of focus detection positions based on the position of the tracking target determined by the determination unit and the focus adjustment state detected by the focus detection unit. When,
A focus adjustment device comprising: a focus adjustment control unit that performs focus adjustment control of the imaging optical system based on a focus adjustment state of the focus detection position selected by the selection unit . An imaging unit that captures a first image at a first time and captures a second image at a second time after the first time;
A storage unit that stores reference information corresponding to a part of the image to be tracked in the first image;
A tracking calculation unit for calculating the tracking target by calculating a correlation between the reference information stored in the storage unit and a partial image included in a predetermined range of the second image;
A determination unit that determines a position of the tracking target based on a calculation result of the tracking calculation unit ;
A focus detection unit for detecting a focus adjustment state of the imaging optical system with respect to a plurality of focus detection positions set in a screen by the imaging optical system;
A selection unit that selects at least one focus detection position from the plurality of focus detection positions based on the position of the tracking target determined by the determination unit and the focus adjustment state detected by the focus detection unit. When,
A focus adjustment control unit that performs focus adjustment control of the imaging optical system based on a focus adjustment state of the focus detection position selected by the selection unit,
The tracking calculation unit performs a calculation so that the correlation with the reference information is higher when the partial image is in the center of the predetermined range than when the partial image is in the vicinity of the predetermined range. Focus adjustment device . The focus adjustment device according to claim 3 ,
The predetermined range is a search range of the partial image,
The tracking calculation unit detects a difference between the partial image cut out from the search range and the reference information, and when the partial image is at the center of the search range with respect to the difference, the partial image is A focus adjustment device that performs weighting so that the correlation with the reference information is higher than that in the vicinity of the search range. An imaging unit that captures a first image at a first time and captures a second image at a second time after the first time;
A storage unit that stores reference information corresponding to a part of the image to be tracked in the first image;
A tracking calculation unit for calculating the tracking target by calculating a correlation between the reference information stored in the storage unit and a partial image included in a predetermined range of the second image;
A determination unit that determines a position of the tracking target based on a calculation result of the tracking calculation unit ;
A focus detection unit for detecting a focus adjustment state of the imaging optical system with respect to a plurality of focus detection positions set in a screen by the imaging optical system;
A selection unit that selects at least one focus detection position from the plurality of focus detection positions based on the position of the tracking target determined by the determination unit and the focus adjustment state detected by the focus detection unit. When,
A focus adjustment control unit that performs focus adjustment control of the imaging optical system based on a focus adjustment state of the focus detection position selected by the selection unit,
The tracking computation unit performs computation so that when the partial image is in the center of the second image, the correlation with the reference information is higher than when the partial image is not in the center of the second image. Focus adjustment device characterized by. A focus adjusting apparatus according to any one of claims 2 to 5 ,
The focus adjustment device , wherein the tracking calculation unit performs calculation for tracking the tracking target using color information. An imaging apparatus comprising the focus adjustment apparatus according to any one of claims 2 to 6 . The photographing apparatus according to claim 7,
A photometric unit that performs photometry using the output of the imaging unit;
An imaging apparatus comprising: an imaging unit that captures an image to be recorded. The imaging device according to claim 7 or claim 8,
An imaging apparatus, wherein a lens barrel having the imaging optical system is detachable.

Images