JP5328616B2 - AF frame automatic tracking system - Google Patents

Description

  The present invention relates to an AF frame automatic tracking system, and in particular, an AF frame automatic tracking system having a function of automatically tracking an AF frame (AF area) indicating a range of a subject to be focused by autofocus (AF) to a predetermined subject. About.

  Conventionally, in an autofocus (AF) system that automatically adjusts the focus of a camera, the camera must be instructed where to focus. At this time, in a general camera or the like, the position to be focused is fixed at the center of the shooting range, and for example, the person in the center of the shooting range is focused.

  However, when shooting a moving subject, it is inconvenient if the focus position is fixed in this way. Therefore, for example, when shooting a scene where the subject is moving rapidly, such as sports, using a TV camera or the like, there is an AF frame automatic tracking system that automatically tracks an AF area (AF frame) to the subject for the purpose of focusing on the subject. It is known (see, for example, Patent Document 1). In this specification, an AF frame indicating the outline of the range of the AF area is mainly used as a term meaning the range of the subject to be focused in the same manner as the AF area.

JP 2006-267221 A

  By the way, in an AF frame automatic tracking system, for example, an operation unit such as a focus controller is provided with a display with a touch panel. The display with the touch panel displays the currently set AF frame range together with the current shot image captured by the camera, and the operation related to the AF frame is performed by the touch operation on the display with the touch panel. Be able to.

  In particular, AF frame auto provided with a plurality of tracking modes such as a mode for tracking an arbitrary type of object with an AF frame (object tracking mode) and a mode for tracking the face of an arbitrary person with an AF frame (face detection tracking mode). In the tracking system, the tracking mode can be switched by a touch operation on a display with a touch panel.

  In such an AF frame automatic tracking system, a cameraman usually performs focus confirmation and field angle adjustment while looking at a viewfinder installed in the camera body. For this reason, there is a demand to remove and use a display with a touch panel depending on photographing conditions and personal preference.

  However, if the display with the touch panel is removed from the AF frame automatic tracking system, the tracking mode cannot be switched, and the AF frame cannot be automatically tracked in the tracking mode suitable for the subject to be tracked. A malfunction occurs. For this reason, there is a problem that the operation must always be performed with a display with a touch panel attached, which is not convenient.

  The present invention has been made in view of such circumstances, and provides an AF frame automatic tracking system capable of switching the AF frame automatic tracking mode even when display means such as a display with a touch panel is removed. For the purpose.

  In order to achieve the object, an AF frame automatic tracking system according to claim 1 includes: an imaging unit that captures a subject image formed by an optical system; and a predetermined image among images captured by the imaging unit. Auto-focus means for adjusting the focus of the optical system so that the subject within the range of the AF frame is in focus, and auto-tracking the AF frame to the subject to be tracked so as to focus on a predetermined subject to be tracked In the AF frame automatic tracking system, the AF frame automatic tracking unit has a plurality of tracking modes with different subjects that can be set as the subject to be tracked, and the AF frame automatic tracking unit Display means configured as a separate body from the tracking means, which displays a captured image captured by the imaging means on an image display screen and superimposes on the captured image Display means for displaying a range of the currently set AF frame, and further displaying a menu image capable of selecting an arbitrary tracking mode among the plurality of tracking modes; and the display means is the AF frame automatic tracking means Determining means for determining whether or not connected to the AF frame automatic tracking means, and selecting means capable of selecting any tracking mode among the plurality of tracking modes, The AF frame automatic tracking unit performs automatic tracking of the AF frame according to the tracking mode selected by the selection unit according to the determination result by the determination unit.

  The AF frame automatic tracking system according to claim 2 is the AF frame automatic tracking system according to claim 1, wherein the AF frame automatic tracking unit is configured to perform the selection by the selection unit when the display unit is not connected. The AF frame is automatically tracked according to the selected tracking mode.

  The AF frame automatic tracking system according to claim 3 is the AF frame automatic tracking system according to claim 1 or 2, wherein the AF frame automatic tracking unit is configured to display the display when the display unit is connected. The AF frame is automatically tracked according to a tracking mode selected by a predetermined operation from a menu image displayed on the means.

  The AF frame automatic tracking system according to claim 4 is the AF frame automatic tracking system according to any one of claims 1 to 3, wherein the plurality of tracking modes include images taken sequentially. A face detection tracking mode is included in which a face to be tracked is detected by face detection processing, and the AF frame is automatically tracked on the face to be tracked.

  The AF frame automatic tracking system according to claim 5 is the AF frame automatic tracking system according to any one of claims 1 to 4, wherein an image of a subject to be tracked is stored in the plurality of tracking modes. In addition, an object tracking mode is included in which an image of a subject to be tracked is detected by pattern matching processing from captured images that are sequentially captured, and the AF frame is automatically tracked by the subject to be tracked.

  The AF frame automatic tracking system according to claim 6 is the AF frame automatic tracking system according to any one of claims 1 to 5, wherein the display unit and the AF frame automatic tracking unit are detachable via a connector. The determination means automatically determines whether or not the display means is connected by using a pin of the connector.

  The AF frame automatic tracking system according to claim 7 is the AF frame automatic tracking system according to claim 6, wherein the determination unit is configured to determine whether a power supply pin and a GND pin included in the connector are in a short-circuit state. And automatically determining whether the display means is connected or not.

  The AF frame automatic tracking system according to claim 8 is the AF frame automatic tracking system according to any one of claims 1 to 7, wherein the AF frame automatic tracking unit manually adjusts the focus of the optical system. It is incorporated in a controller for operation.

  According to the present invention, it is determined whether or not a display means (for example, a display with a touch panel) that displays a menu image capable of selecting a desired tracking mode among a plurality of tracking modes is connected, and according to the determination result. Then, the AF frame automatic tracking process is executed in accordance with the tracking mode selected by the selection unit configured integrally with the AF frame operation unit. Thereby, even when the display unit is used in a state where the display unit is removed depending on the photographer's preference or shooting conditions, the AF frame can be automatically tracked in the tracking mode suitable for the subject to be tracked, and convenience is improved.

1 is an external view showing an embodiment of a television camera system to which the present invention is applied. The block diagram which showed the whole structure of the AF frame automatic tracking system applied to the television camera system of FIG. Illustration of AF frame (AF area) External view of focus demand The figure which showed an example of the screen displayed on a liquid crystal display with a touch panel Flowchart showing processing procedure of AF frame automatic tracking in CPU of image processing unit

  Hereinafter, an autofocus system according to the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is an external view showing an embodiment of a television camera system to which the present invention is applied. As shown in the figure, a television camera 10 is a television camera mainly used for broadcasting or business use. The television camera 10 includes a lens device 12 and a camera body 14 and is mounted on a pedestal stand 16. It is supported by.

  The pan head 18 is extended with two left and right bread bars 22 and 24, and a focus demand (focus controller) 26 is installed on the grip part 22 </ b> A of the right bread bar 22 with a mounting clamp 38, and the left side A zoom demand (zoom controller) 28 is installed in the grip portion of the pan bar 24.

  The focus demand 26 is provided with a rotatable focus knob 30. When focus control is performed by manual focus (MF), when the focus knob 30 is rotated, a focus corresponding to the rotation position is obtained. A focus control signal for instructing movement of the focus (focus lens) with the position as the target position is given from the focus demand 26 to the lens device 12. As a result, the focus lens of the lens device 12 moves to the target position commanded by the focus control signal.

  The zoom demand 28 is provided with a rotatable thumb ring 34. When the thumb ring 34 is rotated in the left-right direction, the zoom (zoom lens) is moved with a zoom speed corresponding to the rotation position as a target speed. A zoom control signal to be commanded is given from the zoom demand 28 to the lens device 12. As a result, the zoom lens of the lens device 12 moves at the target speed commanded by the zoom control signal.

  Although not shown in the figure, the focus demand 26 is provided with various operation members related to autofocus (AF) and controls an AF frame indicating a subject range (AF target range) to be focused by AF ( An AF frame control device (AF frame automatic tracking device) for performing a change in position and the like is incorporated, and various operation members of the AF frame control device are also provided in the focus demand 26.

  Further, as shown in the figure, a liquid crystal display (LCD) 40 with a touch panel is installed on the upper part of the focus demand 26 as a constituent element of the AF frame control device, and is connected to the focus demand 26 by a cable (not shown).

  In the following description, the LCD 40 is simply referred to as the LCD 40 with a touch panel. The LCD 40 can be installed at any position other than the upper part of the main body of the focus demand 26. For example, it may be installed beside the viewfinder 36.

  A viewfinder 36 that is a display device is installed on the camera body 14. Since the viewfinder 36 displays an image of the subject photographed by the television camera 10, the cameraman operates the focus demand 26 and the zoom demand 28 while viewing the image, thereby selecting the subject with a desired composition. You can shoot. In the following description, the term “captured video” or “captured image” refers to a video or image currently captured by the television camera 10.

  In addition, an image of the AF frame indicating the position, size, and shape (aspect ratio) where the AF frame is currently set is superimposed on the captured image displayed on the viewfinder 36. When focus control is performed by AF, it is possible to know which range of subjects in the captured image can be focused. The focus control of MF and AF can be switched by a mode switch or the like provided in the focus demand 26.

  FIG. 2 is a block diagram showing an overall configuration of an autofocus system applied to the television camera system.

  The autofocus system 1 in FIG. 1 shows the lens device 12, the camera body 14, and the viewfinder 36 of the television camera 10 shown in FIG. 1. Further, as components of the focus demand 26 in FIG. 1, a focus operation unit 50, an image processing unit 58 and an AF frame operation unit 60 constituting an AF frame control device (AF frame automatic tracking device) incorporated in the focus demand 26. It is shown.

  The television camera 10 includes a camera body 14 composed of an HD camera compatible with a high-definition television [HD (High Definition) TV] system, and a lens device 12 having a photographing lens (optical system) attached to a lens mount of the camera body 14. It consists of.

  The camera body 14 is equipped with an image sensor (for example, a CCD), a required signal processing circuit, and the like. The image formed by the photographing lens of the lens device 12 is photoelectrically converted by the image sensor and then subjected to signal processing. Necessary signal processing is performed by the circuit and output as an HDTV video signal (HDTV signal) from the video signal output terminal of the camera body 14 to the outside.

  In addition, as shown in FIG. 1, a video captured by the television camera 10 is displayed on the viewfinder 36 installed on the upper part of the camera body 14 or the like. Various information other than the captured video is displayed on the viewfinder 36. For example, an image indicating the currently set AF frame range (position, size, shape) is superimposed on the captured video. Has been displayed.

  The lens device 12 includes a photographic lens (zoom lens) 64 attached to a lens mount of the camera body 14, and the subject 56 forms an image on the imaging surface of the image sensor of the camera body 14 by the photographic lens 64. It is like that. Although not shown, the photographing lens 64 is provided with movable parts for adjusting photographing conditions such as a focus lens group, a zoom lens group, and a diaphragm as its constituent elements. Servo mechanism) is electrically driven. For example, the focus lens group and the zoom lens group move in the optical axis direction, the focus (subject distance) adjustment is performed by moving the focus lens group, and the focal length (zoom magnification) is adjusted by moving the zoom lens group. Adjustments are made.

  In the AF-related system, it is sufficient that at least the focus lens group can be driven electrically, and other movable parts may be driven only manually.

  The lens device 12 includes an AF unit 66 and a lens CPU (not shown). The lens CPU controls the entire lens device 12 and controls the state (position, speed) of a control target that is electrically driven by a motor such as a focus lens group, a zoom lens group, and a diaphragm by driving the motor. The AF unit 66 is a processing unit for acquiring information necessary for performing AF focus control (automatic focus adjustment), and is configured from an AF processing unit, an AF imaging circuit, and the like, although not shown. Has been.

  The AF imaging circuit is disposed in the lens device 12 to acquire an AF processing video signal, and an output signal from an imaging device such as a CCD (referred to as an AF imaging device) or an AF imaging device is output in a predetermined format. A processing circuit for outputting as a signal is provided. The video signal output from the AF imaging circuit is a luminance signal.

  On the imaging surface of the AF imaging device, subject light branched from subject light incident on the imaging device of the camera body 14 is imaged by a half mirror or the like disposed on the optical path of the photographing lens 64. . The shooting range and subject distance (distance of the subject in focus) with respect to the imaging area of the AF imaging element are configured to match the shooting range and subject distance with respect to the imaging area of the imaging element of the camera body 14. The subject image captured by the image sensor coincides with the subject image captured by the image sensor of the camera body 14. It should be noted that the shooting ranges of the two do not need to be completely the same. For example, the shooting range of the AF imaging element may be a larger range including the shooting range of the imaging element of the camera body 14.

  The AF processing unit acquires a video signal from the AF imaging circuit, and based on the video signal, calculates a focus evaluation value indicating the level of contrast of the subject image within an AF area (AF frame) that is an AF target range. calculate. For example, a high frequency component signal is extracted from a video signal obtained from an AF image sensor by a high-pass filter, and then a range corresponding to an AF area set as described later in the high frequency component signal. Are integrated for each screen (one frame). The integrated value obtained for each screen in this manner indicates the level of contrast of the subject image in the AF area, and the integrated value is given to the lens CPU as a focus evaluation value.

  The lens CPU acquires AF frame information (AF frame information) indicating the range (contour) of the AF area from the image processing unit 58 as described later, and the range within the AF frame specified by the AF frame information is obtained. The AF area is designated as the AF area. Then, the focus evaluation value obtained from the image (video signal) in the AF area is acquired from the AF processing unit.

  In this way, every time a video signal for one screen is acquired from the AF imaging circuit (each time the focus evaluation value is obtained by the AF processing unit), the focus evaluation value is acquired from the AF processing unit, and the acquired focus is obtained. The focus lens group is controlled so that the evaluation value is maximum (maximum), that is, the contrast of the subject image in the AF frame is maximum. For example, a hill-climbing method is generally known as a control method for a focus lens group based on a focus evaluation value, and the focus evaluation value starts to decrease by moving the focus lens group in a direction in which the focus evaluation value increases. Is detected, the focus lens group is set at that position. Thereby, the subject in the AF frame is automatically focused.

  Note that the above-described AF processing unit obtains a video signal from the AF image sensor mounted on the lens device 12 in order to calculate the focus evaluation value, but the video imaged by the image sensor of the camera body 14 The video signal may be obtained from the camera body 14. Also, any AF means for automatically focusing on the subject within the AF frame may be used.

  Here, as shown in FIG. 3, the AF area 200 is set as a rectangular area with respect to the imaging area 202 of the imaging device in the camera body 14, and a frame 204 indicating the outline indicates an AF frame, A subject photographed in the range of the AF area 200 (within the AF frame 204) is an object to be focused by AF.

  In this specification, the range of the AF frame 204 (AF area 200) with respect to the imaging area 202 is determined by three factors including the position, size, and shape (aspect ratio) of the AF frame 204. The description of “changing the frame range” means changing at least one of the three elements of the position, size, and shape of the AF frame.

  The lens device 12 is connected to the camera body 14 via a cable or directly, and various kinds of information are transmitted through serial communication interfaces (SCI) 12a and 14a provided in the lens device 12 and the camera body 14, respectively. You can communicate. As a result, information on the AF frame currently set in the AF unit 66 is also transmitted to the camera body 14, and the position of the AF frame currently set in the captured image displayed on the viewfinder 36 by processing in the camera body 14. The image of the AF frame corresponding to the size and shape is superimposed and displayed.

  The focus operation unit 50 is a constituent element of the focus demand 26 and also shows constituent elements of a general focus demand. As the components of the focus operation unit 50, the focus knob 30 shown in FIG. 1, a mode switch (not shown) for switching between the AF mode and the MF mode and switching the AF mode type (continuous mode or momentary mode). And an operation member related to AF control contents and MF control, such as an AF start switch (not shown) for instructing the start of AF, and detecting the setting state of these operation members, and based on the detected setting state A processing circuit for sending control signals is provided.

  The focus demand 26 is provided with an interface (I / F) 52 for connecting to the lens device 12 with a cable. The focus operation unit 50 is connected to the lens device 12 via the I / F 52 and the cable, and the SCI 12a. Various signals can be exchanged through serial communication with the lens CPU.

  Accordingly, various control signals sent from the focus operation unit 50 are given to the lens CPU, and processing according to the control signals is executed by the lens CPU. For example, when an instruction for focus control (AF mode) by AF is given, focus control by AF is performed based on the focus evaluation value obtained from the AF unit 66 as described above, and focus control by MF (MF When an instruction of (mode) is given, focus control by MF is performed according to a focus position command signal given from the focus operation unit 50 based on the operation of the focus knob 30.

  The image processing unit 58 is a processing unit incorporated in the focus demand 26 as a component of the AF frame control device, and the range (position, size, shape (vertical and horizontal) of the AF frame set in the AF unit 66 of the lens device 12. A ratio)) is designated by a manual operation or AF frame automatic tracking process described later.

  The image processing unit 58 includes an SCI 70a. The SCI 70a is connected to the lens device 12 via the I / F 52, and various signals can be exchanged with the lens CPU through the SCI 12a by serial communication. ing. Thereby, for example, AF frame information for designating the range of the AF frame is given from the image processing unit 58 to the lens CPU of the lens apparatus 12, and the range of the AF frame in the AF unit 66 is set based on the AF frame information. .

  The focus demand 26 is provided with a video input connector for taking a video signal into the image processing unit 58, and the video output connector of the camera body 14 is connected to the video input connector via a down converter 68 with a cable. The As a result, the HDTV signal output from the video output connector of the camera body 14 is converted (down-converted) into a standard television [NTSC (National Television System Committee)] video signal (SDTV signal) by the down converter 68. Are input to the image processing unit 58.

  When executing the AF frame automatic tracking process, the image processing unit 58 sequentially captures one frame of the captured image from the image signal of the captured image input from the camera body 14, and selects a predetermined tracking target from the captured image. The process of detecting the subject is performed. Then, the AF frame range is determined so that the subject can be focused by AF, and the determined AF frame range is transmitted to the lens CPU of the lens device 12.

  The AF frame operation unit 60 is integrally provided with the image processing unit 58 in the focus demand 26 as an AF frame control device, or a part or all of the AF frame operation unit 60 is a separate device from the focus demand 26, that is, image processing. The unit 58 is provided in a separate device and connected by a cable or the like. In the present embodiment, as shown in FIG. 1, the LCD 40 with a touch panel is provided separately from the focus demand 26 (image processing unit 58), and other components (including a tracking mode changeover switch 112 described later) are the focus demand. 26 is provided integrally with the image processing unit 58.

  The AF frame operation unit 60 is an operation unit for mainly performing operations related to control of the AF frame, and an operation member for an operator to manually input an AF frame range or an AF frame to a desired subject. There is provided an operation member for performing an operation related to AF frame automatic tracking to be automatically tracked. Further, as will be described later, a changeover switch for selecting a mode for automatically tracking the AF frame is also provided.

  As shown in the external view of the focus demand 26 in FIG. 4, as the operation member of the AF frame operation unit 60, a position operation member 100 (for example, for moving the position of the AF frame up and down and left and right manually by the user) , A joystick or a trackball), a size operation member 102 (for example, a knob) for manually changing the size of the AF frame, and a shape operation member 104 (for example, a knob) for changing the shape of the AF frame by manual operation. ), A tracking start switch 108 for instructing start of AF frame automatic tracking, and a tracking stop switch 110 for instructing stop of AF frame automatic tracking are provided. Setting of these operation members 100, 102, 104, 108, 110 is provided. The state is read by the image processing unit 58 (CPU 78 of the main board 70 described later).

  Further, the LCD 40 of the AF frame operation unit 60 is configured such that settings such as a mode related to AF frame automatic tracking can be input by a touch operation (tap operation), and an image displayed on the LCD 40 by the CPU 78 of the image processing unit 58 is displayed. It can be switched appropriately according to the setting contents. As shown in FIG. 2, the LCD 40 is detachably connected to the image processing unit 58 via a connector 84.

  In the present embodiment, the AF frame control device including the image processing unit 58 and the AF frame operation unit 60 is incorporated in the focus demand 26. However, the AF frame control device is different from the focus demand 26. It may be configured as a body device. In this case, a part or all of the AF frame operation unit 60 may be provided in an apparatus integrated with the image processing unit 58, or may be provided in a separate apparatus.

  Next, the configuration and processing contents of the image processing unit 58 will be described.

  The image processing unit 58 mainly includes a main board 70, a pattern matching processing calculation board 72, and a face recognition processing calculation board 74. Each of the main board 70, the pattern matching processing calculation board 72, and the face recognition processing calculation board 74 is equipped with CPUs 78, 90, and 92. Individual calculation processing is performed for each board, and each of the CPUs 78, 90, Reference numerals 92 are connected by a bus or a control line so that data can be exchanged or arithmetic processing can be synchronized with each other.

  The processing in the image processing unit 58 is performed on the main board 70 in an integrated manner. In addition to the CPU 78 that performs arithmetic processing, the main board 70 is equipped with an SCI 70a, a decoder (A / D converter) 76, a superimposer 82, a RAM 80, and the like.

  The SCI 70 a is an interface circuit for performing serial communication with the SCI 12 a of the lens device 12 as described above, and transmits the AF frame information and the like to the lens device 12.

  The decoder 76 is a circuit for converting a video signal (SDTV signal) of a video image taken by the television camera 10 input from the down converter 68 to the image processing unit 58 into data that can be digitally processed by the image processing unit 58. A / D conversion processing for converting an analog SDTV signal into a video signal of digital data is performed. The video signal of the captured video output from the decoder 76 is also sent to the pattern matching processing calculation board 72 and the face recognition processing calculation board 74, and the television camera 10 is also used in the pattern matching processing calculation board 72 and the face recognition processing calculation board 74. The captured video can be acquired as a captured image for each frame.

  The superimposer 82 is a circuit that synthesizes the video signal of the captured video obtained by the decoder 76 and the image signal generated by the CPU 78 and outputs and displays the synthesized video signal on the LCD 40. As a result, the image captured by the television camera 10 is displayed on the LCD 40 in the same manner as the viewfinder 36 installed in the camera body 14, and the AF indicating the currently set AF frame range is superimposed on the image captured. An image of the frame, a menu screen (menu image) that allows input operations on the touch panel, and the like are displayed on the LCD 40. Of course, it is also possible to display only the image generated by the CPU 78 without being superimposed on the captured video.

  The RAM 80 is a memory that temporarily stores data used in the arithmetic processing of the CPU 78.

  On the other hand, the pattern matching processing calculation board 72 and the face recognition processing calculation board 74 are calculation boards for individually performing pattern matching and face detection / recognition processing. In addition to the CPUs 90 and 92 that perform calculation processing, image data VRAM 94, 96, etc. are temporarily stored.

  Further, the image processing unit 58 is provided with a slot 115 into which a data card 114 is loaded as an external memory such as an SD (Secure Digital) card or a USB memory, and when detecting a face of a specific person by face recognition. Authentication data indicating the face of the specific person is stored in the data card 114 in advance, and the data card 114 is loaded into the slot 115, whereby the CPU 78 can read the authentication data necessary for face recognition from the data card 114. It is like that.

  Subsequently, control of the AF frame by the image processing unit 58 configured as described above will be described together with processing relating to display and operation of the LCD 40.

  As shown in FIG. 5, on the screen 40a of the LCD 40, a menu screen (menu image) composed of various buttons 300 to 310 superimposed on the video image taken by the TV camera 10, and an AF indicating the currently set AF frame range. A frame image 204 (simply referred to as AF frame 204) is displayed. Images to be superimposed on the captured video, such as the various buttons 300 to 310 on the menu screen and the AF frame 204, are generated by the CPU 78 of the main board 70 in the image processing unit 58 shown in FIG. The poser 82 is displayed on the LCD 40 so as to be superimposed on the video image taken by the television camera 10 output from the decoder 76. Note that the CPU 78 controls the display (display contents) on the LCD 40.

  On the other hand, the LCD 40 is provided with a touch panel, and when a touch operation with which a fingertip or the like touches the screen 40a of the LCD 40 is performed, position information indicating the touched position (coordinates) is given to the CPU 78. As a result, the position of the touch operation performed on the screen 40a of the LCD 40 and the type of operation (tap operation, double tap operation, etc.) are detected by the CPU 78. Then, processing according to the operation is executed by the CPU 78.

  As basic operations on the screen 40a of the LCD 40, there are an operation of inputting an instruction assigned in advance to each of the buttons 300 to 310 and an operation of designating a range of the AF frame 204. The former operation is performed by using the buttons 300 to 310. Is tapped with a fingertip or the like. The latter operation of designating the range of the AF frame 204 is performed, for example, by tapping the position where the AF frame 204 is to be moved on the screen 40a of the LCD 40 on which the captured image is displayed, so that the position becomes the center. The AF frame 204 can be moved. Also, the size and shape of the AF frame 204 can be changed by moving the position of the touched vertex or side to the position where the drag operation is performed by a drag operation of touching and sliding the vertex or side of the AF frame 204 with a fingertip or the like. it can.

  The position, size, and shape of the AF frame 204 can be changed by operating the position operation member 100, the size operation member 102, and the shape operation member 104 of the AF frame operation unit 60 (focus demand 26).

  The menu screen (menu image) displayed on the screen 40a of the LCD 40 will be described. In FIG. 5, a fixed mode selection button 300 displayed as “Fixed”, an object tracking mode selection button 302 displayed as “Object tracking”, A face detection tracking mode selection button 304 displayed as “face detection” and a face recognition tracking mode selection button 306 displayed as “face recognition” are buttons for selecting a control mode of the AF frame. By tapping any one of 306, a desired mode can be selected from the fixed mode, the object tracking mode, the face detection tracking mode, and the face recognition tracking mode.

  The fixed mode is a mode (manual mode) in which the operator manually designates the range (position, size, shape) of the AF frame and fixes the AF frame at the designated position. This fixed mode is a mode that is useful for shooting news programs that hardly move the camera.

  When the fixed mode selection button 300 is tapped on the screen 40a of the LCD 40 in FIG. 5, the fixed mode is selected, and the CPU 78 mounted on the main board 70 of the image processing unit 58 executes the processing of the fixed mode.

  That is, the CPU 78 operates to change the AF frame range for the screen 40a of the LCD 40 as described above, or an operation member (position operation member) for manually changing the AF frame 204 provided in the AF frame operation unit 60. 100, the range of the AF frame is determined based on the operation of the size operation member 102 and the shape operation member 104). When determining the range of the AF frame, the CPU 78 transmits AF frame information indicating the range of the AF frame to the lens CPU of the lens device 12 through the SCI 70a.

  The object tracking mode is one mode for automatically tracking the AF frame, and is a mode for tracking an arbitrary type of object with the AF frame. This object tracking mode is a mode useful for photographing at a horse race relay, a car race relay, etc. for tracking other than a person's face. In this mode, when the range of the AF frame is specified so that the operator includes an image of an arbitrary object that is desired to be a tracking target for the captured video, the object in that range is set as the tracking target. Then, the image to be tracked is registered as a reference pattern, and the CPU 90 of the pattern matching processing calculation board 72 performs pattern matching processing for detecting an image range that matches the reference pattern on the sequentially obtained captured images. Is called. The CPU 78 of the main board 70 determines the range in which the reference pattern is detected as the AF frame range and transmits it to the lens CPU of the lens device 12. When focus control by AF is not performed in the lens device 12 when AF frame automatic tracking is started (when AF mode is not set), AF is started in conjunction with the start of AF frame automatic tracking. Is also instructed.

  The face detection tracking mode is one mode for automatically tracking the AF frame, and is a mode for tracking the face of an arbitrary person using the AF frame. This face detection tracking mode is a mode useful for shooting in a song program or the like that detects and tracks a person's face. In this mode, first, a well-known face detection process for detecting a face image of an arbitrary person from a photographed image is performed by the CPU 92 of the face recognition processing calculation board 74. When the operator designates a face image to be tracked from the detected face images, the face image is set as the track target. Thereafter, the CPU 92 of the face recognition processing calculation board 74 performs face detection processing on the sequentially obtained photographed images, and the process of specifying the tracking target face image from the detected face images is the CPU 78 of the main board 70. Is done. The CPU 78 of the main board 70 determines the detected range of the face image to be tracked as the range of the AF frame and transmits it to the lens CPU of the lens device 12.

  The face recognition tracking mode is one mode for automatically tracking the AF frame, and is a mode for tracking the face of a person registered in advance as authentication data using the AF frame. This face recognition tracking mode is a mode useful for shooting in a song program or a sports broadcast in which a person to be shot is determined in advance. In this mode, face authentication data of a person to be tracked is fetched from the face authentication data card 114 loaded in the slot 115 shown in FIG. Then, face detection processing is performed in the CPU 92 of the face recognition processing calculation board 74 in the same manner as in the face detection tracking mode, and the face image to be tracked among the detected face images is known face authentication processing using authentication data. Is detected. The CPU 78 of the main board 70 determines the detected range of the face image to be tracked as the range of the AF frame and transmits it to the lens CPU of the lens device 12.

  In FIG. 5, a set button 308 displayed as “SET” and a reset button 310 displayed as “RESET” are buttons for instructing start and stop of AF frame automatic tracking. 310 is displayed only when a control mode (object tracking mode, face detection tracking mode) in which the operator instructs to start or stop AF frame automatic tracking is selected. The set button 308 and the reset button 310 are buttons that operate in the same manner as the tracking start switch 108 and the tracking stop switch 110 (see FIGS. 2 and 4) of the AF frame operation unit 60.

  In the present embodiment, as described above, the LCD 40 and the image processing unit 58 are detachably connected via the connector 84. In this connector 84, a GND pin 84a connected to GND, a power supply pin 84b connected to a reference voltage (Vcc) via a predetermined resistor, and an image synthesized by the superimposer 82 of the image processing unit 58 A signal pin 84c for outputting a signal to the LCD 40 and a signal pin 84d for inputting a signal detected by the touch panel of the LCD 40 to the image processing unit 58 (CPU 78 of the main board 70) are included.

  Among these pins 84a to 84d, the GND pin 84a and the power supply pin 84b are in a closed state (short-circuit state) when the LCD 40 and the image processing unit 58 are connected via the connector 84, and the connection is released. In this case (that is, when the LCD 40 is removed), an open state (non-short circuit state) is established.

  The CPU 78 of the main board 70 in the image processing unit 58 monitors a signal (detection signal) detected from a line connected to the power supply pin 84b, and the presence / absence of the LCD 40 is determined by the level (High / Low) of the detection signal. Judging. That is, the CPU 78 determines that the LCD 40 is connected when the detection signal is at the Low level, and determines that the LCD 40 is not connected when the detection signal is at the High level.

  As shown in the external view of the focus demand 26 in FIG. 4, in addition to the operation members 100, 102, 104, 108, 110 described above, a tracking mode changeover switch 112 is provided as an operation member of the AF frame operation unit 60. It is provided integrally. The tracking mode changeover switch 112 is configured by a slide switch as illustrated in FIG. 4, for example. As a mode for automatically tracking the AF frame, an object tracking mode (“OBJECT” side in FIG. 4) and a face detection tracking mode (see FIG. 4). 4 ("FACE" side) can be selected. The tracking mode selected by the tracking mode changeover switch 112 is read by the image processing unit 58 (CPU 78 of the main board 70).

  When the CPU 78 of the main board 70 determines that the LCD 40 is not connected by a signal (detection signal) detected from a line connected to the power supply pin 84b, the setting state of the tracking mode switch 112 is validated. The AF frame is automatically tracked according to the tracking mode selected by the changeover switch 112. For example, as shown in FIG. 4, when the tracking mode changeover switch 112 selects the face detection tracking mode (“FACE” side in FIG. 4), the AF frame is automatically tracked in the face detection tracking mode. .

  Next, the AF frame automatic tracking processing procedure by the image processing unit 58 (CPU 78 of the main board 70) configured as described above will be described with reference to the flowchart shown in FIG.

  First, the CPU 78 of the main board 70 determines whether or not the LCD 40 is connected to the image processing unit 58 via the connector 84 (step S10). In the present embodiment, as described above, whether or not the LCD 40 is connected is determined according to the connection state (short circuit state / non-short circuit state) between the GND pin 84a and the power supply pin 84b included in the connector 84. Specifically, it is determined whether or not the LCD 40 is connected according to the level (High / Low) of the signal (detection signal) detected from the line connected to the power supply pin 84b. When it is at the high level, it is determined that the LCD 40 is not connected, and when the detection signal is at the low level, it is determined that the LCD 40 is connected.

  If NO in step S10, that is, if it is determined that the LCD 40 is not connected, the CPU 78 detects that the tracking mode selected by the tracking mode switch 112 provided in the AF frame operation unit 60 is the face detection. It is determined whether or not the tracking mode is set (step S12).

  If Yes in step S12, that is, if the face detection tracking mode is selected by the tracking mode changeover switch 112, the CPU 78 sets the face detection tracking mode as the tracking mode (step S14), and the setting is made. The AF frame automatic tracking process is executed in accordance with the tracking mode (step S16). On the other hand, if No in step S12, that is, if the object tracking mode is selected by the tracking mode switch 112, the CPU 78 sets the object tracking mode as the tracking mode (step S18), and the setting is performed. The AF frame automatic tracking process is executed in accordance with the tracking mode (step S16).

  If No in step S10, that is, if it is determined that the LCD 40 is connected, the CPU 78 performs the following processing based on the signal detected from the touch panel of the LCD 40.

  That is, the CPU 78 sequentially determines whether the tracking mode selected through the touch panel of the LCD 40 corresponds to any of the object tracking mode, the face detection tracking mode, and the face recognition tracking mode (steps S20, 22, 24). . When the object tracking mode is selected (Yes in Step S20), the object tracking mode is set as the tracking mode (Step S18), and when the face detection tracking mode is selected (Yes in Step S22) ), The face detection tracking mode is set as the tracking mode (step S18), and when the face recognition tracking mode is selected (Yes in step S24), the face recognition tracking mode is set as the tracking mode (step S24). Step S26). Then, the CPU 78 executes AF frame automatic tracking processing according to the set tracking mode (step S16).

  In step S16, if the operator instructs stop of automatic tracking, or if the automatic tracking process fails, the AF frame automatic tracking process is stopped, and the process returns to step S10.

  On the other hand, when the tracking mode selected through the touch panel of the LCD 40 does not correspond to any of the object tracking mode, the face detection tracking mode, and the face recognition tracking mode (when all of Steps S20, 22, and 24 are No), the CPU 78 It is determined that the fixed mode is selected, and the process in the fixed mode is executed (step S28). Then, when the operator instructs to stop the processing in the fixed mode, the process returns to step S10.

  According to the present embodiment, the LCD 40 and the image processing unit 58 are detachably connected via the connector 84, and according to the connection state (short circuit / non-short circuit state) of the GND pin 84a and the power supply pin 84b included in the connector 84. Thus, it is automatically determined whether or not the LCD 40 is connected. The AF frame operation unit 60 is provided with a tracking mode changeover switch 112 that can select an arbitrary tracking mode from a plurality of tracking modes. When it is determined that the LCD 40 is not connected, the tracking mode changeover switch Processing for automatically tracking the AF frame in the tracking mode selected at 112 is performed. On the other hand, when it is determined that the LCD 40 is connected, not the tracking mode selected by the tracking mode changeover switch 112 but the AF frame automatic tracking processing is performed by the tracking mode selected through the touch panel of the LCD 40. . Thus, even when the LCD 40 is used in a state where it is removed depending on the photographer's preference or shooting conditions, the AF frame can be automatically tracked in the tracking mode suitable for the subject to be tracked, and convenience is improved.

  In the present embodiment, a mode in which the presence or absence of the connection of the LCD 40 is determined using the pins (84a, 84b) of the connector 84 that connects the LCD 40 and the image processing unit 58 is preferably applied. However, the present invention is not limited to this, and an operator (for example, a cameraman) may manually set the presence or absence of the LCD 40 using a mechanical or electrical switch, and determine the presence or absence of the LCD 40 by reading the setting state of the switch. .

  Although the AF frame automatic tracking system of the present invention has been described in detail above, the present invention is not limited to the above examples, and various improvements and modifications may be made without departing from the spirit of the present invention. Of course.

  DESCRIPTION OF SYMBOLS 1 ... Autofocus system, 10 ... Television camera, 12 ... Lens apparatus, 14 ... Camera body, 26 ... Focus demand, 36 ... Viewfinder, 40 ... Liquid crystal display (LCD) with a touch panel, 50 ... Focus operation part, 58 ... Image Processing unit 60 ... AF frame operation section 66 ... AF unit 68 ... Down converter 70 ... Main board 72 ... Pattern matching processing calculation board 74 ... Face recognition processing calculation board 76 ... Decoder 78, 90, 92 ... CPU, 82 ... Superimposer, 84 ... Connector, 112 ... Tracking target changeover switch, 114 ... Data card, 115 ... Slot, 200 ... AF area, 204 ... AF frame, 300 ... Fixed mode selection button, 302 ... Object tracking Mode selection button, 304 ... Face detection tracking mode selection Button, 306 ... face recognition tracking mode selection button, 308 ... set button, 310 ... reset button

Claims (8)

An imaging unit that captures a subject image formed by the optical system, and a focus adjustment of the optical system is performed so that a subject within a predetermined AF frame is in focus among the captured images captured by the imaging unit. In an AF frame automatic tracking system comprising autofocus means and AF frame automatic tracking means for automatically tracking the AF frame to the subject to be tracked so that the subject to be tracked is in focus.
The AF frame automatic tracking means has a plurality of tracking modes with different subjects that can be set as the subject to be tracked,
The AF frame automatic tracking unit is a display unit configured separately from the AF frame automatic tracking unit, and displays a captured image captured by the imaging unit on an image display screen and is currently set to be superimposed on the captured image. Display means for displaying an AF frame range, and further displaying a menu image capable of selecting an arbitrary tracking mode among the plurality of tracking modes;
Determining means for determining whether or not the display means is connected to the AF frame automatic tracking means;
The AF frame automatic tracking unit is configured integrally, and includes a selection unit capable of selecting an arbitrary tracking mode among the plurality of tracking modes,
The AF frame automatic tracking unit performs automatic tracking of the AF frame according to the tracking mode selected by the selection unit according to the determination result by the determination unit.   2. The AF frame automatic tracking unit according to claim 1, wherein the AF frame automatic tracking unit performs automatic tracking of the AF frame according to a tracking mode selected by the selection unit when the display unit is not connected. 3. Automatic frame tracking system.   The AF frame automatic tracking unit performs automatic tracking of the AF frame according to a tracking mode selected by a predetermined operation from a menu image displayed on the display unit when the display unit is connected. The AF frame automatic tracking system according to claim 1 or 2.   The plurality of tracking modes include a face detection tracking mode in which a face to be tracked is detected from captured images that are sequentially captured by face detection processing, and the AF frame is automatically tracked to the face to be tracked. The AF frame automatic tracking system according to any one of claims 1 to 3.   In the plurality of tracking modes, an image of the subject to be tracked is stored, and an image of the subject to be tracked is detected from the captured images that are sequentially picked up by pattern matching processing, and the subject AF is tracked. 5. The AF frame automatic tracking system according to claim 1, further comprising an object tracking mode for automatically tracking the frame. The display means and the AF frame automatic tracking means are detachably connected via a connector,
6. The AF frame automatic tracking system according to claim 1, wherein the determination unit automatically determines whether or not the display unit is connected by using a pin of the connector. 7.   7. The AF according to claim 6, wherein the determination unit automatically determines whether or not the display unit is connected depending on whether or not a power supply pin and a GND pin included in the connector are in a short-circuit state. Automatic frame tracking system.   The AF frame automatic tracking system according to any one of claims 1 to 7, wherein the AF frame automatic tracking means is incorporated in a controller for manually operating the focus adjustment of the optical system. .

Images