KR101299988B1 - Tracking control system using audio/video information - Google Patents

Abstract

PURPOSE: A tracking control system using AV information is provided to control a lens direction of a mobile camera for photographing a determined target area by determining the target area by using event information or sound information. CONSTITUTION: One or more first cameras (110) photograph a specific image and sense a specific event. A lens of a second camera (120) is rotated in every direction. A sound recognizing device (130) recognizes a sound inputted through one or more microphones. A control device (140) determines a target area by using event information sensed by the first cameras and sound information recognized by the sound recognizing device. The control device controls the second camera to rotate, zoom, and photograph the determined target area so that the lens of the second camera heads for the determined target area. [Reference numerals] (110) First camera; (120) Second camera; (130) Sound recognizing device; (140) Control device

Description

Tracking control system using audio information {Tracking control system using audio / video information}

The present invention relates to a tracking control system, and more particularly, to a tracking control system for determining an area to be tracked using audio / video information.

In recent years, surveillance cameras are often installed in hotspots or secluded places to prevent crimes.In addition, surveillance cameras are installed for accidents in places where there is a high risk of accidents due to a large floating population or traffic. have. When installing a surveillance camera, how much information can be obtained compared to the cost of installation and whether or not to solve the blind area is a matter.

On the other hand, in the conventional surveillance system, a plurality of fixed cameras mainly called detection cameras are provided. The fixed camera means fixing of the shooting direction, not fixing of the installed place.

Since the plurality of detection cameras monitors the surrounding area by dividing the area, a large number of detection cameras must be installed in one place for shooting a blind spot, so the monitoring efficiency is low compared to the installation cost and images acquired from a large number of detection cameras The problem is that the recruitment of monitoring personnel must be involved in the analysis.

In order to solve this problem, efforts have been proposed to reduce installation costs and solve labor costs by combining with a mobile camera called a PTZ camera (or tracking camera).

However, in this case, since the PTZ camera determines the shooting target based on the image acquired by the detection camera, it cannot be the ultimate solution for shooting blind spots. There is a problem that they must be installed.

The present invention has been made to solve the above problems, and an object of the present invention is to determine a target area by using at least one of event information detected by the first camera and sound information recognized by the sound recognition apparatus. It is to provide a tracking control system for controlling the lens direction of the second camera to shoot the target area.

According to an embodiment of the present invention for achieving the above object, the tracking control system, at least one first camera for capturing a specific area and detects whether a specific event occurs; A second camera whose lens is rotated up, down, left and right; A sound recognition device recognizing a sound input through at least one microphone; And determining the target area by using the event information detected by the first camera and the sound information recognized by the sound recognition device, and rotating and zooming in so that the lens of the second camera faces the target area. It includes; a control device for controlling to be photographed.

Herein, when the occurrence of the specific event is detected by the first camera and the sound recognition apparatus recognizes a sound having an intensity greater than or equal to a first intensity value and less than a second intensity value, the first camera detects the occurrence of the specific event. The second camera to select a plurality of target area candidates based on the received event information and the recognized sound information, determine a target area according to a predetermined priority among the plurality of target area candidates, and photograph the determined target area; To control the lens direction.

In addition, when the direction of the sound calculated by the sound recognition device is included in a specific area photographed by the first camera where the event is detected, the control device has a specific area corresponding to the calculated sound direction as the highest priority. By determining the target area, the lens direction of the second camera may be controlled so that the second camera captures the determined target area.

In addition, among the plurality of target area candidates selected based on the event information, a plurality of subjects are detected and an area where an event occurs is set to have a higher priority than an area where an event occurs because a single subject is detected. The subject with frequent movements of the arm movement is detected and the area where the event is generated is detected. The subject with frequent movements of the foot movement is detected and the priority is set higher than the area where the event is generated. The priority of the generated area is set to be higher than the area where the event is generated because a subject with a slow motion is detected, and among the plurality of target area candidates selected based on the sound information, the sound intensity recognized by the sound recognition apparatus is detected. The larger the value, the higher the priority may be set.

In addition, the control device, when the occurrence of the specific event is not detected in the first camera and the sound of the intensity is greater than the first intensity value is recognized by the sound recognition device or the occurrence of the specific event in the first camera When the sound recognition device detects a sound having an intensity greater than or equal to the first intensity value by the sound recognition device, the sound direction is calculated using only the recognized sound information, and the direction of the sound is determined by the target area. The lens direction of the second camera may be controlled to capture the determined target area.

When the occurrence of the specific event is detected by the first camera and a sound less than a first intensity value is recognized by the sound recognition device, the control device may determine a target area through the event information detected by the first camera. The lens direction of the second camera may be controlled to capture the determined target area.

The first camera, the second camera, and the sound recognition device may be configured as one set device and installed at a site around the target area, and the control device may include a set of a plurality of the set devices. It may be installed separately in an external control center for managing the group or included in the one set device.

According to various embodiments of the present disclosure, a target area is determined using at least one of event information detected by a fixed camera and sound information recognized by a sound recognition device, and the lens direction of the mobile camera is controlled to photograph the determined target area. Since the tracking control system can be provided, blind areas, which are difficult to detect with a fixed camera, can be photographed with a mobile camera using sound information.

1 is a block diagram showing a configuration of a tracking control system according to an embodiment of the present invention.
2 is a flowchart provided to explain the operation of the tracking control system according to an embodiment of the present invention.
3 is a block diagram showing a configuration of a tracking control system according to another embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

In particular, the first embodiment of the present invention will be described with reference to FIGS. 1 and 2, and the second embodiment of the present invention will be described with reference to FIG. 3.

< Example  1>

1 is a block diagram showing a configuration of a tracking control system 100 according to an embodiment of the present invention. As shown in FIG. 1, the tracking control system 100 includes a stationary camera 110, a mobile camera 120, a sound recognition device 130, and a control device 140.

The fixed camera 110 captures a specific area and detects whether a specific event occurs. The fixed camera 110 is composed of at least one camera, each of the cameras to shoot a different specific area. In addition, the fixed camera 110 may detect whether a specific event occurs in a specific area during the shooting. Here, the specific event represents a case where at least a moving subject is detected within the specific area. That is, the fixed camera 110 detects the presence of a moving subject in a specific area.

The fixed camera 110 may be a camera capable of capturing various types of images such as a general camera, a dome camera, an infrared camera, a laser camera, and a thermal imaging camera. In addition, the fixed camera 110 may be a camera capable of shooting a wide range of angle of view.

The movable camera 120 is a camera capable of zooming out or rotating the lens up, down, left, or right. In detail, the mobile camera 120 may shoot and track a subject by rotating the lens to a shooting target area and setting zoom and focus under the control of the control device 140. The mobile camera 120 may be a PTZ (Pan Tilt Zoom) camera including a lens rotation function, a zoom function, and a focus adjustment function, and may include a driving device for such an operation.

The sound recognition device 130 recognizes a sound input through at least one microphone. In addition, the sound recognition device 130 may include three or more microphones to calculate the direction of the input sound. The sound recognition device 130 transmits the input sound information to the control device 140. The microphones included in the sound recognition apparatus 130 may be installed at a position where at least one stationary camera 110 is disposed and at a position where the mobile camera 120 is disposed, and a blind spot that the stationary camera 110 cannot photograph. It can also be installed in.

The control device 140 controls the overall operation of the tracking control system 100. In detail, the control device 140 detects whether there is a moving object (ie, an event) in the image captured by the at least one fixed camera 110, and detects the moving object as an event when there is a moving object.

 At this time, the control device 140 may assign a priority according to the degree of change of the movement. In addition, when a plurality of events are simultaneously generated by the plurality of fixed cameras 110, the control device 140 may prioritize each event according to whether the subject is a person and the degree of movement of the subject. You can also choose a high event. For example, when the number of subjects is plural, the priority may be higher than when the number is singular, and the priority may be higher when the momentary movement of the subject is faster than when the momentary movement of the subject is slow.

In addition, the control device 140 may calculate the direction of the point where the sound is generated using three or more sound signals input from the sound recognition device 130. In addition, the control device 140 may calculate the direction of the sound only when the intensity of the input sound signal is equal to or greater than the first intensity value.

The control device 140 determines a shooting target area by using at least one of event information detected by the fixed camera 110 and sound information recognized by the sound recognition device 130, and moves the mobile camera to capture the determined shooting target area. The lens direction of 120 is controlled and moved. In addition, the control device 140 controls the mobile camera 120 to enlarge and photograph the moving subject included in the photographing target area through zoom in.

Determining the shooting target area by using at least one of the above descriptions may include determining the shooting target area using only the sound information recognized by the sound recognition apparatus 130 or selecting the shooting target area by using only the event information detected by the fixed camera 110. It means that the photographing target area can be determined according to the decision result or the combination result of these pieces of information, or according to the information of higher priority. Specifically, it may be divided into whether an event is detected through the fixed camera 110.

First, when an event is not detected through the fixed camera 110, the control device 140 uses only the recognized sound information when the sound of the intensity greater than or equal to the first intensity value is recognized by the sound recognition device 130. The lens direction of the mobile camera 120 is controlled to determine an area and to photograph the determined target area.

Here, the first intensity value represents a loudness value greater than the noise normally generated in the vicinity. That is, the occurrence of a sound higher than the first intensity value may be recognized as an event different from usual. Therefore, when the sound of the first intensity value or more is recognized, the control device 140 controls the mobile camera to capture the area where the sound is generated.

In this case, the crime or accident scene occurring in the blind spot of the fixed camera 110 will be used as a method for photographing by judging the scene.

Next, when an event is detected through the fixed camera 110, the control device 140 is detected by the fixed camera 110 when the sound of the intensity of the first intensity value or more is recognized by the sound recognition device 130. The object direction is determined using both the event information and the recognized sound information, and the lens direction of the mobile camera 120 is controlled to photograph the determined target area.

If the perceived intensity of the sound is greater than or equal to the second intensity value, the control device 140 may calculate the direction of the sound using the recognized sound information and may immediately determine the direction of the sound as the target region. Subsequently, the control device 140 controls the mobile camera 120 to photograph the cause of the sound by allowing the mobile camera 120 to photograph the direction in which the corresponding sound is sensed. That is, even when an event occurs in the fixed camera 110, the event may be immediately ignored and the direction of sound may be determined as the target region.

Here, the second intensity value corresponds to the intensity of the treble (for example, screams) or the impact sound (for example, gunshots, bombs, etc.) generated when it is in danger. In other words, the second intensity value is greater than the first intensity value. Therefore, when the control device 140 recognizes a sound having a second intensity value or more, the mobile device 120 controls the mobile camera 120 to preferentially capture an area where the sound is detected because it corresponds to a dangerous situation.

Finally, when the perceived intensity of the sound is between the first intensity value and the second intensity value, the control device 140 combines or compares the sound information with the event information to determine the photographing target according to the priority. To this end, the control device 140 calculates the direction of the sound using the recognized sound information, and determines whether an event is detected in a specific area photographed by the at least one fixed camera. When an event is detected in a specific area captured by the fixed camera 110, the control device 140 determines whether the calculated sound direction is included in the specific area captured by the fixed camera 110 on which the event is detected. You will be judged.

If the calculated sound direction is included in a specific area photographed by the stationary camera 110 in which the event is generated, the control device 140 selects a specific area corresponding to the direction of the calculated sound by the mobile camera 120. Control to shoot.

On the other hand, when the direction of the calculated sound is not included in the specific area photographed by the fixed camera 110 in which the event is detected, the control device 140 captures a specific area photographed by the fixed camera 120 in which the event is detected. Done. In this case, the control device 140 may control the mobile camera 120 to capture the direction corresponding to the higher priority by comparing the priority of the event information with the priority of the sound information.

To this end, the control device 140 may assign the priority to the event at various levels, or may assign the priority to the sound information at various levels for each intensity. In addition, when a plurality of events are detected by the plurality of fixed cameras 110, the control device 140 moves a specific area photographed by the camera on which one event having the highest priority is detected among the plurality of events. ) Can be controlled to shoot in detail.

For example, the control device 140 may determine a priority such as "sound intensity value A> motion event a> sound intensity value B> motion event b>…" according to a user's setting or operation, where sound The intensity value A is greater than the sound intensity value B, the movement event a may be set as a fast moving arm, and the movement event b may be set as a fast moving leg. This is because the case where the sound is louder than when the sound is small and when the arm moves faster than when the leg moves quickly is more likely to cause a crime or an accident.

On the other hand, when no event is detected in a specific area captured by the fixed camera 110, the control device 140 calculates the direction of the sound using the recognized sound information, and determines the direction of the sound as the target area. do.

In addition, when no sound is recognized by the sound recognition device 130 and an event is detected by the fixed camera 110, the control device 140 selects a specific area that is being captured by the fixed camera 110 where the event is detected. The lens direction of the mobile camera 120 is controlled to determine and photograph the determined target area.

The tracking control system 100 having such a configuration recognizes and monitors not only event detection information of the fixed camera 110 but also sound information, so that various areas can be monitored without blind spots.

Hereinafter, with reference to FIG. 2, the operation of the tracking control system 100 will be described by way of example. 2 is a flowchart provided to explain the operation of the tracking control system 100, according to an embodiment of the invention.

First, the tracking control system 100 determines whether an event is detected by the fixed camera 110 (S210). If an event is detected (S210-Y), the tracking control system 100 determines whether sound is detected through the sound recognition apparatus 130 (S220). If the sound is detected (S220-Y), the tracking control system 100 determines whether the sound intensity is greater than or equal to the first intensity value (S230), and determines whether the sound intensity is greater than or equal to the second intensity value (S220-Y). S240). In addition, when the sound intensity is smaller than the second intensity value (S240 -N), the tracking control system 100 determines the target area for the mobile camera 120 to photograph the subject according to a preset priority.

The priority may include whether the direction of the sound is included in the specific area where the event is generated. If the direction of the sound is included in the specific area where the event is generated, the mobile camera 120 may take a picture as the highest priority. Direction can be determined. In addition, if the direction of the sound is not included in the specific region where the event occurs, as described above, the direction to be photographed may be determined according to various priorities set by the user.

On the other hand, if an event is detected but no sound is detected (S220-N), or if the sound intensity is smaller than the first intensity value (S230-N), the tracking control system 100 detects an area to be photographed of the mobile camera 120. The event area (that is, the shooting area of the fixed camera 110 in which an event is detected) is determined (S260).

On the other hand, if an event is detected and the intensity of the sound is greater than or equal to the second intensity value (S240-Y), or if no event is detected, the sound is detected (S225-Y) and if the intensity of the sound is greater than or equal to the first intensity value (S235) -Y), the tracking control system 100 determines the photographing target area of the mobile camera 120 in the sound direction (that is, the direction in which the sound is detected) (S255).

In addition, the tracking control system 100 rotates the lens of the mobile camera 120 to face the determined target area (S270). In addition, the tracking control system 100 performs the zoom-in and focus adjustment so that the mobile camera 120 photographs the subject of the target area, and photographs and tracks the subject (S280).

Through such a process, the tracking control system 100 recognizes and monitors not only event detection information of the fixed camera 110 but also sound information, so that various areas can be monitored without blind spots.

On the other hand, in the above, the fixed camera 110, the mobile camera 120, the sound recognition device 130 and the control device 140 is set in the field and installed in a batch, the process is monitored by the mobile camera 120 Although described overall, the monitored result, that is, the acquired image is monitored in a separate control center can be processed and edited as needed by the control center as a matter of course. In addition, such a set device may be provided for each site to monitor the images obtained from a plurality of sites in the control center.

In addition, it will be apparent to those skilled in the art that such control centers may be implemented to individually or collectively control the fixed camera 110 and the mobile camera 120 as needed.

In addition, in the above, it is assumed that the stationary camera 110, the mobile camera 120, the sound recognition device 130, and the control device 140 are set at a specific site such as the upper end of the post, and are collectively installed. This is merely an example for the convenience of description. Therefore, as shown in FIG. 3, the control device 140 for controlling the fixed camera 110, the mobile camera 120, and the sound recognition device 130 may be installed in a separate external control center. The technical spirit of the invention may be applied as it is. Hereinafter, a configuration of a tracking control system according to another embodiment of the present invention will be described with reference to FIG. 3.

< Example  2>

3 is a block diagram showing a configuration of a tracking control system according to another embodiment of the present invention.

As shown, the fixed camera 110, the mobile camera 120, and the sound recognition device 130 are set so that the scenes 300-1, 300-2, ..., 300- around the predetermined surveillance target area are set. N), the control device 140 may be installed separately in the external control center 350, in this case, the external control center 350 or the control unit 140 manages all of a plurality of sets individually or You can control it.

This prevents unnecessary duplication of resources and enables continuous and total management of crimes or accidents caused by collective management and site movement.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: tracking control system 110: fixed camera
120; Mobile Camera 130: Sound Recognition Device
140: control unit

Claims (7)

At least one first camera that captures a specific area and detects whether a specific event occurs;
A second camera in which the lens is rotated up, down, left and right;
A sound recognition device recognizing a sound input through at least one microphone; And
The target area is determined using the event information detected by the first camera and the sound information recognized by the sound recognition device, and the determined target area is determined by rotating and zooming in so that the lens of the second camera faces the target area. And a control device for controlling to be photographed.
The control device includes:
When the occurrence of the specific event is detected by the first camera and the sound recognition apparatus recognizes a sound having an intensity greater than or equal to a first intensity value and less than a second intensity value, the event information detected by the first camera and the recognized Selecting a plurality of target region candidates based on sound information, determining a target region according to a predetermined priority among the plurality of target region candidates, and controlling a lens direction of the second camera to photograph the determined target region,
The control device includes:
When the direction of the sound calculated by the sound recognition apparatus is included in the specific area photographed by the first camera where the event is detected, the specific area corresponding to the calculated sound direction is determined as the highest priority and determined as the target area. Controlling the lens direction of the second camera so that the second camera captures the determined target area;
Among the plurality of target area candidates selected based on the event information,
The area where the event is generated by detecting a plurality of subjects is set to have a higher priority than the area where the event is detected by a single subject, and the area where the event is generated by detecting a subject with frequent arm movements. The subject with frequent movements of the foot motion is detected and the priority is set higher than the area where the event is generated, and the subject with the fast motion is detected and the area where the event is generated is detected by the subject with the slow motion. The priority is set high,
Among the plurality of target area candidates selected based on the sound information,
The priority is set higher as the intensity of the sound recognized by the sound recognition device increases.
The control device includes:
Although the occurrence of the specific event is not detected by the first camera and a sound of an intensity greater than or equal to a first intensity value is recognized by the sound recognition device, or the occurrence of the specific event is detected by the first camera, When a sound having an intensity greater than or equal to the second intensity value is greater than the first intensity value, a direction of the sound is calculated using only the recognized sound information, the direction of the sound is determined as the target area, and the determined target area is determined. Control the lens direction of the second camera to shoot the
The control device includes:
When the occurrence of the specific event is detected by the first camera and a sound less than a first intensity value is recognized by the sound recognition device, a target area is determined based on the event information detected by the first camera, and the determined object And control the lens direction of the second camera to capture an area. delete delete delete delete delete The method of claim 1,
The first camera, the second camera and the sound recognition device is composed of a set device is installed in the field around the target area,
The control device is a tracking control system, characterized in that the one set device is installed separately or included in the one set device in an external control center for managing a set group of a plurality of sets.

Images