KR100964726B1 - Method for tracking moving objects using characteristics of moving objects in image camera system - Google Patents

Abstract

The present invention discloses a moving object tracking method using moving object characteristics in an image camera system. A moving object tracking method according to an embodiment of the present invention is a moving object tracking method in a system including a plurality of video cameras, comprising: extracting a moving object to be tracked from an image photographed by the video camera; Storing characteristic information about the moving object; Comparing and updating characteristic information of the moving object in units of frames; And displaying the moving path of the moving object on the screen based on the result of the comparison, and further, when the moving object leaves the photographing area of the corresponding video camera, the stored updated characteristic information of the moving object is stored. On the basis, the moving object may be tracked from the image captured by the remaining video camera to display a moving path on the screen.

Moving Object, Tracking, Camera, Security

Description

Moving object tracking method using moving object characteristics in video camera system {METHOD FOR TRACKING MOVING OBJECTS USING CHARACTERISTICS OF MOVING OBJECTS IN IMAGE CAMERA SYSTEM}

The present invention relates to tracking a moving object, and more particularly, to move a moving object using characteristic information such as direction, color, and texture information of the moving object in a system having a plurality of video cameras. The present invention relates to a moving object tracking method using characteristics of a moving object in a video camera system for tracking a path.

Security and security equipment is being installed and operated to protect valuable life and property, from major facilities, buildings, and buildings to homes. From primitive equipment that suspended sounding objects on the initial line to recent CCTV-based equipment, security and security equipment aims to create an optimal environment that can protect valuable lives and property by responding immediately to intrusions. The video camera system for security and method purposes can obtain desired information by storing images captured by a plurality of video cameras and displaying them on a screen as necessary.

However, since the conventional video camera system stores only the captured video, it is troublesome to directly search the video captured by the plurality of video cameras in order to know the moving path of the person or moving object photographed by the specific video camera. .

Accordingly, there is a need for a method of tracking a moving path for a specific person or moving object from an image captured or stored in real time.

An object according to an embodiment of the present invention was devised to solve the above problems, all the images constituting the moving path of the moving object by using the characteristics such as the extracted direction, color and texture of the selected moving object. The present invention provides a moving object tracking method using moving object characteristics in an image camera system to be tracked using a camera.

Another object of the present invention is to provide a moving object characteristic in a video camera system capable of performing a security and crime prevention as well as tracking of a moving object in a network video recorder (NVR) system including a plurality of network cameras. It is to provide a moving object tracking method used.

In order to achieve the above object, a moving object tracking method according to an aspect of the present invention is a moving object tracking method in a system including a plurality of video cameras, a moving object to be tracked from an image captured by the video camera Extracting; Storing characteristic information about the moving object; Comparing and updating characteristic information of the moving object in units of frames; And displaying a coefficient of a moving path of the moving object on the screen on the screen based on the result of the comparison.

delete

Furthermore, when the moving object is out of the photographing area of the corresponding video camera, the moving object may be displayed on the screen by tracking the moving object from the image captured by the remaining video camera based on the last updated characteristic information of the stored moving object. Can be.

delete

According to another aspect of the present invention, there is provided a moving object tracking method in a moving object tracking method in a system including a plurality of image cameras, the image being captured by a plurality of image cameras and captured by a first image camera. Receiving a moving object to be tracked from the captured image; Extracting information including at least one of a direction, a color, and a texture of the selected moving object by comparing the frame unit; Displaying a moving path of the moving object in the image photographed by the first image camera based on the extracted characteristic information on the moving object; When the moving object is out of the photographing area of the first image camera, the moving object stores characteristic information on the moving object and based on the stored characteristic information on the moving object, the moving object from the images captured by the remaining video camera. Searching for; And displaying coefficients of the moving path of the moving object and the moving path order of the moving object on the moving path on the screen based on the result of the searched by the remaining image camera.

A moving object tracking method according to another aspect of the present invention is a moving object tracking method in a system including a plurality of video cameras, the direction, color and texture of the moving object taken by each of the plurality of video cameras Extracting and storing characteristic information including at least one of the following; Selecting a tracking moving object to be tracked from an image photographed by a first image camera among the plurality of image cameras; Retrieving feature information that matches the feature information of the tracked moving object from among the property information of the moving object photographed and stored by the plurality of video cameras; And tracking the moving path of the tracking moving object based on the characteristic information of the moving object that matches the characteristic information of the tracking moving object to sequentially move the tracking moving object and the moving path of the tracking moving object on the moving path. And displaying coefficients for the screen.

The extracting and storing of the characteristic information may include retrieving the characteristic information of the moving object of the captured image from the characteristic information of the previously stored moving object, and if the matching information exists, the movement of the characteristic information existing. It can be stored as characteristic information about an object.

Other objects and features of the present invention in addition to the above objects will be apparent from the description of the embodiments with reference to the accompanying drawings.

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, a moving object tracking method using moving object characteristics in an image camera system according to an exemplary embodiment will be described in detail with reference to FIGS. 1 to 6.

1 shows a system diagram of an embodiment for explaining the present invention.

Referring to FIG. 1, the system includes a storage unit 110, a control device 120, a display unit 130, and a plurality of video cameras 140.

The storage unit 110 may store the image photographed by the plurality of image cameras 140 for performing the present invention, characteristic information on at least one or more moving objects, and characteristic information on a tracking moving object to be tracked.

In this case, the characteristic information on the moving object may include a direction, color, texture, size, luminance, and the like of the moving object.

Of course, the storage means 110 may also store image information about the corresponding video camera. When the image cameras 141 to 143 are network cameras, the storage means 110 may also store the IP address of the image camera.

Here, the network camera will be briefly described as follows.

Network camera is used as IP camera or camera server. It is a system that combines a camera and a computer, and compresses and digitizes images as well as network connection. These network cameras do not require the use of analog cables because the network cable is directly connected, which makes a 100% network-based end-to-end digital system.

The display unit 130 may display an image photographed by the image cameras 141 to 143 or display a tracking path of a tracking moving object.

Furthermore, the display unit 130 may display on one side the number of moving objects that enter and the number of moving objects that enter the photographing area of the specific image camera, for example, the first image camera 141, and the tracking of the moving objects. When displaying a trace route, the coefficient corresponding to the sequence number of the trace route may also be displayed.

In this case, the display unit 130 may display the tracking path by various methods such as blinking or dotted lines, but the displaying method is not limited thereto.

The plurality of image cameras 140 stores an image in the storage means 110 by capturing an image of a corresponding photographing area and transmitting the image to the control device 120 through a transmission cable.

The control device 120 is a device responsible for the overall control of the video camera system. In the present invention, the control device 120 receives an image captured by the video camera, stores the image in the storage means 110, and stores the image or image stored in the storage means 110. The image captured in real time by the camera is displayed on the display unit 130 to directly select the tracking moving object to be tracked, and the moving path of the selected tracking moving object is tracked and displayed on the display unit 130.

When the tracking moving object is selected from the image photographed by the specific image camera, the control device 120 extracts and stores characteristic information about the selected tracking moving object, for example, direction, color, texture, brightness, and size. Of course, the direction of the tracking moving object can be determined by comparing with the previous image frame, and the color, texture, luminance and size can be extracted when the tracking moving object is selected in the corresponding image frame.

For example, the color information of the tracking moving object may be extracted through color codes of the selected tracking moving object when the tracking moving object is selected, and the texture information may be obtained by extracting texture pixels from the tracking moving object.

Furthermore, the control device 120 tracks the moving path of the selected tracking moving object in the image of the corresponding video camera and displays the moving path as a flickering or dotted line on the screen, and the tracking moving object is moved out of the shooting area of the corresponding video camera. After storing the characteristic information of the tracking moving object, the tracking moving object may be detected from the image captured by the remaining video camera based on the stored information, and the moving path of the tracking moving object may be displayed on the screen. This series of processes is repeated until the tracking moving object is removed from all the video cameras, and whether or not the tracking moving object is removed from the shooting area of all the video cameras can be determined by various methods such as a method using time.

In addition, the control device 120 receives the tracking movement object from the image stored in the storage means 110, not the tracking movement object from the image captured in real time, and retrieves the movement path of the tracking movement object from the stored image on the screen. This method extracts the characteristic information of the selected tracking moving object and compares it with the frame of the image stored in the storage means 110 to match the information or if the matching rate is higher than the preset value, and determines the tracking moving object. You can also track. Of course, by searching in consideration of the storage time of the image for the selected tracking moving object, the range of the image to be compared may be determined.

Furthermore, the control device 120 extracts a moving object included in the image before the image is captured by the image camera and stored in the storage means 110, and stores the characteristic information about the moving object together with the image. ) Can be stored separately, and if the tracking moving object is selected using the characteristic information of the separately stored moving object, the moving path of the tracking moving object can be tracked and displayed on the screen using the stored information.

Of course, the characteristic information of the moving object extracted at the time of shooting may be stored in a predetermined format. For example, the information of the corresponding video camera (for example, an IP address), the shooting time, etc. may be matched with the characteristic information of the moving object. Can be stored.

In addition, when displaying the moving path on the screen, the control device 120 may display the moving path as a whole by displaying a coefficient for the moving path sequence of the tracking moving object together.

The video camera system shown in FIG. 1 may be an NVR system including a plurality of network cameras.

2 is a flowchart illustrating a method of tracking a moving object according to an embodiment of the present invention, and a process of tracking a moving path by selecting a tracking moving object from an image captured in real time.

Referring to FIG. 2, in the moving object tracking method, a tracking moving object to be tracked is selected from an image captured by a specific image camera, for example, a first image camera (S210).

From the selected tracking moving object, information including characteristic information, for example, direction, color, texture, and the like is extracted and stored (S220).

In this case, as in the example shown in FIG. 3, the direction information of the tracking moving object may know the direction information of the tracking moving object by comparing the i-th frame with the (i + 1) -th frame, for example. . For example, by comparing two image frames, the previous frame and the current frame may be sequentially compared in units of 8 × 8 macro blocks (MBs). That is, the direction of the tracking moving object can be known by comparing the left, right, up, and down MB between two frames.

When the characteristic information of the tracking moving object is stored, the characteristic information of the tracking moving object is compared in units of frames, the characteristic information of the tracking moving object is extracted in the next frame, and the previously stored characteristic information is updated (S230).

By repeating step S230 to display the movement path for the tracking moving object in various ways such as flickering or dotted lines on the screen (S240).

Of course, as shown in the example shown in Figure 4, when displaying the movement path for the tracking movement object, the order of the movement path, that is, the order of movement of the tracking movement object, such as 1, 2, 3, 4, 5, etc. You can also display the sequence number together.

Repeating steps S230 and S240, which are information updating and moving path display processes of the tracking moving object, is performed until the shooting area of the specific video camera is separated, and when the shooting area of the specific video camera is separated by step S250, The final update information of the updated tracking moving object is stored to track the moving path of the tracking moving object from the image captured by the remaining video camera (S260).

That is, the tracking moving object may be tracked by comparing the last updated characteristic information of the stored tracking moving object with the frames of the images captured by the remaining video cameras to determine whether the tracking moving object is to be tracked.

By performing the step S260 in all video cameras except for the specific video camera, the movement path of the tracking moving object in the remaining video cameras is displayed on the screen (S270).

At this time, the movement path of the tracking moving object may be sequentially displayed on one screen, or may be displayed on an image captured by the corresponding video camera, and the skilled person may recognize that the display method is not limited thereto. will be.

Of course, after detecting all the moving paths for the tracking moving object, the moving path and the order of the moving path may be simultaneously displayed on each corresponding image.

As can be seen in an embodiment according to the present invention, the present invention by using the characteristic information of the tracking moving object, such as the direction, color, texture of the tracking moving object to quickly detect and display the moving path on the screen, grasp the moving path It can reduce the time it takes to remove, and eliminate the hassle of having to search the stored video screen.

FIG. 5 is a flowchart illustrating a method of tracking a moving object according to another embodiment of the present invention, and is a process of extracting and displaying a moving path of a selected tracking moving object from a stored image from the stored image.

Referring to FIG. 5, the moving object tracking method stores the images photographed by the plurality of image cameras in the storage means provided at step S510.

Among the images stored in the storage means, for example, a tracking moving object to be tracked is selected from an image captured by the first image camera and stored in the storage means (S520).

When the tracking moving object is selected, the feature information of the selected tracking moving object is extracted, and the moving path of the tracking moving object is searched and displayed on the screen based on the extracted characteristic information (S530 and S540).

Of course, in order to track the tracking moving object, it is preferable to compare the image by the frame unit and update and store the characteristic information of the tracking moving object based on the comparison result.

Repeat step S540 until the selected tracking moving object leaves the area of the image captured by the corresponding video camera, and when leaving the shooting area, saves the property information of the last updated tracking moving object, and stores the characteristics of the stored moving object. The tracking moving object is searched for from the image photographed / stored by the remaining video camera based on the information (S560 to S580).

When the tracking moving object is found from the image captured / stored by the remaining video camera, the tracking movement of the remaining video is stored by updating / saving the characteristic information of the searched tracking moving object through comparison of image frames as in steps S530 and S540. The movement path for the object is displayed (S590).

Of course, it is described to display the moving path by performing the moving path for the selected tracking moving object for each of the video cameras. You can also search for objects at the same time to mark their path.

FIG. 6 is a flowchart illustrating a method for tracking a moving object according to another embodiment of the present invention, and extracting and storing characteristic information about a moving object when storing an image captured by an image camera, and then selecting the selected tracking moving object. It is about the process of displaying the movement path.

Referring to FIG. 6, the moving object tracking method extracts a moving object from an image photographed by each of the plurality of video cameras, extracts a characteristic of each of the extracted moving objects, and stores the extracted object with the image (S610).

That is, when it is determined that the moving object is compared by comparing at least one moving object in an image frame unit, feature information about the moving object is extracted, and the extracted characteristic information and the image are stored together. The information may be information about a time point determined as the moving object or a time point when the moving object leaves the photographing area, and the corresponding video camera information, the image, the photographing time, and the characteristic information may be matched and stored together.

In this case, when extracting the characteristic information of the moving object from the image captured in real time, it is determined whether the same characteristic information exists by searching for the characteristic information of the moving object that is stored in advance, and if the same characteristic information exists, The same characteristic information may be stored as characteristic information about a moving object extracted from the corresponding image.

In the state in which the characteristic information of each moving object included in the image is separately stored in operation S610, the image captured / stored by the first image camera among the plurality of image cameras is read and displayed on the screen, and the image is to be tracked. The moving object is selected (S620). Of course, it is obvious that the tracking moving object may be selected from an image captured by another image camera other than the image captured by the first image camera.

When the tracking moving object is selected, information corresponding to the characteristic information stored at the time of image capturing of the selected tracking moving object is searched in a field or a predetermined region in which the characteristic information of the moving object is stored (S630).

For example, color information, texture information, and the like among the characteristic information of the previously stored moving object detect a moving object that matches the characteristic information of the tracking moving object.

When the moving object having the same characteristic information is found, the moving path of the searched moving object is displayed on the screen, so that the entire moving path of the selected tracking moving object can be displayed on the screen (S640).

Of course, as described above with reference to FIGS. 2 and 5, when the moving paths of the tracking moving objects are displayed for all the video cameras, the sequence numbers of the moving paths are displayed together so that the user can see the exact moving path of the tracking moving objects. You can check on

As can be seen in Figure 6, the present invention by extracting and storing the characteristic information of the moving object when storing the real-time image, it can be compared by searching only the characteristic information when you want to track the movement path later to select the moving object You can quickly track your route and display it on the screen.

The moving object tracking method using the moving object characteristic in the image camera system according to the present invention can be modified and applied in various forms within the scope of the technical idea of the present invention and is not limited to the above embodiments. In addition, the embodiments and drawings are merely for the purpose of describing the contents of the invention in detail, not intended to limit the scope of the technical idea of the invention, the present invention described above is common knowledge in the technical field to which the present invention belongs As those skilled in the art can have various substitutions, modifications, and changes without departing from the spirit of the present invention, it is not limited to the embodiments and the accompanying drawings. And should be judged to include equality.

1 shows a system diagram of an embodiment for explaining the present invention.

2 is a flowchart illustrating a moving object tracking method according to an exemplary embodiment of the present invention.

3 is an exemplary diagram for illustrating a comparison of image frame units.

4 is an exemplary diagram for indicating a coefficient for a sequence of a moving path.

5 is a flowchart illustrating a moving object tracking method according to another exemplary embodiment of the present invention.

6 is a flowchart illustrating a moving object tracking method according to another embodiment of the present invention.

Claims (13)

In the moving object tracking method in a system comprising a plurality of video camera, Extracting a moving object to be tracked from the image photographed by the image camera; Storing characteristic information about the moving object; Comparing and updating characteristic information of the moving object in units of frames; And Displaying coefficients for the moving path of the moving object and the moving path sequence of the moving object on the moving path based on the result of the comparison; Moving object tracking method comprising a. delete The method of claim 1, The characteristic information about the moving object And at least one of direction information, color information, luminance information, texture information, and size information of the moving object. The method of claim 1, When the moving object is out of the photographing area of the corresponding video camera, the moving object tracks the moving object from the image captured by the remaining video camera based on the last updated characteristic information of the moving object and displays the moving path on the screen. Tracking method. The method of claim 4, wherein The last updated characteristic information of the moving object Moving object tracking method that is the direction information, color information and texture information of the moving object. The method of claim 1, The moving object Moving object tracking method that is directly selected and extracted from the image taken by the video camera. The method of claim 1, The video camera Moving object tracking method that is a network camera. The method of claim 1, The movement path is Moving object tracking method displayed on the screen by a dotted line or flashing. The method of claim 1, Displaying the number of moving objects entering the shooting area of the video camera and the number of moving objects moving out on one side of the screen; Moving object tracking method further comprising. delete In the moving object tracking method in a system comprising a plurality of video camera, Receiving a moving object to be tracked from an image captured by a first image camera among images captured and stored by the plurality of image cameras; Extracting information including at least one of a direction, a color, and a texture of the selected moving object by comparing the frame unit; Displaying a moving path of the moving object in the image photographed by the first image camera based on the extracted characteristic information on the moving object; When the moving object is out of the photographing area of the first image camera, the moving object stores characteristic information on the moving object and based on the stored characteristic information on the moving object, the moving object from the images captured by the remaining video camera. Searching for; And Displaying coefficients of the moving path of the moving object and the moving path order of the moving object on the moving path on the screen based on the result of the searched from the images captured by the remaining image cameras; Moving object tracking method comprising a. In the moving object tracking method in a system comprising a plurality of video camera, Extracting and storing characteristic information including at least one of a direction, a color, and a texture of a moving object photographed by each of the plurality of image cameras; Selecting a tracking moving object to be tracked from an image photographed by a first image camera among the plurality of image cameras; Retrieving feature information that matches the feature information of the tracked moving object from among the property information of the moving object photographed and stored by the plurality of video cameras; And The moving path of the tracking moving object is tracked based on the characteristic information of the moving object that matches the characteristic information of the tracking moving object, so that the moving path of the tracking moving object and the moving path of the tracking moving object are sequentially moved. Display coefficients on screen Moving object tracking method comprising a. The method of claim 12, Extracting and storing the characteristic information Moving object tracking method for retrieving the characteristic information of the moving object of the image photographed from the stored characteristic information of the moving object, and storing the existing characteristic information as the characteristic information of the moving object to be photographed if there is a matching information .

Images