KR101872811B1 - Apparatus and method for action pattern recognition, and method for generating of action pattern classifier - Google Patents

Abstract

The apparatus includes a processor for executing a program stored in a memory and a memory in which a behavior pattern recognition program for an object is stored, and the processor executes, based on the execution of the program, a density trajectory characteristic Calculates a density trajectory covariance matrix for the object based on the density trajectory feature, and classifies the behavior pattern for the object based on the behavior trajectory categorizer and the density trajectory covariance matrix for the object. In this case, the image data is image data of one or more viewpoints corresponding to the object, the behavior pattern classifier is generated based on the learning image data, and passes the density locus covariance matrix to classify into one or more behavior patterns. Is image data of one or more viewpoints collected respectively for a plurality of behavior patterns.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a behavior pattern recognition apparatus, a behavior pattern recognition method, and a behavior pattern classifier generation method.

The present invention relates to a behavior pattern recognition apparatus, a behavior pattern recognition method, and a behavior pattern classifier generation method for an object.

Action recognition technology is a technique for recognizing and classifying the behavior of people, animals, and objects using image data observed through a moving picture or a camera. This technique mainly recognizes specific behavior patterns and classifies behaviors using visual features extractable from image data. Therefore, behavior recognition technology is used in various fields such as surveillance system, human - computer interaction and entertainment.

However, the conventional behavior recognition technology based on image information has a limitation in accurately recognizing complicated behavior at an arbitrary point in time. Especially, the problem that the recognition accuracy is lowered when the pattern of behavior is complicated and the viewpoint is a target of various human beings can be further deepened.

Conventional techniques for solving such problems include a three-dimensional reconstruction-based behavior recognition technology. 3D reconstruction based behavior recognition technology requires stereo matching based depth information, so expensive equipment is needed.

In this regard, Korean Patent Laid-Open Publication No. 10-2014-0187541 (entitled "Method of recognizing behavior patterns using histograms of intensity and direction of motion of multiple viewpoints" Discloses a method of recognizing a human behavior pattern using a histogram. Specifically, the present invention performs a normalization of an image at multiple viewpoints in terms of space and time, generates a histogram of a motion direction and a motion intensity, and recognizes a human behavior pattern using the histogram.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the conventional art, and it is an object of the present invention to provide a behavior pattern recognition device for recognizing a behavior pattern of an object from image data based on a correlation between features included in image data, Thereby providing a classifier generation method.

It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

There is provided an apparatus for recognizing a behavior pattern of an object according to the first aspect of the present invention includes a processor for executing a program stored in a memory and a memory in which a behavior pattern recognition program of an object is stored, The processor extracts density trajectory features from the image data for the object, calculates a density trajectory covariance matrix for the object based on the density trajectory feature, and generates a density trajectory covariance matrix for the behavior pattern classifier and the object, Based on the classification of behavior patterns for objects. In this case, the image data is image data of one or more viewpoints corresponding to the object, the behavior pattern classifier is generated based on the learning image data, and passes the density locus covariance matrix to classify into one or more behavior patterns. Is image data of one or more viewpoints collected respectively for a plurality of behavior patterns.

According to a second aspect of the present invention, there is provided a behavior pattern recognition method for an object in a behavior pattern recognition apparatus, comprising: extracting a density trajectory feature from image data for an object; Computing a density trajectory covariance matrix for the object based on the density trajectory feature; And classifying the behavior pattern for the object based on the behavior pattern classifier and the density trajectory covariance matrix for the object. In this case, the image data is image data of one or more viewpoints corresponding to the object, the behavior pattern classifier is generated based on the learning image data, and is classified into any one of a plurality of behavior patterns based on the density locus covariance matrix. The image data is image data of one or more viewpoints collected for each of a plurality of behavior patterns.

A behavior pattern classifier generation method of a behavior pattern recognition apparatus according to a third aspect of the present invention includes: extracting a density trajectory feature from learning image data; Calculating a density locus covariance matrix for the learning image data based on the density locus feature extracted from the learning image data, and generating a behavior pattern classifier based on the density locus covariance matrix for the image data. In this case, the behavior pattern classifier classifies the behavior pattern classifiers into any one of a plurality of behavior patterns based on the density trajectory covariance matrix, and the learning image data is image data of one or more points of view collected for each of a plurality of behavior patterns.

The present invention can classify a behavior pattern of an object based on a covariance matrix of density trajectories extracted from image data. In addition, the present invention can use temporal correlation information on the behavior of an object.

Therefore, the present invention is capable of recognizing a behavior pattern for a point in time that is not included in the learning image data. In addition, the present invention can improve performance such as accuracy of behavior recognition in a situation where learning image data is not sufficient. Accordingly, the present invention is easy to apply to real life.

1 is a block diagram of a behavior pattern recognition apparatus for an object according to an embodiment of the present invention.
FIG. 2 is an exemplary view of image data at one or more viewpoints according to an embodiment of the present invention.
3 is an exemplary diagram of a behavior pattern recognition apparatus according to an embodiment of the present invention.
FIG. 4 is an exemplary diagram illustrating noise elimination of a density trajectory characteristic according to an embodiment of the present invention. Referring to FIG.
5 is a diagram illustrating an example of learning image data according to an exemplary embodiment of the present invention.
6 is a diagram illustrating an example of a behavior pattern classifier learning according to an embodiment of the present invention.
7 is a flowchart of a behavior pattern recognition method for an object in the behavior pattern recognition apparatus according to an embodiment of the present invention.
8 is a flowchart of a method of generating a behavior pattern classifier of a dynamic pattern recognition apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

1 to 6, a behavior pattern recognition apparatus 100 for an object 150 according to an embodiment of the present invention will be described.

1 is a block diagram of a behavior pattern recognition apparatus 100 for an object 150 according to an embodiment of the present invention.

The behavior pattern recognition apparatus 100 for the object 150 recognizes a behavior pattern for the object 150 from the image data. At this time, the behavior pattern recognition apparatus 100 for the object 150 includes a memory and a processor 120. In addition, the behavior pattern recognition apparatus 100 may further include a camera 130 for collecting image data.

The memory 110 stores a behavior pattern recognition program. At this time, the memory 110 collectively refers to a non-volatile storage device that keeps stored information even when no power is supplied, and a volatile storage device that requires power to maintain stored information.

The processor 120 executes a behavior pattern recognition program stored in the memory 110. [ That is, the processor 120 can recognize the behavior pattern of the object 150 from the image data for the object 150 based on the behavior pattern recognition program.

At this time, the object 150 may be a person, an animal, or an object capable of extracting motion information from the image data and recognizing a behavior pattern. Hereinafter, the object 150 will be described as an example of a person, but the present invention is not limited thereto.

In addition, the image data may be a still image or a moving image including an object 150 for recognizing a behavior pattern. And the image data may be collected to include the object 150 at one or more viewpoints. The video data will be described with reference to Fig.

FIG. 2 is an exemplary view of image data at one or more viewpoints according to an embodiment of the present invention.

For example, image data collected at one or more viewing points may be collected through a camera 130 disposed at a position capable of sensing movement of the object 150. At this time, the camera 130 may be a single camera or a plurality of cameras.

For example, the camera may be a closed-circuit television (CCTV) camera, but is not limited thereto.

In the case of using a single camera, a single camera can continuously capture objects 150 in different directions with constant time intervals to generate image data. At this time, the predetermined time interval may be short enough so that the behavior pattern of the object 150 does not change.

Further, when using a plurality of cameras, the plurality of cameras may be arranged at angles to photograph the objects 150 in different directions. Therefore, a plurality of cameras can simultaneously generate image data in different directions.

FIG. 3 is an exemplary view of a behavior pattern recognition apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 3, processor 120 extracts dense trajectory features for object 150 from the image data collected for multiple views. At this time, the density trajectory feature may be extracted for a predetermined number of frames included in the moving image data or a predetermined number of still image data.

For example, if the predetermined number is 16, the processor 120 may extract 16 frames from each viewpoint of the image data. The processor 120 may then extract the density trajectory features based on the 16 frames extracted from each viewpoint.

Meanwhile, the processor 120 may perform preprocessing of the image data for the object 150 before extracting the density trajectory feature.

Specifically, the processor 120 may convert image data for the object 150 into grayscale. The processor 120 can extract an area where a change in brightness over a certain level occurs in the image data converted into gray scale. The processor 120 may then extract the foreground region based on the extracted region.

For example, the processor 120 may extract the foreground region from the image data for the object 150 through Equation (1).

In Equation (1), R denotes the foreground region. In Equation (1), I denotes a frame converted to gray scale, and t denotes a frame number. And? Denotes a predetermined threshold value.

Processor 120 may perform preprocessing on the density trajectory based on the extracted foreground regions. That is, the processor 120 may remove noise included in the density trajectory based on the foreground region.

FIG. 4 is an exemplary diagram illustrating noise elimination of a density trajectory characteristic according to an embodiment of the present invention. Referring to FIG.

The processor 120 may extract the density trajectory from the image data. Referring to Figure 4 (a), the density trajectory can be represented by a point on the image. For example, a density trajectory can be represented by a red dot or a green dot. At this time, the red dot may be a fixed object or foreground. Also, the green dot may be a motion object.

The processor 120 may then extract the density trajectory feature from the extracted density trajectory. Referring to FIG. 4B, the density trajectory may include a fixed object or a background together with a motion object to be a behavior pattern recognition object.

In addition, the processor 120 may extract a foreground region to remove a fixed object or background from the density trajectory feature. At this time, the extracted foreground region is shown in (c) of FIG.

Processor 120 may perform preprocessing based on the extracted density trajectory features and foreground regions. For example, as shown in FIG. 4 (d), the processor 120 may perform preprocessing to remove noise included in the density trajectory feature by removing the foreground region from the extracted density trajectory feature.

Meanwhile, the processor 120 can extract the density trajectory feature from the noise-removed image data. At this time, the density trajectory feature can be an image feature that can be extracted from the image data. The density trajectory feature may also include surrounding contour information and surrounding motion information for the object 150.

For example, the surrounding contour information may include a histogram of oriented gradient (HOG) feature extracted from the object 150. In addition, the neighboring motion information may include, but is not limited to, a histogram of optical flow (HOF) characteristic and a motion boundary histogram (MBH) characteristic extracted from the object 150.

At this time, the HOG characteristic can be calculated based on the direction of an edge pixel whose gradient is larger than a predetermined value in the image data. Further, the HOF can be extracted based on an optical flow in each frame in the image data. The MBH feature can be extracted based on the inclination information of the motion boundary line of the object 150 included in the image data.

In addition, the processor 120 may generate a dense trajectory covariance matrix using the density trajectory feature.

For example, the processor 120 may generate a covariance matrix for each feature included in the density trajectory feature. That is, the processor 120 may generate the HOG feature covariance matrix using the HOG feature. The processor 120 may generate the HOF feature covariance matrix using the HOF feature and generate the MBH feature covariance matrix using the MBH feature.

At this time, the equation for calculating the density locus covariance matrix for the density trajectory characteristic is expressed by Equation (2).

In Equation (2), k is an index of the density trajectory characteristic. In Equation (2), E () denotes an expectation value function, and x _i ^k denotes a kth feature value of the i- th locus information. d is the dimension of each feature.

For example, if the density trajectory feature includes the HOF feature, the HOG feature, and the MBH feature as described above, k means either the HOF feature, the HOG feature, or the MBH feature. Also, the dimension d of the feature can be determined according to whether the corresponding feature is HOF feature, HOG feature or MBH feature.

The processor 120 can calculate a density trajectory log covariance matrix based on eigenvalue decomposition for the density trajectory covariance matrix, as shown in Equations (3) to (5).

First, the processor 120 may perform eigenvalue decomposition on the density trajectory covariance matrix as in Equation (3). In this case, V denotes a matrix which is a set of eigenvectors.

The processor 120 may convert the calculated eigenvalue matrix D into logarithmic values as in Equation (4) through eigenvalue decomposition.

을 생성할 수 있다. The processor 120 re-merges the log eigenvalue matrix with the eigenvector matrix, as shown in equation (5), to obtain a density locus log covariance matrix

Can be generated.

The processor 120 generates a behavior descriptor for the object 150 using the density locus log covariance matrix.

Specifically, the processor 120 may extract an upper triangular matrix component for each feature included in the density trajectory log covariance matrix. The processor 120 may then generate one vector form of behavior descriptor based on the upper triangular matrix component of each feature.

For example, the extracted behavior descriptor for the HOF feature, the HOG feature, and the MBH feature included in the density trajectory feature may be as shown in [Equation 6]. In Equation (6), tu () denotes an upper triangular matrix in a matrix for each feature.

The processor 120 may classify the behavior pattern of the object 150 based on the behavioral descriptor and the behavior pattern classifier extracted for the object 150. [

The behavior pattern classifier may be generated based on the learning image data.

At this time, the behavior pattern classifier may be one generated by the behavior pattern recognition apparatus 100. In addition, the behavior pattern classifier may be generated through a different behavior pattern recognition apparatus different from the behavior pattern recognition apparatus 100 or a separate behavior pattern classifier generation apparatus, and then transmitted to the behavior pattern recognition apparatus. Therefore, a process of generating a behavior pattern classifier through the behavior pattern recognition apparatus 100 will be described below, but the present invention is not limited thereto.

The behavior pattern classifier generation process will be described with reference to FIGS. 5 and 6. FIG.

5 is a diagram illustrating an example of learning image data according to an exemplary embodiment of the present invention.

The processor 120 may collect learning image data for learning the behavior pattern classifier. At this time, the learning image data may be collected based on a behavior pattern to be classified. Further, the learning image data may be one in which the corresponding behavior pattern is labeled.

Specifically, the processor 120 may collect image data corresponding to a behavior pattern to generate a classifier through the camera 150. [ Alternatively, the processor 120 may utilize image data stored in a database (not shown).

For example, when the behavior pattern classifier is to learn a behavior pattern classifier that classifies the first behavior pattern and the second behavior pattern, the processor 120 collects learning image data for the first behavior pattern and the second behavior pattern can do.

Referring to FIG. 5, the collected learning image data may be image data of four viewpoints for the first behavior pattern and image data of four viewpoints for the second behavior pattern.

At this time, the processor 120 may collect various learning image data on the behavior pattern to improve the classification accuracy of the behavior pattern classifier and to increase the reliability. For example, the processor 120 may collect image data of a first behavior pattern and image data of a second behavior pattern for a plurality of objects.

6 is a diagram illustrating an example of a behavior pattern classifier learning according to an embodiment of the present invention.

The processor 120 can learn the behavior pattern classifier using the collected learning image data and the learning algorithm.

Specifically, the processor 120 may extract a density trajectory characteristic for each of the collected learning image data, and calculate a density trajectory covariance matrix based on the extracted density trajectory characteristic. At this time, the process of extracting the density trajectory characteristic and calculating the density trajectory covariance matrix may be the same as the process of extracting the density trajectory characteristic for the behavior pattern recognition object 150 described above.

The processor 120 may learn a behavior pattern classifier using a density trajectory covariance matrix and a learning algorithm for learning image data. At this time, the learning algorithm may be at least one of a known statistical classification algorithm, a machine learning algorithm, and an image processing algorithm, but is not limited thereto. For example, the learning algorithm may be a support vector machine (SVM) algorithm.

The processor 120 may store the learned behavior pattern classifier in the memory 110, the storage module (not shown), or the database (not shown) included in the behavior pattern recognition apparatus 100 when the behavior pattern classifier is learned.

Therefore, the processor 120 can classify the behavior pattern corresponding to the target object by passing the extracted behavior descriptor corresponding to the behavior pattern recognition object to the learned behavior pattern classifier.

At this time, the view direction and the number of viewpoints of the image data of the plurality of objects for learning the image data of the behavior pattern recognition target object 150 and the behavior pattern classifier may be the same or different from each other.

Next, a behavior pattern recognition method for the object 150 of the behavior pattern recognition apparatus 100 according to an embodiment of the present invention will be described with reference to FIG.

7 is a flowchart of a behavior pattern recognition method for an object 150 of the behavior pattern recognition apparatus 100 according to an embodiment of the present invention.

The behavior pattern recognition apparatus 100 extracts a density trajectory feature from the image data of the object 150 (S700). At this time, the image data is image data of one or more viewpoints corresponding to the object (150).

Then, the behavior pattern recognition apparatus 100 calculates a density locus covariance matrix for the object 150 based on the density locus characteristic (S710).

At this time, the behavior pattern recognition apparatus 100 can extract the surrounding contour information and the surrounding motion information for the object 150 based on the density trajectory feature. The surrounding contour information may include a histogram of oriented gradient (HOG) extracted from the object 150. The surrounding motion information may include at least one of a histogram of optical flow (HOF) and a motion boundary histogram (MBH) extracted from the object 150.

The behavior pattern recognition apparatus 100 may calculate a density locus covariance matrix for the object 150 based on the surrounding contour information and the neighboring motion information.

The behavior pattern recognition apparatus 100 classifies the behavior pattern for the object 150 based on the calculated density locus covariance matrix and the behavior pattern classifier (S720). At this time, the behavior pattern classifier is generated based on the learning image data. The learning image data is a plurality of image data for one or more viewpoints collected for each of a plurality of behavior patterns.

On the other hand, the behavior pattern recognition apparatus 100 can collect image data through a plurality of cameras. At this time, the plurality of cameras are arranged to photograph the object 150 in different directions, respectively, and collect image data.

Therefore, the behavior pattern recognition apparatus 100 may extract the density trajectory feature from the image data for the object 150 collected using a plurality of cameras.

Next, a behavior pattern classifier generation method of the behavior pattern recognition apparatus 100 according to an embodiment of the present invention will be described with reference to FIG.

8 is a flowchart of a method of generating a behavior pattern classifier of a behavior pattern recognition apparatus according to an embodiment of the present invention.

The behavior pattern recognition apparatus 100 extracts a density trajectory feature from the learning image data (S800). At this time, the learning image data is one or more image data collected for each of a plurality of behavior patterns.

The behavior pattern recognition apparatus 100 calculates a density locus covariance matrix for the learning image data based on the density locus feature extracted from the learning image data (S810).

Then, the behavior pattern recognition apparatus 100 generates a behavior pattern classifier based on the density locus covariance matrix for the image data (S820).

The behavior pattern recognition apparatus 100, the behavior pattern recognition method, and the behavior pattern classifier generation method according to an embodiment of the present invention can classify the behavior pattern of the object based on the covariance matrix for the density trajectory extracted from the image data. Also, the behavior pattern recognition apparatus 100, the behavior pattern recognition method, and the behavior pattern classifier generation method may use temporal correlation information on the behavior of the object.

Therefore, the behavior pattern recognition apparatus 100, the behavior pattern recognition method, and the behavior pattern classifier generation method can recognize a behavior pattern at a point in time that is not included in the learning image data. In addition, the behavior pattern recognition apparatus 100, the behavior pattern recognition method, and the behavior pattern classifier generation method can improve the performance of the behavior recognition accuracy and the like in a situation where the learning image data is not sufficient. Accordingly, the behavior pattern recognition apparatus 100, the behavior pattern recognition method, and the behavior pattern classifier generation method can be easily applied to real life situations.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

While the methods and systems of the present invention have been described in connection with specific embodiments, some or all of those elements or operations may be implemented using a computer system having a general purpose hardware architecture.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Behavior pattern recognition device
110: Memory
120: Processor
130: camera
150: object

Claims (15)

An apparatus for recognizing a behavior pattern for an object,
A memory in which the behavior pattern recognition program of the object is stored; And
And a processor for executing a program stored in the memory,
Wherein the processor extracts a density trajectory characteristic for each image data of a plurality of viewpoints photographed in different directions with respect to the object in accordance with the execution of the program and generates a histogram of the HOG extracted from the object based on the density trajectory characteristic oriented gradient covariance matrix; calculating a density trajectory covariance matrix for the object based on the surrounding contour information; and classifying the density trajectory covariance matrix into one of a plurality of predetermined behavior patterns based on the density trajectory covariance matrix Classifying a behavior pattern according to a density trajectory covariance matrix for the object through a behavior pattern classifier,
Wherein the behavior pattern classifier is generated by using, as learning image data, image data of at least one viewpoint collected for each of the plurality of behavior patterns,
Wherein the density trajectory characteristic is extracted for a predetermined number of frames or still image data included in the image data. The method according to claim 1,
Wherein the processor further extracts surrounding motion information for the object based on the density trajectory feature,
And calculates a density trajectory covariance matrix for the object based on the surrounding contour information and the neighboring motion information. 3. The method of claim 2,
Wherein the surrounding motion information includes at least one of a histogram of optical flow (HOF) characteristic and a motion boundary histogram (MBH) characteristic extracted from the object. The method according to claim 1,
Wherein the processor extracts a foreground image from the image data for the object and performs pre-processing to remove noise from the density trajectory feature using the foreground image. The method according to claim 1,
Wherein the processor extracts an action descriptor based on a density trajectory covariance matrix for the object,
And classifies a behavior pattern for the object based on the behavior descriptor and the behavior pattern classifier. 6. The method of claim 5,
Wherein the processor calculates a density locus log covariance matrix based on a density locus covariance matrix for the object,
And extracts the behavior descriptor based on the density locus log covariance matrix. The method according to claim 1,
Wherein the processor extracts a density trajectory feature from the learning image data,
A density trajectory covariance matrix for the learning image data is calculated based on the density trajectory feature extracted from the learning image data,
And generates the behavior pattern classifier based on a density locus covariance matrix for the image data. 8. The method of claim 7,
Wherein the processor generates the behavior pattern classifier based on a density trajectory covariance matrix and a support vector machine algorithm for the learning image data. The method according to claim 1,
A plurality of cameras arranged to photograph the object simultaneously in different directions and collecting image data for the object at a plurality of points of view, or a plurality of cameras continuously photographing in different directions at predetermined time intervals, Further comprising a single camera for collecting image data for the first camera,
Wherein the processor extracts the density trajectory feature based on image data of a plurality of views collected from the camera. A behavior pattern recognition method for an object of a behavior pattern recognition apparatus,
Extracting a density trajectory characteristic for each image data of a plurality of views photographed in different directions with respect to the object;
Extracting peripheral contour information including a histogram of oriented gradient (HOG) characteristic extracted from the object based on the density trajectory characteristic;
Calculating a density locus covariance matrix for the object based on the peripheral contour information; And
Classifying a behavior pattern according to a density trajectory covariance matrix for the object through a behavior pattern classifier that classifies the behavior pattern into one of a plurality of predetermined behavior patterns based on a density trajectory covariance matrix,
Wherein the behavior pattern classifier is generated by using, as learning image data, image data of at least one viewpoint collected for each of the plurality of behavior patterns,
Wherein the density trajectory characteristic is extracted for a predetermined number of frames or still image data included in the image data. 11. The method of claim 10,
Prior to the step of computing a density trajectory covariance matrix for the object,
Further comprising extracting neighboring motion information for the object based on the density trajectory feature extracted for each of the plurality of viewpoints,
And calculating a density trajectory covariance matrix for the object based on the surrounding contour information and the neighboring motion information. 12. The method of claim 11,
Wherein the surrounding motion information includes at least one of a histogram of optical flow (HOF) characteristic and a motion boundary histogram (MBH) characteristic extracted from the object. 11. The method of claim 10,
Wherein the extracting of the density trajectory feature comprises:
A plurality of cameras arranged to photograph the object in different directions from each other and collecting image data for the object at a plurality of points of view, Acquiring image data of a plurality of viewpoints of the object from a single camera that collects image data of the object; And
And extracting the density trajectory feature from the image data of the plurality of viewpoints for the object. A behavior pattern classifier generation method of a behavior pattern recognition apparatus,
Extracting a density trajectory feature from the learning image data in which a plurality of predetermined behavior patterns are labeled;
Extracting peripheral contour information including a histogram of oriented gradient (HOG) feature extracted from the object from image data obtained by photographing an arbitrary object at a plurality of viewpoints, based on the density trajectory feature extracted from the learning image data; ;
Calculating a density locus covariance matrix for the learning image data based on the peripheral appearance information; And
Generating a behavior pattern classifier that classifies the behavior pattern classifier into one of the plurality of behavior patterns based on a density locus covariance matrix for the learning image data,
Wherein the density trajectory feature is extracted for a predetermined number of frames or still image data included in the image data,
Wherein the learning image data is image data of at least one viewpoint collected for each of the plurality of behavior patterns. A computer-readable recording medium recording a program for performing the method according to any one of claims 10 to 14 on a computer.

Images