CN110992397B

CN110992397B - Personnel access track tracking method, system, computer equipment and storage medium

Info

Publication number: CN110992397B
Application number: CN201910998596.1A
Authority: CN
Inventors: 林勉嵩; 李海伟
Original assignee: Zhejiang Dahua Technology Co Ltd
Current assignee: Zhejiang Dahua Technology Co Ltd
Priority date: 2019-10-21
Filing date: 2019-10-21
Publication date: 2023-07-21
Anticipated expiration: 2039-10-21
Also published as: CN110992397A

Abstract

The application relates to a method, a system, a computer device and a storage medium for tracking a person access track. The method comprises the following steps: acquiring a first shoe print and a first time when the first shoe print is acquired, and acquiring a first personnel image at the first time; acquiring a first attribute through a first shoe print, acquiring a second attribute according to a first person image, and associating the first person image with the first shoe print according to the first attribute and the second attribute; after the association is successful, a first event is obtained that is executed by the first person at a first time. By means of the collected shoe print information and personnel image information in the same time and space, personnel images of the same personnel are associated with the shoe print according to personnel attributes obtained by the shoe print information and personnel attributes obtained by the personnel images, events executed by personnel at an entrance are accurately judged, and accordingly more accurate personnel access tracks are obtained, and accurate passenger flow statistical analysis is achieved.

Description

Personnel access track tracking method, system, computer equipment and storage medium

Technical Field

The application relates to the technical field of entrance and exit people counting, in particular to a personnel entrance and exit track tracking method, a system, computer equipment and a storage medium.

Background

In many public environments, there is a need for accurate statistical analysis of passenger flows, for example, in the case of public transportation means or elevators, large data analysis is required to be performed by data such as the number of passengers on each station or floor, the number of passengers on a certain passenger station, etc., so as to obtain accurate passenger flow data. The passageway of the public transportation means has the characteristics that: the passing person has no identity mark; the number of people is relatively large, so that crowding exists; one ticket gets on the bus, swipes the card, pays the coin or pays the money electronically once, and cannot know which station the person gets off, and accurate statistical analysis of passenger flow cannot be performed. In the related art, in the process of collecting personnel images through a camera to perform passenger flow statistical analysis, a plurality of scenes are formed, for example, the camera installed in a public transportation tool cannot collect personnel face images due to crowded personnel or personnel facing to the outside, some parking points of the public transportation tool have no fixed positions, the camera of a parking site cannot collect the personnel face images, and in addition, when the personnel flow amount is large in a gateway of a mall or an office building, the camera cannot accurately collect the problem that passenger flow statistical data of each access personnel are inaccurate.

Aiming at the problem of inaccurate passenger flow statistical data in the related technology, no effective solution is proposed at present.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a personnel access trajectory tracking method, system, computer device, and storage medium.

To achieve the above object, according to one aspect of the present invention, there is provided a person access trajectory tracking method, the method comprising:

acquiring a first shoe print and a first time when the first shoe print is acquired, and acquiring a first person image at the first time;

acquiring a first attribute through the first shoe print, acquiring a second attribute according to the first person image, and associating the first person image with the first shoe print according to the first attribute and the second attribute;

and after the association is successful, a first event executed by a first person at the first time is obtained, wherein the first person corresponds to the first person image.

In one embodiment, the obtaining a first attribute through the first shoe print, obtaining a second attribute according to the first person image, and associating the first person image with the first shoe print according to the first attribute and the second attribute includes:

Acquiring a first attribute through the first shoe print, and acquiring a second attribute through the first person image;

the first attribute includes: a first spatial distribution characteristic, a first gender, and a first estimated height;

the second attribute includes: a second spatial distribution characteristic, a second gender, and a second estimated height;

and associating the first footprint with the first person image, with a first person, if the first and second spatial distribution characteristics match, the first and second sexes match, and the first and second estimated heights match.

In one embodiment, after the association is successful, obtaining the first event performed by the first person at the first time includes:

acquiring a first face direction of the first person in the first person image and a first shoe print direction of the first shoe print;

and under the condition that the first face direction and the first shoe print direction are both towards the first direction, judging that the first event is executed by the first person at the first time.

In one embodiment, after the association is successful, after the first event performed by the first person at the first time, the method includes:

Acquiring a second shoe print and acquiring a second time of the second shoe print, and acquiring a second personnel image of the first personnel at the second time under the condition that the second shoe print is consistent with the first shoe print;

acquiring a second face direction of the first person and a second shoe print direction of the second shoe print in the second person image;

and judging that the first person executes a second event at the second time under the condition that the second face direction and the second shoe print direction are both towards a second direction.

acquiring a second shoe print and acquiring a second time of the second shoe print, recording the second time as last acquisition time under the condition that the second shoe print is consistent with the first shoe print, acquiring no shoe print consistent with the first shoe print within a time threshold preset after the second time, and executing a second event by the first person at the second time.

According to another aspect of the present invention, there is provided a person access trajectory tracking method, the method comprising:

Collecting a first shoe print at a vehicle entrance and a first time when the first shoe print is collected, and obtaining a first person image at the first time;

and after the association is successful, acquiring a first site according to the first time, and obtaining that a first person executes a first event at the first site at the first time, wherein the first person corresponds to the first person image.

acquiring a first attribute through the shoe print, and acquiring a second attribute through the personnel image;

The shoe print and the person image are associated to the same person in case the first and second spatial distribution features coincide, the first and second gender coincide and the first and second estimated height coincide.

In one embodiment, after the association is successful, acquiring the first site according to the first time, and obtaining the first event executed by the first person at the first site at the first time includes:

and judging that the first person gets on the bus at the first station at the first time under the condition that the first face direction and the first shoe print direction are both towards the interior of the carriage of the public transport means.

In one embodiment, the method includes, after obtaining the first event performed by the first person at the first site according to the first time to obtain the first site, the method includes:

and under the condition that the second face direction and the second shoe print direction are both towards the outside of the carriage of the public transport means, acquiring a second station according to the second time, and judging that the first person gets off the carriage at the second station at the second time.

acquiring a second shoe print and acquiring a second time of the second shoe print, recording the second time as last acquisition time under the condition that the second shoe print is consistent with the first shoe print, acquiring a second site according to the second time when the shoe print which is consistent with the first shoe print is not acquired within a time threshold preset after the second time, and executing a second event by the first person at the second site.

In one embodiment, the collecting the first footprint at the vehicle entrance and the obtaining the second footprint comprises:

Collecting the first shoe print or the second shoe print at the entrance and the exit of the vehicle in a state that a vehicle door of the vehicle is opened;

in a door-closed state of the vehicle, the first shoe print at the vehicle entrance is not acquired and the second shoe print is not acquired.

In one embodiment, the collecting the first footprint at the vehicle access opening comprises:

collecting the first shoe print at the vehicle entrance in a door open state of the vehicle;

in a door closed state of the vehicle, the first shoe print at the vehicle entrance is not collected.

According to another aspect of the present invention, there is provided a personnel access trajectory tracking system, the system comprising: shoe print collection device, image collection device and analysis processor:

the shoe print collecting equipment obtains a first shoe print and the first time when the first shoe print is collected, and sends the first shoe print to the analysis processor;

the image acquisition device acquires a first personnel image at the first time and sends the first personnel image to the analysis processor;

The analysis processor obtains a first attribute through the first shoe print, obtains a second attribute according to the first person image, and associates the first person image with the first shoe print according to the first attribute and the second attribute; and after the association is successful, the analysis processor acquires a first position at the first time to obtain a first event executed by the first person at the first position, wherein the first person corresponds to the first person image.

According to another aspect of the present invention, there is also provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of a method for tracking a person's entry and exit trajectory as described above when the computer program is executed.

According to another aspect of the present invention, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of a person entry and exit trajectory tracking method as described above.

According to the personnel access track tracking method, system, computer equipment and storage medium, the personnel images of the same personnel are associated with the shoe marks according to the acquired shoe mark information and personnel attribute acquired by the personnel images in the same time and space, and the events executed by the personnel at the access opening are more accurately judged, so that more accurate personnel access tracks are acquired, and accurate passenger flow statistical analysis is achieved.

Drawings

FIG. 1 is a diagram of an application scenario of a method for tracking a human access trajectory according to an embodiment of the present invention;

FIG. 2 is a flow chart of a method for tracking a person's entry and exit trajectory according to one embodiment of the invention;

FIG. 3 is a diagram illustrating an application scenario of a method for tracking a human access trajectory according to another embodiment of the present invention;

FIG. 4 is a flowchart of a method for tracking a path of a person's entry and exit according to another embodiment of the present invention;

FIG. 5 is a second flowchart of a method for tracking a path of a person's entry and exit according to another embodiment of the present invention;

FIG. 6 is a flowchart of a method for tracking a path of a person's entry and exit according to another embodiment of the present invention;

FIG. 7 is a flowchart of a method for tracking a person's entry and exit trajectory according to another embodiment of the present invention;

FIG. 8 is a flowchart of a method for tracking a person's entry and exit trajectory according to yet another embodiment of the present invention;

FIG. 9 is a schematic illustration of a shoe print collected by a method for tracking a path of a person's access in accordance with yet another embodiment of the present invention;

FIG. 10 is a flowchart of a method for tracking a person's entry and exit trajectory according to another embodiment of the present invention;

FIG. 11 is a schematic diagram of a personnel access trajectory tracking system according to one embodiment of the invention;

FIG. 12 is a schematic diagram of a personnel access trajectory tracking system according to another embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

Fig. 1 is an application scenario diagram of a method for tracking a person's entry and exit track according to an embodiment of the present invention, as shown in fig. 1, where a shoe print collecting device 12 and an image collecting device 14 may be connected to an analysis processor through a network. The shoe print collecting device 12 is located at the entrance a and can collect shoe prints of persons entering and exiting the entrance a, and the image collecting device 14 is located near the entrance a and can collect images of persons entering and exiting the entrance a.

In one embodiment, fig. 2 is a flowchart of a method for tracking a person's access track according to one embodiment of the present invention, as shown in fig. 2, and a method for tracking a person's access track is provided, which is described by taking the application of the method to the shoe print collecting device 12 and the image collecting device 14 in fig. 1 as an example, and includes the following steps:

Step S210, acquiring a first shoe print and the first time when the first shoe print is acquired, and acquiring a first person image at the first time;

in step S210, the shoe print collecting device 12 collects the first shoe print and records the time stamp, and obtains the first time when the shoe print is collected according to the time stamp, and obtains the first person image captured by the image collecting device 14 at the first time, and through this step S210, the shoe print information collected by the shoe print collecting device 12 and the person image information collected by the image collecting device 14 are obtained in the same space at the same time.

Step S220, acquiring a first attribute through a first shoe print, acquiring a second attribute according to a first person image, and associating the first person image with the first shoe print according to the first attribute and the second attribute;

in step S220, a first attribute of a person corresponding to the first shoe print is obtained through the first shoe print, and at the same time, a second attribute of a person corresponding to the person image is obtained through the first person image, wherein the obtaining of the first attribute and the second attribute mainly depends on a preset judgment rule based on experience, for example, the sex of the person corresponding to the first shoe print can be judged through the size and the shape of the first shoe print, and if the pressure generated by the first shoe print can be collected, even the weight of the person corresponding to the first shoe print can be judged; and the face and the figure characteristics of the person corresponding to the first person image can be acquired through the first person image, and when the person attribute in the first attribute is consistent with the person attribute in the second attribute, the first person image and the first person image can be judged to belong to the same person, and the first person image are correlated to correspond to the same person. In the step S220, according to the first shoe print and the first person image acquired by the shoe print acquisition device 12 and the image acquisition device 14 in the same space at the same time, the shoe print information and the person image information corresponding to the same person are obtained, so that the problem that the identity of the person in and out cannot be recognized only by the shoe print acquisition device, and the specific action of the person in and out cannot be judged even if the person image acquisition device is crowded is solved.

Step S230, after the association is successful, a first event executed by a first person at a first time is obtained, wherein the first person corresponds to a first person image;

in this step S230, after the first person image and the first shoe print are related, the first event performed by the first person at the entrance a at the first time may be determined by the first shoe print and the face and limb actions presented by the first person in the first person image, where the first event may be a description of the action of the first person or a determination of the movement track of the first person according to the action of the first person, for example, the first person answering a phone at the entrance a, or the first person leaving the building at the entrance a. More specific information can be obtained by combining the first time and the identification of the first personnel image, for example, 9 am on a certain day: 20, the first person is judged to enter the entrance A according to the first shoe print, and the first person is judged to be the worker Wang Mou according to the first person image, so that the first person can accurately count that the worker Wang Mou enters the entrance A at 9:20 am.

According to the method for tracking the personnel access track, the shoe print collecting device 12 collects shoe prints, the image collecting device 14 collects shoe prints and personnel images in the same space at the same time, personnel attributes obtained by shoe print information are compared with personnel attributes obtained by personnel images, personnel images with consistent personnel attributes are associated with the shoe prints, events carried out by personnel at an access opening are judged more accurately, on one hand, more accurate personnel access track is obtained so as to achieve accurate passenger flow statistical analysis, on the other hand, the shoe prints are associated with the personnel images, and the subsequent comparison and analysis of the collected shoe prints can be achieved as long as the shoe print collecting device 12 or an analysis processor records the associated shoe prints and the personnel images into a database.

The first time in the above embodiment may be linked with other systems, for example, when the mobile device is used in a mobile application scenario, the position of the mobile scenario may be obtained according to the first time, so as to further determine the position of the mobile device executed at the first time.

In one embodiment, obtaining a first attribute from a first shoe print, obtaining a second attribute from a first person image, associating the first person image with the first shoe print based on the first attribute and the second attribute comprises:

acquiring a first attribute through a first shoe print, and acquiring a second attribute through a first personnel image;

in the event that the first and second spatial distribution characteristics match, the first and second sexes match and the first and second estimated heights match, the first shoe print and the first person image are associated to the same person.

In this embodiment, the shoe print collecting device 12 may collect multiple shoe prints at the same time point, and the different shoe prints have different distributions in the shoe print image, so that the first spatial distribution characteristic of the person, such as the southwest corner located in the shoe print collecting area, may be determined; the first sex and the first estimated height of the person can be further judged through the length of the shoe mark. The image acquisition device 14 acquires a plurality of personnel images at the same time point, the spatial position distribution of different personnel in the images is different, for example, four personnel images are captured in the image at the same time, so that a second spatial distribution characteristic can be obtained according to the distribution of the four personnel in the images, the second distribution characteristic can also be used as a reference object by selecting the shoe print acquisition device 12, the distribution of the first personnel on the shoe print image is judged according to the position of the first personnel in the images, the second spatial distribution characteristic is compared with the first spatial distribution characteristic, and the shoe print with consistent spatial distribution characteristics and the corresponding identical personnel of the images can be obtained; in addition, the second sex of the person can be further judged through the face, the hairstyle and the like, meanwhile, the height difference among different persons can be recognized through the person image, and the second estimated height of the person is calculated. By combining the first spatial distribution characteristic of the first shoe print and the second spatial distribution characteristic of the spatial position of the first person in the first person image, the first gender, the second gender, the first estimated height and the second estimated height, the association relationship between different shoe prints and different persons can be accurately judged, and by means of the implementation of the embodiment, the shoe prints and the images of the persons can be associated through the comparison of three most representative elements in the attribute of the persons, so that the data records corresponding to the shoe prints and the persons are obtained, and accurate passenger flow analysis is convenient.

In one embodiment, after the association is successful, a first event is obtained for execution by the first person at a first time comprising:

acquiring a first face direction of a first person in a first person image and acquiring a first shoe print direction of a first shoe print; in the case where the first face direction and the first shoe print direction are both oriented in the first direction, it is determined that the first person is executing the first event at the first time.

In this embodiment, in the case where the first person image and the first shoe print are both of the first person, the first face direction of the first person in the first person image is acquired, for example, when the first face direction and the first shoe print direction of the first person are both toward the inside of the building where the doorway a is located, it may be determined that the first person enters the doorway a. Similarly, when both the first face direction and the first shoe print direction of the first person are directed toward the outside of the building in which the doorway a is located, it can be determined that the first person is away from the doorway a. The above-mentioned face and footprint directions are consistent, and the angles of the first face direction and the first footprint direction are not required to be completely consistent, but are consistent in a certain range, so that the possibility that the first person walks while twisting his/her head and following the person speaks or looks in other directions can be covered. By the embodiment, the specific event executed by the first person at the first time can be estimated through the first face image and the first shoe print of the first person, so that the accuracy of passenger flow analysis is further improved.

In one embodiment, after the association is successful, obtaining a second stamp after a first event performed by the first person at a first time and a second time when the second stamp is collected, and obtaining a second person image of the first person at the second time if the second stamp is consistent with the first stamp;

acquiring a second face direction of the first person and a second shoe print direction of the second shoe print in the second person image; and judging that the first person executes a second event at a second time under the condition that the second face direction and the second shoe print direction are both towards the second direction.

In this embodiment, the shoe print collection device 12 collects the second shoe print, and after comparing, finds that the second shoe print is consistent with the first shoe print, that is, the second shoe print also belongs to the first person, then the second shoe print is collected for a second time, and the second person image captured by the image collection device 14 at the second time is obtained, the second face direction of the first person in the second person image is obtained, the second shoe print direction of the foot of the first person in the second shoe print is obtained, and when the second face direction and the second shoe print direction are consistent, for example, the second face direction and the second shoe print direction are both towards the outside of the building where the entrance a is located, then the first person is judged to leave the entrance a. In this embodiment, the shoe print collection device 12 records the collected shoe print and compares the shoe print collected later with the shoe print collected earlier, wherein the recording and comparing can be performed for a valid time according to the application scenario, for example, the valid time is 24 hours, the shoe print collection device 12 empties the database storing shoe prints once every 24 hours, and then re-collects the shoe print and stores it in the database; the shoe print collection device 12 may also collect shoe prints and send them to other analysis devices for comparison by the analysis device. According to the embodiment, the behavior that the face cannot be shot can be corresponding to the first person associated with the first person, for example, when the first person enters a building and is subjected to identity verification through the shot face, the image of the first person is associated with the shoe print, when the first person leaves the building, the image acquisition device 14 can judge that the first person leaves the entrance A at the second time through shoe print comparison when the shoe print acquisition device 12 acquires the second shoe print of the first person under the condition that the facial features of the first person cannot be captured. By means of the implementation mode of the embodiment, under the condition that the face features of the personnel cannot be captured, the event executed by the personnel corresponding to the personnel image can be judged by utilizing the associated personnel image and the related shoe mark, and accuracy of passenger flow statistical analysis is improved.

In one embodiment, after the association is successful, after a first event performed by a first person at a first time, the method includes:

acquiring a second shoe print and acquiring second time of the second shoe print, acquiring the second shoe print and acquiring the second time of the second shoe print under the condition that the second shoe print is consistent with the first shoe print, recording the second time as last acquisition time under the condition that the second shoe print is consistent with the first shoe print, acquiring a second site according to the second time after the shoe print which is consistent with the first shoe print is not acquired within a time threshold preset after the second time, and executing a second event at the second site by the first person.

In this embodiment, the last collection time of the shoe print is determined to be the departure time of the first person, and if the shoe print corresponding to the first shoe print is collected again in a preset time threshold after the second time, the last collection time corresponding to the first shoe print may be updated, where the preset time threshold may be set according to a specific application scenario, for example, when the solution is applied to an elevator, a situation that the first person moves near the elevator door but does not leave the elevator immediately may occur, in which case the preset time threshold may be set to be the time from opening to closing of the elevator door, and the shoe print of the first person is collected at the second time, but after the shoe print is collected, the elevator door does not collect the shoe print corresponding to the first shoe print in the time from opening to closing, and the first person is determined to leave the elevator. If the shoe print belonging to the first person is collected again, it can be judged that the first person is staying at the entrance. Through the implementation manner in this embodiment, the misjudgment that personnel appear when the passageway remains can be overcome, meanwhile, the special situations that the personnel leave the passageway in the back gesture can be overcome, for example, the time threshold is set to be the running time of one trip of the elevator, even if the face direction and the shoe print direction of the first personnel face the elevator, the shoe print of the first personnel is not collected after the second time, the first personnel still can be judged to leave the elevator in the second time, and the accuracy of passenger flow statistical analysis data is further improved.

Fig. 3 is a view showing an application scenario of a method for tracking a person's entrance and exit trajectory according to another embodiment of the present invention, where, as shown in fig. 3, when the method for tracking a person's entrance and exit trajectory is applied to a vehicle, a footprint collection device 12 is disposed at an entrance a, an image collection device 14 faces the entrance a, a footprint collection device 16 is disposed at an entrance B, and an image collection device 18 faces the entrance B. Similarly, only one set of collection devices may be provided when the vehicle has only one entrance and more sets of collection devices may be provided when the vehicle has more exits. The shoe print collecting device 12, the shoe print collecting device 16, the image collecting device 14 and the image collecting device 18 can be connected through a network, and can also be connected to the same analysis processor through the network for data interaction.

In one embodiment, fig. 4 is a flowchart of a method for tracking a person's entrance and exit track according to another embodiment of the present invention, as shown in fig. 4, a method for tracking a person's entrance and exit track is provided, and the method is applied to the shoe print collecting device 12 and the image collecting device 14 in fig. 3, or the shoe print collecting device 16 and the image collecting device 18 are illustrated as examples, and includes the following steps:

Step S410: collecting a first shoe print at a vehicle entrance and a first time when the first shoe print is collected, and obtaining a first person image at the first time;

in step S410, the shoe print collection device 12 or the shoe print collection device 16 on the public transportation means collects the first shoe print and records the time stamp, and according to the time stamp, the first time when the shoe print collection device 12 or the shoe print collection device 16 collects the shoe print is obtained, the first person image captured by the image collection device 14 or the image collection device 18 which belongs to the same entrance as the shoe print collection device at the first time is obtained, and in the same space at the same time, the shoe print information and the person image information collected by the shoe print collection device 12 or the shoe print collection device 16 and the image collection device 14 or the image collection device 18 are obtained by the step S410.

Step S420: acquiring a first attribute through a first shoe print, acquiring a second attribute according to a first person image, and associating the first person image with the first shoe print according to the first attribute and the second attribute;

in this step S420, the first attribute of the person corresponding to the shoe print is obtained through the shoe print, and at the same time, the second attribute of the person corresponding to the person image is obtained through the first person image, where the obtaining of the first attribute and the second attribute mainly depends on the preset rule of judgment based on experience, for example, the sex of the person corresponding to the first shoe print can be judged through the size and the shape of the first shoe print, and if the pressure generated by the first shoe print can be collected, the weight of the person corresponding to the first shoe print can even be judged; and the face and the figure characteristics of the person corresponding to the first person image can be acquired through the first person image, and when the person attribute in the first attribute is consistent with the person attribute in the second attribute, the first person image and the first person image can be judged to belong to the same person, and the first person image are correlated to correspond to the same person. In this step S420, according to the first shoe print and the first person image acquired by the set of shoe print acquisition devices and the image acquisition device at the same entrance and exit in the same space at the same time, the shoe print information and the person image information corresponding to the same person are obtained, which solves the problem that the identity of the person in and out cannot be recognized only when the shoe print acquisition device is provided, and the specific action of the person in and out cannot be accurately counted under the crowded condition when the person image acquisition device is provided, and improves the accuracy of statistical analysis of the passenger flow.

Step S430: after the association is successful, a first site is acquired according to the first time, and a first event is executed by a first person at the first site at the first time, wherein the first person corresponds to the first person image.

In this step S430, after the first person image and the first shoe print are related, the event performed by the first person at the first time at the entrance a of the vehicle is determined by the first shoe print and the face and limb actions presented by the first person in the first person image, where the time of the performing mainly refers to the behavior of getting on or off the vehicle, for example, 9 am on a certain day: 20, judging that a first person enters the vehicle according to the first shoe print, and judging that the identity of the first person is king through the first person image, accurately counting that the first person enters the vehicle through the entrance A at 9:20 Wang Mou of the morning on a certain day, and obtaining the geographic position and the first station information of the vehicle at the time by means of a positioning module on the vehicle or data in a management system of the vehicle, namely obtaining that the first person enters the vehicle through the entrance A at 9:20 Wang Mou of the morning on the certain day.

According to the method for tracking the personnel access track, the shoe print collecting device 12 or the shoe print collecting device 16 collects shoe print, the image collecting device 14 or the image collecting device 18 collects personnel images, the personnel attributes obtained by the shoe print information and the personnel attributes obtained by the personnel images are compared, the personnel images with the same personnel attributes are associated with the shoe print, the event executed by personnel at an access opening is judged more accurately, meanwhile, the site where a transportation means is located is obtained according to the shoe print collecting time, on one hand, more accurate personnel boarding and alighting track is obtained so as to achieve accurate passenger flow statistical analysis, on the other hand, a record corresponding to the personnel images is also created, and the follow-up call of the record is facilitated.

acquiring a first attribute through a shoe print, and acquiring a second attribute through a personnel image;

in the event that the first and second spatial distribution characteristics match, the first and second sexes match, and the first and second estimated heights match, the shoe print and the person image are associated to the same person.

In this embodiment, the shoe mark collecting device 12 or the shoe mark collecting device 16 may collect a plurality of shoe marks at the same time point, and the distribution of different shoe marks in the image is different, so that the first spatial distribution characteristic of the person, such as southwest corner located in the shoe mark collecting area, may be determined; the first sex and the first estimated height of the person can be further judged through the length of the shoe mark. The image acquisition device 14 or the image acquisition device 18 acquires a plurality of personnel images at the same time point, the spatial distribution of different personnel in the images is also different, and the second distribution characteristic of the personnel can be obtained; the second sex of the person can be further judged through the face, the hairstyle and the like, meanwhile, the height difference among different persons can be identified through the person image, and the second estimated height of the person is calculated. By combining the first spatial distribution characteristic of the shoe print and the second spatial distribution characteristic of the person in the image, the first gender, the second gender, the first estimated height and the second estimated height, the association relationship between different shoe prints and different persons can be accurately judged, and by means of the implementation of the embodiment, the shoe print and the image of the person can be associated through comparison of three most representative elements in the attribute of the person, so that data records corresponding to the shoe print and the face are obtained, and accurate passenger flow analysis is convenient.

In one embodiment, fig. 5 is a flowchart of a second method for tracking a path of an entrance and exit of a person according to another embodiment of the present invention, as shown in fig. 5, after the association is successful, acquiring a first site according to a first time, and obtaining a first event executed by a first person at the first site at the first time includes:

step S510: acquiring a first face direction of a first person in a first person image and acquiring a first shoe print direction of a first shoe print;

step S520: under the condition that the first face direction and the first shoe print direction face the interior of the carriage of the public transport means, the first person is judged to get on the bus at the first station at the first time.

According to the tracking method of the personnel access track, under the condition that the first personnel image and the first shoe print belong to the first personnel, the first face direction of the first personnel in the first personnel image and the first shoe print direction of the feet of the first personnel in the first shoe print are obtained, and when the first face direction and the first shoe print direction of the first personnel face towards the interior of the carriage of the vehicle, the first personnel can be judged to get on the vehicle. Likewise, when both the first face direction and the first footprint direction of the first person are toward the outside of the cabin of the vehicle, it may be determined that the first person is getting off. The above-mentioned direction coincidence does not require that the angles of the first face direction and the first shoe print direction be completely coincident, but the directions are coincident within a certain range, so that the possibility that the first person can turn his head while getting on his car and speak or look in other directions can be covered. Through the implementation manner in this embodiment, the first person can be judged to get on the bus at the first site at the first time through the first face image and the first shoe print of the first person, so that the accuracy in passenger flow analysis is further improved.

In one embodiment, fig. 6 is a flowchart III of a method for tracking a path of an entrance and exit of a person according to another embodiment of the present invention, as shown in fig. 6, a first station is acquired according to a first time, and after a first event executed by the first person at the first station at the first time is obtained, the method includes:

step S610: acquiring a second shoe print and a second time for acquiring the second shoe print, and acquiring a second person image of a first person at the second time under the condition that the second shoe print is consistent with the first shoe print;

step S620: acquiring a second face direction of the first person and a second shoe print direction of the second shoe print in the second person image;

step S630: and under the condition that the second face direction and the second shoe print direction face the outside of the carriage of the public transport means, acquiring a second station according to the second time, and judging that the first person gets off at the second station at the second time.

In this embodiment, the shoe print collection device 16 collects the second shoe print, and after comparison, finds that the second shoe print is consistent with the first shoe print, that is, the second shoe print also belongs to the first person, then the second time for collecting the second shoe print is obtained, and the second person image captured by the image collection device 18 at the second time is obtained, the second face direction of the first person in the second person image is obtained, the second shoe print direction of the foot of the first person in the second shoe print is obtained, and when the second face direction and the second shoe print direction of the first person are both towards the outside of the carriage of the vehicle, the first person is judged to get off from the entrance B. In this embodiment, the shoe print collection device 16 records the collected shoe print and shares the record with other shoe print collection devices on the vehicle, and all shoe print collection devices on the vehicle can compare the shoe print collected later with the shoe print collected earlier, and the record and comparison can set the effective time according to the specific application scenario, and can be generally set as the running time of the vehicle from the starting point to the end point; all the collecting devices on the transportation means can collect the shoe marks and send the shoe marks to the external analysis device for shoe mark comparison by the analysis device. Through the embodiment, the behavior that the face cannot be shot can be corresponding to the first person associated with the first person, for example, when the first person gets on the car and performs identity verification through the shot face, the image of the first person is associated with the shoe print, and when the first person gets off the car, the image acquisition device 18 cannot capture the facial features of the first person, but when the shoe print acquisition device 16 acquires the second shoe print of the first person, the shoe print can be compared and judged to belong to the first person through the shoe print, and still the first person can be judged to leave the entrance B at the second time through the fact that the second face direction and the second shoe print direction are both towards the outer side of the carriage. By the method in the embodiment, the event executed by the person corresponding to the person image at a certain site can be judged by utilizing the related person image and the related shoe mark under the condition that the face characteristics of the person cannot be captured, so that the accuracy of passenger flow statistical analysis is improved.

In one embodiment, fig. 7 is a flowchart of a method for tracking a person's access track according to another embodiment of the present invention, as shown in fig. 7, a first site is acquired according to a first time, and after a first event executed by a first person at the first site at the first time is obtained, the method includes:

step S710: acquiring a second shoe print and acquiring a second time of the second shoe print, and recording the second time as the last acquisition time under the condition that the second shoe print is consistent with the first shoe print;

step S720: and acquiring a second site according to the second time, so as to obtain a second event at the second site by the first person.

In this embodiment, the last collection time of the shoe print is determined as the time of executing the second event by the first person, if the shoe print consistent with the first shoe print is collected again in a preset time threshold after the second time, the last collection time corresponding to the first shoe print is updated, the station where the bus is located when the bus reaches the end point according to the last collection time can be obtained according to the second time, the second station information can be recorded as a backup when the bus is located when the last collection time is obtained according to the last collection time, and after a preset time threshold, if the second time is determined as the getting-off time, the backed-up second station information is the getting-off station point. The preset time threshold may be set according to a specific application scenario, for example, the preset time threshold is set as a time from opening to closing of a bus door after the bus arrives at a station, or a time interval from a second time to a terminal station, for example, a first person's shoe print is collected at the second time, but after the shoe print is collected, a shoe print consistent with the first shoe print is not collected in a time from opening to closing of the bus door, and then the first person gets off at the second time. If the shoe print belonging to the first person is collected again during this period of time, it may be determined that the first person is staying at the doorway. Through the implementation manner in this embodiment, the misjudgment that personnel appear when the passageway remains can be overcome, meanwhile, the special situations that the passageway is left in the back gesture can be overcome, for example, the time threshold is set to be the running time of one trip of the bus, even if the face direction and the shoe print direction of the first personnel face the inside of the bus, the shoe print of the first personnel is not collected after the second time, the first personnel can still be judged to leave the bus in the second time, and the accuracy of passenger flow statistical analysis data is further improved.

In one embodiment, collecting a first footprint at a vehicle access opening and obtaining a second footprint comprises:

collecting a first shoe print or a second shoe print at an entrance and an exit of a vehicle in a vehicle door opening state;

in a door-closed state of a vehicle, the first shoe print at the vehicle entrance is not acquired and the second shoe print is not acquired.

In one embodiment, collecting a first footprint at a vehicle access opening comprises:

collecting a first shoe print at an entrance of a vehicle in a vehicle door open state;

in a closed state of a door of the vehicle, the first shoe print at the vehicle entrance is not collected.

In the embodiment, the power consumption and storage resources of the acquisition device can be saved by considering that the personnel can get on or off the vehicle only in the state that the vehicle door is opened.

In a specific embodiment, fig. 8 is a flowchart of a method for tracking a person's entry and exit track according to another embodiment of the present invention, as shown in fig. 8, the method for tracking a person's entry and exit track on a bus includes the following steps:

Step S802: in the door non-closed state, the image capturing device 14 captures a first person image; the shoe print collection device 12 collects a first shoe print;

step S804: identifying a first sex, a first height and a first spatial distribution of the person by a first shoe print; identifying a second gender, a second height, and a second spatial distribution by the first person image;

step S806: associating the first shoe print with the first person image by a preset principle, wherein the first shoe print and the first person image are both associated to the first person;

step S808: judging whether the first shoe print direction and the first face direction of the first person face the inside of the bus or not through the first shoe print direction and the first face direction;

step S810: judging that a first person gets on a bus by the first shoe print direction and the first face direction of the first person facing the interior of the bus;

step S812: registering the associated first shoe print, the first person image, the first time when the first shoe print was acquired, and the first site acquired according to the first time into a shoe print comparison database;

step S814: judging that the first person gets off the bus when the first shoe print direction and the first face direction of the first person are not towards the interior of the bus;

Step S816: the associated first shoe print, the first person image, the first time at which the first shoe print was collected, and the first site obtained from the first time are sent to an analysis system and deleted from the shoe print comparison database.

When the video cannot collect the face information, the method judges the personnel access track by combining the video with the shoe print, and realizes personnel access track tracking on public transportation means.

In a specific embodiment, fig. 9 is a schematic diagram of a shoe mark collected by a method for tracking a person's access track according to another embodiment of the present invention, where the shoe mark can be determined to be oriented north as shown in fig. 9.

In a specific embodiment, fig. 10 is a flowchart of a method for tracking a person's entry and exit track according to another embodiment of the present invention, as shown in fig. 10, the method for tracking a person's entry and exit track applied to a bus includes:

step S1002: the bus starts at the starting station;

in the step, the information of all stations such as a starting station, a destination station and the like is directly obtained from a bus system or the bus is provided with a positioning unit;

step S1004: the image capturing device 14 captures a first person image; the shoe print collection device 12 collects a first shoe print;

Step S1006: identifying a first sex, a first height and a first spatial distribution of the person by a first shoe print; identifying a second gender, a second height, and a second spatial distribution by the first person image;

step S1008: associating the first shoe print with the first person image by a preset principle, wherein the first shoe print and the first person image are both associated to the first person;

step S1010: comparing the shoe print comparison database, and judging whether the first shoe print is acquired for the first time;

step S1012: the first shoe seal is collected for the first time, and the associated first shoe seal, the first person image, the first time when the first shoe seal is collected and the first site obtained according to the first time are registered into a shoe seal comparison database;

in step S1012, according to the database comparison result, it is determined whether the person or the shoe mark is first entering, the shoe mark is a shoe mark a, the collection time is T0, and the related site information is P0. More preferably, the person image and the shoe print are collected in the open state of the vehicle door.

Step S1014: the first shoe mark is not collected for the first time, a time threshold is set, and in the time threshold, the shoe mark is not appeared any more, and the first person is judged to get off;

in this step S1014, when the comparison result of the shoe print B is considered to be the same shoe print as the shoe print a, the collection time T1 of the shoe print B, the associated site information P1, is recorded as the last collection time and site of the shoe print a. Setting a threshold t, collecting the same shoe mark again within the time range of t after the shoe mark B is collected, and refreshing the last collection time and the station of the shoe mark A. If the shoe print is not collected any more, T1 is considered to be the getting-off time of the person, and P1 is considered to be the getting-off station of the person. If no shoe print is collected which is the same as the shoe print A, the shoe print A is considered as invalid data, and the situation that a person gets on a car and then backs up to get off the car may exist. The value of the threshold T may be the interval from the acquisition time T1 to the closing time of the station, or may be the travel time from the acquisition time T1 to the end point of the vehicle.

Step S1016: recording the associated first shoe print, first person image, departure time and departure station;

step S1018: and when the bus arrives at the terminal, the recorded data is sent to an analysis system, and the shoe print comparison database is emptied.

The method overcomes the uncertainty of getting on or off the vehicle due to personnel, such as the situation of backing off to get on or off the vehicle and the situation that the personnel is crowded at the entrance when the other persons get off the vehicle.

In one embodiment, a personnel access track tracking system is provided, fig. 11 is a schematic diagram of a personnel access track tracking system according to one embodiment of the present invention, as shown in fig. 11, the personnel access track tracking system includes:

the shoe print collection device 12 obtains the first shoe print and the first time the first shoe print was collected, sends the first shoe print to the analysis processor 116;

the image capture device 14 acquires a first person image at a first time, and sends the first person image to the analysis processor 116;

the analysis processor 116 obtains a first attribute from the first shoe print transmitted by the shoe print collection device 12, obtains a second attribute from the first person image transmitted by the image collection device 14, and associates the first person image with the first shoe print based on the first attribute and the second attribute; after the association is successful, the analysis processor 116 obtains a first location at a first time, resulting in a first person performing a first event at the first location, wherein the first person corresponds to a first person image, and in some embodiments, the analysis processor and the shoe print collection device may be the same device.

According to the personnel access track tracking system, the acquired personnel image information and personnel image information in the same time and space are correlated with the personnel image of the same personnel and the personnel attribute acquired by the personnel image according to the personnel attribute acquired by the personnel image information, so that the event executed by the personnel at the access opening is accurately judged, and the more accurate personnel access track is acquired, so that accurate passenger flow statistical analysis is achieved.

In a specific embodiment, fig. 12 is a schematic diagram of a personnel access track tracking system according to another embodiment of the present invention, as shown in fig. 12, the personnel access track tracking system of the bus includes:

the passenger flow collection system 122 comprises a shoe print collection device 12 and an image collection device 14, the shoe print collection device 12 collects a first shoe print at the entrance and the exit of a vehicle, obtains a first time for collecting the first shoe print, obtains a first person image captured by the image collection device 14 at the first time, and the passenger flow collection system 122 can only collect the shoe print and the image, and after the bus arrives at a point under the condition of only collecting the shoe print and the image, the passenger flow collection system 122 sends all images and shoe print information with time stamps to the passenger flow analysis system 124. Passenger flow collection system 122 may also include a shoe print comparison subsystem that compares the second shoe print to shoe print database 125 to determine if the second shoe print was first occurring when shoe print collection device 12 obtains the second shoe print. The passenger flow collection system 122 may also be configured to obtain a first attribute from the personal identification system 127 via a first stamp, obtain a second attribute from the first person image, and associate the first person image with the first stamp based on the first attribute and the second attribute; in addition, the passenger flow collection system 122 may further include a positioning unit 128, and position the vehicle by using GPS, and obtain the first station according to the first time.

The passenger flow analysis system 124 performs data analysis on the images and the shoe print information sent by the passenger flow collection system 122 and the door opening and closing information with the time stamp and the stop information recorded by the bus system, so that the functions of the analysis processor 116 are realized.

The bus system 126 sends the door opening and closing information and the stop information with the time stamp to the passenger flow analysis system 124, and the passenger flow collection system 122 sends the door opening and closing information and the stop information with the time stamp to the passenger flow collection system 122 when the passenger flow collection system 122 is provided with the personal identification and the shoe print ratio equivalent analysis subsystem.

In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the above-mentioned method for tracking a person's entrance and exit track when executing the computer program, and the collected person's entrance and exit track and person's image information in the same time and space, and according to the person's attribute obtained from the person's information and the person's attribute obtained from the person's image, associates the person's image with the person's mark, and more accurately determines the event performed by the person at the entrance and exit, thereby obtaining a more accurate person's entrance and exit track, so as to achieve accurate statistical analysis of passenger flow.

In one embodiment, a computer readable storage medium having a computer program stored thereon is provided, which when executed by a processor implements the above-described personnel access trajectory tracking method.

According to the computer readable storage medium, the collected shoe print information and personnel image information in the same time and space are used for associating the personnel image of the same personnel with the shoe print according to the personnel attribute acquired by the shoe print information and the personnel attribute acquired by the personnel image, so that the event executed by the personnel at the entrance and the exit is accurately judged, and the more accurate personnel access track is acquired, so that accurate passenger flow statistics is achieved.

It should be understood that, although the steps in the flowchart are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims

1. A method for tracking a person's entry and exit trajectory, the method comprising:

After the association is successful, a first event executed by a first person at the first time is obtained, wherein the first person corresponds to the first person image;

acquiring a second shoe print and acquiring a second time of the second shoe print, recording the second time as last acquisition time under the condition that the second shoe print is consistent with the first shoe print, and acquiring the shoe print which is consistent with the first shoe print within a time threshold preset after the second time, so as to obtain a second event executed by the first person at the second time.

2. The method of claim 1, wherein the obtaining a first attribute from the first shoe print, obtaining a second attribute from the first person image, and associating the first person image with the first shoe print based on the first attribute and the second attribute comprises:

3. The method of claim 1, wherein obtaining the first event performed by the first person at the first time after the association is successful comprises:

4. A method according to claim 3, wherein after the association is successful, resulting in a first event being performed by a first person at the first time, the method comprising:

5. A method for tracking a person's entry and exit trajectory, the method comprising:

after the association is successful, a first site is acquired according to the first time, and a first event is executed by a first person at the first site at the first time, wherein the first person corresponds to the first person image;

6. The method of claim 5, wherein the obtaining a first attribute from the first shoe print, obtaining a second attribute from the first person image, and associating the first person image with the first shoe print based on the first attribute and the second attribute comprises:

7. The method of claim 5, wherein the collecting the first footprint at the vehicle access opening comprises:

8. The method of claim 5, wherein after the association is successful, obtaining a first site from the first time, the first event performed by the first person at the first site at the first time comprises:

and under the condition that the first face direction and the first shoe print direction face the inside of the carriage of the vehicle, judging that the first person gets on the vehicle at the first station at the first time.

9. The method of claim 5, wherein the obtaining a first site from the first time results in the first event performed by a first person at the first site at the first time, the method comprising:

and under the condition that the second face direction and the second shoe print direction face the outside of the carriage of the vehicle, acquiring a second station according to the second time, and judging that the first person gets off at the second station at the second time.

10. The method of claim 5 or 9, wherein the collecting the first footprint at the vehicle access opening and the obtaining the second footprint comprises:

11. A personnel access trajectory tracking system, the system comprising: shoe print collection device, image collection device and analysis processor:

the analysis processor obtains a first attribute through the first shoe print, obtains a second attribute according to the first person image, and associates the first person image with the first shoe print according to the first attribute and the second attribute; after the association is successful, the analysis processor acquires a first position at the first time to obtain a first event executed by the first person at the first position, wherein the first person corresponds to the first person image;

the shoe print collecting equipment also obtains a second shoe print and a second time for collecting the second shoe print, and sends the second shoe print to the analysis processor;

and the analysis processor is used for comparing the first shoe print with the second shoe print, recording a second time as a last acquisition time under the condition that the second shoe print is consistent with the first shoe print, and acquiring a second position according to the second time when the shoe print which is consistent with the first shoe print and acquired by the shoe print acquisition equipment is not received within a time threshold which is preset after the second time, wherein the first person executes a second event at the second position.

12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 10 when the computer program is executed by the processor.

13. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 10.