CN107153819A - A kind of queue length automatic testing method and queue length control method - Google Patents
A kind of queue length automatic testing method and queue length control method Download PDFInfo
- Publication number
- CN107153819A CN107153819A CN201710312890.3A CN201710312890A CN107153819A CN 107153819 A CN107153819 A CN 107153819A CN 201710312890 A CN201710312890 A CN 201710312890A CN 107153819 A CN107153819 A CN 107153819A
- Authority
- CN
- China
- Prior art keywords
- mrow
- queue
- feature
- queue length
- msub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000002789 length control Methods 0.000 title claims abstract description 21
- 238000012360 testing method Methods 0.000 title 1
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 32
- 230000001186 cumulative effect Effects 0.000 claims description 17
- 238000005070 sampling Methods 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 11
- 238000012806 monitoring device Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 abstract description 8
- 238000012545 processing Methods 0.000 abstract description 4
- 230000009466 transformation Effects 0.000 abstract description 2
- 239000000523 sample Substances 0.000 description 32
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 244000291564 Allium cepa Species 0.000 description 1
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003370 grooming effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
Abstract
本发明提供一种排队长度自动检测方法及排队长度控制方法,基于人体结构模型算法检测行人;采用特征在线选择提升算法跟踪行人;根据检测到的人,采用基于RANSAC的最小二乘多项式曲线拟合方法拟合人的队列形状,从而估计队列的长度;通过图像标定实现图像坐标系到世界坐标系的转换,计算实际排队的长度;根据曲线拟合计算曲线长度,再根据排队的长度和队列中相邻人之间的距离,计算队列中的人数。本发明的排队长度自动检测方法及排队长度控制方法能快速、准确的检测出监控场景中的行人排队长度,避免目标丢失的问题,减少漏检;通过实时监控排队情况,及时调整办理窗口,从而有效的解决排队等候的问题,更好的服务旅客。
The invention provides an automatic queue length detection method and a queue length control method, which detect pedestrians based on the human body structure model algorithm; use the feature online selection and promotion algorithm to track pedestrians; according to the detected people, use the least squares polynomial curve fitting based on RANSAC The method fits the queue shape of people, thereby estimating the length of the queue; realizes the transformation from the image coordinate system to the world coordinate system through image calibration, and calculates the actual queue length; calculates the curve length according to the curve fitting, and then according to the queue length and the queue length The distance between adjacent people, counting the number of people in the queue. The queuing length automatic detection method and queuing length control method of the present invention can quickly and accurately detect the queuing length of pedestrians in the monitoring scene, avoid the problem of target loss, and reduce missed detection; through real-time monitoring of the queuing situation, the processing window can be adjusted in time, thereby Effectively solve the problem of waiting in line and better serve passengers.
Description
技术领域technical field
本发明涉及图像处理技术领域,特别是涉及一种排队长度自动检测方法及排队长度控制方法。The invention relates to the technical field of image processing, in particular to a queue length automatic detection method and a queue length control method.
背景技术Background technique
在机场等公共环境中,旅客在办理登机牌和进入安检口时,经常需要排队等候,由于人员比较集中,当人数较多时旅客排队等候时间就会延长,从而引起旅客的焦躁情绪;同时,旅客需要提前很长时间到达机场以避免延误班机,大大降低了旅客的乘机体验。在医院等公共场合同样存在以上问题。In public environments such as airports, passengers often need to wait in line when checking in for boarding passes and entering security checkpoints. Due to the concentration of people, when the number of people is large, the waiting time for passengers in line will be prolonged, which will cause passengers' anxiety; at the same time, Passengers need to arrive at the airport a long time in advance to avoid flight delays, which greatly reduces the passenger experience. There are above problems in public places such as hospitals equally.
现有的解决方法是机场的工作人员通过人工疏导,减少旅客的排队等候时间;由于人工疏导完全靠工作人员对现场情况的把控,费时费力,且效率也相当低。The existing solution is that the staff of the airport use manual guidance to reduce the waiting time of passengers in line; since manual guidance is completely dependent on the staff's control of the situation on the spot, it is time-consuming and laborious, and the efficiency is also quite low.
因此,如何更好的服务旅客,减少旅客排队等候时间,提高机场工作效率减少人力资源开销已成为本领域技术人员亟待解决的问题之一。Therefore, how to better serve passengers, reduce the waiting time of passengers in line, improve airport work efficiency and reduce human resource expenses has become one of the problems to be solved urgently by those skilled in the art.
发明内容Contents of the invention
鉴于以上所述现有技术的缺点,本发明的目的在于提供一种排队长度自动检测方法及排队长度控制方法,用于解决现有技术中人工疏导费时费力的问题。In view of the above-mentioned shortcomings of the prior art, the purpose of the present invention is to provide an automatic queue length detection method and a queue length control method for solving the time-consuming and labor-intensive problem of manual grooming in the prior art.
为实现上述目的及其他相关目的,本发明提供一种排队长度自动检测方法,所述排队长度自动检测方法至少包括:In order to achieve the above purpose and other related purposes, the present invention provides a method for automatic detection of queue length, which at least includes:
步骤S1:获取行人排队视频,录入所述行人排队视频;Step S1: Obtain the pedestrian queuing video, and record the pedestrian queuing video;
步骤S2:基于人体结构模型算法检测所述行人排队视频中的行人;Step S2: Detect pedestrians in the pedestrian queuing video based on the human structure model algorithm;
步骤S3:检测到行人后,基于特征在线选择提升算法不断更新行人图像特征值,以对行人进行跟踪定位;Step S3: After the pedestrian is detected, the feature value of the pedestrian image is continuously updated based on the feature online selection and promotion algorithm, so as to track and locate the pedestrian;
步骤S4:根据检测到的行人,拟合行人的队列形状曲线;Step S4: according to the detected pedestrians, fitting the queue shape curve of pedestrians;
步骤S5:图像标定,将图像坐标转换为世界坐标;Step S5: Image calibration, converting image coordinates into world coordinates;
步骤S6:根据所述队列形状曲线计算队列的实际长度和相邻行人之间的距离,从而计算得到队列中的人数。Step S6: Calculate the actual length of the queue and the distance between adjacent pedestrians according to the queue shape curve, so as to calculate the number of people in the queue.
优选地,步骤S2具体包括:根据人体结构构造一基于行人部件的二维模型,通过提取行人图像的结构特征与二维模型进行匹配,从而识别行人。Preferably, step S2 specifically includes: constructing a two-dimensional model based on pedestrian parts according to the human body structure, and identifying pedestrians by matching the structural features of pedestrian images with the two-dimensional model.
优选地,所述在线提升算法进一步包括:N个特征选择器,作为强分类器;M个特征构成一特征池,作为弱分类器;当新样本到达时,N个特征选择器依次生成,每次生成均对M个特征的累积分类正确样本权值和累积分类错误样本权值进行更新,各特征选择器将当前最小累积错误率的特征作为其对应的弱分类器,N个特征选择器组合形成强分类器,目标新位置通过在上一帧时目标位置附近范围内用强分类器评价决定。Preferably, the online promotion algorithm further includes: N feature selectors as strong classifiers; M features form a feature pool as weak classifiers; when a new sample arrives, N feature selectors are generated sequentially, each Each generation updates the cumulative correct sample weights and cumulative incorrect sample weights of M features, each feature selector uses the feature with the current minimum cumulative error rate as its corresponding weak classifier, and the combination of N feature selectors A strong classifier is formed, and the new position of the target is determined by evaluating with a strong classifier in the vicinity of the target position in the previous frame.
更优选地,对M个特征的累积分类正确样本权值和累积分类错误样本权值进行更新的方法具体包括:More preferably, the method for updating the accumulative correct sample weights and accumulative misclassified sample weights of the M features specifically includes:
当hm(x)=y时,When h m (x) = y,
当hm(x)≠y时,When h m (x)≠y,
其中,hm,(m=1,...,M)为特征,x为与目标区域等大小的窗口图像,y用于表示正样本或负样本,y=0为负样本,y=1为正样本,为累积分类正确样本权值,为累积分类错误样本权值,λ为样本当前的权值,初始值为1。Among them, h m , (m=1,...,M) is a feature, x is a window image with the same size as the target area, y is used to represent a positive sample or a negative sample, y=0 is a negative sample, and y=1 is a positive sample, For accumulating classification correct sample weights, is the cumulative weight of misclassified samples, λ is the current weight of the sample, and the initial value is 1.
更优选地,所述强分类器由N个特征选择器按权重组合形成:More preferably, the strong classifier is formed by combining N feature selectors according to weights:
权重αn满足如下关系:The weight α n satisfies the following relationship:
其中,为特征选择器,εn为特征n对应的累积错误率。in, is the feature selector, and ε n is the cumulative error rate corresponding to feature n.
更优选地,目标新位置满足如下关系:More preferably, the new position of the target satisfies the following relationship:
其中,pw(w=1,...,W)为搜索范围内的目标候选位置,in, p w (w=1,...,W) is the target candidate position within the search range,
为特征选择器,αn为权重。 is the feature selector, and α n is the weight.
更优选地,所述在线提升算法中的特征包括:Haar特征,边缘方向直方图特征及基于空间块状信息的局部二值模式的特征。More preferably, the features in the online boosting algorithm include: Haar features, edge direction histogram features, and features of local binary patterns based on spatial block information.
更优选地,所述Haar特征的计算方法采用积分直方图。More preferably, the calculation method of the Haar feature adopts integral histogram.
更优选地,所述边缘方向直方图特征的计算方法如下:将像素点梯度的方向θ在区间θ∈(-π,π]内量化为多个角度区域,并对区域内每个像素点的梯度进行统计,将对应的幅值加入对应的角度并获得直方图。More preferably, the calculation method of the edge direction histogram feature is as follows: the direction θ of the gradient of the pixel point is quantized into multiple angle areas in the interval θ∈(-π, π], and each pixel point in the area The gradient is used for statistics, and the corresponding amplitude is added to the corresponding angle to obtain a histogram.
更优选地,所述像素点梯度的方向满足如下关系:More preferably, the direction of the pixel gradient satisfies the following relationship:
其中,在水平方向上提取梯度幅值在垂直方向上梯度的幅值A为样本图像输入,*为二维卷积运算。Among them, the gradient magnitude is extracted in the horizontal direction the magnitude of the gradient in the vertical direction A is the sample image input, * is the two-dimensional convolution operation.
优选地,将具有不同半径和采样点数的局部二值模式算子取并集得到基于空间块状信息的局部二值模式的特征:Preferably, the local binary pattern operators with different radii and sampling points are unioned to obtain the features of the local binary pattern based on spatial block information:
其中,LBP为局部二值模式特征值,P为相邻像素点的个数,R为半径。Among them, LBP is the characteristic value of the local binary pattern, P is the number of adjacent pixels, and R is the radius.
优选地,采用基于RANSAC的最小二乘多项式曲线拟合方法来拟合所述队列形状曲线。Preferably, the queue shape curve is fitted using a least squares polynomial curve fitting method based on RANSAC.
为实现上述目的及其他相关目的,本发明提供一种排队长度控制方法,所述排队长度控制方法至少包括:In order to achieve the above purpose and other related purposes, the present invention provides a queue length control method, the queue length control method at least includes:
在需要进行排队长度控制的场合设置监控装置,采集行人排队视频;Set up monitoring devices in occasions where queuing length control is required to collect videos of pedestrians queuing;
采用上述排队长度自动检测方法对排队长度进行检测;Adopt above-mentioned queuing length automatic detection method to detect queuing length;
当排队长度超出预设人数时,向客户端发出预警信息,客户端调整排队队列,解决排队等候问题。When the queue length exceeds the preset number of people, an early warning message is sent to the client, and the client adjusts the queue to solve the problem of waiting in line.
优选地,客户端调整排队队列的方法包括:调整服务窗口、统计客流量或引导行人排队。Preferably, the method for the client to adjust the queuing queue includes: adjusting the service window, counting passenger flow, or guiding pedestrians to queue.
如上所述,本发明的排队长度自动检测方法及排队长度控制方法,具有以下有益效果:As mentioned above, the queue length automatic detection method and the queue length control method of the present invention have the following beneficial effects:
本发明的排队长度自动检测方法及排队长度控制方法能快速、准确的检测出监控场景中的行人排队长度,避免目标丢失的问题,减少漏检;通过实时监控排队情况,及时调整办理窗口,从而有效的解决排队等候的问题,更好的服务旅客。The queuing length automatic detection method and queuing length control method of the present invention can quickly and accurately detect the queuing length of pedestrians in the monitoring scene, avoid the problem of target loss, and reduce missed detection; through real-time monitoring of the queuing situation, the processing window can be adjusted in time, thereby Effectively solve the problem of waiting in line and better serve passengers.
附图说明Description of drawings
图1显示为本发明的排队长度自动检测方法的流程示意图。Fig. 1 is a schematic flow chart of the automatic queue length detection method of the present invention.
图2~图4显示为本发明的三个局部二值模式特征的示意图。2 to 4 are schematic diagrams showing three local binary mode features of the present invention.
图5显示为本发明的基于空间块状信息的局部二值模式算法中的8*8斑块示意图。Fig. 5 is a schematic diagram of 8*8 patches in the local binary pattern algorithm based on spatial block information of the present invention.
图6显示为本发明的基于空间块状信息的局部二值模式算法中的像素点的直方图示意图。FIG. 6 is a schematic diagram of a histogram of pixels in the local binary pattern algorithm based on spatial block information of the present invention.
图7显示为本发明的队列中的人数计算原理示意图。Fig. 7 is a schematic diagram showing the calculation principle of the number of people in the queue of the present invention.
图8显示为本发明的排队长度控制方法的示意图。FIG. 8 is a schematic diagram of the queue length control method of the present invention.
元件标号说明Component designation description
r1~r3 采样半径r1~r3 sampling radius
S1~S6 步骤S1~S6 steps
具体实施方式detailed description
以下通过特定的具体实例说明本发明的实施方式,本领域技术人员可由本说明书所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外不同的具体实施方式加以实施或应用,本说明书中的各项细节也可以基于不同观点与应用,在没有背离本发明的精神下进行各种修饰或改变。Embodiments of the present invention are described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present invention.
请参阅图1~图7。需要说明的是,本实施例中所提供的图示仅以示意方式说明本发明的基本构想,遂图式中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制,其实际实施时各组件的型态、数量及比例可为一种随意的改变,且其组件布局型态也可能更为复杂。Please refer to Figure 1 to Figure 7. It should be noted that the diagrams provided in this embodiment are only schematically illustrating the basic idea of the present invention, and only the components related to the present invention are shown in the diagrams rather than the number, shape and shape of the components in actual implementation. Dimensional drawing, the type, quantity and proportion of each component can be changed arbitrarily during actual implementation, and the component layout type may also be more complicated.
如图1所示,本发明提供一种排队长度自动检测方法,包括以下步骤:As shown in Figure 1, the present invention provides a kind of queue length automatic detection method, comprises the following steps:
步骤S1:获取行人排队视频,录入所述行人排队视频。Step S1: Acquire video of pedestrians queuing, and record the video of pedestrians queuing.
具体地,从监控系统中获取行人排队的视频,将所述行人排队视频录入本发明的检测系统中。Specifically, the video of pedestrians queuing is obtained from the monitoring system, and the video of pedestrians queuing is recorded into the detection system of the present invention.
步骤S2:基于人体结构模型算法检测所述行人排队视频中的行人。Step S2: Detecting pedestrians in the pedestrian queuing video based on a human structure model algorithm.
具体地,采用基于形状的方法构建基于人体结构模型的行人检测算法。在本实施例中,通过构造人体模型来识别行人。更具体地,根据人体结构构造一基于行人部件的二维模型,通过提取行人图像的结构特征(人体构造)与二维模型进行匹配;若提取到的行人图像的部分结构特征与二维模型中相应的人体结构模型匹配,则检测到行人;若提取到的行人图像的部分结构特征与二维模型中相应的人体结构模型不匹配,则未检测到行人。该方法可以有效处理遮挡问题,并可以推断出人体的姿态。Specifically, a shape-based approach is used to construct a pedestrian detection algorithm based on a human body structure model. In this embodiment, pedestrians are identified by constructing a human body model. More specifically, construct a two-dimensional model based on pedestrian parts according to the structure of the human body, and match the two-dimensional model by extracting the structural features (human body structure) of the pedestrian image; If the corresponding human structure model matches, the pedestrian is detected; if some structural features of the extracted pedestrian image do not match the corresponding human structure model in the 2D model, the pedestrian is not detected. The method can effectively deal with the occlusion problem and can infer the pose of the human body.
步骤S3:检测到行人后,基于特征在线选择提升算法不断更新行人图像特征,以对行人进行跟踪定位。通过在线选择提升算法有效解决上一帧检测到目标,而当前帧目标丢失的问题,减少漏检。Step S3: After the pedestrian is detected, the image features of the pedestrian are continuously updated based on the feature online selection and promotion algorithm, so as to track and locate the pedestrian. Through the online selection and promotion algorithm, the problem that the target was detected in the previous frame and the target was lost in the current frame is effectively solved, and the missed detection is reduced.
所述在线提升算法中的强分类器包括N个特征选择器各特征选择器共用一个特征池,所述特征池包括M个特征hm,(m=1,...,M),所述M个特征代表弱分类器。所述在线提升算法一直维持和更新各特征的累积分类正确样本权值和分类错误样本权值以此实现对行人的跟踪。The strong classifier in the online boosting algorithm includes N feature selectors Each feature selector shares a feature pool, the feature pool includes M features h m , (m=1, . . . , M), and the M features represent weak classifiers. The online boosting algorithm maintains and updates the cumulative classification correct sample weights of each feature all the time and misclassified sample weights In this way, the tracking of pedestrians is realized.
具体地,在目标定位后,将跟踪窗口内的目标区域作为正样本,将跟踪窗口外和目标等大小的若干背景区域作为负样本。当新样本(x,y),y∈{0,1}到达时,N个特征选择器依次生成,每次生成均对M个特征hm,(m=1,...,M)进行更新,其中,新样本(x,y)为当前帧图像中跟踪窗口内的目标区域(正样本)及跟踪窗口外与目标区域等大小的若干背景区域(负样本),x为与目标区域等大小的窗口图像,y用于表示正样本或负样本,y=0为负样本,y=1为正样本:Specifically, after the target is located, the target area within the tracking window is used as a positive sample, and several background areas outside the tracking window and the size of the target are used as negative samples. When a new sample (x, y), y ∈ {0, 1} arrives, N feature selectors Generated sequentially, each generation updates M features h m , (m=1,...,M), where the new sample (x, y) is the target area in the tracking window in the current frame image (positive sample) and some background areas (negative samples) of the same size as the target area outside the tracking window, x is a window image of the same size as the target area, y is used to represent a positive sample or a negative sample, y=0 is a negative sample, y= 1 is a positive sample:
当hm(x)=y时,When h m (x) = y,
当hm(x)≠y时,When h m (x)≠y,
其中,λ为样本当前的权值,初始值为1。Among them, λ is the current weight value of the sample, and the initial value is 1.
更新完毕后,各特征选择器将挑选当前最小累积错误率的特征作为其对应的弱分类器:(m+即当前最小累积错误率的特征),其中,εm为每个特征的累积错误率,其中,特征n的累积错误率对应的权重为 εn为特征n对应的累积错误率,当前最小累积错误率。After the update is complete, each feature selector will select the feature with the current minimum cumulative error rate as its corresponding weak classifier: (m + is the feature of the current minimum cumulative error rate), where ε m is the cumulative error rate of each feature, and the weight corresponding to the cumulative error rate of feature n is ε n is the cumulative error rate corresponding to feature n, The current minimum cumulative error rate.
第n个特征选择器生成后样本(x,y)的权值λ也根据是否被错分来进行增加或减少。经过N次挑选后强分类器由这个挑选出来的特征按照各自的权重组合而成:nth feature selector The weight λ of the generated sample (x, y) is also increased or decreased according to whether it is misclassified. After N times of selection, the strong classifier is composed of the selected features according to their respective weights:
目标新位置通过在上一帧时目标位置附近范围内用强分类器评价决定。设搜索范围为S,搜索范围S内的目标候选位置为pw(w=1,...,W),目标新位置为xnew,则其中,w+为经过N个强分类器的总评价最大的候选位置,满足下式:The new position of the target is determined by evaluating the range around the target position in the previous frame with a strong classifier. Suppose the search range is S, the target candidate position within the search range S is p w (w=1,...,W), and the new target position is x new , then Among them, w + is the candidate position with the largest total evaluation after passing through N strong classifiers, which satisfies the following formula:
其中,即在候选位置为pw处经过特征n的特征选择器的值,从上式可以看出目标定位时需要N个特征选择器在W个候选位置上进行评价。in, That is, the feature selector that passes through the feature n at the candidate position p w From the above formula, it can be seen that N feature selectors are required to evaluate W candidate positions during target positioning.
具体地,在本实施例中,所述在线选择提升算法的特征包括:Haar特征,边缘方向直方图特征和基于空间块状信息的局部二值模式的特征,在目标整体区域内生成,通过三种特征的计算分别对具有明显矩形特性的图像、边缘图像及全局纹理进行识别,减少单一特征带来的误差和错误。Specifically, in this embodiment, the features of the online selection and promotion algorithm include: Haar features, edge direction histogram features, and features of local binary patterns based on spatial block information, which are generated in the overall area of the target, through three The calculation of these features recognizes images with obvious rectangular characteristics, edge images and global textures, reducing errors and errors caused by a single feature.
更具体地,Haar特征分为四类:边缘特征、线性特征、中心特征和对角线特征,这四类特征组合成特征模板。特征模板内有白色和黑色两种矩形,并定义该模板的特征值为白色矩形像素和减去黑色矩形像素和。Haar特征值反映了图像的灰度变化情况。例如:脸部的一些特征能由矩形特征简单的描述,如:眼睛要比脸颊颜色要深,鼻梁两侧比鼻梁颜色要深,嘴巴比周围颜色要深等。在本实施例中,采用积分直方图对Haar特征进行计算,只遍历一次图像就可以求出图像中所有区域像素的和,可大大的提高了图像特征值计算的效率。积分直方图主要的思想是将图像从起点开始到各个点所形成的矩形区域像素之和作为一个数组的元素保存在内存中,当要计算某个区域的像素和时可以直接索引数组的元素,不用重新计算这个区域的像素和,从而加快了计算。积分直方图能够在多种尺度下,使用相同的时间(常数时间)来计算不同的特征,因此大大提高了检测速度。通过大量的具有比较明显的Haar特征(矩形)的物体图像用模式识别的方法训练出分类器,分类器是个级联的,每级都以大概相同的识别率保留进入下一级的具有物体特征的候选物体,而每一级的子分类器则由许多Haar特征构成(由积分直方图计算得到,并保存下位置),有水平的、竖直的、倾斜的,并且每个特征带一个阈值和两个分支值,每级子分类器带一个总的阈值。识别物体的时候,同样计算积分直方图为后面计算Haar特征做准备,然后采用与训练的时候有物体的窗口同样大小的窗口遍历整幅图像,以后逐渐放大窗口,同样做遍历搜索物体;每当窗口移动到一个位置,即计算该窗口内的Haar特征,加权后与分类器中Haar特征的阈值比较从而选择左或者右分支值,累加一个级的分支值与相应级的阈值比较,大于该阈值才可以通过进入下一轮筛选。More specifically, Haar features are classified into four categories: edge features, linear features, center features, and diagonal features, which are combined into feature templates. There are two kinds of rectangles, white and black, in the feature template, and the feature value of the template is defined as the sum of the pixels of the white rectangle minus the sum of the pixels of the black rectangle. The Haar eigenvalue reflects the grayscale variation of the image. For example, some features of the face can be simply described by rectangular features, such as: the eyes are darker than the cheeks, the sides of the bridge of the nose are darker than the bridge of the nose, and the mouth is darker than the surroundings. In this embodiment, the integral histogram is used to calculate the Haar feature, and the sum of pixels in all regions in the image can be obtained by traversing the image only once, which can greatly improve the efficiency of image feature value calculation. The main idea of the integral histogram is to save the sum of pixels in the rectangular area formed by the image from the starting point to each point as an array element in the memory. When calculating the pixel sum of a certain area, you can directly index the elements of the array. There is no need to recalculate the sum of pixels in this area, thus speeding up the calculation. The integral histogram can use the same time (constant time) to calculate different features at multiple scales, thus greatly improving the detection speed. Through a large number of object images with obvious Haar features (rectangles), the classifier is trained by pattern recognition. The classifier is a cascade, and each level retains the object features that enter the next level at approximately the same recognition rate. Candidate objects, and the sub-classifiers at each level are composed of many Haar features (calculated from the integral histogram, and save the position), there are horizontal, vertical, and inclined, and each feature has a threshold and two branch values, with an overall threshold for each level of sub-classifiers. When recognizing an object, the integral histogram is also calculated to prepare for the later calculation of the Haar feature, and then the window with the same size as the window with the object during training is used to traverse the entire image, and then the window is gradually enlarged, and the same traversal is performed to search for the object; Move the window to a position, that is, calculate the Haar feature in the window, compare it with the threshold of the Haar feature in the classifier after weighting to select the left or right branch value, and compare the accumulated branch value of one level with the threshold of the corresponding level, which is greater than the threshold Only then can they pass to the next round of screening.
更具体地,边缘方向直方图特征的提取过程如下:设样本图像输入为A,利用边缘算子在水平方向上提取梯度幅值为Gx,在垂直方向上梯度的幅值为Gy,计算公式如下,其中*为二维卷积运算:More specifically, the extraction process of edge-oriented histogram features is as follows: Set the sample image input as A, use the edge operator to extract the gradient amplitude in the horizontal direction as G x , and the gradient amplitude in the vertical direction as G y , calculate The formula is as follows, where * is a two-dimensional convolution operation:
定义在这个像素点上梯度的幅值GMxy满足如下关系:Define the magnitude GM xy of the gradient at this pixel point to satisfy the following relationship:
其次定义该像素点梯度的方向θ满足如下关系:Secondly, the direction θ of the gradient of the pixel is defined to satisfy the following relationship:
最后将该像素点梯度的方向θ在区间θ∈(-π,π]内量化为NC个角度区域,并对区域内每个像素点的梯度进行统计,将对应的幅值加入对应的角度并获得直方图。直方图内每个统计区间的特征值即为我们需要的边缘特征,将其收集到整个特征向量中即可。Finally, the direction θ of the pixel gradient is quantified into N C angle areas in the interval θ∈(-π, π], and the gradient of each pixel point in the area is counted, and the corresponding amplitude is added to the corresponding angle And obtain the histogram. The eigenvalue of each statistical interval in the histogram is the edge feature we need, and it can be collected into the entire eigenvector.
更具体地,由于纹理特征受到光照等的影响较小,因此选择局部二值模式作为行人区域的局部纹理特征。局部二值模式通过分析像素点与其周围像素点之间的关系来获取特征值的。对于相邻的像素点来说,中央的像素点的局部二值模式通过如下方法计算:将相邻的像素点的数值gp与中心像素点的灰度值gc进行比较,若大于中心像素点的灰度值则记为1,若小于中心像素点的灰度值则记为0,反之亦可。此后以某一固定的位置为起始点,以顺时针方向链接获得的二值数据得到长度为八位的二值数据串,将其转化为十进制数据,便得到该像素点的局部二值模式特征值。计算方法如下:More specifically, since texture features are less affected by illumination etc., local binary patterns are selected as local texture features in pedestrian areas. Local binary mode obtains feature values by analyzing the relationship between a pixel and its surrounding pixels. For adjacent pixels, the local binary mode of the central pixel is calculated by the following method: compare the value g p of the adjacent pixel with the gray value g c of the central pixel, if it is greater than the central pixel The gray value of the point is recorded as 1, and if it is smaller than the gray value of the center pixel, it is recorded as 0, and vice versa. Afterwards, starting from a certain fixed position, linking the binary data obtained in a clockwise direction to obtain a binary data string with a length of eight bits, converting it into decimal data, and then obtaining the local binary pattern characteristics of the pixel value. The calculation method is as follows:
其中,LBP为局部二值模式特征值,P为相邻像素点的个数,R为半径,gp为相邻的像素点的数值,gc为中心像素点的灰度值。Among them, LBP is the characteristic value of the local binary pattern, P is the number of adjacent pixels, R is the radius, g p is the value of adjacent pixels, and g c is the gray value of the central pixel.
局部二值模式很好地描述了行人的局部纹理信息,但是不能描述行人的全局信息,如行人衣服上的图案会使行人检测精度下降。进一步地,在本实施例中提出了基于空间块状信息的局部二值模式算法,在本实施例中,斑块大小设定为8*8,在实际使用中,可根据算法要求设定所述斑块的大小,不以本实施例为限。The local binary pattern describes the local texture information of pedestrians well, but cannot describe the global information of pedestrians. For example, the pattern on pedestrian clothes will reduce the detection accuracy of pedestrians. Furthermore, in this embodiment, a local binary pattern algorithm based on spatial block information is proposed. In this embodiment, the patch size is set to 8*8. In actual use, the required value can be set according to the algorithm requirements. The size of the plaques is not limited to this embodiment.
如图2~图4所示,在本实施例中,将3个具有不同半径和采样点数的局部二值模式算子连接起来得到基于空间块状信息的局部二值模式的特征L。如图2所示,第一局部二值模式特征的采样半径为r1,采样点数为8个;如图3所示,第二局部二值模式特征的采样半径为r2,采样点数为12个;如图4所示,第三局部二值模式特征的采样半径为r3,采样点数为16个;其中r1<r2<r3。使得对于图像的每个点可以得到3个不同的局部二值模式特征LBPP,R,这些特征的并集包含了图像最重要的纹理信息:As shown in Figures 2 to 4, in this embodiment, three local binary pattern operators with different radii and numbers of sampling points are connected to obtain the feature L of the local binary pattern based on spatial block information. As shown in Figure 2, the sampling radius of the first local binary pattern feature is r1, and the number of sampling points is 8; as shown in Figure 3, the sampling radius of the second local binary pattern feature is r2, and the number of sampling points is 12; As shown in FIG. 4 , the sampling radius of the third local binary mode feature is r3, and the number of sampling points is 16; where r1<r2<r3. So that for each point of the image, three different local binary pattern features LBP P, R can be obtained, and the union of these features contains the most important texture information of the image:
如图5所示,在斑块的块状区域内计算每个像素点的梯度,并计算梯度的幅值和方向,与边缘方向直方图特征中计算梯度的幅值和方向的方法一致,在此不一一赘述。如图6所示,统计块状区域内8个方向(0到360度,每45度一个方向)的像素点的直方图统计,直方图统计结果为特征向量(8维的特征向量)。As shown in Figure 5, the gradient of each pixel is calculated in the blocky area of the patch, and the magnitude and direction of the gradient are calculated, which is consistent with the method of calculating the magnitude and direction of the gradient in the edge direction histogram feature. This will not repeat them one by one. As shown in Figure 6, the histogram statistics of the pixels in 8 directions (0 to 360 degrees, one direction every 45 degrees) in the block area are counted, and the result of the histogram statistics is a feature vector (8-dimensional feature vector).
步骤S4:根据检测到的行人,拟合行人的队列形状曲线。Step S4: According to the detected pedestrians, fit the queue shape curve of pedestrians.
具体地,采用基于RANSAC的最小二乘多项式曲线拟合方法来拟合队列形状曲线。RANSAC算法(Random Sample Consensus,随机抽样一致算法)是根据一组包含异常数据的样本数据集,计算出数据的数学模型参数,得到有效样本数据的算法。它于1981年由Fischler和Bolles最先提出。RANSAC算法的基本假设是样本中包含正确数据(inliers,可以被模型描述的数据),也包含异常数据(outliers,偏离正常范围很远、无法适应数学模型的数据),即数据集中含有噪声。这些异常数据可能是由于错误的测量、错误的假设、错误的计算等产生的。同时RANSAC也假设,给定一组正确的数据,存在可以计算出符合这些数据的模型参数的方法。RANSAC基本思想描述如下:①考虑一个最小抽样集的势为b的模型(b为初始化模型参数所需的最小样本数)和一个样本集Q,集合Q的样本数#(Q)>b,从Q中随机抽取包含b个样本的Q的子集T初始化模型D;②余集TC=Q\T中与模型D的误差小于某一设定阈值t的样本集以及T构成T*。T*认为是内点集,它们构成T的一致集(Consensus Set);③若#(T*)≥B,认为得到正确的模型参数,并利用集T*(内点inliers)采用最小二乘等方法重新计算新的模型D*;重新随机抽取新的T,重复以上过程。④在完成一定的抽样次数后,若未找到一致集则算法失败,否则选取抽样后得到的最大一致集判断内外点,算法结束。Specifically, a RANSAC-based least squares polynomial curve fitting method is used to fit the queue shape curve. The RANSAC algorithm (Random Sample Consensus) is an algorithm that calculates the mathematical model parameters of the data based on a set of sample data sets containing abnormal data, and obtains effective sample data. It was first proposed by Fischler and Bolles in 1981. The basic assumption of the RANSAC algorithm is that the sample contains correct data (inliers, data that can be described by the model) and abnormal data (outliers, data that deviates far from the normal range and cannot adapt to the mathematical model), that is, the data set contains noise. These abnormal data may be generated due to wrong measurements, wrong assumptions, wrong calculations, etc. At the same time, RANSAC also assumes that, given a correct set of data, there is a method that can calculate the model parameters that conform to these data. The basic idea of RANSAC is described as follows: ①Consider a model with the potential of the minimum sampling set b (b is the minimum number of samples required to initialize the model parameters) and a sample set Q, the number of samples of the set Q#(Q)>b, from Randomly select a subset T of Q containing b samples from Q to initialize the model D; ②The residual set TC=the sample set in Q\T whose error with model D is less than a certain threshold t and T constitutes T*. T* is regarded as a set of interior points, which constitute the consensus set of T; ③ If #(T*)≥B, it is considered that the correct model parameters are obtained, and the set T* (inliers) is used to adopt least squares and other methods to recalculate the new model D*; re-randomly select a new T, and repeat the above process. ④ After completing a certain number of sampling times, if no consistent set is found, the algorithm fails, otherwise, the largest consistent set obtained after sampling is selected to judge the inner and outer points, and the algorithm ends.
步骤S5:图像标定,将图像坐标转换为世界坐标。Step S5: Image calibration, transforming image coordinates into world coordinates.
步骤S6:根据队列形状曲线计算队列实际长度和相邻行人之间的距离,从而计算得到队列中的人数。Step S6: Calculate the actual length of the queue and the distance between adjacent pedestrians according to the queue shape curve, so as to calculate the number of people in the queue.
如图7所示,根据曲线拟合计算曲线长度,即排队的长度L,根据排队的长度L和队列中相邻人之间的距离d,计算队列中的人数,计算公式如下:As shown in Figure 7, the length of the curve is calculated according to the curve fitting, that is, the length L of the queue, and the number of people in the queue is calculated according to the length L of the queue and the distance d between adjacent people in the queue. The calculation formula is as follows:
人数=L/d。Number of people = L/d.
本发明能够在不同应用场景、不同气候和光照条件下进行实时、有效、快速和准确的行人排队长度检测。The invention can perform real-time, effective, fast and accurate pedestrian queue length detection under different application scenarios, different climates and illumination conditions.
如图8所示,本发明还提供一种排队长度控制方法,所述排队长度控制方法至少包括:As shown in Figure 8, the present invention also provides a queue length control method, the queue length control method at least includes:
在需要排队长度控制的场合设置监控装置,采集行人排队视频。Set up monitoring devices in occasions that require queuing length control to collect video of pedestrians queuing.
具体地,在需要进行排队长度控制的场合,例如机场、医院等公共环境,设置监控探头等监控装置。Specifically, in places where queue length control is required, such as public environments such as airports and hospitals, monitoring devices such as monitoring probes are installed.
采用上述排队长度自动检测方法对排队长度进行检测。The above-mentioned queue length automatic detection method is adopted to detect the queue length.
具体地,基于人体结构模型算法检测行人;采用特征在线选择提升算法跟踪行人,主要解决上一帧检测到目标而当前帧目标丢失的问题,减少漏检,特征在线选择提升算法的特征采用的是Haar特征,边缘方向直方图特征和基于空间块状信息的局部二值模式的特征,在线选取特征的方法根据目标所处场景自动选取具有表现力的特征可以提高跟踪效果;根据检测到的人,采用基于RANSAC的最小二乘多项式曲线拟合方法拟合人的队列形状,从而估计队列的长度;通过图像标定实现图像坐标系到世界坐标系的转换,从而计算实际排队的长度;根据曲线拟合计算曲线长度,即排队的长度,再根据排队的长度和队列中相邻人之间的距离,计算队列中的人数。具体方法参见上文,在此不一一赘述。Specifically, pedestrians are detected based on the human body structure model algorithm; pedestrians are tracked using the feature online selection and promotion algorithm, which mainly solves the problem that the target is detected in the previous frame but the target is lost in the current frame, and reduces missed detection. The feature of the feature online selection and promotion algorithm is Haar features, edge direction histogram features, and local binary pattern features based on spatial block information. The online feature selection method automatically selects expressive features according to the scene where the target is located to improve the tracking effect; according to the detected person, Use the least squares polynomial curve fitting method based on RANSAC to fit the shape of the queue to estimate the length of the queue; realize the transformation from the image coordinate system to the world coordinate system through image calibration, so as to calculate the actual length of the queue; according to the curve fitting Calculate the length of the curve, that is, the length of the queue, and then calculate the number of people in the queue based on the length of the queue and the distance between adjacent people in the queue. For specific methods, refer to the above, and details will not be repeated here.
当排队长度超出预设人数时,向客户端发出预警信息,客户端调整排队队列,解决排队等候问题。When the queue length exceeds the preset number of people, an early warning message is sent to the client, and the client adjusts the queue to solve the problem of waiting in line.
具体地,客户端调整排队队列的方法包括:运营管理中心接收到预警信息后,及时增加服务窗口,缓解排队等候的时间;客户端对行人流量进行统计;工作人员或预警指示及时引导行人排队,将人多的队列中的行人引导至人少的队列;从而有效的解决排队等候的问题,更好的服务旅客。Specifically, the method for the client to adjust the queuing queue includes: after the operation management center receives the warning information, it will increase the service window in time to ease the waiting time in the queue; Guide the pedestrians in the queue with many people to the queue with few people; thus effectively solve the problem of waiting in line and serve passengers better.
本发明可以实时监控办理登机区域和安检口区域的排队情况,及时调整排队队列,有效解决排队等候的问题。The invention can monitor the queuing situation in the boarding area and the security check area in real time, adjust the queuing queue in time, and effectively solve the problem of queuing and waiting.
综上所述,本发明提供一种排队长度自动检测方法及排队长度控制方法,基于人体结构模型算法检测行人;采用特征在线选择提升算法跟踪行人,主要解决上一帧检测到目标而当前帧目标丢失的问题,减少漏检,特征在线选择提升算法的特征采用的是Haar特征,边缘方向直方图特征和基于空间块状信息的局部二值模式的特征,在线选取特征的方法根据目标所处场景自动选取具有表现力的特征可以提高跟踪效果;根据检测到的人,采用基于RANSAC的最小二乘多项式曲线拟合方法拟合人的队列形状,从而估计队列的长度;通过图像标定实现图像坐标系到世界坐标系的转换,从而计算实际排队的长度;根据曲线拟合计算曲线长度,即排队的长度,再根据排队的长度和队列中相邻人之间的距离,计算队列中的人数。本发明的排队长度自动检测方法及排队长度控制方法能快速、准确的检测出监控场景中的行人排队长度,避免目标丢失的问题,减少漏检;通过实时监控排队情况,及时调整办理窗口,从而有效的解决排队等候的问题,更好的服务旅客。所以,本发明有效克服了现有技术中的种种缺点而具高度产业利用价值。In summary, the present invention provides an automatic queue length detection method and a queue length control method, which detect pedestrians based on the human body structure model algorithm; use the feature online selection and promotion algorithm to track pedestrians, and mainly solve the problem that the target detected in the previous frame is not detected in the current frame. The problem of loss, to reduce missed detection, feature online selection and promotion algorithm uses Haar feature, edge direction histogram feature and local binary mode feature based on spatial block information. The method of online feature selection depends on the scene where the target is located. Automatic selection of expressive features can improve the tracking effect; according to the detected people, the least squares polynomial curve fitting method based on RANSAC is used to fit the shape of the queue to estimate the length of the queue; the image coordinate system is realized through image calibration Convert to the world coordinate system to calculate the actual length of the queue; calculate the length of the curve based on curve fitting, that is, the length of the queue, and then calculate the number of people in the queue based on the length of the queue and the distance between adjacent people in the queue. The queuing length automatic detection method and queuing length control method of the present invention can quickly and accurately detect the queuing length of pedestrians in the monitoring scene, avoid the problem of target loss, and reduce missed detection; through real-time monitoring of the queuing situation, the processing window can be adjusted in time, thereby Effectively solve the problem of waiting in line and better serve passengers. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial application value.
上述实施例仅例示性说明本发明的原理及其功效,而非用于限制本发明。任何熟悉此技术的人士皆可在不违背本发明的精神及范畴下,对上述实施例进行修饰或改变。因此,举凡所属技术领域中具有通常知识者在未脱离本发明所揭示的精神与技术思想下所完成的一切等效修饰或改变,仍应由本发明的权利要求所涵盖。The above-mentioned embodiments only illustrate the principles and effects of the present invention, but are not intended to limit the present invention. Anyone skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and technical ideas disclosed in the present invention should still be covered by the claims of the present invention.
Claims (14)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710312890.3A CN107153819A (en) | 2017-05-05 | 2017-05-05 | A kind of queue length automatic testing method and queue length control method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710312890.3A CN107153819A (en) | 2017-05-05 | 2017-05-05 | A kind of queue length automatic testing method and queue length control method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107153819A true CN107153819A (en) | 2017-09-12 |
Family
ID=59794055
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710312890.3A Pending CN107153819A (en) | 2017-05-05 | 2017-05-05 | A kind of queue length automatic testing method and queue length control method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107153819A (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110517399A (en) * | 2019-08-30 | 2019-11-29 | 山东浪潮商用系统有限公司 | A kind of realization method and system for tax handling service hall's business intelligence early warning |
CN110555363A (en) * | 2018-05-30 | 2019-12-10 | 佳能株式会社 | Information processing apparatus, image pickup apparatus, information processing method, and storage medium |
CN111008611A (en) * | 2019-12-20 | 2020-04-14 | 浙江大华技术股份有限公司 | Queuing time determining method and device, storage medium and electronic device |
CN111325057A (en) * | 2018-12-14 | 2020-06-23 | 杭州海康威视数字技术股份有限公司 | Queuing queue detection method and device |
WO2020140749A1 (en) * | 2019-01-02 | 2020-07-09 | 京东方科技集团股份有限公司 | Queuing recommendation method and device, terminal, and computer readable storage medium |
CN112288792A (en) * | 2020-09-28 | 2021-01-29 | 上海数川数据科技有限公司 | Vision-based instant measurement method for guest queuing length and waiting time |
CN112735019A (en) * | 2021-01-20 | 2021-04-30 | 联仁健康医疗大数据科技股份有限公司 | Queuing guidance method, device, system, electronic equipment and storage medium |
CN112954268A (en) * | 2019-12-10 | 2021-06-11 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring equipment |
CN112949350A (en) * | 2019-12-10 | 2021-06-11 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring equipment thereof |
CN117576822A (en) * | 2023-11-20 | 2024-02-20 | 上海徽视科技集团有限公司 | Queuing and number calling guiding system based on Internet platform |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103761515A (en) * | 2014-01-27 | 2014-04-30 | 中国科学院深圳先进技术研究院 | Human face feature extracting method and device based on LBP |
CN103903445A (en) * | 2014-04-22 | 2014-07-02 | 北京邮电大学 | Vehicle queuing length detection method and system based on video |
CN103971095A (en) * | 2014-05-09 | 2014-08-06 | 西北工业大学 | Large-scale facial expression recognition method based on multiscale LBP and sparse coding |
CN104134078A (en) * | 2014-07-22 | 2014-11-05 | 华中科技大学 | Automatic selection method for classifiers in people flow counting system |
CN104835142A (en) * | 2015-03-10 | 2015-08-12 | 杭州电子科技大学 | Vehicle queuing length detection method based on texture features |
US20150312529A1 (en) * | 2014-04-24 | 2015-10-29 | Xerox Corporation | System and method for video-based determination of queue configuration parameters |
CN105447492A (en) * | 2015-11-13 | 2016-03-30 | 重庆邮电大学 | Image description method based on 2D local binary pattern |
US20160180173A1 (en) * | 2014-12-18 | 2016-06-23 | Sensormatic Electronics, LLC | Method and System for Queue Length Analysis |
CN105763853A (en) * | 2016-04-14 | 2016-07-13 | 北京中电万联科技股份有限公司 | Emergency early warning method for stampede accident in public area |
CN106096553A (en) * | 2016-06-06 | 2016-11-09 | 合肥工业大学 | A kind of pedestrian traffic statistical method based on multiple features |
CN106128121A (en) * | 2016-07-05 | 2016-11-16 | 中国石油大学(华东) | Vehicle queue length fast algorithm of detecting based on Local Features Analysis |
CN106250820A (en) * | 2016-07-20 | 2016-12-21 | 华南理工大学 | A kind of staircase mouth passenger flow based on image procossing is blocked up detection method |
-
2017
- 2017-05-05 CN CN201710312890.3A patent/CN107153819A/en active Pending
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103761515A (en) * | 2014-01-27 | 2014-04-30 | 中国科学院深圳先进技术研究院 | Human face feature extracting method and device based on LBP |
CN103903445A (en) * | 2014-04-22 | 2014-07-02 | 北京邮电大学 | Vehicle queuing length detection method and system based on video |
US20150312529A1 (en) * | 2014-04-24 | 2015-10-29 | Xerox Corporation | System and method for video-based determination of queue configuration parameters |
CN103971095A (en) * | 2014-05-09 | 2014-08-06 | 西北工业大学 | Large-scale facial expression recognition method based on multiscale LBP and sparse coding |
CN104134078A (en) * | 2014-07-22 | 2014-11-05 | 华中科技大学 | Automatic selection method for classifiers in people flow counting system |
US20160180173A1 (en) * | 2014-12-18 | 2016-06-23 | Sensormatic Electronics, LLC | Method and System for Queue Length Analysis |
CN104835142A (en) * | 2015-03-10 | 2015-08-12 | 杭州电子科技大学 | Vehicle queuing length detection method based on texture features |
CN105447492A (en) * | 2015-11-13 | 2016-03-30 | 重庆邮电大学 | Image description method based on 2D local binary pattern |
CN105763853A (en) * | 2016-04-14 | 2016-07-13 | 北京中电万联科技股份有限公司 | Emergency early warning method for stampede accident in public area |
CN106096553A (en) * | 2016-06-06 | 2016-11-09 | 合肥工业大学 | A kind of pedestrian traffic statistical method based on multiple features |
CN106128121A (en) * | 2016-07-05 | 2016-11-16 | 中国石油大学(华东) | Vehicle queue length fast algorithm of detecting based on Local Features Analysis |
CN106250820A (en) * | 2016-07-20 | 2016-12-21 | 华南理工大学 | A kind of staircase mouth passenger flow based on image procossing is blocked up detection method |
Non-Patent Citations (5)
Title |
---|
刘中华等: "基于多尺度局部二值模式的人脸识别", 《计算机科学》 * |
查宇飞等: "《视频目标跟踪方法》", 31 July 2015 * |
涂宏斌等著: "《基于机器学习的行为识别技术研究》", 30 September 2016 * |
邱天圆: "基于多特征融合的行人检测算法研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
颜佳等: "遮挡环境下采用在线Boosting的目标跟踪", 《光学精密工程》 * |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110555363A (en) * | 2018-05-30 | 2019-12-10 | 佳能株式会社 | Information processing apparatus, image pickup apparatus, information processing method, and storage medium |
CN111325057B (en) * | 2018-12-14 | 2024-02-27 | 杭州海康威视数字技术股份有限公司 | Queuing queue detection method and device |
CN111325057A (en) * | 2018-12-14 | 2020-06-23 | 杭州海康威视数字技术股份有限公司 | Queuing queue detection method and device |
WO2020140749A1 (en) * | 2019-01-02 | 2020-07-09 | 京东方科技集团股份有限公司 | Queuing recommendation method and device, terminal, and computer readable storage medium |
US11488321B2 (en) * | 2019-01-02 | 2022-11-01 | Beijing Boe Technology Development Co., Ltd. | Queuing recommendation method and device, terminal and computer readable storage medium |
CN110517399A (en) * | 2019-08-30 | 2019-11-29 | 山东浪潮商用系统有限公司 | A kind of realization method and system for tax handling service hall's business intelligence early warning |
CN112949350A (en) * | 2019-12-10 | 2021-06-11 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring equipment thereof |
CN112954268A (en) * | 2019-12-10 | 2021-06-11 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring equipment |
US11138754B2 (en) | 2019-12-10 | 2021-10-05 | Vivotek Inc. | Queue analyzing method and image monitoring apparatus |
TWI756597B (en) * | 2019-12-10 | 2022-03-01 | 晶睿通訊股份有限公司 | Queue analyzing method and image monitoring apparatus |
CN112954268B (en) * | 2019-12-10 | 2023-07-18 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring equipment |
CN112949350B (en) * | 2019-12-10 | 2024-04-09 | 晶睿通讯股份有限公司 | Queue analysis method and image monitoring device thereof |
CN111008611A (en) * | 2019-12-20 | 2020-04-14 | 浙江大华技术股份有限公司 | Queuing time determining method and device, storage medium and electronic device |
CN112288792A (en) * | 2020-09-28 | 2021-01-29 | 上海数川数据科技有限公司 | Vision-based instant measurement method for guest queuing length and waiting time |
CN112288792B (en) * | 2020-09-28 | 2022-12-02 | 上海数川数据科技有限公司 | Vision-based method for measuring guest queuing length and waiting time in real time |
CN112735019A (en) * | 2021-01-20 | 2021-04-30 | 联仁健康医疗大数据科技股份有限公司 | Queuing guidance method, device, system, electronic equipment and storage medium |
CN117576822A (en) * | 2023-11-20 | 2024-02-20 | 上海徽视科技集团有限公司 | Queuing and number calling guiding system based on Internet platform |
CN117576822B (en) * | 2023-11-20 | 2024-04-30 | 上海徽视科技集团有限公司 | Queuing and number calling guiding system based on Internet platform |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107153819A (en) | A kind of queue length automatic testing method and queue length control method | |
CN109522793B (en) | Multi-person abnormal behavior detection and recognition method based on machine vision | |
US10319096B2 (en) | Automated tattoo recognition techniques | |
CN106874894B (en) | A Human Object Detection Method Based on Regional Fully Convolutional Neural Networks | |
CN108509859B (en) | Non-overlapping area pedestrian tracking method based on deep neural network | |
CN104268900B (en) | Motion object detection method and device | |
CN108596055B (en) | Airport target detection method of high-resolution remote sensing image under complex background | |
CN106228125B (en) | Method for detecting lane lines based on integrated study cascade classifier | |
CN109409190A (en) | Pedestrian detection method based on histogram of gradients and Canny edge detector | |
US9489561B2 (en) | Method and system for estimating fingerprint pose | |
WO2016015547A1 (en) | Machine vision-based method and system for aircraft docking guidance and aircraft type identification | |
CN114998852A (en) | Intelligent detection method for road pavement diseases based on deep learning | |
CN110276264A (en) | A Crowd Density Estimation Method Based on Foreground Segmentation Map | |
CN101986348A (en) | Visual target identification and tracking method | |
CN109376740A (en) | A kind of water gauge reading detection method based on video | |
CN104036284A (en) | Adaboost algorithm based multi-scale pedestrian detection method | |
CN107633226A (en) | A kind of human action Tracking Recognition method and system | |
CN104615986A (en) | Method for utilizing multiple detectors to conduct pedestrian detection on video images of scene change | |
CN108256462A (en) | A kind of demographic method in market monitor video | |
CN106778683A (en) | Based on the quick Multi-angle face detection method for improving LBP features | |
CN112287802A (en) | Face image detection method, system, storage medium and equipment | |
JP2020038132A (en) | Crack on concrete surface specification method, crack specification device, and crack specification system, and program | |
CN110502977A (en) | A kind of building classification of change detection method, system, device and storage medium | |
CN104778472A (en) | Extraction method for facial expression feature | |
CN104599291A (en) | Structural similarity and significance analysis based infrared motion target detection method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170912 |
|
RJ01 | Rejection of invention patent application after publication |