[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112201056A - Vehicle queuing length detection method based on angular point characteristic analysis - Google Patents

Vehicle queuing length detection method based on angular point characteristic analysis Download PDF

Info

Publication number
CN112201056A
CN112201056A CN201910608002.1A CN201910608002A CN112201056A CN 112201056 A CN112201056 A CN 112201056A CN 201910608002 A CN201910608002 A CN 201910608002A CN 112201056 A CN112201056 A CN 112201056A
Authority
CN
China
Prior art keywords
corner
vehicle
detection
queue
length
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910608002.1A
Other languages
Chinese (zh)
Inventor
刘新平
张影
王风华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China University of Petroleum East China
Original Assignee
China University of Petroleum East China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China University of Petroleum East China filed Critical China University of Petroleum East China
Priority to CN201910608002.1A priority Critical patent/CN112201056A/en
Publication of CN112201056A publication Critical patent/CN112201056A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/065Traffic control systems for road vehicles by counting the vehicles in a section of the road or in a parking area, i.e. comparing incoming count with outgoing count
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/255Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0125Traffic data processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to a vehicle queuing length detection method based on angular point characteristic analysis, and belongs to vehicle flow detection of an intelligent traffic management system. The method obtains an improved FAST algorithm by combining the traditional FAST corner detection method and the motion detection process, and can extract the corner feature map representing the existence of vehicles on the current traffic road and acquire the motion state of the corner position by using the improved FAST corner feature analysis technology. And obtaining the result of the improved FAST algorithm, forming vehicle queue by the static corner point characteristics in the single lane, carrying out PCA (principal component analysis) processing to obtain a low-dimensional vector, and finally carrying out morphological processing on the low-dimensional vector to detect the vehicle queue length in the single lane. The result shows that the detection precision of the method is 98% on average, and the method can be applied to actual scenes.

Description

Vehicle queuing length detection method based on angular point characteristic analysis
Technical Field
The invention discloses a vehicle queuing length detection method based on angular point characteristic analysis, and belongs to vehicle flow detection of an intelligent traffic management system.
Background
Road traffic parameters such as traffic flow, vehicle speed, lane occupancy and the like can be obtained through the detection result of the vehicle queuing length. The detection process of the vehicle queue length mainly comprises the steps of motion detection, vehicle existence detection and vehicle queue length measurement. At present, three methods are commonly used for a vehicle queue length detection algorithm, and the first method is a vehicle detection method combining background difference and vehicle characteristics. Yang Lianggyi et al use a three-frame time difference method of motion detection to detect moving vehicles, edge information as a vehicle presence flag, and a moving detection window to detect the vehicle queue length at the intersection. And finally, obtaining the vehicle queuing length by using a camera calibration technology. The algorithm mainly obtains the moving vehicles in the video through a time difference method, and the queuing length of the static vehicles in the case of traffic jam cannot be detected. The second is a vehicle detection method based on vehicle characteristics and perspective transformation, Wang Chuang et al obtains a bird's-eye view of a traffic road by establishing a world coordinate system and using inverse perspective transformation, identifies lane lines by using hough transformation based on highway structural constraint, and finally detects a vehicle contour by using a sobel operator. The method obtains a clearer vehicle queuing result through inverse perspective transformation, but the method is based on vehicle queuing formation and neglects judgment of the vehicle motion state. Thirdly, most of the conventional detection methods for the vehicle queuing length are based on a sliding window method, and after the vehicle is extracted by Liu Zhe based on morphological edges, a vehicle queuing length detection method for a telescopic window is provided. The above algorithms can effectively detect the vehicle to a certain extent, but all have certain limitations.
Disclosure of Invention
On the basis of the existing vehicle queue length detection method, the invention mainly performs the following work in the vehicle queue length detection process. Firstly, the process of improving the FAST corner detection is to combine FAST algorithm detection with an interframe difference method, use corner information as a mark of vehicle existence in a detection window, and compare pixel change of corner positions between adjacent frames with a threshold value to judge the motion state of the vehicle and acquire a vehicle queue in a video. Secondly, when the current vehicle is in a static state, a static vehicle corner feature map is obtained, corner information in the queue is compressed into a low-dimensional vector by combining a PCA technology, and useful corner information in original video monitoring is retained while isolated noise points are removed. Thirdly, the obtained low-dimensional vector is subjected to morphological processing of a variable template, and finally converted into the actual queuing length. In order to achieve the purpose, the technical scheme of the invention is as follows:
step one, preprocessing the real-time road condition video collected by a traffic intersection camera. The method comprises the steps of graying a video image, removing noise and extracting an interested area;
step two, judging the position and the motion state of an angular point in a current detection window by using an improved FAST algorithm so as to judge the formation of vehicle queuing;
step three, acquiring a vehicle queue when a large number of static angular point features are detected in the current detection window;
step four, the corner features obtained in the queue are compressed into low-dimensional vectors by applying PCA (principal component analysis) processing to represent the length of the vehicle queue;
step five, performing morphological processing on the PCA result to determine the queue length;
and step six, converting the result obtained in the step five into the pixel length.
Has the advantages that:
the method for detecting the vehicle length combines PCA processing with FAST algorithm, and is characterized in that a low-dimensional data set generated by the PCA processing can retain the variable of original data as much as possible. And (3) generating a new image by using an improved FAST algorithm and the corner feature key point set according to the mapping principle, so that the image is conveniently used for PCA processing to obtain a low-dimensional vector to detect the queuing length of the vehicle.
In the existing vehicle queue length detection method, the indispensable steps comprise motion detection and vehicle existence detection before vehicle queue detection, and the second point of improvement of the FAST algorithm in the method is that the motion detection method is integrated into the FAST algorithm, so that the operation burden of the system is reduced.
Drawings
FIG. 1 is a flow chart of a vehicle queue length detection method according to an embodiment of the invention;
FIG. 2 is a schematic diagram of region of interest extraction according to an embodiment of the present invention;
FIG. 3 is the result of the modified FAST algorithm within the detection window in the example of the present invention;
FIG. 4 is a static corner feature map in an example of the present invention;
FIG. 5 is a compression result of the PCA algorithm in an example of the present invention;
FIG. 6 shows the results of morphological processing in an example of the invention;
FIG. 7 is a pixel length of vehicle queue in an example of the invention.
Detailed Description
The invention discloses a vehicle queuing length detection method based on angular point characteristic analysis. The method is based on FAST corner detection to extract the vehicle corner features in a single lane in a surveillance video, and uses PCA to extract principal components and compress the principal components into low-dimensional vectors. And finally, obtaining the vehicle queuing length by using the morphological processing of the variable template.
In the following detailed example, referring to fig. 1, the vehicle queue length detection based on the corner feature analysis is further explained:
in this embodiment, the vehicle queuing length at a certain intersection is detected, and the detection steps are as follows:
example (b):
step one, preprocessing the real-time road condition video collected by a traffic intersection camera. Including graying the video image, noise removal and region of interest extraction. The extraction result of the region of interest in different scenes is shown in fig. 2;
step two, after preprocessing the original video, setting a virtual detection area in front of the stop line, judging the position and the motion state of the corner point in the current detection window by using an improved FAST algorithm, and distinguishing the static corner point from the dynamic corner point by using different colors, as shown in fig. 3. Assuming that p is the position where the corner is detected, the method for detecting the motion state is as follows:
Figure BDA0002121372180000041
Figure BDA0002121372180000042
it (p) is the value of the pixel p at time t, s (p) is the set of neighborhoods of p, and comparing the obtained d (p) with the threshold t to obtain e (p), i.e. the motion state of the vehicle. When E (p) is 1, the static corner points are, and when E (p) is 0, the dynamic corner points are;
and step three, acquiring a vehicle queue when a large number of static corner point features are detected in the current detection window, as shown in fig. 3 (b). When the vehicles in the virtual detection area are in a static state, the default traffic is in a congestion state and the vehicle queue length is measured. The method generates a new image from the static corner feature key point set according to the mapping principle, and is convenient to use the image to carry out PCA processing to obtain a low-dimensional vector, wherein the image is as shown in FIG. 4;
and step four, PCA processing is applied to the corner features obtained in the queue, and the corner features are compressed into low-dimensional vectors to represent the length of the vehicle queue. The low-dimensional vector map shown in fig. 5 is generated by performing PCA on the corner point map generated as shown in fig. 4;
and step five, performing morphological processing on the PCA result to determine the queue length. The above obtained discontinuous results are optimized using morphological treatments. Due to the large and small features during imaging, as shown in fig. 6, the image is processed using variable template morphology:
Figure BDA0002121372180000051
where B (i, j) represents the range of the matrix formed by aligning the center of B with the (i, j) position of Ar, which is an image expanded using the variable template B (2r +1 ). Ar (p, q) is the point falling on the B (i, j) # Ar portion, resulting in its maximum value;
and step six, converting the obtained morphological processing result into a pixel length, wherein the vehicle queue length in the invention is formed by white areas, namely, a first line white area encountered from (x, y) ═ 0, 0+ +, is the tail of the vehicle queue, and a first line white area encountered from (x, y) ═ 0, img. The pixel length obtained in this example is as shown in fig. 7.

Claims (4)

1. A vehicle queuing length detection method based on angular point feature analysis is characterized by comprising the following steps:
step one, preprocessing the real-time road condition video collected by a traffic intersection camera. The method comprises the steps of graying a video image, removing noise and extracting an interested area;
and step two, after the original video is preprocessed, a virtual detection area is arranged in front of a stop line, the position and the motion state of the corner point in the current detection window are judged by using an improved FAST algorithm, and static corner points and dynamic corner points are distinguished by using different colors. Assuming that p is the position where the corner is detected, the method for detecting the motion state is as follows:
Figure FDA0002121372170000011
Figure FDA0002121372170000012
it (p) is the value of the pixel p at time t, s (p) is the set of neighborhoods of p, and comparing the obtained d (p) with the threshold t to obtain e (p), i.e. the motion state of the vehicle. When E (p) is 1, the static corner is, and when E (p) is 0, the dynamic corner is;
and step three, when the vehicles in the virtual detection area are in a static state, defaulting that the traffic is in a congestion state, acquiring a vehicle queue, and measuring the vehicle queue length. The method generates a new image from the static angular point feature key point set according to the mapping principle, and is convenient for using the image to carry out PCA processing to obtain a low-dimensional vector;
step four, the corner feature maps obtained in the queue are compressed into low-dimensional vectors by applying PCA (principal component analysis) processing to represent the length of the vehicle queue;
and step five, performing morphological processing on the PCA result to determine the queue length. The above obtained discontinuous results are optimized using morphological treatments. Due to the characteristics of the near size and the far size in the imaging process, the image is subjected to morphological processing by using a variable template:
Figure FDA0002121372170000013
where B (i, j) represents the range of the matrix formed by aligning the center of B with the (i, j) position of Ar, which is an image expanded using the variable template B (2r +1 ). Ar (p, q) is the point falling on the B (i, j) # Ar portion, resulting in its maximum value;
step six, the vehicle queue length in the invention is composed of white areas, namely, the white area of the first line encountered from (x, y) ═ 0, 0+ +, is the queue tail of the vehicle queue, and the white area of the first line encountered from (x, y) ═ 0, img.
2. The method for detecting vehicle queue length based on corner feature analysis according to claim 1, characterized in that FAST algorithm detection is combined with frame-to-frame difference method to determine the motion state of the corner while detecting it.
3. The vehicle queue length detection method based on corner feature analysis as claimed in claim 1, characterized in that the improved FAST algorithm obtains the static vehicle corner feature map, and compresses the corner information in the queue into low-dimensional vectors by combining PCA technology.
4. The method of claim 1, wherein the low-dimensional vector obtained by the PCA is subjected to a variable template morphology process.
CN201910608002.1A 2019-07-08 2019-07-08 Vehicle queuing length detection method based on angular point characteristic analysis Pending CN112201056A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910608002.1A CN112201056A (en) 2019-07-08 2019-07-08 Vehicle queuing length detection method based on angular point characteristic analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910608002.1A CN112201056A (en) 2019-07-08 2019-07-08 Vehicle queuing length detection method based on angular point characteristic analysis

Publications (1)

Publication Number Publication Date
CN112201056A true CN112201056A (en) 2021-01-08

Family

ID=74004318

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910608002.1A Pending CN112201056A (en) 2019-07-08 2019-07-08 Vehicle queuing length detection method based on angular point characteristic analysis

Country Status (1)

Country Link
CN (1) CN112201056A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090034846A1 (en) * 2007-07-30 2009-02-05 Senior Andrew W High density queue estimation and line management
CN101469985A (en) * 2007-12-26 2009-07-01 河海大学常州校区 Single-frame image detection apparatus for vehicle queue length at road junction and its working method
US20100232709A1 (en) * 2009-03-10 2010-09-16 Liang Zhang Estimation of image relations from point correspondences between images
CN103136520A (en) * 2013-03-25 2013-06-05 苏州大学 Shape matching and target recognition method based on PCA-SC algorithm
CN103903445A (en) * 2014-04-22 2014-07-02 北京邮电大学 Vehicle queuing length detection method and system based on video
CN106128121A (en) * 2016-07-05 2016-11-16 中国石油大学(华东) Vehicle queue length fast algorithm of detecting based on Local Features Analysis
CN107274673A (en) * 2017-08-15 2017-10-20 苏州科技大学 Vehicle queue length measuring method and measuring system based on amendment local variance

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090034846A1 (en) * 2007-07-30 2009-02-05 Senior Andrew W High density queue estimation and line management
CN101469985A (en) * 2007-12-26 2009-07-01 河海大学常州校区 Single-frame image detection apparatus for vehicle queue length at road junction and its working method
US20100232709A1 (en) * 2009-03-10 2010-09-16 Liang Zhang Estimation of image relations from point correspondences between images
CN103136520A (en) * 2013-03-25 2013-06-05 苏州大学 Shape matching and target recognition method based on PCA-SC algorithm
CN103903445A (en) * 2014-04-22 2014-07-02 北京邮电大学 Vehicle queuing length detection method and system based on video
CN106128121A (en) * 2016-07-05 2016-11-16 中国石油大学(华东) Vehicle queue length fast algorithm of detecting based on Local Features Analysis
CN107274673A (en) * 2017-08-15 2017-10-20 苏州科技大学 Vehicle queue length measuring method and measuring system based on amendment local variance

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
YEH, CC: "GPU ACCELERATION OF UAV IMAGE SPLICING USING ORIENTED FAST AND ROTATED BRIEF COMBINED WITH PCA", 《IEEE INTERNATIONAL SYMPOSIUM ON GEOSCIENCE AND REMOTE SENSING IGARSS》 *
YONGJIAN KE;XINPING LIU: "Equitable financial evaluation method for public-private partnership projects", 《TSINGHUA SCIENCE AND TECHNOLOGY》 *
朱会强: "基于视频跟踪的车辆行为分析技术研究", 《信息科技》 *
李善梅: "空中交通拥挤的识别与预测方法研究", 《工程科技Ⅱ辑》 *
窦菲;刘新平;王风华: "基于OpenCV的道路视频分析系统", 《计算机系统应用》 *

Similar Documents

Publication Publication Date Title
CN107330376B (en) Lane line identification method and system
CN110070570B (en) Obstacle detection system and method based on depth information
WO2019196130A1 (en) Classifier training method and device for vehicle-mounted thermal imaging pedestrian detection
WO2019196131A1 (en) Method and apparatus for filtering regions of interest for vehicle-mounted thermal imaging pedestrian detection
CN108985170A (en) Transmission line of electricity hanger recognition methods based on Three image difference and deep learning
CN112819094A (en) Target detection and identification method based on structural similarity measurement
CN105678213B (en) Dual-mode mask person event automatic detection method based on video feature statistics
CN108563979B (en) Method for judging rice blast disease conditions based on aerial farmland images
CN109460722B (en) Intelligent license plate recognition method
CN112381870B (en) Binocular vision-based ship identification and navigational speed measurement system and method
CN103577828B (en) A kind of Approach for road detection based on edge feature
Rabiu Vehicle detection and classification for cluttered urban intersection
Su et al. A new local-main-gradient-orientation HOG and contour differences based algorithm for object classification
CN115166717A (en) Lightweight target tracking method integrating millimeter wave radar and monocular camera
CN113781421A (en) Underwater-based target identification method, device and system
CN111241979B (en) Real-time obstacle detection method based on image feature calibration
CN116524196A (en) Intelligent power transmission line detection system based on image recognition technology
CN107977608B (en) Method for extracting road area of highway video image
CN111814773A (en) Lineation parking space identification method and system
CN107507140A (en) The outdoor scene vehicle shadow disturbance restraining method of highway of feature based fusion
CN108563997B (en) Method and device for establishing face detection model and face recognition
WO2017161544A1 (en) Single-camera video sequence matching based vehicle speed measurement method and system
Zhao et al. License plate location based on Haar-like cascade classifiers and edges
JP2002197588A (en) Method for discriminating tire type of traveling vehicle and method and device for discriminating vehicle model
CN109800683A (en) A kind of infrared pedestrian detection method and device based on FPGA

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210108