[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN102303609A - Lane departure warning system and method - Google Patents

Lane departure warning system and method Download PDF

Info

Publication number
CN102303609A
CN102303609A CN201110162154A CN201110162154A CN102303609A CN 102303609 A CN102303609 A CN 102303609A CN 201110162154 A CN201110162154 A CN 201110162154A CN 201110162154 A CN201110162154 A CN 201110162154A CN 102303609 A CN102303609 A CN 102303609A
Authority
CN
China
Prior art keywords
gray
lane line
lane
unit
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201110162154A
Other languages
Chinese (zh)
Other versions
CN102303609B (en
Inventor
李植滔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rail Car Electronic Ltd By Share Ltd
Original Assignee
Steelmate Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Steelmate Co Ltd filed Critical Steelmate Co Ltd
Priority to CN 201110162154 priority Critical patent/CN102303609B/en
Publication of CN102303609A publication Critical patent/CN102303609A/en
Application granted granted Critical
Publication of CN102303609B publication Critical patent/CN102303609B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to a lane departure warning system and a lane departure warning method, wherein the system comprises an electrically connected camera unit for receiving and transmitting road condition signals; the lane line identification unit is connected with the camera unit, receives the road condition signal and performs Hough conversion on the road condition signal so as to identify a lane line; the deviation detection unit is connected with the lane line identification unit, calculates the distance between the lane line identification unit and the vehicle body according to the identified lane line, and sends out an early warning instruction when the distance exceeds a preset threshold value; and the early warning unit is connected with the offset detection unit, receives the early warning instruction and sends out a corresponding early warning signal. The method comprises the following steps: and calibrating the camera unit, setting an effective area, carrying out edge detection, searching lane lines, judging whether the lane lines deviate or not and sending an alarm signal.

Description

车道偏离预警系统及方法Lane departure warning system and method

【技术领域】 【Technical field】

本发明涉及一种车道偏离报警系统。The invention relates to a lane departure warning system.

【技术背景】 【technical background】

目前驾驶员因疏忽、疲劳、瞌睡或状态不集中的状况下导致的车道偏离事故和汽车追尾事故约占整个公路交通事故的60%-70%,死亡人数约占70%。据美国联邦公路局的估计,利用能检测车辆运行时的横向位置的系统和能检测到车辆运行时前车距离的系统将能大大降低这些交通事故的发生,因此,车道偏离预警和防前车碰撞系统的研究引起了各个国家的高度重视。At present, lane departure accidents and car rear-end collisions caused by drivers' negligence, fatigue, drowsiness or lack of concentration account for about 60%-70% of the entire road traffic accidents, and about 70% of the fatalities. According to the estimates of the U.S. Federal Highway Administration, the use of a system that can detect the lateral position of a vehicle and a system that can detect the distance from a vehicle in front of a vehicle will greatly reduce the occurrence of these traffic accidents. Therefore, lane departure warning and front vehicle prevention The research of collision system has aroused great attention of various countries.

国内外基于机器视觉的车道偏离系统主要有以下几种方法:基于特征的识别方法、基于模型的识别方法、基于视觉和其他传感器融合的方法等。基于特征的识别方法是从车辆前方的序列灰度图像中,利用道路边界及车道标识线的灰度特征而完成的对道路边界及车道标识线的识别;基于模型的识别方法主要是基于不同的道路图像模型采用不同的识别技术来对道路边界及车道标识线进行识别;基于视觉与其他传感器融合的方法通过融合多传感器感知到的道路信息,利用多种图像特征对道路进行识别。目前,世界上有些国家已成功研制出一些各具特色的车道偏离警告系统,如:Mobileye_AWS系统、AutoVue系统、GOLD系统、NavLab系统等。这些系统通过预先给驾驶员以警告信息,提醒驾驶员采取正确的操作措施,达到防止这类事故或者降低这类事故的伤害程度的目的。There are mainly the following methods for machine vision-based lane departure systems at home and abroad: feature-based recognition methods, model-based recognition methods, and methods based on fusion of vision and other sensors. The feature-based recognition method uses the gray-scale features of the road boundary and lane marking lines to complete the recognition of the road boundary and lane marking lines from the sequential grayscale images in front of the vehicle; the model-based recognition method is mainly based on different The road image model uses different recognition technologies to recognize road boundaries and lane markings; the method based on fusion of vision and other sensors fuses road information sensed by multiple sensors, and uses multiple image features to recognize roads. At present, some countries in the world have successfully developed some distinctive lane departure warning systems, such as: Mobileye_AWS system, AutoVue system, GOLD system, NavLab system, etc. These systems give the driver warning information in advance to remind the driver to take correct operation measures to prevent such accidents or reduce the degree of injury of such accidents.

然而,由于道路环境复杂,车辆种类多样,车道偏离预警和前车防撞预警系统不仅要有良好的实时性,而且还要有较强的鲁棒性。而现有的系统还不能很好的满足这些方面的要求,本发明提出了一种有较好实时性和鲁棒性的系统。However, due to the complex road environment and various types of vehicles, the lane departure warning and front collision avoidance warning systems must not only have good real-time performance, but also have strong robustness. However, the existing system cannot satisfy these requirements well. The present invention proposes a system with better real-time performance and robustness.

【发明内容】 【Content of invention】

针对上述问题,本发明提出一种车道偏离预警系统,主要用于防止正在行驶的车辆发生车道偏离,所述系统包括电连接的In view of the above problems, the present invention proposes a lane departure warning system, which is mainly used to prevent lane departure of vehicles in motion, and the system includes electrically connected

摄像单元,用于接收并传递路况图像信号;The camera unit is used to receive and transmit road condition image signals;

车道线识别单元,与所述摄像单元连接,接收所述路况图像信号,并对所述信号进行canny边缘检测和Hough变换,以识别车道线;A lane line identification unit, connected to the camera unit, receives the road condition image signal, and performs canny edge detection and Hough transform on the signal to identify the lane line;

偏移检测单元,与所述车道线识别单元连接,根据识别出的车道线,计算其与车体之间的距离,当所述距离超过预设阀值时,发出预警指令;An offset detection unit, connected to the lane line recognition unit, calculates the distance between the lane line and the vehicle body according to the identified lane line, and sends an early warning command when the distance exceeds a preset threshold;

预警单元,与偏移检测单元连接,接收所述预警指令,并发出相应预警信号。The early warning unit is connected with the offset detection unit, receives the early warning instruction, and sends out a corresponding early warning signal.

本发明同时提出一种实现车道偏离预警的方法,所述方法包括以下步骤:The present invention simultaneously proposes a method for realizing lane departure warning, said method comprising the following steps:

步骤1标定摄像单元,以接收并传递路况图像信号;Step 1 calibrates the camera unit to receive and transmit road condition image signals;

步骤2根据车辆行驶状态设置检测车道线的有效区域,所述有效区域的面积大于实际车道线在图像中的面积;有效区域范围根据此时是否已经检测出车道线来设定:如果此时检测到了车道线,那么根据步骤1标定的摄像单元,并根据中国道路的车道大小这一经验值来确定有效区域,这段区域只要包含检测到的车道线即可;如果没有检测到车道线,或者发生车辆压线的情况,此时的有效区域是整幅图像。设置了有效区域后能够去掉大部分的无效区域,提高算法的实时性;Step 2: Set the effective area for detecting lane lines according to the driving state of the vehicle. The area of the effective area is larger than the area of the actual lane line in the image; the effective area range is set according to whether the lane line has been detected at this time: if the detection When the lane line is reached, the effective area is determined according to the camera unit calibrated in step 1 and the empirical value of the lane size of the Chinese road. This area only needs to contain the detected lane line; if no lane line is detected, or In the case of vehicle line pressing, the effective area at this time is the entire image. After the effective area is set, most of the invalid areas can be removed to improve the real-time performance of the algorithm;

步骤3对有效区域内的图像信号进行canny边缘检测,得到二值化图像;Step 3: Carry out canny edge detection on the image signal in the effective area to obtain a binarized image;

步骤4利用二值化后的图像进行Hough变换,查找并匹配车道线;Step 4 uses the binarized image to perform Hough transform to find and match lane lines;

步骤5根据检测出的车道线,求取车体和所述车道线之间的距离,并判断是否发出预警指令;Step 5 Calculate the distance between the vehicle body and the lane line according to the detected lane line, and determine whether to issue an early warning instruction;

步骤6根据预警指令发出预警信号。Step 6: Send out an early warning signal according to the early warning instruction.

所述步骤4进一步包括以下步骤:Said step 4 further comprises the following steps:

步骤41检测车辆当前的行驶状态;Step 41 detects the current driving state of the vehicle;

步骤42查找满足一定约束条件的车道线参数;Step 42 searches for lane line parameters that meet certain constraints;

步骤43根据车道线参数确定车道线;Step 43 determines the lane line according to the lane line parameters;

其中步骤42中所述的约束条件为:(thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh),Wherein the constraints described in step 42 are: (thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh),

其中:Theta和Rho是Hough变换后,当前车道线对应Hough空间中的直线参数,thetaTh1和thetaTh2是车道线夹角Theta的范围,PreTheta是上一帧中的有效车道线的夹角;DeltaThetaTh为连续两帧中间车道线夹角的变化阈值;Distance和PreDistance分别是当前车道线和上一帧车道线在底部水平线上的X坐标值,DeltaDisTh为前后两帧中间两条车道线距离的变化阈值。Among them: Theta and Rho are Hough transformation, the current lane line corresponds to the straight line parameters in Hough space, thetaTh1 and thetaTh2 are the range of the lane line angle Theta, PreTheta is the effective lane line angle in the previous frame; DeltaThetaTh is continuous The change threshold of the angle between the lane lines in the middle of two frames; Distance and PreDistance are the X coordinate values of the current lane line and the lane line of the previous frame on the bottom horizontal line respectively, and DeltaDisTh is the change threshold of the distance between the two lane lines in the middle of the two frames before and after.

当车辆正常行驶时,计算其中一侧的车道线参数时,所述thetaTh1可以为30-60之间的正整数,thetaTh2为90;计算另一侧的车道线参数时,所述thetaTh1为-60--30之间的负整数,thetaTh2为-90。当车辆发生偏离时,计算其中一侧的车道线参数时,所述thetaTh1可以为10-30之间的正整数,thetaTh2为60-80之间的正整数;计算另一侧的车道线参数时,所述thetaTh1为-30--10之间的负整数,thetaTh2为-80--60。When the vehicle is running normally, when calculating the lane line parameters on one side, thetaTh1 can be a positive integer between 30-60, and thetaTh2 is 90; when calculating the lane line parameters on the other side, the thetaTh1 is -60 --Negative integer between 30, thetaTh2 is -90. When the vehicle deviates, when calculating the lane line parameters on one side, thetaTh1 can be a positive integer between 10-30, and thetaTh2 can be a positive integer between 60-80; when calculating the lane line parameters on the other side , thetaTh1 is a negative integer between -30-10, and thetaTh2 is -80-60.

当车辆发生偏离时,进行中间车道线检测,所述Theta的范围为70-90之间。When the vehicle deviates, middle lane line detection is performed, and the range of Theta is between 70-90.

本发明通过Hough空间变换后,设计特有的车道线识别单元进行车道识别,有效地实现了一种有较好实时性和鲁棒性的系统。The present invention designs a unique lane line recognition unit for lane recognition after Hough space transformation, and effectively realizes a system with better real-time performance and robustness.

【附图说明】 【Description of drawings】

图1为本发明的车道偏离预警系统连接示意图;Fig. 1 is the connection schematic diagram of lane departure warning system of the present invention;

图2为本发明的两条车道线有效区域示意图;Fig. 2 is a schematic diagram of the effective areas of two lane lines of the present invention;

图3为本发明的三条车道线有效区域示意图;Fig. 3 is a schematic diagram of the effective areas of three lane lines of the present invention;

图4为本发明的预警流程图;Fig. 4 is the early warning flowchart of the present invention;

图5为本发明的另一实施例的系统连接图;Fig. 5 is a system connection diagram of another embodiment of the present invention;

图6为发明的硬件连接电路图;Fig. 6 is the hardware connection circuit diagram of invention;

附图主要标识为:The main marks of the accompanying drawings are:

摄像单元1,车道线识别单元2,偏移检测单元3,预警单元4,显示单元5,控制单元6,存储单元7,系统电源8,有效区域9,车道线10。Camera unit 1 , lane line recognition unit 2 , deviation detection unit 3 , warning unit 4 , display unit 5 , control unit 6 , storage unit 7 , system power supply 8 , effective area 9 , and lane lines 10 .

【具体实施方式】 【Detailed ways】

参见图1-3,本发明提出一种车道偏离预警系统,主要用于防止正在行驶的车辆发生车道偏离,所述系统包括电连接的摄像单元1、车道线识别单元2、偏移检测单元3和预警单元4。Referring to Figures 1-3, the present invention proposes a lane departure warning system, which is mainly used to prevent lane departure of a driving vehicle. The system includes an electrically connected camera unit 1, a lane line recognition unit 2, and a deviation detection unit 3 and early warning unit 4.

摄像单元1,可置于车体前部,如汽车挡风玻璃或汽车仪表盘处,用于摄录车体前方路况影像。摄像单元1可以包括摄像头11和视频转换芯片12。The camera unit 1 can be placed at the front of the car body, such as a car windshield or a car dashboard, and is used to record images of road conditions in front of the car body. The camera unit 1 may include a camera 11 and a video conversion chip 12 .

车道线识别单元2,与所述摄像单元1连接,接收所述路况信号,并对所述信号进行Hough变换,以识别车道线10。为提高信号处理的速度,检测车道线10时,可假设车道线10为直线模型,充分利用车道线宽度、车道线灰度比路面灰度值大等特征,有效提高系统鲁棒性和实时性。The lane line identification unit 2 is connected with the camera unit 1 , receives the road condition signal, and performs Hough transform on the signal to identify the lane line 10 . In order to improve the speed of signal processing, when detecting the lane line 10, it can be assumed that the lane line 10 is a straight line model, making full use of the characteristics of the width of the lane line, the gray value of the lane line is larger than the gray value of the road surface, etc., effectively improving the robustness and real-time performance of the system .

偏移检测单元3,与所述车道线识别单元2连接,根据识别出的车道线10,通过车体中间位置和车道线10之间的距离来判断是否发生了车道偏离,当所述距离超过预设阀值时,发出预警指令。The offset detection unit 3 is connected to the lane line recognition unit 2, and judges whether a lane departure has occurred based on the distance between the middle position of the vehicle body and the lane line 10 according to the identified lane line 10. When the distance exceeds When the threshold is preset, an early warning command is issued.

预警单元4,与偏移检测单元3连接,接收所述预警指令,并发出相应的预警信号。预警单元4可以包括音频处理电路41和与之相连的扬声器42。The early warning unit 4 is connected with the offset detection unit 3, receives the early warning instruction, and sends out a corresponding early warning signal. The warning unit 4 may include an audio processing circuit 41 and a speaker 42 connected thereto.

本发明还提出一种实现车道偏离预警的方法,所述方法包括以下步骤:The present invention also proposes a method for realizing lane departure warning, said method comprising the following steps:

步骤1标定摄像单元1,以接收并传递路况信号。摄像单元1标定的目的主要是为了求的摄像头的内外参数,用这些参数来计算车体到左右车道线的距离、车体和前方车辆之间的距离以及计算车辆的真实高度和宽度等。摄像头标定的方法比较成熟,而且有大量的文献对其进行了深入的讲解,所以便不再详细介绍。Step 1 calibrates the camera unit 1 to receive and transmit road condition signals. The purpose of camera unit 1 calibration is mainly to obtain the internal and external parameters of the camera, and use these parameters to calculate the distance between the vehicle body and the left and right lane lines, the distance between the vehicle body and the vehicle in front, and the real height and width of the vehicle. The method of camera calibration is relatively mature, and there are a large number of documents that explain it in depth, so I will not introduce it in detail.

步骤2根据车辆行驶状态设置检测车道线10的有效区域9。如果此时车辆正常行驶,且此时车道线10的检测稳定(连续几帧都检测到车道线10),那么车道线10的有效区域9设置为前帧已检测出的车道线10顶部左右宽各10个像素,底部左右宽各15个像素的一个梯形区域,如图2中所标定的区域9。如果我们认为车道线10近似为一条直线,那么车道线10可以表示为:Step 2 is to set the effective area 9 for detecting the lane line 10 according to the driving state of the vehicle. If the vehicle is running normally at this time, and the detection of the lane line 10 is stable at this time (the lane line 10 is detected in several consecutive frames), then the effective area 9 of the lane line 10 is set to the top left and right width of the lane line 10 detected in the previous frame 10 pixels each, and a trapezoidal region with a left and right width of 15 pixels at the bottom, such as the region 9 marked in FIG. 2 . If we think that the lane line 10 is approximately a straight line, then the lane line 10 can be expressed as:

y=k*x+by=k*x+b

在已知感兴趣区域的上下纵坐标的情况下,可以计算出梯形区域的4个顶点,从而确定这个有效区域。如果车道线10处于偏离状态,且此时车道线10的检测稳定,车道线10的有效区域9为三条车道线分别确定的梯形区域,如图3所示,设置方法同上。如果车道线10的检测不稳定,车道线10的有效区域9设置为整幅图片。When the upper and lower ordinates of the region of interest are known, the four vertices of the trapezoidal region can be calculated to determine the effective region. If the lane marking 10 is in a deviation state, and the detection of the lane marking 10 is stable at this time, the effective area 9 of the lane marking 10 is a trapezoidal area respectively determined by the three lane markings, as shown in FIG. 3 , and the setting method is the same as above. If the detection of the lane marking 10 is unstable, the effective area 9 of the lane marking 10 is set to be the whole picture.

无特殊说明,以下关于车道线10的操作都将在这个有效区域中进行。Without special instructions, the following operations on the lane line 10 will be performed in this effective area.

步骤3在有效区域9内进行有条件的canny边缘检测,得到二值化图像。车道线10具有具有以下固有特征:Step 3: Carry out conditional canny edge detection in the valid area 9 to obtain a binarized image. Lane markings 10 have the following inherent characteristics:

i、车道标识线主要颜色是白色或黄色;i. The main color of lane marking lines is white or yellow;

ii、虽然由于透视变换的影响,车道线10在图像中的宽度不一样,但车道线10在图像中还是有一定宽度的;ii. Although due to the influence of perspective transformation, the width of the lane line 10 in the image is different, the lane line 10 still has a certain width in the image;

iii、车道线10灰度值大于路面的灰度值;iii. The gray value of the lane line 10 is greater than the gray value of the road surface;

iv、车道线10由连续的或间断的车道标识组成,在一定程度上可以假定车道线10是连续的;iv. The lane line 10 is composed of continuous or discontinuous lane markings, and it can be assumed that the lane line 10 is continuous to a certain extent;

v、车道线10可以近似由直线描述:一般情况下,公路弯道曲率较小,在车辆前方某范围内可以将车道线10作为直线来对待。v. The lane line 10 can be approximately described by a straight line: in general, the curvature of road curves is small, and the lane line 10 can be treated as a straight line within a certain range in front of the vehicle.

在车道线检测时可利用上述车道线10的固有特征,去除不属于车道线10边缘的点,不仅能提高车道线识别的准确性,而且大大提高了系统的实时性。In lane line detection, the inherent characteristics of the above-mentioned lane line 10 can be used to remove points that do not belong to the edge of the lane line 10, which can not only improve the accuracy of lane line recognition, but also greatly improve the real-time performance of the system.

在边缘检测时,约束条件为:In edge detection, the constraints are:

(grad_right2left[x][y]>th1)&&(grad_left2right[x][y]<th2)&&(gray_right_average[x][y]>th3),(grad_right2left[x][y]>th1)&&(grad_left2right[x][y]<th2)&&(gray_right_average[x][y]>th3),

其中grad_right2left[x][y]是当前检测帧图像[x][y]右侧灰度值与左侧灰度值之差,其计算公式为:Where grad_right2left[x][y] is the difference between the gray value on the right side and the gray value on the left side of the currently detected frame image [x][y], and its calculation formula is:

grad_right2left[x][y]=gray[x+3][y]+gray[x+4][y]-gray[x-1][y]-gray[x-2][y],grad_right2left[x][y]=gray[x+3][y]+gray[x+4][y]-gray[x-1][y]-gray[x-2][y],

所述gray[x][y]是图像[x][y]处灰度值;th1为图像中车道线10右侧灰度值与左侧灰度值差的阈值,该阈值的取值范围可以取30-50的非负整数;grad_left2right[x][y]是当前检测帧图像[x][y]右侧一定距离的灰度值与左侧灰度值之差,其计算公式为:The gray[x][y] is the gray value at the image [x][y]; th1 is the threshold of the difference between the gray value on the right side of the lane line 10 in the image and the gray value on the left side, and the value range of the threshold It can be a non-negative integer of 30-50; grad_left2right[x][y] is the difference between the gray value at a certain distance on the right side of the currently detected frame image [x][y] and the gray value on the left side, and its calculation formula is:

grad_left2right[x][y]=gray[x+L+1][y]+gray[x+L+2][y]-gray[x+1][y]-gray[x+2][y],grad_left2right[x][y]=gray[x+L+1][y]+gray[x+L+2][y]-gray[x+1][y]-gray[x+2][y ],

所述的L为车道线10的宽度;th2为图像中车道线10右侧一定距离后灰度值与左侧灰度值差的阈值,该阈值的取值范围可以取-10-0的负数;gray_right_average[x][y]是当前检测帧图像[x][y]右侧某邻域内像素的平均灰度值,其计算公式为:The L is the width of the lane line 10; th2 is the threshold value of the difference between the gray value and the left gray value after a certain distance on the right side of the lane line 10 in the image, and the value range of the threshold can be a negative number of -10-0 ;gray_right_average[x][y] is the average gray value of pixels in a certain neighborhood on the right side of the currently detected frame image [x][y], and its calculation formula is:

gray_right_average[x][y]=(gray[x+1][y]+gray[x+2][y]+gray[x+3][y])/3,gray_right_average[x][y]=(gray[x+1][y]+gray[x+2][y]+gray[x+3][y])/3,

其中,th3为路面灰度阈值,由于在整幅图像中路面灰度值并不一样,所以th3的值可以采用行扫描的方式给出。条件grad_right2left[x][y]>th1使用了车道线灰度值大于路面的灰度值这个先验知识;grad_left2right[x][y]<th2使用了车道线10有一定宽度且车道线灰度值大于路面的灰度值这两个先验知识。Among them, th3 is the gray threshold value of the road surface. Since the gray value of the road surface is not the same in the whole image, the value of th3 can be given in the way of line scanning. The condition grad_right2left[x][y]>th1 uses the prior knowledge that the gray value of the lane line is greater than the gray value of the road surface; grad_left2right[x][y]<th2 uses the lane line 10 with a certain width and the gray level of the lane line The value is greater than the two prior knowledge of the gray value of the road surface.

在符合上述约束条件的情况下,根据canny算法进行边缘增强和边缘二值化处理,由于canny边缘检测后的得到的是单像素宽的边缘,提高程序运行的实时性和鲁棒性。In the case of meeting the above constraints, edge enhancement and edge binarization are performed according to the canny algorithm. Since the edge detected by canny is a single-pixel wide edge, the real-time and robustness of the program operation is improved.

步骤4利用二值化后的图像进行Hough变换,查找并匹配车道线10;Step 4 uses the binarized image to perform Hough transform to find and match the lane line 10;

由于车辆行驶的速度较快,车道线10在前后几帧中的位置不会发生较大的变化,利用这个特性,我们可以对前后几帧中检测出来的车道线10进行匹配,只有连续几帧都匹配的情况下,我们才认为此时检测出的车道线10确实是一条车道线。Hough变换后,在Hough空间中查找车道线10的步骤为:Due to the fast speed of the vehicle, the position of the lane line 10 will not change greatly in the preceding and following frames. Using this feature, we can match the detected lane lines 10 in the preceding and following frames. Only a few consecutive frames When all match, we think that the lane line 10 detected at this time is indeed a lane line. After the Hough transformation, the steps to find the lane line 10 in the Hough space are:

步骤41、检测此时车辆行驶的状态,包括正常行驶状态和发生车道偏离状态。Step 41. Detect the driving state of the vehicle at this time, including normal driving state and lane departure state.

步骤42、在得知车辆行驶状态后,查找车道线10。如果此时是正常行驶状态,只查找行驶车辆的左右两条车道线10;如果此时发生了车道偏离,在查找行驶车辆左右两条车道线10的同时,还有查找此时车辆压或即将压上的那条车道线10。下面以查找行驶车辆左边的车道线10为例,详述查找车道线10的方法:左侧车道线参数是满足一定约束条件的Hough空间中最大值和次大值对应的Theta和Rho的平均值,约束条件为:Step 42, after knowing the driving state of the vehicle, search for the lane line 10. If it is a normal driving state at this time, only the left and right lane lines 10 of the running vehicle are searched; Press 10 on that lane line. Taking the lane line 10 on the left side of the driving vehicle as an example, the method of finding the lane line 10 is described in detail below: the left lane line parameter is the average value of Theta and Rho corresponding to the maximum value and the second maximum value in the Hough space satisfying certain constraints , the constraints are:

(thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh),(thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh),

其中(Theta,Rho)是Hough变换后,当前车道线10对应Hough空间中的直线参数;thetaTh1和thetaTh2是左侧车道线夹角Theta的范围,如果此时车辆为正常行驶状态,可以选择thetaTh1为45左右的正整数,最好为30-60之间的正整数,thetaTh2为90,即左侧车道线最大角度,如果此时车辆发生偏离可以选择thetaTh1为20左右的正整数,最好为10-30之间的正整数,thetaTh2为70左右正整数,最好为60-80之间的正整数;PreTheta为上一帧检测得到的左侧有效车道线10的夹角;DeltaThetaTh为连续两帧中间车道线夹角的变化阈值,DeltaThetaTh可以取5-8之间的正整数;Distance和PreDistance分别是此时和前一帧中车道线10在底部水平线上的X坐标值,DeltaDisTh为前后两帧中间两条车道线10距离变化阈值,DeltaDisTh可以取10-15之间的正整数。Among them (Theta, Rho) is after the Hough transformation, the current lane line 10 corresponds to the straight line parameters in the Hough space; thetaTh1 and thetaTh2 are the range of the angle Theta between the left lane line, if the vehicle is in a normal driving state at this time, you can choose thetaTh1 as A positive integer around 45, preferably a positive integer between 30-60, thetaTh2 is 90, which is the maximum angle of the left lane line, if the vehicle deviates at this time, you can choose thetaTh1 to be a positive integer around 20, preferably 10 A positive integer between -30, thetaTh2 is a positive integer around 70, preferably a positive integer between 60-80; PreTheta is the angle between the left effective lane line 10 detected in the previous frame; DeltaThetaTh is two consecutive frames The change threshold of the angle between the middle lane line, DeltaThetaTh can take a positive integer between 5-8; Distance and PreDistance are the X coordinate values of the lane line 10 on the bottom horizontal line in this and the previous frame respectively, and DeltaDisTh is the two frames before and after The distance change threshold of the middle two lane lines 10, DeltaDisTh can take a positive integer between 10-15.

右侧车道线10和中间车道线10的检测方法和左侧车道线10检测方法基本相同,仅仅是车道线夹角的范围不同。右侧车道线10的夹角约束可以为,正常行驶时thetaTh1为-45左右,thetaTh2为-90,发生偏离时,thetaTh1可以选为-20,thetaTh2可以选为-70;中间车道线10仅在发生车道偏离时才检测,Theta的范围满足abs(Theta)在70至90之间。The detection method of the right lane marking 10 and the middle lane marking 10 is basically the same as that of the left lane marking 10, only the range of the angle between the lane markings is different. The angle constraint of the right lane line 10 can be as follows: thetaTh1 is about -45 during normal driving, and thetaTh2 is -90. When deviation occurs, thetaTh1 can be selected as -20, and thetaTh2 can be selected as -70; It is only detected when lane departure occurs, and the range of Theta satisfies that abs(Theta) is between 70 and 90.

步骤43、在检测到符合条件的两条直线后,如果这两条直线的距离相差不大,求这两条直线对应参数的平均值即为此时车道线10的参数;如果这两条直线的距离相差较大,取在Hough变化时检测到的像素数最多的那条直线作为车道线,在Hough算法内部,检测到的所有直线上的像素数是可知的,Hough算法详细的说明如下:Step 43. After detecting two straight lines that meet the conditions, if the distance between the two straight lines is not much different, calculate the average value of the parameters corresponding to the two straight lines, which is the parameter of the lane line 10 at this time; if the two straight lines The distance of the distance is quite different, and the line with the most pixels detected when Hough changes is taken as the lane line. Inside the Hough algorithm, the number of pixels on all lines detected is known. The detailed description of the Hough algorithm is as follows:

当在XY坐标系中有一点时,过这一点会有无数条直线,而每一条直线可以用一组唯一的极坐标系坐标(ρ,θ)值来表示。因此XY坐标系中的一点在极坐标系统对应一条曲线。那么XY平面上的一条直线上的无数点会在极坐标平面上对应无数条曲线,而这些曲线的交点对应的坐标(ρ,θ)可用来表示该直线。When there is a point in the XY coordinate system, there will be countless straight lines passing through this point, and each straight line can be represented by a unique set of polar coordinate system coordinates (ρ, θ) values. Therefore, a point in the XY coordinate system corresponds to a curve in the polar coordinate system. Then countless points on a straight line on the XY plane will correspond to countless curves on the polar coordinate plane, and the coordinates (ρ, θ) corresponding to the intersection points of these curves can be used to represent the straight line.

车道线经过canny边缘检测,可以获取到很多边缘点,将这些边缘点进行Hough变换转换成Hough空间中的一条曲线。以Hough空间的坐标参数Theta和Rho的不同值为标志建立一个累加器数组。当曲线经过相应的坐标值时,该坐标值对应得累加器值加1。这样对所有边缘点进行Hough变换后,当Hough空间坐标对应的累加器的值大于设定的参数时,则认为该坐标值的Theta和Rho值对应一条车道线。After the lane line is detected by canny edge, many edge points can be obtained, and these edge points are converted into a curve in Hough space by Hough transform. Create an accumulator array with different values of coordinate parameters Theta and Rho in Hough space. When the curve passes through the corresponding coordinate value, the corresponding coordinate value will add 1 to the accumulator value. In this way, after Hough transformation is performed on all edge points, when the value of the accumulator corresponding to the Hough space coordinate is greater than the set parameter, it is considered that the Theta and Rho values of the coordinate value correspond to a lane line.

步骤5根据检测出的车道线10,求取车体和所述车道线10之间的距离,并判断是否发生了车道偏离。Step 5 Calculate the distance between the vehicle body and the lane line 10 based on the detected lane line 10 , and judge whether lane departure occurs.

如果此时车辆行驶状态为正常行驶,检测此时是否发生车道偏离,是否发生车道偏离程度可以由此时下式来确定:If the driving state of the vehicle is normal at this time, it is detected whether lane departure occurs at this time, and whether the degree of lane departure occurs can be determined by the following formula:

LeftDis<SafeDisanceTh或RightDis<SafeDisanceThLeftDis<SafeDisanceTh or RightDis<SafeDisanceTh

其中LeftDis是车体中间位置和左侧车道线10之间距离;RightDis是车体中间位置和右侧车道线10之间距离;SafeDisanceTh为车体和车道线10之间预警距离阈值,当车体中间位置和任何一条车道线10之间的距离小于这个预警距离阈值时,认为发生了车道偏离,发出进行相应的预警指令。Among them, LeftDis is the distance between the middle position of the car body and the left lane line 10; RightDis is the distance between the middle position of the car body and the right lane line 10; SafeDisanceTh is the warning distance threshold between the car body and the lane line 10, when the car body When the distance between the middle position and any lane line 10 is less than the warning distance threshold, it is considered that lane departure has occurred, and a corresponding warning command is issued.

步骤6预警单元根据报警指令发出相应的预警信号,预警信号可以为声光信号。Step 6: The early warning unit sends a corresponding early warning signal according to the alarm instruction, and the early warning signal can be an audible and visual signal.

根据图4,其预警流程可简述如下:当启动车道偏离预警系统时,需预先标定摄像单元1;再设置检测车道线10的有效区域9,在有效区域9中边缘检测,以查找出车道线10;查找出车道线10后,将车体的位置与车道线10对比,得出车体是否偏离的判断,若结果为偏离,则进行预警。According to Figure 4, the early warning process can be briefly described as follows: when the lane departure warning system is activated, the camera unit 1 needs to be calibrated in advance; then the effective area 9 for detecting the lane line 10 is set, and edge detection is performed in the effective area 9 to find out the lane Line 10: After finding out the lane line 10, compare the position of the vehicle body with the lane line 10 to determine whether the vehicle body deviates, and if the result is deviation, an early warning is given.

如图5所示所述系统还进一步包括显示单元5,其与所述偏移检测单元相连接,将车体的速度、距离和路况信号中的一个或多个显示于LCD显示屏上。As shown in FIG. 5 , the system further includes a display unit 5 , which is connected to the deviation detection unit and displays one or more of the speed, distance and road condition signals of the vehicle body on the LCD display.

如图6所示所述系统进一步包括控制单元6和存储单元7,所述控制单元6与所述摄像单元1和预警单元4相连接,并包括所述车道线识别单元2和偏移检测单元3,用于控制并调度系统的整体运行。其可以为高性能的DSP芯片,用来控制并调度系统电路的整体运行,识别车道线,并根据车道线参数与位置等信息与车体位置信息计算车体和车道线的距离,如果这个距离小于某设定的阈值,则输出车道偏离预警指令。As shown in Figure 6, the system further includes a control unit 6 and a storage unit 7, the control unit 6 is connected with the camera unit 1 and the early warning unit 4, and includes the lane line recognition unit 2 and the deviation detection unit 3. It is used to control and schedule the overall operation of the system. It can be a high-performance DSP chip, which is used to control and schedule the overall operation of the system circuit, identify the lane line, and calculate the distance between the car body and the lane line according to the information such as the lane line parameters and position and the position information of the car body. If it is less than a certain set threshold, a lane departure warning command is output.

所述存储单元7用于存储系统运行程序、数据以及预设参数,与所述控制单元6连接,并受其控制。可采用FLASH72或存储器71存储。The storage unit 7 is used to store system operating programs, data and preset parameters, and is connected to and controlled by the control unit 6 . It can be stored in FLASH72 or memory 71.

系统电源8通过控制单元6给各单元提供电力。The system power supply 8 provides power to each unit through the control unit 6 .

本发明通过Hough空间变换后,设计特有的车道线识别单元进行车道识别,有效地实现了一种有较好实时性和鲁棒性的系统。The present invention designs a unique lane line recognition unit for lane recognition after Hough space transformation, and effectively realizes a system with better real-time performance and robustness.

Claims (10)

1.一种车道偏离预警系统,其特征在于:所述系统包括电连接的摄像单元,用于接收并传递路况的图像信号;1. A lane departure warning system, characterized in that: the system includes an electrically connected camera unit for receiving and transmitting image signals of road conditions; 车道线识别单元,与所述摄像单元连接,接收所述图像信号,并对所述图像信号进行canny边缘检测和Hough变换,以识别车道线;A lane line identification unit, connected to the camera unit, receives the image signal, and performs canny edge detection and Hough transform on the image signal to identify the lane line; 偏移检测单元,与所述车道线识别单元连接,根据识别出的车道线,计算其与车体之间的距离,当所述距离超过预设阀值时,发出预警指令;An offset detection unit, connected to the lane line recognition unit, calculates the distance between the lane line and the vehicle body according to the identified lane line, and sends an early warning command when the distance exceeds a preset threshold; 预警单元,与偏移检测单元连接,接收所述预警指令,并发出相应的预警信号。The early warning unit is connected with the offset detection unit, receives the early warning instruction, and sends out a corresponding early warning signal. 2.如权利要求1所述的车道偏离预警系统,其特征在于:所述系统进一步包括显示单元,其与所述偏移检测单元相连接,将车体的速度、距离和路况图像信号中的一个或多个显示于LCD显示屏上。2. The lane departure warning system according to claim 1, characterized in that: the system further comprises a display unit, which is connected with the deviation detection unit, and displays the speed, distance and road condition image signal of the vehicle body One or more are displayed on the LCD display. 3.如权利要求1所述的车道偏离预警系统,其特征在于:所述系统进一步包括:3. The lane departure warning system according to claim 1, wherein said system further comprises: 控制单元,与所述摄像单元和预警单元相连接,并包括所述车道线识别单元和偏移检测单元,用于控制并调度系统的整体运行;a control unit, connected to the camera unit and the early warning unit, and including the lane line recognition unit and the deviation detection unit, for controlling and scheduling the overall operation of the system; 存储单元,与所述控制单元连接,并受其控制,用于存储系统运行程序、数据以及预设参数。The storage unit is connected to and controlled by the control unit, and is used for storing system operation programs, data and preset parameters. 4.一种实现车道偏离预警的方法,其特征在于:所述方法包括以下步骤:4. A method for realizing lane departure warning, characterized in that: said method comprises the following steps: 步骤1标定摄像单元,以接收并传递路况图像信号;Step 1 calibrates the camera unit to receive and transmit road condition image signals; 步骤2根据车辆行驶状态设置检测车道线的有效区域,所述有效区域的面积大于实际车道线在图像中的面积;Step 2 is to set the effective area for detecting the lane line according to the vehicle driving state, the area of the effective area is greater than the area of the actual lane line in the image; 步骤3对有效区域内的图像信号进行canny边缘检测,得到二值化图像;Step 3: Carry out canny edge detection on the image signal in the effective area to obtain a binarized image; 步骤4利用二值化后的图像进行Hough变换,查找并匹配车道线;Step 4 uses the binarized image to perform Hough transform to find and match lane lines; 步骤5根据检测出的车道线,求取车体和所述车道线之间的距离,并判断是否发出预警指令;Step 5 Calculate the distance between the vehicle body and the lane line according to the detected lane line, and determine whether to issue an early warning instruction; 步骤6根据预警指令发出预警信号。Step 6: Send out an early warning signal according to the early warning instruction. 5.如权利要求4所述的实现车道偏离预警的方法,其特征在于:所述步骤3进行canny边缘检测时,约束条件为:5. the method for realizing lane departure warning as claimed in claim 4 is characterized in that: when described step 3 carries out canny edge detection, constraint condition is: (grad_right2left[x][y]>th1)&&(grad_left2right[x][y]<th2)&&(gray_right_average[x][y]>th3),(grad_right2left[x][y]>th1)&&(grad_left2right[x][y]<th2)&&(gray_right_average[x][y]>th3), 其中[x][y]是计算机中的二维数组索引,[x][y]所在的坐标系为:以图像左上角为原点,水平向右为x轴正方向,水平向下为y轴正方向,grad_right2left[x][y]是当前检测帧的图像[x][y]右侧灰度值与左侧灰度值之差,其计算公式为:Among them, [x][y] is the two-dimensional array index in the computer, and the coordinate system where [x][y] is located is: the upper left corner of the image is the origin, the horizontal direction to the right is the positive direction of the x-axis, and the horizontal direction is the y-axis In the positive direction, grad_right2left[x][y] is the difference between the gray value on the right side and the gray value on the left side of the image [x][y] of the current detection frame, and its calculation formula is: grad_right2left[x][y]=gray[x+3][y]+gray[x+4][y]-gray[x-1][y]-gray[x-2][y],grad_right2left[x][y]=gray[x+3][y]+gray[x+4][y]-gray[x-1][y]-gray[x-2][y], 所述gray[x][y]是所述当前检测帧图像[x][y]处灰度值;gray[x+3][y]是X正方向上距所述当前检测帧图像[x][y]处3个像素位置处的像素灰度值,gray[x+4][y]是X正方向上距所述当前检测帧图像[x][y]处4个像素位置处的像素灰度值,gray[x-1][y]是X负方向上距所述当前检测帧图像[x][y]处1个像素位置处的像素灰度值,gray[x-2][y]是负方向上距所述当前检测帧图像[x][y]处2个像素位置处的像素灰度值;th1为所述当前检测帧图像[x][y]右侧灰度值与前检测帧图像[x][y]左侧灰度值的差必须满足的最小值;grad_left2right[x][y]是所述当前检测帧图像[x][y]右侧一定距离的灰度值与左侧一定距离灰度值之差,其计算公式为:The gray[x][y] is the gray value at the current detection frame image [x][y]; gray[x+3][y] is the distance from the current detection frame image [x] in the positive direction of X The pixel gray value at the 3 pixel position at [y], gray[x+4][y] is the pixel gray at the 4 pixel position from the current detection frame image [x][y] in the positive direction of X gray[x-1][y] is the pixel gray value at a pixel position from the current detection frame image [x][y] in the negative direction of X, gray[x-2][y ] is the pixel gray value at two pixel positions away from the current detection frame image [x][y] in the negative direction; th1 is the gray value on the right side of the current detection frame image [x][y] and The minimum value that must be satisfied by the difference of the left gray value of the previous detection frame image [x][y]; grad_left2right[x][y] is the gray value at a certain distance on the right side of the current detection frame image [x][y] The difference between the value and the gray value at a certain distance to the left, its calculation formula is: grad_left2right[x][y]=gray[x+L+1][y]+gray[x+L+2][y]-gray[x+1][y]-gray[x+2][y],gray[x+L+1][y]是X正方向上距当前检测帧图像[x][y]处L+1个像素宽度位置处的像素灰度值,gray[x+L+2][y]是X正方向上距所述当前检测帧图像[x][y]处L+2个像素宽度位置处的像素灰度值,gray[x+1][y]是X正方向上距所述当前检测帧图像[x][y]处1个像素宽度位置处的像素灰度值,gray[x+2][y]是X正方向上距所述当前检测帧图像[x][y]处2个像素宽度位置处的像素灰度值,L为有效区域中假设的车道线的宽度);th2为所述当前检测帧图像[x][y]X正方向上大于L距离的灰度值与前检测帧图像[x][y]X正方向上相邻像素灰度值差必须满足的最大值;gray_right_average[x][y]是所述当前检测帧的图像[x][y]X正方向上四个相邻像素范围内的平均灰度值,其计算公式为:grad_left2right[x][y]=gray[x+L+1][y]+gray[x+L+2][y]-gray[x+1][y]-gray[x+2][y ], gray[x+L+1][y] is the pixel gray value at the position L+1 pixel width away from the current detection frame image [x][y] in the positive direction of X, gray[x+L+2 ][y] is the pixel gray value at the position of L+2 pixel width away from the current detection frame image [x][y] in the positive direction of X, and gray[x+1][y] is the distance in the positive direction of X The pixel gray value at the position of 1 pixel width at the current detection frame image [x][y], gray[x+2][y] is the distance from the current detection frame image [x][y] in the positive direction of X ] at the pixel gray value at the position of 2 pixel widths, L is the width of the assumed lane line in the effective area); th2 is the gray value of the distance greater than L in the positive direction of the current detection frame image [x][y]X The value must meet the maximum value of the difference between the gray value of the adjacent pixel in the positive direction of the previous detection frame image [x][y]X; gray_right_average[x][y] is the image [x][y]X of the current detection frame The average gray value within the range of four adjacent pixels in the positive direction, its calculation formula is: gray_right_average[x][y]=(gray[x+1][y]+gray[x+2][y]+gray[x+3][y])/3,其中,th3为路面灰度阈值。gray_right_average[x][y]=(gray[x+1][y]+gray[x+2][y]+gray[x+3][y])/3, where th3 is the road gray threshold . 6.如权利要求4所述的实现车道偏离预警的方法,其特征在于:所述步骤4进一步包括以下步骤:6. The method for realizing lane departure warning as claimed in claim 4, characterized in that: said step 4 further comprises the following steps: 步骤41检测车辆当前的行驶状态;Step 41 detects the current driving state of the vehicle; 步骤42确定车辆行驶状态后,查找满足一定约束条件的车道线;Step 42: After determining the driving state of the vehicle, search for lane lines that meet certain constraints; 步骤43检测到符合条件的车道线后,确定车道线;After step 43 detects the lane line that meets the conditions, determine the lane line; 其中步骤42中所述的约束条件为:(thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh),其中:Theta和Rho是Hough变换后,当前车道线对应Hough空间中的直线参数,thetaTh1和thetaTh2是车道线夹角Theta的范围,PreTheta是上一帧中的车道线的夹角;DeltaThetaTh为连续两帧中间车道线夹角的变化阈值;Distance和PreDistance分别是当前车道线和上一帧车道线在底部水平线上的X坐标值,DeltaDisTh为前后两帧中间两条车道线距离的变化阈值。Wherein the constraint condition described in step 42 is: (thetaTh1<Theta<thetaTh2)&&(abs(Theta-PreTheta)<DeltaThetaTh)&&(abs(Distance-PreDistance)<DeltaDisTh), wherein: Theta and Rho are after Hough transformation , the current lane line corresponds to the straight line parameters in Hough space, thetaTh1 and thetaTh2 are the range of the lane line angle Theta, PreTheta is the lane line angle in the previous frame; DeltaThetaTh is the change threshold of the lane line angle in the middle of two consecutive frames ;Distance and PreDistance are the X coordinate values of the current lane line and the lane line of the previous frame on the bottom horizontal line, respectively, and DeltaDisTh is the change threshold of the distance between the two lane lines in the middle of the two frames before and after. 7.如权利要求6所述的实现车道偏离预警的方法,其特征在于:车辆正常行驶时,所述thetaTh1为30-60之间的正整数,thetaTh2为90;或所述thetaTh1为-60--30之间的负整数,thetaTh2为-90。7. The method for realizing lane departure warning according to claim 6, characterized in that: when the vehicle is running normally, said thetaTh1 is a positive integer between 30-60, and thetaTh2 is 90; or said thetaTh1 is -60- Negative integer between -30, thetaTh2 is -90. 8.如权利要求6所述的实现车道偏离预警的方法,其特征在于:车辆发生偏离时,所述thetaTh1为10-30之间的正整数,thetaTh2为60-80之间的正整数;或所述thetaTh1为-30--10之间的负整数,thetaTh2为-80--60。8. The method for realizing lane departure warning as claimed in claim 6, characterized in that: when the vehicle deviates, said thetaTh1 is a positive integer between 10-30, and thetaTh2 is a positive integer between 60-80; or The thetaTh1 is a negative integer between -30-10, and thetaTh2 is -80-60. 9.如权利要求6所述的实现车道偏离预警的方法,其特征在于:所述DeltaThetaTh为5-8之间的正整数。所述DeltaDisTh为10-15之间的正整数。9. The method for realizing lane departure warning according to claim 6, characterized in that: said DeltaThetaTh is a positive integer between 5-8. The DeltaDisTh is a positive integer between 10-15. 10.如权利要求4所述的实现车道偏离预警的方法,其特征在于:车辆发生偏离时,进行中间车道线检测,Hough变换后Theta的范围为70-90之间。10. The method for realizing lane departure warning as claimed in claim 4, characterized in that: when the vehicle deviates, middle lane line detection is performed, and the range of Theta after Hough transformation is between 70-90.
CN 201110162154 2011-06-16 2011-06-16 Lane departure early warning system and method Expired - Fee Related CN102303609B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110162154 CN102303609B (en) 2011-06-16 2011-06-16 Lane departure early warning system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110162154 CN102303609B (en) 2011-06-16 2011-06-16 Lane departure early warning system and method

Publications (2)

Publication Number Publication Date
CN102303609A true CN102303609A (en) 2012-01-04
CN102303609B CN102303609B (en) 2013-11-06

Family

ID=45377562

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110162154 Expired - Fee Related CN102303609B (en) 2011-06-16 2011-06-16 Lane departure early warning system and method

Country Status (1)

Country Link
CN (1) CN102303609B (en)

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102706291A (en) * 2012-05-18 2012-10-03 长安大学 Method for automatically measuring road curvature radius
CN102951089A (en) * 2012-08-20 2013-03-06 上海工程技术大学 Vehicle-mounted navigation and active safety system based on mobile equipment camera
CN103057470A (en) * 2012-12-06 2013-04-24 重庆交通大学 Pre-prompt device and pre-prompt method for regulation violation line-rolling of vehicles
CN103496367A (en) * 2013-10-23 2014-01-08 惠州华阳通用电子有限公司 Method and device for detecting mistaken alarm of lane departure alarming
CN103593884A (en) * 2013-11-22 2014-02-19 深圳市捷美安防技术有限公司 Automobile data recorder and control method thereof
CN103810770A (en) * 2012-11-01 2014-05-21 研勤科技股份有限公司 Driving recording device with image analysis function and image analysis method thereof
CN103832357A (en) * 2012-11-23 2014-06-04 深圳华一汽车科技有限公司 Lane departure warning system and method based on machine vision
CN104129389A (en) * 2014-08-06 2014-11-05 中电海康集团有限公司 Method for effectively judging and recognizing vehicle travelling conditions and device thereof
CN104156727A (en) * 2014-08-26 2014-11-19 中电海康集团有限公司 Lamplight inverted image detection method based on monocular vision
CN104517111A (en) * 2013-09-27 2015-04-15 比亚迪股份有限公司 Lane line detection method and system, and lane deviation early warning method and system
CN104657735A (en) * 2013-11-21 2015-05-27 比亚迪股份有限公司 Lane line detection method and system, as well as lane departure early warning method and system
CN105550652A (en) * 2015-12-14 2016-05-04 宁波裕兰信息科技有限公司 Realization method of LDW based on four-camera 360-degree look-around
CN105620359A (en) * 2016-02-25 2016-06-01 上海斐讯数据通信技术有限公司 Mobile terminal-based lane departure forewarning method and system
CN105674992A (en) * 2014-11-20 2016-06-15 高德软件有限公司 Navigation method and apparatus
CN105761525A (en) * 2016-05-11 2016-07-13 南京信息职业技术学院 System device for warning car to enter bus lane
CN105835891A (en) * 2016-01-26 2016-08-10 乐卡汽车智能科技(北京)有限公司 System and method for preventing lane departure
CN106256606A (en) * 2016-08-09 2016-12-28 浙江零跑科技有限公司 A kind of lane departure warning method based on vehicle-mounted binocular camera
CN106295560A (en) * 2016-08-09 2017-01-04 浙江零跑科技有限公司 The track keeping method controlled based on vehicle-mounted binocular camera and stagewise PID
CN106515742A (en) * 2016-07-22 2017-03-22 北京兴科迪科技有限公司 Lane departure early warning method and system
CN106558080A (en) * 2016-11-14 2017-04-05 天津津航技术物理研究所 Join on-line proving system and method outside a kind of monocular camera
CN107264395A (en) * 2017-06-30 2017-10-20 成都西华升腾科技有限公司 Driver's prompt system of lane shift monitoring
WO2017197819A1 (en) * 2016-05-16 2017-11-23 乐视控股(北京)有限公司 Vehicle driving regulation prompting method and apparatus, and electronic device
CN107451539A (en) * 2017-07-13 2017-12-08 华域汽车系统股份有限公司 A kind of lane departure warning method and system
CN107491722A (en) * 2017-06-16 2017-12-19 南京栎树交通互联科技有限公司 One kind realizes that driver fatigue sentences method for distinguishing based on lane line image procossing
CN107833492A (en) * 2017-11-24 2018-03-23 南京视莱尔汽车电子有限公司 A kind of zebra stripes real-time monitoring system based on intelligent driving
CN107918763A (en) * 2017-11-03 2018-04-17 深圳星行科技有限公司 Method for detecting lane lines and system
CN108189844A (en) * 2017-12-28 2018-06-22 东风商用车有限公司 Warning method of lane departure warning system
CN108297867A (en) * 2018-02-11 2018-07-20 江苏金羿智芯科技有限公司 A kind of lane departure warning method and system based on artificial intelligence
CN108437987A (en) * 2018-03-30 2018-08-24 吉利汽车研究院(宁波)有限公司 A kind of method and system preventing deviation
CN108528336A (en) * 2018-04-18 2018-09-14 福州大学 A kind of vehicle crimping gives warning in advance system
CN108692949A (en) * 2017-04-10 2018-10-23 深圳市航盛电子股份有限公司 A kind of simple lane shift real steering vectors device and validation test method
CN108705972A (en) * 2018-04-03 2018-10-26 吉利汽车研究院(宁波)有限公司 A kind of vehicle lateral control information display system
CN108776767A (en) * 2018-04-18 2018-11-09 福州大学 It is a kind of effectively to differentiate vehicle crimping and pre-tip system
CN109080536A (en) * 2018-08-28 2018-12-25 格陆博科技有限公司 A kind of Lane Departure Warning System
CN109147368A (en) * 2018-08-22 2019-01-04 北京市商汤科技开发有限公司 Intelligent driving control method device and electronic equipment based on lane line
CN109271959A (en) * 2018-09-30 2019-01-25 京东方科技集团股份有限公司 A kind of vehicle shift method for early warning and device
CN110654382A (en) * 2018-06-28 2020-01-07 比亚迪股份有限公司 Calibration method and calibration system of lane yaw early warning system and vehicle
CN111002990A (en) * 2019-12-05 2020-04-14 华南理工大学 A lane departure warning method and system based on dynamic departure threshold
CN111376902A (en) * 2018-12-29 2020-07-07 浙江吉利控股集团有限公司 Automatic driving lane keeping method and system
CN116834729B (en) * 2023-08-28 2023-11-17 常州星宇车灯股份有限公司 Transverse and longitudinal combined control system and control method for vehicle auxiliary driving

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7015944B2 (en) * 2001-06-30 2006-03-21 Daimlerchrysler Ag Device for improving visibility in vehicles
CN101016052A (en) * 2007-01-25 2007-08-15 吉林大学 Warning method and system for preventing deviation for vehicle on high standard highway
CN101992778A (en) * 2010-08-24 2011-03-30 上海科世达-华阳汽车电器有限公司 Lane deviation early warning and driving recording system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7015944B2 (en) * 2001-06-30 2006-03-21 Daimlerchrysler Ag Device for improving visibility in vehicles
CN101016052A (en) * 2007-01-25 2007-08-15 吉林大学 Warning method and system for preventing deviation for vehicle on high standard highway
CN101992778A (en) * 2010-08-24 2011-03-30 上海科世达-华阳汽车电器有限公司 Lane deviation early warning and driving recording system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
马雷,于福莹,李昊: "基于灰度图像的复杂环境下智能车辆道路边界识别", 《汽车工程》 *

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102706291B (en) * 2012-05-18 2014-12-24 长安大学 Method for automatically measuring road curvature radius
CN102706291A (en) * 2012-05-18 2012-10-03 长安大学 Method for automatically measuring road curvature radius
CN102951089A (en) * 2012-08-20 2013-03-06 上海工程技术大学 Vehicle-mounted navigation and active safety system based on mobile equipment camera
CN102951089B (en) * 2012-08-20 2015-04-01 上海工程技术大学 Vehicle-mounted navigation and active safety system based on mobile equipment camera
CN103810770A (en) * 2012-11-01 2014-05-21 研勤科技股份有限公司 Driving recording device with image analysis function and image analysis method thereof
CN103832357A (en) * 2012-11-23 2014-06-04 深圳华一汽车科技有限公司 Lane departure warning system and method based on machine vision
CN103832357B (en) * 2012-11-23 2017-10-13 深圳华一汽车科技有限公司 A kind of lane-departure warning system and method based on machine vision
CN103057470A (en) * 2012-12-06 2013-04-24 重庆交通大学 Pre-prompt device and pre-prompt method for regulation violation line-rolling of vehicles
CN103057470B (en) * 2012-12-06 2015-09-16 重庆交通大学 A kind of vehicle peccancy line ball pre-tip device and reminding method thereof
CN104517111B (en) * 2013-09-27 2018-09-07 比亚迪股份有限公司 Method for detecting lane lines, system, lane departure warning method and system
CN104517111A (en) * 2013-09-27 2015-04-15 比亚迪股份有限公司 Lane line detection method and system, and lane deviation early warning method and system
CN103496367A (en) * 2013-10-23 2014-01-08 惠州华阳通用电子有限公司 Method and device for detecting mistaken alarm of lane departure alarming
CN104657735B (en) * 2013-11-21 2018-01-23 比亚迪股份有限公司 Method for detecting lane lines, system, lane departure warning method and system
CN104657735A (en) * 2013-11-21 2015-05-27 比亚迪股份有限公司 Lane line detection method and system, as well as lane departure early warning method and system
CN103593884A (en) * 2013-11-22 2014-02-19 深圳市捷美安防技术有限公司 Automobile data recorder and control method thereof
CN103593884B (en) * 2013-11-22 2016-01-20 深圳市捷美安防技术有限公司 A kind of drive recorder and control method thereof
CN104129389A (en) * 2014-08-06 2014-11-05 中电海康集团有限公司 Method for effectively judging and recognizing vehicle travelling conditions and device thereof
CN104156727B (en) * 2014-08-26 2017-05-10 中电海康集团有限公司 Lamplight inverted image detection method based on monocular vision
CN104156727A (en) * 2014-08-26 2014-11-19 中电海康集团有限公司 Lamplight inverted image detection method based on monocular vision
CN105674992A (en) * 2014-11-20 2016-06-15 高德软件有限公司 Navigation method and apparatus
CN105550652A (en) * 2015-12-14 2016-05-04 宁波裕兰信息科技有限公司 Realization method of LDW based on four-camera 360-degree look-around
CN105835891A (en) * 2016-01-26 2016-08-10 乐卡汽车智能科技(北京)有限公司 System and method for preventing lane departure
CN105620359B (en) * 2016-02-25 2017-12-19 上海斐讯数据通信技术有限公司 A kind of lane departure warning method and system based on mobile terminal
CN105620359A (en) * 2016-02-25 2016-06-01 上海斐讯数据通信技术有限公司 Mobile terminal-based lane departure forewarning method and system
CN105761525A (en) * 2016-05-11 2016-07-13 南京信息职业技术学院 System device for warning car to enter bus lane
WO2017197819A1 (en) * 2016-05-16 2017-11-23 乐视控股(北京)有限公司 Vehicle driving regulation prompting method and apparatus, and electronic device
CN106515742A (en) * 2016-07-22 2017-03-22 北京兴科迪科技有限公司 Lane departure early warning method and system
CN106515742B (en) * 2016-07-22 2019-04-26 北京兴科迪科技有限公司 A kind of lane departure warning method and system
CN106295560B (en) * 2016-08-09 2019-06-18 浙江零跑科技有限公司 Lane keeping method based on vehicle-mounted binocular camera and segmented PID control
CN106256606A (en) * 2016-08-09 2016-12-28 浙江零跑科技有限公司 A kind of lane departure warning method based on vehicle-mounted binocular camera
CN106295560A (en) * 2016-08-09 2017-01-04 浙江零跑科技有限公司 The track keeping method controlled based on vehicle-mounted binocular camera and stagewise PID
CN106558080B (en) * 2016-11-14 2020-04-24 天津津航技术物理研究所 Monocular camera external parameter online calibration method
CN106558080A (en) * 2016-11-14 2017-04-05 天津津航技术物理研究所 Join on-line proving system and method outside a kind of monocular camera
CN108692949A (en) * 2017-04-10 2018-10-23 深圳市航盛电子股份有限公司 A kind of simple lane shift real steering vectors device and validation test method
CN107491722A (en) * 2017-06-16 2017-12-19 南京栎树交通互联科技有限公司 One kind realizes that driver fatigue sentences method for distinguishing based on lane line image procossing
CN107264395A (en) * 2017-06-30 2017-10-20 成都西华升腾科技有限公司 Driver's prompt system of lane shift monitoring
CN107451539A (en) * 2017-07-13 2017-12-08 华域汽车系统股份有限公司 A kind of lane departure warning method and system
CN107451539B (en) * 2017-07-13 2020-11-27 华域汽车系统股份有限公司 Lane departure early warning method and system
CN107918763A (en) * 2017-11-03 2018-04-17 深圳星行科技有限公司 Method for detecting lane lines and system
CN107833492A (en) * 2017-11-24 2018-03-23 南京视莱尔汽车电子有限公司 A kind of zebra stripes real-time monitoring system based on intelligent driving
CN108189844B (en) * 2017-12-28 2020-06-26 东风商用车有限公司 Warning method of lane departure warning system
CN108189844A (en) * 2017-12-28 2018-06-22 东风商用车有限公司 Warning method of lane departure warning system
CN108297867A (en) * 2018-02-11 2018-07-20 江苏金羿智芯科技有限公司 A kind of lane departure warning method and system based on artificial intelligence
CN108297867B (en) * 2018-02-11 2019-12-03 江苏金羿智芯科技有限公司 A kind of lane departure warning method and system based on artificial intelligence
CN108437987B (en) * 2018-03-30 2020-04-28 吉利汽车研究院(宁波)有限公司 Method and system for preventing lane departure
CN108437987A (en) * 2018-03-30 2018-08-24 吉利汽车研究院(宁波)有限公司 A kind of method and system preventing deviation
CN108705972A (en) * 2018-04-03 2018-10-26 吉利汽车研究院(宁波)有限公司 A kind of vehicle lateral control information display system
CN108705972B (en) * 2018-04-03 2020-07-07 吉利汽车研究院(宁波)有限公司 Vehicle transverse control information display system
CN108776767B (en) * 2018-04-18 2019-12-17 福州大学 An effective system for judging vehicle line pressure and warning in advance
WO2019200937A1 (en) * 2018-04-18 2019-10-24 福州大学 System for performing effective identification of vehicle line pressing and giving early prompt
CN108528336B (en) * 2018-04-18 2021-05-18 福州大学 An early warning system for vehicle pressure line
CN108528336A (en) * 2018-04-18 2018-09-14 福州大学 A kind of vehicle crimping gives warning in advance system
CN108776767A (en) * 2018-04-18 2018-11-09 福州大学 It is a kind of effectively to differentiate vehicle crimping and pre-tip system
CN110654382A (en) * 2018-06-28 2020-01-07 比亚迪股份有限公司 Calibration method and calibration system of lane yaw early warning system and vehicle
CN109147368A (en) * 2018-08-22 2019-01-04 北京市商汤科技开发有限公司 Intelligent driving control method device and electronic equipment based on lane line
CN109080536A (en) * 2018-08-28 2018-12-25 格陆博科技有限公司 A kind of Lane Departure Warning System
CN109271959A (en) * 2018-09-30 2019-01-25 京东方科技集团股份有限公司 A kind of vehicle shift method for early warning and device
US10759448B2 (en) 2018-09-30 2020-09-01 Boe Technology Group Co., Ltd. Method and apparatus for early warning of vehicle offset
CN111376902A (en) * 2018-12-29 2020-07-07 浙江吉利控股集团有限公司 Automatic driving lane keeping method and system
CN111376902B (en) * 2018-12-29 2021-07-27 浙江吉利控股集团有限公司 Automatic driving lane keeping method and system
CN111002990A (en) * 2019-12-05 2020-04-14 华南理工大学 A lane departure warning method and system based on dynamic departure threshold
CN111002990B (en) * 2019-12-05 2021-06-08 华南理工大学 Lane departure early warning method and system based on dynamic departure threshold
CN116834729B (en) * 2023-08-28 2023-11-17 常州星宇车灯股份有限公司 Transverse and longitudinal combined control system and control method for vehicle auxiliary driving

Also Published As

Publication number Publication date
CN102303609B (en) 2013-11-06

Similar Documents

Publication Publication Date Title
CN102303609B (en) Lane departure early warning system and method
CN109435942B (en) Information fusion-based parking space line and parking space recognition method and device
CN105206109B (en) A kind of vehicle greasy weather identification early warning system and method based on infrared CCD
CN110443225B (en) Virtual and real lane line identification method and device based on feature pixel statistics
EP3418943B1 (en) Object detecting apparatus, object detecting method, and computer-readable medium
US10860870B2 (en) Object detecting apparatus, object detecting method, and computer program product
US8311283B2 (en) Method for detecting lane departure and apparatus thereof
CN102303563B (en) Front vehicle collision early warning system and method
CN106647776B (en) Method and device for judging lane changing trend of vehicle and computer storage medium
CN103308056B (en) A kind of roadmarking detection method
CN105047019B (en) A kind of passenger stock prevent rear car overtake other vehicles after lane change determination methods and device suddenly
US20030099377A1 (en) Vehicle surroundings monitoring apparatus
CN107590470B (en) Lane line detection method and device
US20180178785A1 (en) System for detecting lane line of road and method thereof
CN110203210A (en) A kind of lane departure warning method, terminal device and storage medium
US20120294482A1 (en) Environment recognition device and environment recognition method
Wei et al. Research on lane detection and tracking algorithm based on improved hough transform
CN104916163A (en) Parking space detection method
CN107097794B (en) Road lane line detection system and method
CN201825037U (en) Lane departure alarm device for vehicles on highway
CN107229906A (en) A kind of automobile overtaking&#39;s method for early warning based on units of variance model algorithm
US10108866B2 (en) Method and system for robust curb and bump detection from front or rear monocular cameras
WO2014017601A1 (en) Three-dimensional object detection device and three-dimensional object detection method
CN103192830B (en) A kind of self-adaptive visual lane departure warning device
US10902632B2 (en) Position detection apparatus and position detection method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: STEELMATE CO., LTD.

Free format text: FORMER OWNER: GUANGDONG STEELMATE SECURITY CO., LTD.

Effective date: 20141120

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20141120

Address after: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee after: STEELMATE CO., LTD.

Address before: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee before: Guangdong Steelmate Security Co., Ltd.

Effective date of registration: 20141120

Address after: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee after: STEELMATE CO., LTD.

Address before: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee before: Guangdong Steelmate Security Co., Ltd.

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee after: Rail car electronic Limited by Share Ltd

Address before: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee before: STEELMATE CO., LTD.

Address after: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee after: Rail car electronic Limited by Share Ltd

Address before: Peace Avenue steelmate Industrial Park 528425 Guangdong city of Zhongshan province Dong Feng Zhen Dong Fu Lu

Patentee before: STEELMATE CO., LTD.

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20131106

Termination date: 20190616

CF01 Termination of patent right due to non-payment of annual fee