CN118269968B - Prediction method of automatic driving collision risk fused with online map uncertainty - Google Patents
Prediction method of automatic driving collision risk fused with online map uncertainty Download PDFInfo
- Publication number
- CN118269968B CN118269968B CN202410713791.6A CN202410713791A CN118269968B CN 118269968 B CN118269968 B CN 118269968B CN 202410713791 A CN202410713791 A CN 202410713791A CN 118269968 B CN118269968 B CN 118269968B
- Authority
- CN
- China
- Prior art keywords
- uncertainty
- agent
- lane
- collision
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000000605 extraction Methods 0.000 claims abstract description 5
- 239000003795 chemical substances by application Substances 0.000 claims description 103
- 239000013598 vector Substances 0.000 claims description 36
- 230000006870 function Effects 0.000 claims description 31
- 239000011159 matrix material Substances 0.000 claims description 18
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000007246 mechanism Effects 0.000 claims description 8
- 230000003044 adaptive effect Effects 0.000 claims description 7
- 230000002452 interceptive effect Effects 0.000 claims description 7
- 230000004913 activation Effects 0.000 claims description 6
- 230000001133 acceleration Effects 0.000 claims description 3
- 238000010606 normalization Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 230000009467 reduction Effects 0.000 claims description 3
- 230000003442 weekly effect Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 5
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013058 risk prediction model Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 240000001307 Myosotis scorpioides Species 0.000 description 1
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/095—Predicting travel path or likelihood of collision
- B60W30/0953—Predicting travel path or likelihood of collision the prediction being responsive to vehicle dynamic parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/095—Predicting travel path or likelihood of collision
- B60W30/0956—Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/0097—Predicting future conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/0098—Details of control systems ensuring comfort, safety or stability not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/253—Fusion techniques of extracted features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/27—Regression, e.g. linear or logistic regression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/042—Knowledge-based neural networks; Logical representations of neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0001—Details of the control system
- B60W2050/0019—Control system elements or transfer functions
- B60W2050/0028—Mathematical models, e.g. for simulation
- B60W2050/0031—Mathematical model of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0001—Details of the control system
- B60W2050/0043—Signal treatments, identification of variables or parameters, parameter estimation or state estimation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/408—Radar; Laser, e.g. lidar
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/404—Characteristics
- B60W2554/4042—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/404—Characteristics
- B60W2554/4043—Lateral speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/40—High definition maps
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Biomedical Technology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Evolutionary Biology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Mathematics (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Analysis (AREA)
- Algebra (AREA)
- Traffic Control Systems (AREA)
Abstract
本发明属于交通控制领域,涉及一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法,该方法主要包含在线地图不确定性的产生、融合在线地图不确定性的轨迹预测、碰撞风险预测,在线地图不确定性的产生是基于车载摄像头、雷达收集的在线数据产生在线地图和在线地图的不确定性参数,并将其融合到下游的轨迹预测模块进行特征提取、端点预测和轨迹生成,碰撞风险预测模块根据轨迹预测输出目标车辆和周车的轨迹点,输出未来时间步内发生碰撞的概率,同时计算碰撞概率剩余时间,该方法使用了在线地图并考虑了在线地图的不确定性,显著提高了下游风险预测模块的准确性和拓展性,为人机共驾下自动驾驶车辆的接管系统提供了有效、准确的安全评估信号。
The present invention belongs to the field of traffic control and relates to a method for predicting collision risks of autonomous driving by integrating uncertainty of online maps. The method mainly comprises generation of uncertainty of online maps, trajectory prediction integrating uncertainty of online maps, and collision risk prediction. Generation of uncertainty of online maps is based on online data collected by on-board cameras and radars to generate online maps and uncertainty parameters of online maps, and integrate them into a downstream trajectory prediction module for feature extraction, endpoint prediction and trajectory generation. The collision risk prediction module outputs trajectory points of target vehicles and surrounding vehicles according to trajectory prediction, outputs the probability of collision in future time steps, and calculates the remaining time of collision probability at the same time. The method uses online maps and takes uncertainty of online maps into consideration, significantly improves the accuracy and scalability of downstream risk prediction modules, and provides effective and accurate safety assessment signals for the takeover system of autonomous driving vehicles under human-machine co-driving.
Description
技术领域Technical Field
本发明属于交通控制领域,涉及自动驾驶车辆碰撞风险的预测,具体地,涉及一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法。The present invention belongs to the field of traffic control and relates to the prediction of collision risk of an autonomous driving vehicle, and specifically, to a method for predicting collision risk of an autonomous driving vehicle by integrating uncertainty of an online map.
背景技术Background Art
风险预测是自动驾驶堆栈的一个重要组成部分,它影响自动驾驶车辆下游的规划与控制模块,一种好的风险预测方法可以为人机共驾下的接管系统提供有效、准确的安全评估信号。Risk prediction is an important part of the autonomous driving stack. It affects the downstream planning and control modules of the autonomous driving vehicle. A good risk prediction method can provide effective and accurate safety assessment signals for the takeover system under human-machine co-driving.
现有的风险预测大多基于高精地图所提供的数据,但是高精地图的标注和维护成本高昂,只能在特定的区域内使用,拓展性较差,部分学者将工作转向传感器数据在线估算高精度地图,但是这些在线估计的方法并没有考虑到估算的在线地图具有不确定性。因此,需要设计一种新的风险预测方法,用于产生在线地图的不确定性并将产生的不确定性融入到风险预测中,以提高风险预测的精度,为人机共驾下的自动驾驶接管系统的预警的研究提供有价值的参考。Most of the existing risk predictions are based on data provided by high-precision maps. However, high-precision maps are expensive to label and maintain, can only be used in specific areas, and have poor scalability. Some scholars have turned their work to online estimation of high-precision maps based on sensor data, but these online estimation methods do not take into account the uncertainty of the estimated online maps. Therefore, it is necessary to design a new risk prediction method to generate the uncertainty of online maps and incorporate the generated uncertainty into risk prediction, so as to improve the accuracy of risk prediction and provide valuable reference for the research on early warning of autonomous driving takeover systems under human-machine co-driving.
发明内容Summary of the invention
鉴于上述技术问题和缺陷,本发明的目的在于提供一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法,该方法基于车载摄像头、雷达收集的在线数据产生在线地图和在线地图的不确定性参数,并将其融合到下游的轨迹预测模块进行特征提取、端点预测和轨迹生成,之后碰撞风险预测模块根据轨迹预测输出目标车辆和周车的轨迹点,输出未来时间步内发生碰撞的概率,同时计算碰撞概率剩余时间,该方法考虑了在线地图的不确定性,显著提高了下游风险预测模块的准确性,为人机共驾下自动驾驶车辆的接管系统提供了有效、准确的安全评估信号。In view of the above-mentioned technical problems and defects, the purpose of the present invention is to provide a method for predicting collision risks of autonomous driving by integrating the uncertainty of online maps. The method generates online maps and uncertainty parameters of online maps based on online data collected by on-board cameras and radars, and integrates them into the downstream trajectory prediction module for feature extraction, endpoint prediction and trajectory generation. After that, the collision risk prediction module outputs the trajectory points of the target vehicle and the surrounding vehicles according to the trajectory prediction, outputs the probability of collision in the future time step, and calculates the remaining time of the collision probability. The method takes into account the uncertainty of the online map, significantly improves the accuracy of the downstream risk prediction module, and provides an effective and accurate safety assessment signal for the takeover system of the autonomous driving vehicle under human-machine co-driving.
为实现上述目的,本发明采用如下技术方案:To achieve the above object, the present invention adopts the following technical solution:
一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法,该方法包括以下步骤:A method for predicting collision risk of autonomous driving by integrating online map uncertainty, the method comprising the following steps:
步骤1:在线地图不确定性的产生;Step 1: Generation of online map uncertainty;
步骤1.1:收集车载摄像头、雷达获取到的周围道路和代理的信息,并进行相应的降噪处理;Step 1.1: Collect the information of surrounding roads and agents obtained by the on-board camera and radar, and perform corresponding noise reduction processing;
步骤1.2:将经过降噪处理的数据输入到BEV编码器中,将获取的数据转换为一个共同的BEV空间特征;Step 1.2: Input the denoised data into the BEV encoder to convert the acquired data into a common BEV spatial feature;
步骤1.3:建立高斯回归不确定性模型和分类不确定性模型,将BEV空间特征作为输入,使用在线地图回归模型生成地图元素顶点,所述地图元素顶点包括元素顶点的位置和类型,通过高斯回归不确定性模型和分类不确定性模型计算在线地图不确定性相关参数;其中,高斯回归不确定性模型计算每个地图元素顶点的预测位置和位置的相关的不确定性的参数,分类不确定性模型计算每个地图元素顶点的类型的置信度;Step 1.3: Establish a Gaussian regression uncertainty model and a classification uncertainty model, take the BEV spatial features as input, use the online map regression model to generate map element vertices, the map element vertices include the position and type of the element vertices, and calculate the online map uncertainty related parameters through the Gaussian regression uncertainty model and the classification uncertainty model; wherein the Gaussian regression uncertainty model calculates the predicted position of each map element vertex and the parameters of the uncertainty related to the position, and the classification uncertainty model calculates the confidence of the type of each map element vertex;
步骤2:融合在线地图不确定性的轨迹预测;Step 2: Trajectory prediction integrating online map uncertainty;
步骤2.1:使用多层感知机编码,将获得的地图元素顶点的预测位置和位置的相关的不确定性的参数及地图元素顶点的类型的置信度融合到在线地图中;Step 2.1: Use multi-layer perceptron encoding to integrate the predicted positions of the obtained map element vertices, the parameters of the uncertainty associated with the positions, and the confidence of the types of the map element vertices into the online map;
步骤2.2:对于融合了不确定性参数的在线地图,使用VectorNet进行多线段编码,并进行特征提取,在编码车道线特征时,使用VectorNet为每个场景元素编码一个多段线子图,对代理和车道使用两个独立的子图,通过编码获得特征向量;Step 2.2: For the online map with fused uncertainty parameters, use VectorNet to encode multi-segment lines and perform feature extraction. When encoding lane line features, use VectorNet to encode a multi-segment line subgraph for each scene element, and use two independent subgraphs for the agent and lane to obtain the feature vector through encoding. ;
步骤2.3:将获得的特征向量传入到由代理到车道模块,车道到车道模块,车道到代理模块和代理到代理模块堆叠组成的交互建模模块中来更新特征,更新后的特征为;其中,所述代理到车道模块关注的是代理和车道之间的关系,所述车道到车道模块关注的是车道和车道之间的关系,所述车道到代理模块关注的是车道和代理之间的关系,所述代理到代理模块关注的是代理和代理之间的关系,代理到车道模块、车道到车道模块、车道到代理模块、代理到代理模块均为多头注意力块;Step 2.3: Get the feature vector It is passed to the interactive modeling module composed of the agent-to-lane module, lane-to-lane module, lane-to-agent module and agent-to-agent module stack to update the features. The updated features are ; Among them, the agent-to-lane module focuses on the relationship between the agent and the lane, the lane-to-lane module focuses on the relationship between the lane and the lane, the lane-to-agent module focuses on the relationship between the lane and the agent, the agent-to-agent module focuses on the relationship between the agent and the agent, the agent-to-lane module, the lane-to-lane module, the lane-to-agent module, and the agent-to-agent module are all multi-head attention blocks;
步骤2.4:基于元信息f和特征拼接后的特征向量,使用定点预测器和环境自适应预测器来预测目标车辆和周围代理轨迹的端点,并使用多层感知机MLP来生成轨迹;Step 2.4: Based on meta-information f and features The concatenated feature vector , use fixed-point predictors and environment-adaptive predictors to predict the endpoints of the target vehicle and surrounding agent trajectories, and use multi-layer perceptrons (MLPs) to generate trajectories;
步骤3:基于预测轨迹的碰撞风险预测;Step 3: Collision risk prediction based on predicted trajectory;
步骤3.1:根据步骤2.4生成的轨迹获取目标车辆与周围代理的未来时间步的坐标,将预测的目标车辆和周围代理的未来时间步的坐标输入到碰撞概率预测模块,预测周围代理在未来总的时间步内发生碰撞的概率;Step 3.1: Obtain the coordinates of the target vehicle and the surrounding agents in the future time step according to the trajectory generated in step 2.4, input the predicted coordinates of the target vehicle and the surrounding agents in the future time step into the collision probability prediction module, and predict the probability of collision between the surrounding agents in the total future time step;
步骤3.2:将步骤3.1得到的碰撞概率输入到临界碰撞概率剩余时间计算模块中,计算临界碰撞概率剩余时间,并将其传输给人机共驾系统。Step 3.2: Input the collision probability obtained in step 3.1 into the critical collision probability remaining time calculation module, calculate the critical collision probability remaining time, and transmit it to the human-machine co-driving system.
作为本发明的优选,步骤1.1中,周围道路信息包括:道路的类型、限速、是否处于交叉路口、红绿灯、道路的坡度;其中,道路的类型包括交叉路口、左转车道、右转车道、直行车道;周围代理信息包括:代理的类型、速度、加速度,代理的类型包括行人、车辆。As a preferred embodiment of the present invention, in step 1.1, the surrounding road information includes: road type, speed limit, whether it is at an intersection, traffic lights, and road slope; wherein the road type includes intersections, left-turn lanes, right-turn lanes, and through lanes; the surrounding agent information includes: agent type, speed, and acceleration, and the agent type includes pedestrians and vehicles.
作为本发明的优选,步骤1.3中,建立的高斯回归不确定性模型表示为:As a preferred embodiment of the present invention, in step 1.3, the established Gaussian regression uncertainty model is expressed as:
; ;
式中,V为地图元素M顶点的个数,第i个顶点的坐标是,是均值,表示顶点位置的预期值,是标准差,衡量预测位置的不确定性,是方差;i和j用于表示地图元素M的第i个顶点的第j个维度,为高斯回归不确定性模型的输出;Where V is the number of vertices of the map element M, and the coordinates of the i- th vertex are , is the mean, which represents the expected value of the vertex position, is the standard deviation, a measure of the uncertainty in the predicted position, is the variance; i and j are used to represent the jth dimension of the i- th vertex of the map element M, is the output of the Gaussian regression uncertainty model;
所述分类不确定性模型使用多层感知机MLP输出每个地图元素顶点的类型的置信度。The classification uncertainty model uses a multi-layer perceptron (MLP) to output the confidence of the type of each map element vertex.
作为本发明的优选,步骤2.1中,将地图元素顶点的预测位置和位置的相关的不确定性的参数及地图元素顶点的类型的置信度融合到在线地图中的模型为:As a preferred embodiment of the present invention, in step 2.1, the model for integrating the predicted position of the map element vertex and the parameters of the uncertainty related to the position and the confidence of the type of the map element vertex into the online map is:
式中,是第i个顶点的高斯分布均值向量,是高斯回归不确定性模型输出的第i个顶点的不确定性的标准差向量,是第i个顶点的置信度组成的类别概率向量,[ ;; ]表示三个向量的连接,为多层感知机MLP。 In the formula, is the Gaussian distribution mean vector of the i-th vertex, is the standard deviation vector of the uncertainty of the i-th vertex output by the Gaussian regression uncertainty model, is the category probability vector composed of the confidence of the i-th vertex, [;;] represents the connection of three vectors, It is a multi-layer perceptron MLP.
作为本发明的优选,步骤2.3中,交互建模模块使用自注意力编码器后跟前馈网络(FFN)来更新代理到代理模块、车道到车道模块,使用交叉注意力编码器后跟前馈网络来更新车道到代理模块、代理到车道模块,每个编码器都是用多头注意力机制(MHA):As a preferred embodiment of the present invention, in step 2.3, the interaction modeling module uses a self-attention encoder followed by a feed-forward network (FFN) to update the agent-to-agent module and the lane-to-lane module, and uses a cross-attention encoder followed by a feed-forward network to update the lane-to-agent module and the agent-to-lane module, and each encoder uses a multi-head attention mechanism (MHA):
; ;
= K = V = ; = K = V = ;
; ;
式中,、、是学习到的投影,norm正则化;Q、K、V分别是注意力机制的查询向量、键向量、值向量,激活函数,均为特征向量;In the formula, , , is the learned projection, norm regularized; Q, K, and V are the query vector, key vector, and value vector of the attention mechanism, respectively. Activation function, are all eigenvectors;
多头注意力块定义如下:The multi-head attention block is defined as follows:
; ;
将代理到车道模块、车道到车道模块、车道到代理模块、代理到代理模块进行堆叠,以更新特征,获得更新后的特征。Stack agent to lane module, lane to lane module, lane to agent module, agent to agent module to update features , get the updated features .
作为本发明的优选,步骤2.4中,元信息f和特征拼接的模型为:As a preferred embodiment of the present invention, in step 2.4, the meta information f and the feature The spliced model is:
= (,f); = ( , f);
式中,为多层感知机MLP,为元信息和特征拼接后的向量,元信息f包括预测时刻代理的方向和位置信息。In the formula, is a multi-layer perceptron MLP, Meta information and features The concatenated vector,meta-information f includes the direction and position information of the agent at the prediction moment.
作为本发明的优选,步骤2.4中,定点预测器用于预测目标代理的端点,定点预测器借助一个多层感知机实现对端点进行预测,公式如下:As a preferred embodiment of the present invention, in step 2.4, the fixed-point predictor is used to predict the endpoint of the target agent. The fixed-point predictor predicts the endpoint with the help of a multi-layer perceptron, and the formula is as follows:
= (); = ( );
式中,为预测的端点,多层感知机MLP,为元信息f和特征拼接后的特征向量。In the formula, is the predicted endpoint, Multilayer Perceptron MLP, is the meta-information f and feature The concatenated feature vector.
作为本发明的优选,步骤2.4中,环境自适应预测器用于预测周围多个代理的端点,环境自适应预测器采用动态权重学习的方式适应每个代理的具体情况:As a preferred embodiment of the present invention, in step 2.4, the environment adaptive predictor is used to predict the endpoints of multiple surrounding agents, and the environment adaptive predictor adopts a dynamic weight learning method to adapt to the specific situation of each agent:
; ;
; ;
; ;
; ;
式中,、为可训练的参数,、是端点预测模块中的权重动态调节矩阵,norm为层归一化,ReLU为激活函数;是经过动态权重矩阵和特征正则化处理和非线性拟合后的矩阵,为预测的端点。In the formula, , are trainable parameters, , It is the weight dynamic adjustment matrix in the endpoint prediction module, norm is layer normalization, and ReLU is the activation function; is a dynamic weight matrix and Features The matrix after regularization and nonlinear fitting, is the predicted endpoint.
作为本发明的优选,步骤3.1中,碰撞概率预测模块建立了碰撞相交函数、目标车辆与周围代理在预测时间步的时间范围内的碰撞概率预测函数;其中,碰撞相交函数用于判断目标车辆与周车的矩阵在未来预测的每一个时间步是否有重叠的部分,如果有输出1,如果没有输出0;As a preferred embodiment of the present invention, in step 3.1, the collision probability prediction module establishes a collision intersection function, a target vehicle and surrounding agents in the prediction time step The collision probability prediction function within the time range of ; Among them, the collision intersection function is used to determine whether the matrix of the target vehicle and the surrounding vehicle has overlapping parts in each time step of the future prediction. If so, it outputs 1, otherwise it outputs 0;
碰撞相交函数为:The collision intersection function is:
; ;
式中,为预测未来轨迹的时间范围,为目标车辆,为周围代理,为目标车辆的矩阵,为周围代理的矩阵;In the formula, To predict the time horizon of future trajectories, For the target vehicle, For surrounding agents, is the matrix of the target vehicle, is the matrix of surrounding agents;
目标车辆与周围代理在预测时间步的时间范围内的碰撞概率预测函数为:The target vehicle and the surrounding agents at the prediction time step The collision probability prediction function within the time range is:
; ;
式中,为目标车辆与周围代理发生碰撞的事件,= ;为目标车辆与周围代理在预测时间步发生碰撞的概率积分;是指目标车辆和周围代理在时间[]内通过交互性预测得来的分布概率;In the formula, is the event of collision between the target vehicle and surrounding agents, = ; The target vehicle and the surrounding agents at the prediction time step The integral probability of a collision occurring; It refers to the time between the target vehicle and the surrounding agents [ ] is the distribution probability obtained through interactive prediction;
设周围代理为n辆,定义目标车辆在T范围内至少与一辆周围代理发生一次碰撞为(),在未来总的时间步内发生碰撞的概率p(())的计算公式为:Assume that there are n surrounding agents and define the target vehicle at T There is at least one collision with a surrounding agent within the range. ( ), in the future total time steps The probability of a collision occurring within ( )) is calculated as:
; ;
式中,p(())计算了从s到n辆周车在总的时间步的碰撞概率。In the formula, p( ( )) Calculates the total time steps from s to n weekly vehicles The collision probability.
作为本发明的优选,步骤3.2中,临界碰撞概率剩余时间计算模块的计算公式为:As a preferred embodiment of the present invention, in step 3.2, the calculation formula of the critical collision probability remaining time calculation module is:
; ;
式中,指在所有可能的预测时间步中,找到最小的一个,使得在时间的时刻,碰撞概率超过临界值CCP。In the formula, means at all possible prediction time steps Find the smallest one so that The collision probability Exceeds the critical value CCP.
本发明的优点和有益效果:Advantages and beneficial effects of the present invention:
(1)本发明提供的方法使用在线地图作为碰撞风险预测模型的输入,避免了使用高精地图高昂的维护成本,同时提高了碰撞风险预测模型的可扩展性。(1) The method provided by the present invention uses online maps as the input of the collision risk prediction model, avoiding the high maintenance cost of using high-precision maps and improving the scalability of the collision risk prediction model.
(2)本发明建立了在线地图不确定性的生成模型,将在线地图的不确定性融入到下游的预测任务中,有效的提高了碰撞风险预测的精度。(2) The present invention establishes a generative model for online map uncertainty, incorporates the uncertainty of online maps into downstream prediction tasks, and effectively improves the accuracy of collision risk prediction.
(3)本发明车辆轨迹预测模块中端点预测使用的是定点预测器和环境自适应预测器,环境自适应预测器在预测多个代理的端点时,能根据每个代理所处的环境进行动态权重的学习,能有效的避免计算资源的浪费,提高风险预测模块的响应速度。(3) The endpoint prediction in the vehicle trajectory prediction module of the present invention uses a fixed-point predictor and an environment-adaptive predictor. When predicting the endpoints of multiple agents, the environment-adaptive predictor can learn dynamic weights according to the environment in which each agent is located, which can effectively avoid the waste of computing resources and improve the response speed of the risk prediction module.
(4)本发明采用深度学习的前沿技术与传统的风险预测结合的方法,充分的考虑了在风险预测模块上游模块中遇到的问题,并提出了相应的改进方案,为人机共驾接管系统中风险的预警系统的建立提供了一种新的思路和视角。(4) The present invention adopts a method that combines the cutting-edge technology of deep learning with traditional risk prediction, fully considers the problems encountered in the upstream module of the risk prediction module, and proposes corresponding improvement plans, providing a new idea and perspective for the establishment of a risk early warning system in the human-machine co-driving takeover system.
(5)本发明提供的方法中TTCCP 提供了一个具体的时间值,表明系统预计在多久之后,车辆将面临一个潜在碰撞的风险值达到或超过了系统定义的临界水平;这个值可以用于激活安全预警,为人机共驾下自动驾驶车辆的接管系统提供了有效、准确的安全评估信号。(5) In the method provided by the present invention, TTCCP provides a specific time value, indicating how long the system estimates that the vehicle will face a potential collision risk value that reaches or exceeds the critical level defined by the system; this value can be used to activate a safety warning, providing an effective and accurate safety assessment signal for the takeover system of the autonomous driving vehicle under human-machine co-driving.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过参考以下结合附图的说明,并且随着对本发明的更全面理解,本发明的其它目的及结果将更加明白及易于理解。在附图中:By referring to the following description in conjunction with the accompanying drawings, and with a more comprehensive understanding of the present invention, other objects and results of the present invention will become more apparent and easy to understand. In the accompanying drawings:
图1 为本发明提供的一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法流程图;FIG1 is a flow chart of a method for predicting collision risk of autonomous driving by integrating online map uncertainty provided by the present invention;
图2 为本发明的环境自适应预测器预测端点的流程图;FIG2 is a flow chart of an environment adaptive predictor predicting an endpoint of the present invention;
图3 为本发明的基于预测轨迹的碰撞风险预测流程图。FIG3 is a flowchart of collision risk prediction based on predicted trajectory of the present invention.
具体实施方式DETAILED DESCRIPTION
为使本领域技术人员能够更好的理解本发明的技术方案及其优点,下面结合附图对本申请进行详细描述,但并不用于限定本发明的保护范围。In order to enable those skilled in the art to better understand the technical solution and advantages of the present invention, the present application is described in detail below in conjunction with the accompanying drawings, but it is not intended to limit the protection scope of the present invention.
如图1至3所示,本实施例提供的一种融合在线地图不确定性的自动驾驶碰撞风险的预测方法,该方法包括以下步骤:As shown in FIGS. 1 to 3 , this embodiment provides a method for predicting collision risk of autonomous driving by integrating uncertainty of online maps, and the method includes the following steps:
步骤1:在线地图不确定性的产生;Step 1: Generation of online map uncertainty;
步骤1.1:收集车载摄像头、雷达获取到的周围道路和代理的信息,并进行相应的降噪处理;Step 1.1: Collect the information of surrounding roads and agents obtained by the on-board camera and radar, and perform corresponding noise reduction processing;
本实施例中,周围道路信息包括:道路的类型、限速、是否处于交叉路口、红绿灯、道路的坡度;其中,道路的类型包括交叉路口、左转车道、右转车道、直行车道等;周围代理信息包括:代理的类型、速度、加速度等信息,代理的类型包括行人、车辆等智能体,本发明中主要指车辆,速度主要指车速;In this embodiment, the surrounding road information includes: road type, speed limit, whether it is at an intersection, traffic lights, and road slope; wherein the road type includes intersections, left-turn lanes, right-turn lanes, and straight lanes; the surrounding agent information includes: agent type, speed, acceleration, and other information; the agent type includes intelligent agents such as pedestrians and vehicles, and in this invention, it mainly refers to vehicles, and the speed mainly refers to the vehicle speed;
步骤1.2:将经过降噪处理的数据输入到BEV编码器中,将获取的数据转换为一个共同的鸟瞰图(BEV)空间特征;Step 1.2: Input the denoised data into the BEV encoder to convert the acquired data into a common bird's eye view (BEV) spatial feature;
步骤1.3:建立高斯回归不确定性模型和分类不确定性模型,将BEV空间特征作为输入,使用在线地图回归模型生成地图元素顶点,所述地图元素顶点包括元素顶点的位置和类型,通过高斯回归不确定性模型和分类不确定性模型计算在线地图不确定性相关参数;其中,高斯回归不确定性模型计算每个地图元素顶点的预测位置和位置相关的不确定性的参数,分类不确定性模型计算每个地图元素顶点的类型的置信度;Step 1.3: Establish a Gaussian regression uncertainty model and a classification uncertainty model, take the BEV spatial features as input, use the online map regression model to generate map element vertices, the map element vertices include the position and type of the element vertices, and calculate the online map uncertainty related parameters through the Gaussian regression uncertainty model and the classification uncertainty model; wherein the Gaussian regression uncertainty model calculates the predicted position of each map element vertex and the parameters of the position-related uncertainty, and the classification uncertainty model calculates the confidence of the type of each map element vertex;
本实施例中,建立的高斯回归不确定性模型表示为:In this embodiment, the established Gaussian regression uncertainty model is expressed as:
; ;
式中,V为地图元素M顶点的个数,第i个顶点的坐标是,是均值,表示顶点位置的预期值,是标准差,衡量预测位置的不确定性,是方差;i和j用于表示地图元素M的第i个顶点的第j个维度,为高斯回归不确定性模型的输出;Where V is the number of vertices of the map element M, and the coordinates of the i- th vertex are , is the mean, which represents the expected value of the vertex position, is the standard deviation, a measure of the uncertainty in the predicted position, is the variance; i and j are used to represent the jth dimension of the i- th vertex of the map element M, is the output of the Gaussian regression uncertainty model;
所述分类不确定性模型使用多层感知机MLP输出每个地图元素顶点的类型的置信度。The classification uncertainty model uses a multi-layer perceptron (MLP) to output the confidence of the type of each map element vertex.
步骤2:融合在线地图不确定性的轨迹预测;Step 2: Trajectory prediction integrating online map uncertainty;
步骤2.1:使用多层感知机编码,将获得的地图元素顶点的预测位置和位置相关的不确定性的参数及地图元素顶点的类型的置信度融合到在线地图中;Step 2.1: Use multi-layer perceptron encoding to integrate the predicted positions of the map element vertices, the parameters of the position-related uncertainty, and the confidence of the types of the map element vertices into the online map;
本实施例中,将地图元素顶点的预测位置和位置相关的不确定性的参数及地图元素顶点的类型的置信度融合到在线地图中的模型为:In this embodiment, the model for integrating the predicted position of the map element vertex and the parameters of the position-related uncertainty and the confidence of the type of the map element vertex into the online map is:
; ;
式中,是第i个顶点的高斯分布均值向量,是高斯回归不确定性模型输出的第i个顶点的不确定性的标准差向量,是第i个顶点的置信度组成的类别概率向量,[ ;; ]表示三个向量的连接,为多层感知机MLP。 In the formula, is the Gaussian distribution mean vector of the i-th vertex, is the standard deviation vector of the uncertainty of the i-th vertex output by the Gaussian regression uncertainty model, is the category probability vector composed of the confidence of the i-th vertex, [;;] represents the connection of three vectors, It is a multi-layer perceptron MLP.
步骤2.2:对于融合了不确定性参数的在线地图,使用VectorNet进行多线段编码,并进行特征提取,在编码车道线特征时,使用VectorNet为每个场景元素(即多段线)编码一个多段线子图,对代理(车辆)和车道使用两个独立的子图,通过编码获得特征向量;Step 2.2: For the online map that incorporates uncertainty parameters, use VectorNet to encode polyline segments and perform feature extraction. When encoding lane line features, use VectorNet to encode a polyline subgraph for each scene element (i.e., polyline). Use two independent subgraphs for the agent (vehicle) and lane, and obtain the feature vector by encoding. ;
步骤2.3:将获得的特征向量传入到由代理到车道模块(AL),车道到车道模块(LL),车道到代理模块(LA)和代理到代理模块(AA)堆叠组成的交互建模模块中来更新特征,更新后的特征为;其中,所述代理到车道模块关注的是代理和车道之间的关系,所述车道到车道模块关注的是车道和车道之间的关系,所述车道到代理模块关注的是车道和代理之间的关系,所述代理到代理模块关注的是代理和代理之间的关系;Step 2.3: Get the feature vector It is passed to the interactive modeling module composed of the agent-to-lane module (AL), lane-to-lane module (LL), lane-to-agent module (LA) and agent-to-agent module (AA) stack to update the features. The updated features are ; Among them, the agent-to-lane module focuses on the relationship between the agent and the lane, the lane-to-lane module focuses on the relationship between the lane and the lane, the lane-to-agent module focuses on the relationship between the lane and the agent, and the agent-to-agent module focuses on the relationship between the agent and the agent;
具体地,交互建模模块使用自注意力编码器后跟前馈网络(FFN)来更新内部关系(AA、LL),使用交叉注意力编码器后跟前馈网络(FFN)来更新交叉关系(LA、AL),为提高模型的表达能力,每个编码器都是用多头注意力机制(MHA):Specifically, the interaction modeling module uses a self-attention encoder followed by a feedforward network (FFN) to update internal relations (AA, LL), and a cross-attention encoder followed by a feedforward network (FFN) to update cross-relations (LA, AL). To improve the expressiveness of the model, each encoder uses a multi-head attention mechanism (MHA):
; ;
= K = V = ; = K = V = ;
; ;
式中,、、是学习到的投影,norm正则化;Q、K、V分别是注意力机制的查询向量、键向量、值向量,激活函数,均为特征向量;In the formula, , , is the learned projection, norm regularized; Q, K, and V are the query vector, key vector, and value vector of the attention mechanism, respectively. Activation function, are all eigenvectors;
多头注意力块定义如下:The multi-head attention block is defined as follows:
; ;
将AA、LL、LA、AL模块进行堆叠,以更新特征,获得更新后的特征。Stack the AA, LL, LA, and AL modules to update the features , get the updated features .
步骤2.4:基于元信息f和特征拼接后的特征向量,使用定点预测器和环境自适应预测器来预测目标车辆和周围代理(周车)轨迹的端点,并使用多层感知机MLP来生成轨迹;Step 2.4: Based on meta-information f and features The concatenated feature vector , use fixed-point predictors and environment-adaptive predictors to predict the endpoints of the target vehicle and surrounding agent (circumvehicle) trajectories, and use multi-layer perceptron MLP to generate trajectories;
具体地,元信息f和特征拼接的模型为:Specifically, the meta information f and features The spliced model is:
= (,f); = ( , f);
式中,为多层感知机MLP,为元信息和特征拼接后的向量,元信息f包括预测时刻代理的方向和位置信息。In the formula, is a multi-layer perceptron MLP, Meta information and features The concatenated vector,meta-information f includes the direction and position information of the agent at the prediction moment.
本实施例中,定点预测器用于预测目标代理(目标车辆)的端点,定点预测器借助一个多层感知机实现对端点进行预测,公式如下:In this embodiment, the fixed-point predictor is used to predict the endpoint of the target agent (target vehicle). The fixed-point predictor predicts the endpoint with the help of a multi-layer perceptron. The formula is as follows:
= (); = ( );
式中,为预测的端点,多层感知机MLP,为元信息f和特征拼接后的特征向量。In the formula, is the predicted endpoint, Multilayer Perceptron MLP, is the meta-information f and feature The concatenated feature vector.
本实施例中,环境自适应预测器用于预测周围多个代理(周车)的端点,如图2所示,环境自适应预测器采用动态权重学习的方式适应每个代理(车辆)的具体情况:In this embodiment, the environment adaptive predictor is used to predict the endpoints of multiple surrounding agents (circumferential vehicles). As shown in FIG2 , the environment adaptive predictor uses dynamic weight learning to adapt to the specific situation of each agent (vehicle):
; ;
; ;
; ;
; ;
式中,、为可训练的参数,、是端点预测模块中的权重动态调节矩阵,norm为层归一化,ReLU为激活函数;是经过动态权重矩阵和特征正则化处理和非线性拟合后的矩阵,为预测的端点。In the formula, , are trainable parameters, , It is the weight dynamic adjustment matrix in the endpoint prediction module, norm is layer normalization, and ReLU is the activation function; is a dynamic weight matrix and Features The matrix after regularization and nonlinear fitting, is the predicted endpoint.
步骤3:基于预测轨迹的碰撞风险预测;Step 3: Collision risk prediction based on predicted trajectory;
步骤3.1:根据步骤2.4生成的轨迹获取目标车辆与周围车辆的未来时间步的坐标,将预测的目标车辆和周围车辆的未来时间步的坐标输入到碰撞概率预测模块,预测周围代理在未来总的时间步内发生碰撞的概率;如图3所示,具体包括以下步骤:Step 3.1: Obtain the coordinates of the target vehicle and surrounding vehicles in the future time step according to the trajectory generated in step 2.4, input the predicted coordinates of the target vehicle and surrounding vehicles in the future time step into the collision probability prediction module, and predict the probability of collision between the surrounding agents in the total future time step; as shown in Figure 3, it specifically includes the following steps:
步骤3.1.1:获取目标车辆和周车(周围车辆)的四个顶点的坐标;Step 3.1.1: Get the coordinates of the four vertices of the target vehicle and surrounding vehicles;
步骤3.1.2:将目标车辆和周车的四个顶点分别构建成矩阵;Step 3.1.2: Construct the four vertices of the target vehicle and the surrounding vehicle into matrices respectively;
步骤3.1.3:输入碰撞概率预测模块(碰撞判断函数),判断是否发生碰撞;Step 3.1.3: Input the collision probability prediction module (collision judgment function) to determine whether a collision occurs;
步骤3.1.4:输入目标车辆与其中一辆周车的概率计算函数(碰撞概率预测函数)计算概率;Step 3.1.4: Input the probability calculation function (collision probability prediction function) of the target vehicle and one of the surrounding vehicles to calculate the probability;
步骤3.1.5:计算目标车辆与所有周车的碰撞概率。Step 3.1.5: Calculate the collision probability between the target vehicle and all surrounding vehicles.
本实施例中,碰撞概率预测模块建立了碰撞相交函数、目标车辆与周围代理在预测时间步的时间范围内的碰撞概率预测函数;其中,碰撞相交函数用于判断目标车辆与周车的矩阵在未来预测的每一个时间步是否有重叠的部分,如果有输出1,代表发生碰撞;如果没有输出0,代表没有发生碰撞;In this embodiment, the collision probability prediction module establishes a collision intersection function, a target vehicle and surrounding agents in the prediction time step. The collision probability prediction function within the time range of ; Among them, the collision intersection function is used to determine whether the matrix of the target vehicle and the surrounding vehicle has overlapping parts in each time step of the future prediction. If there is an output 1, it means that a collision has occurred; if there is no output 0, it means that no collision has occurred;
碰撞相交函数为:The collision intersection function is:
; ;
式中,为预测未来轨迹的时间范围,为目标车辆,为周围代理,为目标车辆的矩阵,为周围代理的矩阵;In the formula, To predict the time horizon of future trajectories, For the target vehicle, For surrounding agents, is the matrix of the target vehicle, is the matrix of surrounding agents;
目标车辆与周围代理(周围车辆)在预测时间步的时间范围内的碰撞概率预测函数为:The target vehicle and the surrounding agents (surrounding vehicles) at the prediction time step The collision probability prediction function within the time range is:
; ;
式中,为目标车辆与周车发生碰撞的事件, =;为目标车辆与周车在预测时间步发生碰撞的概率积分;是指目标车辆和周围代理在时间[]内通过交互性预测得来的分布概率;In the formula, is the event of the target vehicle colliding with surrounding vehicles. = ; The target vehicle and surrounding vehicles at the prediction time step The integral probability of a collision occurring; It refers to the time between the target vehicle and the surrounding agents [ ] is the distribution probability obtained through interactive prediction;
设周围车辆为n辆,定义目标车辆在T范围内至少与一辆周围车辆发生一次碰撞为(),在未来总的时间步内发生碰撞的概率p(())的计算公式为:Assume that there are n vehicles around and define the target vehicle at T There is at least one collision with a surrounding vehicle within the range. ( ), in the future total time steps The probability of a collision occurring within ( )) is calculated as:
; ;
式中,p(())计算了从s到n辆周车在总的时间步的碰撞概率。In the formula, p( ( )) Calculates the total time steps from s to n weekly vehicles The collision probability.
步骤3.2:将步骤3.1得到的碰撞概率输入到临界碰撞概率剩余时间(TTCCP)计算模块中,计算临界碰撞概率剩余时间,并将其传输给人机共驾系统;临界碰撞概率剩余时间(TTCCP)计算模块的计算公式为:Step 3.2: Input the collision probability obtained in step 3.1 into the critical collision probability remaining time (TTCCP) calculation module, calculate the critical collision probability remaining time, and transmit it to the human-machine co-driving system; the calculation formula of the critical collision probability remaining time (TTCCP) calculation module is:
; ;
式中,指在所有可能的预测时间步中,找到最小的一个,使得在时间的时刻,碰撞概率超过临界值CCP。In the formula, means at all possible prediction time steps Find the smallest one so that The collision probability Exceeds the critical value CCP.
本实施例中,TTCCP 提供了一个具体的时间值,表明系统预计在多久之后,车辆将面临一个潜在碰撞的风险值达到或超过了系统定义的临界水平;这个值可以用于激活安全预警,为人机共驾下自动驾驶车辆的接管系统提供了有效、准确的安全评估信号。In this embodiment, TTCCP provides a specific time value, indicating how long the system estimates that the vehicle will face a potential collision risk value that reaches or exceeds a critical level defined by the system; this value can be used to activate a safety warning, providing an effective and accurate safety assessment signal for the takeover system of the autonomous driving vehicle under human-machine co-driving.
本发明还提供一种电子设备,包括:一个或多个处理器、存储器;其中,所述存储器用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,一个或多个处理器实现上述所述的融合在线地图不确定性的自动驾驶碰撞风险的预测方法。The present invention also provides an electronic device, comprising: one or more processors and a memory; wherein the memory is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned method for predicting collision risk of autonomous driving that integrates uncertainty of online maps.
本发明还提供一种计算机可读介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述所述的融合在线地图不确定性的自动驾驶碰撞风险的预测方法。The present invention also provides a computer-readable medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for predicting collision risk of autonomous driving by integrating uncertainty of online maps as described above is implemented.
本领域技术人员可以理解,上述实施方式中各种方法/模块的全部或部分功能可以通过硬件的方式实现,也可以通过计算机程序的方式实现。当上述实施方式中全部或部分功能通过计算机程序的方式实现时,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器、随机存储器、磁盘、光盘、硬盘等,通过计算机执行该程序以实现上述功能。例如,将程序存储在设备的存储器中,当通过处理器执行存储器中程序,即可实现上述全部或部分功能。Those skilled in the art will appreciate that all or part of the functions of the various methods/modules in the above embodiments may be implemented by hardware or by computer programs. When all or part of the functions in the above embodiments are implemented by computer programs, the program may be stored in a computer-readable storage medium, which may include: a read-only memory, a random access memory, a disk, an optical disk, a hard disk, etc. The program is executed by a computer to implement the above functions. For example, the program is stored in the memory of the device, and when the program in the memory is executed by the processor, all or part of the above functions can be implemented.
另外,当上述实施方式中全部或部分功能通过计算机程序的方式实现时,该程序也可以存储在服务器、另一计算机、磁盘、光盘、闪存盘或移动硬盘等存储介质中,通过下载或复制保存到本地设备的存储器中,或对本地设备的系统进行版本更新,当通过处理器执行存储器中的程序时,即可实现上述实施方式中全部或部分功能。In addition, when all or part of the functions in the above-mentioned embodiments are implemented by means of a computer program, the program can also be stored in a storage medium such as a server, another computer, a disk, an optical disk, a flash drive or a mobile hard disk, and saved to the memory of a local device by downloading or copying, or the system of the local device is updated. When the program in the memory is executed by the processor, all or part of the functions in the above-mentioned embodiments can be implemented.
以上应用了具体个例对本发明进行阐述,只是用于帮助理解本发明,并不用以限制本发明。对于本发明所属技术领域的技术人员,依据本发明的思想,还可以做出若干简单推演、变形或替换。因此,本发明的保护范围应以所述权利要求的保护范围为准。The above specific examples are used to illustrate the present invention, which is only used to help understand the present invention and is not intended to limit the present invention. For those skilled in the art of the present invention, according to the idea of the present invention, some simple deductions, deformations or substitutions can be made. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410713791.6A CN118269968B (en) | 2024-06-04 | 2024-06-04 | Prediction method of automatic driving collision risk fused with online map uncertainty |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410713791.6A CN118269968B (en) | 2024-06-04 | 2024-06-04 | Prediction method of automatic driving collision risk fused with online map uncertainty |
Publications (2)
Publication Number | Publication Date |
---|---|
CN118269968A CN118269968A (en) | 2024-07-02 |
CN118269968B true CN118269968B (en) | 2024-09-24 |
Family
ID=91633868
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410713791.6A Active CN118269968B (en) | 2024-06-04 | 2024-06-04 | Prediction method of automatic driving collision risk fused with online map uncertainty |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118269968B (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115855084A (en) * | 2022-11-30 | 2023-03-28 | 北京百度网讯科技有限公司 | Map data fusion method and device, electronic equipment and automatic driving product |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2562049A (en) * | 2017-05-02 | 2018-11-07 | Kompetenzzentrum Das Virtuelle Fahrzeug | Improved pedestrian prediction by using enhanced map data in automated vehicles |
KR102138979B1 (en) * | 2018-11-29 | 2020-07-29 | 한국과학기술원 | Lane-based Probabilistic Surrounding Vehicle Motion Prediction and its Application for Longitudinal Control |
CN116176627A (en) * | 2023-03-15 | 2023-05-30 | 杭州电子科技大学 | Vehicle track prediction method based on heterogeneous node time-space domain sensing |
-
2024
- 2024-06-04 CN CN202410713791.6A patent/CN118269968B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115855084A (en) * | 2022-11-30 | 2023-03-28 | 北京百度网讯科技有限公司 | Map data fusion method and device, electronic equipment and automatic driving product |
Also Published As
Publication number | Publication date |
---|---|
CN118269968A (en) | 2024-07-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Muhammad et al. | Deep learning for safe autonomous driving: Current challenges and future directions | |
KR102335389B1 (en) | Deep Learning-Based Feature Extraction for LIDAR Position Estimation of Autonomous Vehicles | |
CN113056749B (en) | Future object trajectory prediction for autonomous machine applications | |
US12154352B2 (en) | Lane line detection method and related device | |
WO2022052406A1 (en) | Automatic driving training method, apparatus and device, and medium | |
KR102350181B1 (en) | LIDAR Position Estimation Using RNN and LSTM to Perform Temporal Smoothing in Autonomous Vehicles | |
KR20200096408A (en) | LIDAR location estimation in autonomous vehicles using 3D CNN network to infer a solution | |
CN114995451A (en) | Control method, roadside device and system for vehicle-road cooperative autonomous driving | |
JP2020083308A (en) | Real time prediction of object behavior | |
CN116880462B (en) | Automatic driving model, training method, automatic driving method and vehicle | |
CN110487288A (en) | A kind of estimation method and carriage way estimating system of carriage way | |
CN118470974B (en) | Driving safety early warning system and method based on Internet of vehicles | |
CN116881707B (en) | Autonomous driving models, training methods, devices, and vehicles | |
CN118025228B (en) | Automatic driving track decision method and device for collaborative end-to-end large model | |
US20210303877A1 (en) | Systems and methods for augmenting perception data with supplemental information | |
Jiao et al. | End-to-end uncertainty-based mitigation of adversarial attacks to automated lane centering | |
Thakur et al. | An in-depth evaluation of deep learning-enabled adaptive approaches for detecting obstacles using sensor-fused data in autonomous vehicles | |
WO2023021208A1 (en) | Support tools for av testing | |
Wu et al. | A deep learning-based car accident detection approach in video-based traffic surveillance | |
CN118269968B (en) | Prediction method of automatic driving collision risk fused with online map uncertainty | |
CN117818659A (en) | Vehicle safety decision method and device, electronic equipment, storage medium and vehicle | |
EP4231044A1 (en) | Object detection and state estimation from deep learned per-point radar representations | |
US20240112044A1 (en) | Methods and systems for ontology construction with ai-mediated crowdsourcing and concept mining for high-level activity understanding | |
CN115640828A (en) | Vehicle-mounted digital twin cheating detection method based on antagonistic generation network | |
Tian | Embedded Real‐Time Detection of Vehicles and Pedestrians Based on Minimal Networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |