DE102015218970A1 - Method and system for comparing characteristics of a road user - Google Patents

Abstract

A method (300) for allocating sets of characteristics of one or more road users (120) is described. The method (300) comprises acquiring (301) a first set of characteristics of a road user (120) with means (112) of a vehicle (110), and detecting (302) a second set of properties of a road user (120) with means (131) outside the vehicle (110). In addition, the method (300) includes comparing (303) properties of the first set and characteristics of the second set, and depending on the comparing, determining (304) assigning the first set and the second set to an associated road user ( 120). The assignment may e.g. provided (305) to the vehicle (110).

Description

The invention relates to a method and a system for comparing properties over road users, in particular to determine extended information about characteristics of road users (e.g., for use in vehicle functions).

Currently, various Intelligent Transportation Systems (ITS) initiatives, including the European Standards Authorities ETSI and CEN, as well as ISO, SAE, and IEEE standardize communication protocols and cooperative security applications that will in future provide a cross-vendor, co-operative, The addressed security applications, as well as the associated transmission protocols and data formats are among others in the ETSI standard EN 302 637 or in the SAE Standard SAEJ2735 documented. So in the Standard EN 302 637-2 For example, a so-called cooperative notice message (the so-called Cooperative Awareness Message, CAM) defines which is periodically sent from one ITS station (eg, a vehicle) to another ITS station (eg, a so-called ego vehicle) in the environment to inform selected information (eg speed, acceleration and / or position) of the transmitting ITS station. The information exchanged between the ITS stations, eg based on CAM messages, can be used in the respective ITS stations to detect collision hazards and, if necessary, to initiate appropriate countermeasures (eg warnings).

However, the information that can be transmitted to an (ego) vehicle via an ITS message is limited. The present document deals with the technical problem of providing a method and a corresponding system with which an ego vehicle can be provided with extended information about a traffic situation and in particular about a road user in the vicinity of the (ego) vehicle.

The object is solved by the independent claims. Advantageous embodiments are described i.a. in the dependent claims.

In one aspect, a method of allocating sets of characteristics of one or more road users is described. The method includes detecting a first set of properties (also referred to herein as a first set of properties or properties) of a road user by means of a vehicle (e.g., an environmental sensor of the vehicle). In addition, the method comprises detecting a second set of properties (also referred to in this document as a second set of properties or a second set of properties) of a road user with means outside the vehicle (eg with an environment sensor of an infrastructure unit or another vehicle). The two sets of properties may include characteristics of a same road user from different perspectives.

The method further comprises comparing properties of the first set and characteristics of the second set. In addition, the method includes, depending on the comparing, determining an association of the first amount and the second amount with an associated road user. In particular, it can be determined within the framework of the comparison whether the properties from the first and second quantities have a relatively high degree of similarity or correlation. If so, both sets of properties may be assigned to the same road user (i.e., a common "associated" road user). The assignment of the two sets of properties may then be provided (e.g., for a vehicle function in the vehicle).

The determined assignment may be in a memory of the vehicle or in a memory outside the vehicle, e.g. be provided in an infrastructure device. Alternatively or additionally, a property of a road user (in particular the associated road user) can be provided as a function of the assignment. Depending on the determined assignment, by means of the vehicle or with means outside the vehicle, for example, at least one or more specific properties of one or more specific road users can be provided.

The method can reliably provide enhanced data to a road user (e.g., another vehicle in the vicinity of the vehicle) without the need for accurate identification of the road user.

The assignment determined in the method can be provided for one or more functions of the vehicle, in particular for a driver assistance function, and / or for optimizing a movement of a plurality of vehicles, for example the vehicles of a specific brand.

The method may further comprise, depending on the comparing, determining a third set of characteristics of the associated road user and providing the third amount in the vehicle and / or in another road user. In particular, the third amount may include properties of the second amount that are not included in the first amount. Thus, for example, the vehicle can be provided with enhanced information regarding the associated road user in an efficient manner.

Comparing properties of the first set and characteristics of the second set may include determining a measure of similarity; determining one or more statistical dependencies between properties; and / or determining a plausibility measure. Thus, a reliable assignment of sets of properties can be made.

The comparing and determining an association may include determining a machine learned assignment function, in particular a neural network, configured to determine whether or not a first set of properties and a second set of properties belong to a same road user. The use of machine-learned assignment functions allows efficient and reliable allocation of sets of properties.

The comparing and determining an association may include determining a data model for a road user, wherein a data model may indicate probabilities for combinations of properties. The comparison and the determination of the assignment can then take place in dependence on the data model. In particular, comparing and determining an association may be done in dependence on a plurality of data models for different combinations of properties. Thus, a reliable assignment of sets of properties to specific road users can be made.

The method may further include, depending on the comparing and / or the mapping, determining an input for at least one vehicle function of the vehicle. If necessary, the input value can be determined outside the vehicle. Thus, vehicle functions can be efficiently provided in a vehicle.

The first set and / or the second set may include characteristics of one or more of the following categories: geometric data relating to a road user; Color information regarding a road user; Information regarding the clothing of a pedestrian or a driver of a vehicle; a class of a road user; a building model or a series or a vehicle model of a vehicle; and / or information about a vehicle brand of a road user. Alternatively or additionally, the first set and / or the second set may comprise properties of one or more of the following categories: absolute and / or relative position data relating to a road user; absolute and / or relative movement data relating to a road user; and / or geometric arrangement data of a road user relative to at least one other road user. Alternatively or additionally, the first set and / or the second set of properties may include one or more of: information regarding an official license plate number of a road user; Information relating to a vignette of a road user; and / or information regarding an electronic device that is being moved with the road user.

In this case, the brand of a vehicle, for example, depending on the detection of a brand emblem of a road user with a camera of the (ego) vehicle or with means outside the vehicle, for example with a camera of an infrastructure device, for example on a highway bridge, are detected.

The first amount and the second amount may comprise at least partially different properties, in particular properties from different categories.

The values of corresponding characteristics (ie corresponding properties) can be compared directly if necessary. In a preferred embodiment of the method, for several combinations of one or more properties of the first set of properties and of the second set of Properties set at least one measure. This measure may include a measure of similarity, plausibility, or the completion of at least one data model. For each property, if necessary, a different suitable measure can be used.

In particular, the assignment can be made on the basis of a matrix that specifies for the first set of properties and for the second set of properties, which comparison operation is to be performed between the respective types of properties, and / or an association between the first set as a result of the comparison operation influenced by properties and the second set of properties.

In one example, a combination of several similarity measures, plausibility measures, and measures that represent a supplement to a particular data model is determined. Furthermore, it can be decided depending on the determined measures, for example by means of a simulated neural network, how and / or whether a certain first set of properties and a second set of properties are to be assigned.

The decision to associate the first set of properties and the second set of properties may also depend on the other possible variants of an association. For example, for at least two possible assignment variants, the matching values are determined that speak for and / or against a specific assignment. Then one or more mappings may be determined where the highest matching values are achieved or where a cumulative value of multiple matching values determined according to a predetermined method is greatest.

The determination of an assignment can be made in dependence on data indicating which road users are in a certain road section. Thus, the quality of assignments can be further increased.

The second set of properties may be determined, at least in part, by querying a database outside the vehicle and / or by matching data from a variety of means outside the vehicle. This will further increase the amount of data provided.

A road user may have one or more permanent properties and one or more mutable properties. Variable properties can be represented by their current qualitative or quantitative value or state. Determining an association may be based on the one or more current or changing properties and based on the one or more persistent properties. By considering different types of properties, the quality of the assignment can be increased.

The method may include transmitting, by the vehicle, a request message, the request message comprising information that depends on the first set of properties. Thus, if necessary, extended information on road users can be provided only on request, so that data traffic can be reduced. In this case, the transmission may comprise a direct or indirect transmission of the corresponding information by means of at least one wireless data connection.

In response to the request message, second sets of one or more road users may be primarily detected by the means outside the vehicle, which are displayed in the request message or associated with a displayed road user. Alternatively or additionally, the request message may indicate one or more properties to be detected by the means outside the vehicle. This will further reduce traffic and load on resources.

The method may include determining one or more associated road users associated with the associated road user. Data may then be provided for the one or more associated road users. Associated road users may be road users who are at the current time interval with the (ego) vehicle or among themselves in a particular context. For example, it may be vehicles that are directly related to a maneuver (lane change maneuver, overtaking maneuver, shunting maneuver, turning maneuver, mutual threading maneuver, etc.). Associated road users may be road users who may (at least potentially) hinder or assist one another in a driving action. Thus, the vehicle can obtain the most comprehensive picture possible of a traffic situation, in particular a selected part of the traffic situation Traffic situation affecting the vehicle in a relevant time interval. At the same time, a (mutual) transmission and processing of larger amounts of data can be avoided.

The method may further comprise balancing the first set of properties with the second set of properties. Alternatively or additionally, an environmental model of the vehicle may be created based on the first and second set of properties.

The first, second set of properties, and / or the third set of properties may be used by the vehicle to at least partially automatically guide the vehicle; and / or to output driver information to a driver of the vehicle; and / or issue an action instruction and / or a warning regarding the assigned road user and / or with respect to an associated road user to the driver of the vehicle.

According to a further aspect, computer program, in particular a computer program product, is described. If necessary, the computer program can be loaded directly into the internal memory of a digital device (in particular an electronic control unit of a driver assistance system in a vehicle having a computing unit). Furthermore, the computer program may comprise software code sections with which the steps of the method according to one of the described method claims are executed when the computer product is running on the digital device. In this case, different computer programs for an external unit, for a vehicle and / or for a user terminal can be provided.

In another aspect, a system for allocating sets of characteristics of one or more road users is described. The system includes means of a vehicle for detecting a first set of characteristics of a road user. In addition, the system includes means outside the vehicle for detecting a second set of characteristics of a road user. Furthermore, the system comprises at least one arithmetic unit which is set up to compare properties of the first set and characteristics of the second set; depending on the comparison, to determine an assignment of the first quantity and the second quantity to an assigned road user; and to provide the association. Furthermore, the system can also be designed to carry out further features of the method discussed above.

According to a further aspect, a vehicle is described which is set up to carry out the vehicle-side method steps of the method described in this document. The vehicle may in particular be a multi-lane road motor vehicle or a motorcycle.

According to a further aspect, an external unit (outside the vehicle) is described, which is set up to carry out the method steps carried out by the external unit of the method described in this document.

The method discussed here mainly from the point of view of an (ego) vehicle can be mutually applied to a large number of road users, such that a large number of road users at the same time or alternately have a role of the "ego vehicle". In this case, for example, a gradual optimization of the safety or even driving style of participating in the process road users can be done. Furthermore, the method can also be used to optimize a driving style of a certain group of vehicles, for example the participants of the method or vehicles of a particular brand or with a certain equipment.

It should be understood that the methods, devices and systems described herein may be used alone as well as in combination with other methods, devices and systems described in this document. Furthermore, any aspects of the methods, devices, and systems described herein may be combined in a variety of ways. In particular, the features of the claims can be combined in a variety of ways.

Furthermore, the invention will be described in more detail with reference to exemplary embodiments. Show

1 a block diagram of an exemplary system for assigning sets of characteristics of a road user;

2 an exemplary traffic situation; and

3 a flowchart of an exemplary method for assigning sets of characteristics of a road user.

As stated above, the present document deals with the technical task of providing an ego vehicle as comprehensive as possible information about one or more road users. Thus, advanced driver assistance systems, in particular partially and highly automated driving, can be provided in the first-person vehicle in a reliable and robust manner.

Vehicle functions, such as partially and highly automated driving, place high demands on the environment detection of an ego vehicle, and thus on the environment sensors installed in the ego vehicle (for example cameras, radar, ultrasound, LIDAR, etc.). But even with complex environment sensors, it is typically not possible to capture all the characteristics of other road users that would be useful for reliable provision of specific vehicle functions. This is due in particular to the fact that the perception perspective of the environment sensors is limited from the point of view of the ego vehicle. In particular, the detection perspective of environmental sensors (i.e., on-board sensors) of an ego vehicle typically corresponds approximately to the visual perspective of a driver of the ego vehicle. Thus, the ego vehicle can typically be provided with limited information about its own environment sensors (in particular with regard to a property of another road user and / or with regard to a coherent traffic situation), which is imperceptible from the driver's perspective.

Other reasons for insufficient detection of characteristics of other road users may be e.g. a limited range of the environmental sensors, a concealment of another road user, and / or the presence of a poorly detectable property. For example, the camera of an ego vehicle typically can not detect the contour or extent of other vehicles in the direction of travel due to the detection perspective.

A purely sensory detection of a traffic situation by a human driver (for example, by the optical power of the eyes and the acoustic performance of the ears of the driver) is inferior in many cases compared to the purely sensory possibilities of a vehicle. On the other hand, human perception (based on stimuli being processed by the human brain) provides increased performance in evaluating sensory signals as compared to data processing in a vehicle. This is particularly evident in the guidance of a vehicle, which today can typically be performed better by a driver than by a vehicle, although the vehicle typically has higher sensory capabilities.

The present document describes a method that makes it possible to apply aspects of human processing of sensory perceptions to semi-automated or highly automated driving, thus increasing the quality of vehicle functions.

The basic idea is that based on a first property set for the properties of a road user, who is currently measurable or recognizable by means of a vehicle sensor system of a vehicle, from a set of other means (exterior sensors, sensors of other vehicles, etc.) currently measured or recognized properties a matching second set of properties is assigned. This can be done in such a way that the decision about the association between the property sets is based on a plausibility principle of a model resulting from the two property sets.

In addition, the decision on an association can be made depending on the similarity of the properties that form an intersection between certain properties of the first property set and corresponding properties of the second property set.

Furthermore, in the described method, correlations or correlations between property sets which are independent of a movement information or which are currently not a suitable control variable, e.g. for driver assistance systems, vertical dynamics systems, etc. A correlation may also be a correlation between two functions that indicates a change in at least one variable property of a road user.

In certain cases, a detected with the sensor of the vehicle property, such as a color of a road user, the per se no usable payload for the leadership of a Represents vehicle, used to assign a payload on a particular road user and use this associated payload for vehicle management or for another vehicle function. For example, such a real maneuver decision or regulation decision of a HAF or TAF vehicle depending on a detected with the camera of the HAF or TAF vehicle helmet color of a motorcyclist. In particular, on the basis of the detected helmet color, an assignment to a second property set can take place, wherein information from the second property set can be used for the maneuver decision.

At least one of the property sets can be determined by means of an external sensor system or by means of a sensor system of another vehicle. This sensor can e.g. capture a traffic situation from a different perspective and / or at a different time.

By assigning property sets, the vehicle can thus be used in a driving decision, e.g. in a maneuver decision, having extended information about the surrounding traffic situation and / or a near future traffic situation, compared to the information that can be provided by the vehicle's perceptive means or IT resources. This extended information can be provided in the vehicle and can be advantageously used for vehicle functions and / or for driver information.

An adjustment of the property sets may be in one or more vehicles or e.g. in a wireless router (WLAN, LTE, etc.) on a highway bridge or in a backend. Data from the adjusted property sets can be sent selectively. In particular, only the relevant property sets relevant for this road user or information derived therefrom can be transmitted to a road user. This can reduce the amount of data exchanged.

Thus, this document describes a method for comparing the characteristics of road users, in particular for determining properties of one or more road users or related control information. Furthermore, a corresponding system, further means and a corresponding computer product are described.

1 shows an exemplary system 100 to compare properties about a road user. The system 100 includes an ego vehicle 110 that is in a traffic situation with a road user 120 located. The ego vehicle 110 includes at least one environment sensor 112 (also generally referred to as means within the vehicle), which is set up environment data relating to an environment of the ego vehicle 110 capture. In particular, the environment sensor 112 be set up environment data relating to the road user 120 capture. A control unit or arithmetic unit 111 of the ego vehicle 110 can be set up, based on the environment data, a first property set (or a first set or a first set of properties) with respect to the road user 120 to investigate.

The system 100 further includes a unit 130 . 131 outside of an ego vehicle 110 (briefly referred to as the external unit), where the unit 130 . 131 at least one sensor 131 (For example, a camera, a radar sensor, an ultrasonic sensor, etc.) to capture sensor data in a particular environment (eg in a particular road section). The sensor 131 can also be widely used as a means outside the vehicle 110 be designated. The sensor 131 can be set up a road user 120 capture. For example, image data can be captured by a camera, which is a road user 120 (eg a vehicle). The external unit 130 . 131 comprises a processing unit or arithmetic unit 130 (eg a server), which is set up, the sensor data of the at least one sensor 131 evaluate. In particular, the external unit 130 . 131 be set up based on the sensor data, a second set of properties (or a second set or a second set of properties) with respect to the road user 120 to investigate.

It can then be a comparison of the properties of the first set of characteristics of the road user 120 with the second set of characteristics of the road user 120 respectively. This comparison can eg in the external unit 130 . 131 and / or in the ego vehicle 110 respectively. Furthermore, an association can be made between the first set of properties and the second set of properties. The assignment can then be provided in a memory.

The means inside the vehicle 110 (or a device within the vehicle) may, for example, vehicle sensors or a corresponding additional device (or accessories) include, which deals with the vehicle 110 emotional. Properties from the first set of properties may include processed and / or interpreted data determined as a function of the sensory environment detection.

The means outside the vehicle 110 (or the device outside the vehicle) may include infrastructure sensors, sensors of another vehicle or other known or future devices. The use of means outside the vehicle 110 is advantageous because such means outside the vehicle 110 typically are not subject to the stringent weight, cost, energy consumption, environmental resistance criteria that apply to vehicles. This allows savings and degrees of freedom for high data quality. The method described does not require permanent detection of a road user 120 with the means outside the vehicle 110 , For example, detection can take place at spaced highway bridges.

The one or more road users 120 can road users close to a (user) vehicle 110 be. In this case, a vehicle may simultaneously user or ego vehicle 110 and road users 120 be.

The recording of properties of a road user 120 with funds 131 outside the vehicle 110 can be done from at least two different perspectives (and possibly with several means or sensors). For example, contours of the road user from two or more perspectives, in particular: essentially from above, essentially from the side, and / or substantially from the front, are detected.

The characteristics of a road user 120 can be determined or aggregated from several such contours and further information. For example, the characteristics of a road user 120 a simplified 3D model, for example of the outer dimensions of the road user 120 , include. Many different properties can be identified, including those not currently used for semi-automated guidance of a vehicle.

The first property set and the second property set can be detected in particular in real time.

The comparison and / or assignment can be done according to predefined criteria. The comparison of a first set of properties with one or more sets of second properties may e.g. by means of a matrix designed to match matching or maximally matching sets of properties (to each other).

The comparison can be designed in such a way that the respectively most suitable combinations of properties are assigned to one another. Since complete matching is statistically rather rare, methods are described below to determine correct assignment based on a variety of partially matching properties.

In particular, a comparison or an assignment of the property sets can take place, which in each case relate to the same time interval or which almost represent the current conditions.

A comparison and / or assignment may be made within an infrastructure device, e.g. in a memory of a backend and / or a cloud and / or an internet portal.

In the context of the method described, data from at least one or more (specific) road users are particularly preferred only or predominantly 120 in the vicinity of the vehicle 110 made available.

By the method described can be ensured that the means outside the vehicle 110 and with means inside the vehicle 110 captured recognition information to each other (one-to-all, all-to-one, one-unique) can be assigned.

The memory 114 in which the data for the comparison of the rates of the characteristics of a road user 120 can be provided in the vehicle 110 , in another vehicle and / or in an infrastructure device 130 . 131 (eg in a server on a highway bridge).

2 shows an exemplary traffic situation in a roundabout 200 , The sensor 131 the external unit 130 . 131 can eg at a pole in the middle of the roundabout 200 be arranged so that road users 120 throughout the roundabout 200 can be detected. The vehicle 110 can via the external unit 130 . 131 Information regarding a preceding road user (eg a motorcycle) 120 to be provided.

3 shows a flowchart of an exemplary method 300 for allocating sets (ie sets) of properties of one or more road users 120 , The procedure 300 includes capturing 301 a first set (ie, a first set) of characteristics of a road user 120 with funds 112 of a vehicle 110 , In addition, the method comprises detecting 302 a second set (ie, a second set) of characteristics of a road user 120 with funds 131 outside the vehicle 110 , Furthermore, the method includes 300 the comparison 303 properties of the first set and properties of the second set. Depending on the comparison, the determination is made 304 an assignment of the first set and the second set to a common assigned road user 120 , The determined assignment can then be provided (eg in a memory) 305 become.

The following are exemplary aspects of the method 300 to compare properties of road users 120 , the corresponding system 100 , and a corresponding computer product.

The method described 300 may include determining and providing a third set of properties. The third set of properties may be compared properties associated with at least one associated road user 120 include. The third set of properties may be for the vehicle 110 or for at least one other road user 120 to be provided.

The third set of properties may represent, for example, the following data: properties that are missing or not adequately represented in the first set of properties; Properties that are confirmed by the properties of the second set of properties; Properties that conflict with the properties of the second set of properties; and / or properties fused according to a predetermined method from the properties of the first set of properties and from the properties of the second set of properties.

The provision of the third set of properties can be made to one or more vehicles and / or to a computing unit which is used for influencing a plurality of vehicles, in particular maneuver decisions, path planning or movement trajectories. The third set of features can also be attached to the vehicle 110 yourself.

This results in the following advantages: The amount of information to be transmitted is substantially reduced in comparison to an exchange of the complete first / second sentences. The reduced information can thus be transmitted faster. Furthermore relieves a (relatively inexpensive) computing unit in an infrastructure device, the control units in individual vehicles. In addition, the provision can take place by means of a wireless transmission, for example by WLAN, LTE, G3, etc., for example by a router on a motorway bridge. The memory in which the data on the characteristics of road users 120 can also be located in such a router.

The comparison or assignment of one or more first sets of properties and one or more second sets of properties may be dependent on a determined similarity measure, one or more statistical dependencies, and / or a plausibility measure.

Here, two or more external recognition information (obtained from a second set of properties) may be added to two or more vehicle-side recognition information (derived from a first set of properties) depending on a maximum and / or minimum degree of similarity and / or dependence from mutual completion and / or plausibility. A (complete) correspondence of the external recognition information and the vehicle-side recognition information is thereby for the execution of the method 300 not mandatory. This would not be practicable in practice due to a variety of blurring, disturbances and detection perspectives.

Particularly preferably, at least two corresponding measures (preferably similarity measures, plausibility measures) are determined for two or more possible assignments of a first set of properties and a second set of properties. Depending on the determined plausibility measures can then an association and provision of at least one corresponding pair from a first set of properties and from a second set of properties take place.

Examples of the use of statistical dependencies are: general statistical information (eg how often do red vehicles overtake in the speed range of 70-130 km / h); concrete statistical information within a route (how often has a green vehicle already overtaken a particular brand within a particular road section). Characteristic A Characteristic B Characteristic C Characteristic D Characteristics Characteristic A similar suitable Characteristic B similar suitable Characteristic C suitable similar Characteristic D similar Characteristics suitable similar Table 1

Table 1 shows a first set of properties (features A to E in the horizontal direction) and a second set of properties (features A to E in the vertical direction). The values of corresponding characteristics can be compared directly. In the above example, a similarity is determined. Furthermore, it can be determined for different characteristics whether the values could in principle match one another or are plausible. Thus, in sum, a similarity measure and / or a plausibility measure can be determined between the first set of properties and the second set of properties. Furthermore, depending on the similarity measure and / or the plausibility measure, it may be decided whether the first set of properties and the second set of properties are to be associated with each other (and whether the two sets of properties belong to the same road user 120 to be assigned).

Thus, properties can be determined and provided as useful information for controlling one or more vehicle functions, in particular for controlling at least partially automated driving. The payload may depend on the comparison of the characteristics, which in themselves do not imply any direct or unambiguous conclusions about a current movement of a road user 120 allow to be determined.

By comparing a plurality of the properties of the first and second sets of properties, each of which alone can have a relatively low confidence, a comparatively high confidence of the assignment and thus of the obtained useful information can be achieved.

The comparison or assignment of a first set of properties and a second set of properties may be made such that a degree of matching is increased. This can take place, in particular, if certain assignments of individual properties have a specific type of positive dependency on a determined degree of similarity, and / or if a specific assignment of individual properties of a specific type has a negative dependency on a determined degree of similarity.

In other words, the degree of matching may increase if there is an increased degree of similarity of a set of properties and / or if a low similarity measure or high degree of dissimilarity of another set of properties is determined.

A comparison and / or an assignment can take place by means of a correspondingly conditioned neuronal network.

The comparison and / or the assignment of one or more first sets of properties and one or more second sets of properties may depend on a determined completion of a data model, in particular a data model of a road user 120 , respectively. For example, by means of a database, the statistically occurring, probable or unlikely combinations of features of road users 120 whether or not a certain external recognition information (ie, a feature from the second set of properties) and a certain vehicle-side recognition information (ie, a feature from the first set of Properties), in particular whether and how well the respective features together one for a road user 120 plausible combination.

The comparison and / or assignment of sets of properties may be made dependent on a database representing a plurality of data models. Such a database may represent typical, probable, mating combinations of properties.

In doing so, a matching or simulated joining of a first set of properties or a second set of properties to a data model may be performed, which at an earlier time, e.g. with means outside the vehicle, e.g. when a road user enters a road section, has been detected, and / or corresponds to a statistical data model, and / or can be retrieved from a remote computing unit (backend, cloud, Internet).

Such a database can be with the vehicle 110 or be carried in a mobile user device or the database can be retrieved from a spaced-apart computing unit.

The method may include determining an input for one or more vehicle functions for one or more vehicles. The input variable can be determined as a function of the comparison or of the assignment. The input variable for one or more vehicle functions may represent a parameter set for the operation and / or for the configuration of a vehicle function. Alternatively or additionally, the input variable may include control information for the direct or indirect activation of a vehicle function.

The input to one or more vehicle functions may be determined depending on the comparison of a first set of properties and a second set of properties, and represent an engagement decision for at least partially automated engagement with a vehicle chassis (eg, steering intervention, brake intervention, acceleration intervention) Time intervals, positions, etc.); a maneuver decision (eg a lane change maneuver, an evasive maneuver, an overtaking maneuver, a parking maneuver, a turning maneuver, a shunting maneuver, a target braking maneuver, etc.); Information for the driver of a vehicle, in particular recommendations for action (eg graphic, acoustic warnings, direction-dependent kinesthetic information, etc.). Particularly preferably, these input variables relate to specific time intervals and positions of the vehicle 110 ,

It can thus alternatively or additionally to explicit information about the characteristics of another road user 120 Information or control information already pre-interpreted by an external arithmetic unit to the vehicle 110 be transmitted. The external evaluation can result in synergies, since an interpretation of the assigned properties can also be used for several vehicles.

Determining the input for one or more vehicle functions may be accomplished from a third set of properties depending on one or more characteristics.

The first set of properties and / or the second set of properties may include one or more of the following information categories (alone or in combination): geometric data of a road user 120 , in particular geometric proportions or design features of the visible to the outside parts of the road user 120 ; a color information, for example to a color or color combination of a road user 120 ; an information on a clothing of a pedestrian or a driver, esp. Zweiradfahrer; a class of the road user 120 (eg truck, car, motorcyclist, etc.); a brand or specific model of a road user 120 (in particular a vehicle).

The geometric proportions may be e.g. to specific proportions, e.g. Design proportions of the externally visible parts of the vehicle act. A brand of the vehicle is e.g. by recognizing a brand emblem, logo, etc., e.g. recognizable by means of a camera.

From the totality of the comparisons of such properties can be a relatively safe statement about other characteristics of the road user 120 to be hit. It is not necessary that the properties of a direct statement about physical or traffic characteristics of a road user 120 allow.

In particular, one or more properties may be distinguishing information representing a particular road user 120 particular one or more other road users 120 distinguishes or makes distinguishable.

Preferably, one or more properties comprise one or more quantitative measures of a particular property.

The first set of properties and / or the second set of properties may include one or more of: absolute and / or relative position data of a road user 120 ; absolute and / or relative movement data of the road user 120 ; and / or geometric arrangement data in relation to one or more road users.

At least one property of at least one road user 120 may include information that depends on: an official license plate of the road user 120 , and / or a vignette information, and / or a SIM card number or a device MAC number one with the road user 120 moving electronic device.

The properties of the first set of properties and the properties of the second set of properties may be at least partially of different types or categories. In other words, the first set of properties and the second set of properties may have properties from different categories.

The comparison and / or the assignment of sets of properties can be made dependent on a database that has information about several in the lane section 200 with a sufficient probability of road users 120 includes. It can thus have a prior knowledge of possible road users 120 in a carriageway section 200 be considered to increase the quality of the assignment.

For example, from a highway bridge, the second sets of characteristics of all road users entering a roadway section can be obtained 120 be recorded. Approximately 1000 meters further the vehicle can 110 to get a first set of properties. Depending on predefined criteria, the two sets of properties can be compared and possibly assigned to one another. Depending on the assignment, the vehicle can 110 each missing properties about a road user 120 or control information is transmitted.

Depending on the, a vehicle 110 provided data may include one or more of the following actions: varying the at least partially automated movement of the vehicle 110 and / or an output of information to the driver of the vehicle 110 depending on the determined properties; and / or a maneuver decision on a maneuver to be performed in the near future; and / or a decision on the required degree of involvement of the driver of the vehicle 110 in the near future. In particular, decisions about taking over a longitudinal guide and / or transverse guidance of the vehicle 110 be taken by a driver, eg for a certain time interval.

The procedure 300 may include detecting one or more permanent characteristics of at least one road user 120 (as part of the second set of properties) with means 131 outside the vehicle. This can be done, at least in part, by requesting a database and / or comparing data with other means 131 take place outside the vehicle. For example, an external unit 130 . 131 on a current motorway bridge the characteristics of a road user 120 with the external unit 130 . 131 to balance or merge a previous motorway bridge.

The recorded characteristics of a road user 120 may include a permanent property and / or a variable property and / or a relative property with respect to a particular other vehicle.

Permanent characteristics of the road user 120 may include, for example: technical characteristics such as (outer) contour, weight, maneuverability, a fixed or variable shape (eg, a variable contour in residential trailers or semitrailers), a brand, and / or a model, etc. of road user 120 , This can also include information about a class of the road user 120 (Car, truck, motorcyclist, pedestrian, animal, etc.) belong. These properties can be determined by using the sensors 131 detected sensor data are determined.

Variable (current) characteristics of a road user 120 may include: a position and / or movement data of the road user 120 ; relative movement data of the road user 120 , especially relative to the ego vehicle 100 ; a current driving style (eg gradations from little changeable position to the surrounding road users to active, continuous maneuvering, etc.) of the road user 120 ; a safety margin appropriate to the current traffic situation or to the current driving operation; Information about active functions of the road user 120 especially with regard to lighting functions; Maneuver information, in particular automatically recognized by the road user 120 performed maneuvers, or the perceived intention to perform a (specific) maneuver; and / or a signaling status of the road user 120 (Turn signal operation, light or audio signals, etc.).

Relative (in relation to a particular vehicle) characteristics of the road user 120 may include: the road user 121 moves in a certain arrangement, eg blind spot area, parallel, etc., to another vehicle; the road user 120 overhauls another vehicle (or vice versa); the road user 120 controls the same lane at the same time as another vehicle; Etc.

It may be an assignment of the current or mutable characteristics of at least one road user 120 and one or more permanent properties. A combination (ie, an active association) of database information (to permanent properties) with current sensory properties may be used to provide extended information to a road user 120 be used.

The method may further include, transmitting a request from a vehicle 110 , where the request depends on the first set of properties. The data of the request may be, for example, a digitized form of the first set of properties, or information derived therefrom. In particular, the request may include information about the dependencies of properties of the first set of properties with each other. This means that it is not necessary to send the entire first set of properties, but it may only be possible to send information about dependencies, in particular about correlations, between the properties.

Preferred are requests from the vehicle 110 at least with regard to certain road users 120 sent for the movement of the vehicle 110 relevant in the near future or can be. The sending of the request may be direct or indirect to the external unit 130 . 131 respectively.

Alternatively or additionally, the transmission of a certain property of a particular (by means of the vehicle 110 detected and / or selected) road user 120 respectively.

An appropriate second set of properties (and depending on them also other characteristics) of the road user 120 can then be assigned to the transmitted information.

In response to receiving at least one request to at least one road user 120 can data to one or more with the road user 120 be provided to associated road users according to predetermined criteria. In other words, the vehicle 110 can in a request information for a specific road user 120 Requests. Furthermore, the vehicle can 110 then information on one or more additional associated road users 120 to be provided.

The one or more associated road users 120 can road users 120 be in a predetermined relationship with the (requested) road user 120 stand. The predefined relationship may be preferred: a current or expected distance in the near future (radius of 10, 20, or 100 meters); and / or an arrangement (front vehicle, rear vehicle, parallel driving, etc ...) or a specific formation; and / or a movement (overtaking vehicle, a vehicle to be overtaken, etc.); and / or a (probable) one-sided or mutual influence in a maneuver; and / or an overlap of pre-calculated trajectories in the near future; a road user 120 from the perspective of the vehicle sensor 112 of the vehicle 110 and / or the driver of the vehicle 110 is highly unlikely to be visible (eg, in a blind spot or approaching quickly); and / or a road user 120 by the requested road user 120 for the ego vehicle 110 could be covered.

road users 120 that with a specific road user 120 can be associated with the means 130 . 131 outside the vehicle 110 be determined. This is advantageous because of the perspective of the vehicle-external means 130 . 131 associated road users 120 reliable and resource-efficient can be determined.

It can be a balance of the vehicle 110 received data (eg the second set of properties of the at least one road user 120 ) with the first sentence of the characteristics of the road user 120 respectively. Preference is given to a completion of the inside of the vehicle 110 available data on a direct environment, in particular those with the vehicle 110 associated road users 120 , Particularly useful is the comparison or merging of the different perspectives recorded properties (external perspective and vehicle perspective).

Depending on the received data about the at least one road user 120 can be an environmental model of the vehicle 110 be determined or updated. This can be compared to an environment model, the only on a vehicle sensors 112 based, a completed and / or a specified and / or plausible environmental model can be determined. Depending on an environment model determined in this way: a movement planning of the vehicle 110 be determined in the context of an at least partially automated driving; and / or carriageway areas are determined, in particular at specific time intervals, from the vehicle 110 be driven and / or avoided.

The control unit 111 of the vehicle 110 can be set up a driver information for the driver of the vehicle 110 in relation to the one or more relevant or associated road users 120 stands. For example, instructions for action, in particular with reference to a particular road user 120 ; and / or warnings, in particular relating to a particular road user 120 , are issued. At the road user 120 this may be, in particular, a road user 120 acting out of sight of the driver of the vehicle 110 located.

Capturing a second set of properties of at least one road user 120 with funds 130 . 131 outside the vehicle 110 may be prioritized with respect to at least one particular road user 120 to which the information belongs in a request and / or with such a road user 120 is associated.

In other words, the external unit 130 . 131 can be set up, primarily properties about road users 120 to capture, through a dedicated request from a vehicle 110 are marked or with a road user mentioned therein 120 are associated.

So can the capturing the characteristics of road users 120 by means 130 . 131 outside the vehicle 110 be improved and / or focused. In particular, the resources of the funds 130 . 131 outside the ego vehicle 110 managed beneficial and the real-time capability can be increased. Furthermore, the amount of transmitted data can be reduced.

The of the vehicle 110 sent request may include information that includes one or more specific characteristics of the road user 120 indicates that by the means 130 . 131 outside the vehicle 110 should be provided. In other words, the vehicle 110 may be arranged to request certain properties or types of properties (eg those properties that the vehicle 110 itself, eg in prevailing weather conditions or due to an unfavorable perspective, can not capture well). The means or device 130 . 131 outside the vehicle 110 can then give priority to the requested properties to the requested and / or associated road users 120 capture and deploy.

For example, in the process 300 depending on a comparison or on an assignment of at least a first set of properties of a road user 120 with a second set of characteristics of the road user 120 , certain property of the road user 120 can be determined, which is not determined by the current geometric arrangement of road users sensory. Such properties can then be in the vehicle 110 , in particular for a vehicle function. In addition, on the basis of the determined properties, at least one control information for a vehicle function, for example in a computing unit located at a distance, can be determined and to the vehicle 110 be transmitted wirelessly.

For example, it can be another call with funds 112 of the vehicle 110 detected characteristics, in particular concerning another (complementary) side of the road user 120 , take place or take place from another collection perspective. An exact identification of the road user 120 is not required.

For example, in the process 300 between determining a first set of properties and a second set of properties of the road user 120 at least a period of 5, 10, 20, 30, 60 seconds, in which no adequate detection of one or more characteristics of the road user 120 Alone from the first set of properties is possible.

For example, in the process 300 depending on a comparison or assignment of a first set of the characteristics of a road user 120 with a second set of characteristics of the road user 120 a recognition of a road user 120 and / or support or resumption of a tracking operation.

For example, this can be a road user 120 which has already been sensory detected in a situation 1 minute before is recognized as such. In particular, those on this road user 120 collected data, eg for further tracking.

At least part of the procedure 300 can be performed on a user terminal (eg on a smartphone, tablet, etc.), with the user terminal being connected to the vehicle 110 may be connected by a wired or wireless communication link. For example, the communication unit, the sensors and / or the computing resources of a user terminal can be used, which is an efficient implementation of the method 300 allows.

The procedure 300 in particular in connection with: an at least partially automated driving of the vehicle 100 ; an at least partially automated signaling of the vehicle 100 to the vehicle environment; and / or the at least partially automated parking of at least one or more vehicles. In particular, the method can 300 particularly sensibly applied to multiple vehicles or road users.

Furthermore, in this document funds 111 . 112 inside a vehicle 110 , Medium 130 . 131 outside the vehicle 110 and one or more corresponding computer program products.

The procedure described in this document 300 has a variety of advantages. In particular, the method provides 300 Data on surrounding road users 120 ready, which are not yet available and can be efficiently identified. Thus, a support of a high or a particularly constant degree of automation, for example, in a highly automated driving (HAF) with low risks possible. The procedure 300 is also usable for a number of other (comfort, infotainment and lighting) functions. By the procedure 300 There are cost advantages because of the process 300 Also applicable to vehicles with relatively simple sensors. Furthermore, there are cost advantages, since external computing resources (eg, in an external router) can be used, which are typically less expensive than vehicle computing resources. Besides, that's the procedure 300 Can also be used with already available vehicles (without hardware retrofitting).

The present invention is not limited to the embodiments shown. In particular, it should be noted that the description and figures are intended to illustrate only the principle of the proposed methods, apparatus and systems.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited non-patent literature

• ETSI standard EN 302 637 [0002]
• Standard SAEJ2735 [0002]
• Standard EN 302 637-2 [0002]

Claims (23)

Procedure ( 300 ) for assigning quantities of properties of one or more road users ( 120 ), the process ( 300 ), - detecting ( 301 ) a first set of characteristics of a road user ( 120 ) with means ( 112 ) of a vehicle ( 110 ); - To capture ( 302 ) a second set of characteristics of a road user ( 120 ) with means ( 131 ) outside the vehicle ( 110 ); - To compare ( 303 ) of properties of the first amount and properties of the second amount; Depending on the comparison, determination ( 304 ) an assignment of the first quantity and the second quantity to an assigned road user ( 120 ); and - providing ( 305 ) of assignment. Procedure ( 300 ) according to claim 1, further comprising, - in dependence on the comparing, determining ( 305 ) a third set of characteristics of the associated road user ( 120 ); and - providing the third quantity in the vehicle ( 110 ) and / or in another road user ( 120 ). Procedure ( 300 ) according to any one of the preceding claims, wherein said comparing ( 303 ) comprises properties of the first set and of properties of the second set, - determining a similarity measure, and / or - determining one or more statistical dependencies between properties, and / or - determining a plausibility measure. Procedure ( 300 ) according to any one of the preceding claims, wherein said comparing ( 303 ) and determining ( 304 ) of an association, determining a machine-learned assignment function, in particular a neural network, which is set up to determine whether a first set of properties and a second set of properties belong to a same road user ( 120 ) or not. Procedure ( 300 ) according to one of the preceding claims, wherein - comparing ( 303 ) and determining ( 304 ) of an association, determining a data model for a road user ( 120 ); and - determining ( 304 ) the assignment takes place in dependence on the data model. Procedure ( 300 ) according to claim 5, wherein a data model indicates probabilities for combinations of properties. Procedure ( 300 ) according to claim 6, wherein said comparing ( 303 ) and determining ( 304 ) assignment depending on a plurality of data models for different combinations of properties. Procedure ( 300 ) according to one of the preceding claims, further comprising, depending on the comparison ( 303 ) and / or the assignment, determining an input variable for at least one vehicle function of the vehicle ( 110 ). Procedure ( 300 ) according to one of the preceding claims, wherein the first set and / or the second set comprises properties of one or more of the following categories: - geometric data relating to a road user ( 120 ); - color information concerning a road user ( 120 ); - information regarding the clothing of a pedestrian or a driver of a vehicle; - a class or a vehicle model of a road user ( 120 ); - Information about a vehicle brand of a road user ( 120 ); Procedure ( 300 ) according to one of the preceding claims, wherein the first set and / or the second set comprises properties of one or more of the following categories: absolute and / or relative position data relating to a road user ( 120 ); Absolute and / or relative movement data relating to a road user ( 120 ); and / or - geometrical arrangement data of a road user ( 120 ) relative to at least one other road user ( 120 ). Procedure ( 300 ) according to one of the preceding claims, wherein the first amount and / or the second set of properties comprises one or more of: - information relating to an official number plate of a road user ( 120 ); - information relating to a vignette of a road user ( 120 ); and / or - information relating to an electronic device compatible with the road user ( 120 ) is moved. Procedure ( 300 ) according to one of the preceding claims, wherein the first amount and the second amount at least partially comprise different properties, in particular properties from different categories. Procedure ( 300 ) according to any one of the preceding claims, wherein the determining ( 304 ) is assigned as a function of data indicating which road users ( 120 ) are in a certain section of roadway. Procedure ( 300 ) according to one of the preceding claims, wherein the second set of properties is determined at least in part by querying a database outside the vehicle ( 110 ) and / or by comparing data from a variety of means ( 131 ) outside the vehicle ( 110 ) is determined. Procedure ( 300 ) according to one of the preceding claims, wherein - the first and / or the second set of characteristics of a road user ( 120 ) has one or more permanent properties and one or more mutable properties; and - determining an association based on the one or more mutable properties and based on the one or more persistent properties. Procedure ( 300 ) according to one of the preceding claims, wherein - the method ( 300 ), sending, by the vehicle ( 110 ), a request message; and - the request message includes information that depends on the first set of properties. Procedure ( 300 ) according to claim 16, wherein in response to the request message primarily second sets of one or more road users ( 120 ) by the means ( 131 ) outside the vehicle 110 ) which are displayed in the request message or which are displayed with a displayed road user ( 120 ) are associated. Procedure ( 300 ) according to any one of claims 16 to 17, wherein the request message indicates one or more characteristics determined by the means ( 131 ) outside the vehicle ( 110 ) should be recorded. Procedure ( 300 ) according to one of the preceding claims, further comprising, - determining one or more associated road users ( 120 ) with the assigned road user ( 120 ) being related; and providing data for the one or more associated road users ( 120 ). Procedure ( 300 ) according to one of the preceding claims, further comprising, - matching the first set of properties with the second set of properties; and / or - creating an environment model of the vehicle ( 110 ) based on the first and second set of properties. Procedure ( 300 ) according to one of the preceding claims, wherein the first and the second set of properties of the vehicle ( 110 ), - the vehicle ( 110 ) at least partially automatically; and / or - driver information to a driver of the vehicle ( 110 ) issue; and / or - a handling instruction and / or a warning regarding the assigned road user ( 120 ) and / or in relation to an associated road user ( 120 ) to the driver of the vehicle ( 110 ). Computer program that is set up to run on a processor, and thereby the method ( 300 ) according to one of the preceding claims. System ( 100 ) for assigning quantities of properties of one or more road users ( 120 ), whereby the system ( 100 ), - Medium ( 112 ) of a vehicle ( 110 ) for detecting ( 301 ) a first set of characteristics of a road user ( 120 ); - Medium ( 131 ) outside the vehicle ( 110 ) for detecting ( 302 ) a second set of characteristics of a road user ( 120 ); and a computing unit ( 130 . 111 ) arranged to compare characteristics of the first set and characteristics of the second set; Depending on the comparison, an assignment of the first quantity and the second quantity to an assigned road user ( 120 ) to investigate; and - to provide the assignment.

Images