DE102007008542A1 - Method for controlling light emission of vehicle, involves detecting multiple successive images as image sequence and analyzing part of images of image sequence with help of analysis method - Google Patents

Abstract

The method involves detecting multiple successive images as image sequence. A part of the images of the image sequence is analyzed with the help of an analysis method (62). Another part of the images of the image sequence is analyzed with the help of another analysis method (62 to 68) that is different from the former analysis method. The analysis results, produced by each analysis method, are evaluated with the help of an evaluation method, which gives an evaluation result, and the light emission by a headlight (20,22) of a vehicle (18) is controlled depending on the evaluation result. An independent claim is also included for a device for controlling the light emission of a vehicle.

Description

The The invention relates to a method and a device for controlling the light output of a vehicle, in which several pictures of the Environment of the vehicle are detected and analyzed.

From the document DE 10 2004 063 836 A1 It is known to arrange for imaging a camera in the region of the interior mirror of the motor vehicle, which detects the light of oncoming traffic and the light from other external light sources. The traffic situation in front of the vehicle is analyzed and depending on the analysis result, the range of the low beam headlight of the motor vehicle is adjusted. A variable adjustment of the range of the low beam can be done depending on the design of the headlamp by a headlamp leveling, by rotating a diaphragm shaft, by a sliding lowering of a shutter by a change in performance of one or more light sources, and by connecting one or more light sources. With the help of an already mentioned diaphragm shaft, which is also referred to as VarioX roller and which is arranged in the emission in front of the light source of the headlamp, the cut-off of the headlamp of the motor vehicle can be moved.

From the document EP 0 935 728 B1 a headlight for vehicles is known in which a diaphragm shaft is rotatable in several rotational positions to produce different light patterns. With the help of these light figures, a light-dark border can be varied.

From the document EP 0 971 829 B1 For example, a control system for automatically dimming vehicle headlights is known which comprises an optical system and an image processing system. The optical system is able to distinguish between headlamps and taillights, with the light beams from the headlamps and from the taillights focused on different areas of a sensor pixel array. Depending on the vertical and horizontal angular position as well as the distance of other vehicles, the high beam of the vehicle equipped with the control system is controlled.

task The invention is a method and an apparatus for controlling indicate the light output of a vehicle in which in a simple way and the light output through at least one headlight of the Vehicle can be controlled to the traffic area in front of the vehicle optimally illuminate.

These The object is achieved by a method having the features of the patent claim 1 and a device with the features of claim 11 solved. Advantageous developments of the invention are specified in the dependent claims.

at the method for controlling the light output of a vehicle with the Features of claim 1, several images in succession captured as a sequence of images. At least part of the pictures in the sequence is analyzed by means of a first analysis procedure. Further will at least part of the images of the image sequence using at least a second analysis method different from the first analysis method analyzed, each analysis method at least one analysis result generated.

The Analysis results are evaluated using a rating method and issued an evaluation result. Depending on the evaluation result is the light output through at least one headlight of the vehicle controlled.

at This method according to the invention are several Analysis method preferably parallel, in multitasking mode a control unit or sequentially executed. The analysis results The analytical methods are evaluated using the evaluation procedure. The evaluation method can be preset in particular Take into account evaluation criteria, in particular by statutory or other regulations, for example, in specifications can be implemented. By the procedure with the features of patent claim 1 it is possible that the Light output by at least one headlight of the vehicle automatically depending on the with the help of captured images and the analysis method to adjust the environment of the vehicle. It is with the help of images in particular the area before the Vehicle recorded and evaluated by the at least one of Headlights of the vehicle emitted light rays other road users can hamper. By the method, the light emission the headlight of a vehicle and thus the illumination of the area be optimally adjusted in front of the vehicle, with a disability other road users is avoided.

By a device for controlling the light output of a vehicle with The features of claim 11 may be the same Advantages are achieved as by the method according to claim 1. Furthermore, this device can be developed in the same way be like this procedure.

Further features and advantages of the invention will become apparent from the following description which, taken in conjunction with the accompanying drawings Invention explained with reference to an embodiment.

It demonstrate:

1 a schematic representation of a traffic situation with multiple vehicles;

2 a block diagram for traffic-dependent control of the light output of a motor vehicle;

3 the image taken by a camera of a vehicle ahead in the dark, the taillights of the vehicle in front are visible;

4 the image taken by a camera of an oncoming vehicle in the dark, wherein a headlight of the vehicle is visible;

5 the image taken with the aid of a camera of a street lamp far away from the vehicle in the dark;

6 the image taken with the aid of a camera of a street lamp arranged near the vehicle;

7 the image taken with the aid of a camera of a total of two guide posts, wherein a first guide post near the vehicle and a second guide post are arranged further away from the vehicle;

8th the image taken by a camera of an oncoming vehicle in the dark, the headlights of the vehicle being visible;

9 tracking an object across multiple images to determine the identity of objects found in each image; and

10 a graphical representation of the position of an object using a moving camera to confirm the hypothesis or disprove that the object is a stationary object.

In 1 is a schematic representation of a traffic situation 10 with several vehicles 18 . 24 . 26 . 28 on the lanes 14 . 16 the roadway 12 shown. On the lane 14 is the vehicle 18 , which is a device for controlling the light output of the headlights 20 . 22 of the vehicle 18 having. In front of the vehicle 18 is on the lane 14 the vehicle 24 , The vehicle 24 forms the vehicle 18 nearest traffic ahead. On the lane 16 come to the vehicle 18 the vehicles 26 . 28 contrary to oncoming traffic. There are also two street lamps 30 . 32 on the right side of the track and two streetlights 34 . 36 on the left lane in the area in front of the vehicle 18 , From the vehicle 18 Seen from are still on the right lane two Leitposts 38 . 40 and on the left side of the road two guide posts 42 . 44 available. The street lamps 30 to 36 serve to illuminate the lanes 14 . 16 within a closed village. The guide posts 38 to 44 serve to mark the edges of the road outside closed villages.

In front of the vehicle 18 are those with the help of the headlights 20 . 22 of the vehicle 18 illuminable areas for conventional dipped beam (area 46 ) for headlamps equipped with headlamp leveling and a VarioX roller shutter 20 . 22 of the vehicle 18 illuminable area 48 and the area which can be illuminated by means of the high beam 50 as a projection onto the roadway 12 shown schematically. The vehicle 18 has an image capture unit 52 on, preferably near the rear-view mirror behind the windshield of the vehicle 18 is arranged. The image capture unit 52 preferably generates charge images with the aid of a CMOS pixel array, which are converted into digital image data with the aid of an analog-to-digital converter. For each pixel of the CMOS pixel array, a brightness value is determined, preferably using the image acquisition unit 52 Grayscale images and no color images captured. The image capture unit 52 has a suitable optical system for imaging the entire relevant area in front of the vehicle 18 on, so that on with the help of the image capture unit 52 captured images the preceding vehicle 24 , the oncoming vehicles 26 . 28 , the street lamps 30 to 36 as well as the guide posts 38 to 44 are shown. In the dark are from the image capture unit 52 only the currently light-emitting light sources and the currently light-reflecting elements of these objects are detected as bright areas in the recorded images.

The headlights 20 . 22 have actuators for headlamp leveling and / or for setting a desired position of the respective diaphragm roller or at least allow the switching on and off of the high beam via a data bus. Preferably, the headlights 20 . 22 of the vehicle 18 Control units connected via a CAN bus system with other control units of the vehicle 18 are connected. The image capture unit 52 is also via the CAN bus system with other control units of the vehicle 18 , in particular the control units of the headlamp systems 20 . 22 , connected.

The light control of the vehicle 18 has to be done in such a way that neither the preceding traffic (vehicle 24 ) nor the oncoming traffic (vehicles 26 . 28 ) and thus obstructed.

The image capture unit 52 continuously takes pictures of the relevant area in front of the vehicle 18 on, which are evaluated by an image processing unit, as will be explained in more detail below in connection with the other figures. The analysis results of several analytical methods are evaluated using a suitable evaluation method. An evaluation result of the evaluation process then indicates which headlamp setting of the headlamp 20 . 22 is possible to achieve the optimal road illumination. The optimal road illumination is the maximum illumination of the traffic area that can be generated by the headlights, in which the other road users are not dazzled and obstructed. The optimum illumination can be dispensed with, for example, during day trips and / or in villages in the dark. At the in 1 illustrated traffic situation 10 is the optimal possible illumination through the area 51 given, since in this illumination no road users of the vehicles 24 . 26 . 28 through the headlights 20 . 22 of the vehicle 18 emitted light is impaired.

In 2 is a block diagram with functions for image acquisition, image processing and control of the headlights 20 . 22 shown. With the help of the image acquisition unit 52 will, as already related to 1 described, an image sequence with images of the area in front of the motor vehicle 18 added. Preferably, when driving the motor vehicle 18 with the light system switched on or pictures taken in the dark. The picture is taken with the help of the function block 54 controlled by the function block 54 both the timing of the image acquisition and the conversion of the recorded images is controlled in digital image data. The images of the image sequence can be at the same time intervals or in of the vehicle speed of the motor vehicle 18 dependent time intervals are recorded. With the help of the image acquisition unit 52 and the image pickup control 54 there is a data collection. In the captured images, areas with higher brightness than the rest of the image areas are rendered using the Blobextraktionsfunktion 56 extracted. These areas of greater brightness are radiation sources, such as light sources or light-reflecting objects, ie, for example, traffic signs or guide posts, as well as warning signs and reflectors on motor vehicles.

The Blobextraktion 56 is performed for each image used for further analysis. With the help of a subsequent blobtracking function 58 the same radiation sources are determined in several consecutively recorded images and their movement is tracked over several images. The blobtracking thus includes processing steps that serve the tracking of objects across multiple images and thereby determine the information about the course of the object movement and the position of the object in space. With the help of blobtracking, a prediction of the position and movement information can be made on the basis of the motion information and position information of an object already determined over several images in conjunction with physical and mathematical laws. This process is also called prediction.

The association preferably encompassed by blobtracking identifies individual objects over several measurement cycles or over a plurality of images, as a result of which an object determined in an image currently to be evaluated can be assigned to an object that has already been detected and tracked over several images. On the basis of the motion profiles determined for individual objects, the object can be assigned to a specific object model, as a result of which subsequently at least one object property of the object can be determined. The blob tracking function 58 will provide additional calibration information 60 provided to prevent blobtracking errors.

The of the blobtracking function 58 determined tracking results are subsequently several analysis functions 62 to 68 fed, each performing an analysis method. Every analysis function 62 to 68 become additional information 62a to 68a provided in the form of model knowledge in order to be able to process and evaluate the supplied information accordingly. In the analysis function 62 The 2D properties of objects are recorded, in particular the shape, the structure, the size etc. For this purpose, the Blobstruktur evaluated, in particular the gray value and the gray value distribution of each blob, ie each brightness blob detected in the captured image or in the captured images and is evaluated. However, the gray values and the gray scale distribution of the brightness blobs are strong from the distance and the viewing angle from the image capture unit 52 depending on the radiation source of the blob and the design of the brightness point. Examples of possible blobs whose two-dimensional properties (2D properties), ie their Blobstruktur, analyzed, are described in the following 3 to 8th shown by way of example. However, the analysis of the 2D properties gives a weakly significant feature, which, in combination with the results of further analyzes, makes for a meaningful evaluation result.

The analysis function 64 determines bright areas belonging together from the blob tracking data, preferably over a plurality of successively recorded images of a sequence and analyzes a three-dimensional structure (3D structure) of the individual light-emitting elements in the room and can therefore in particular associate associated elements with an object or combine them into an object. In this analysis, a modeling of expected structures takes place. In particular, pairs of lights, such as headlight pairs and pairs of taillights, are determined. For example, with the 3D structural analysis, vehicles with numerous auxiliary lights can be identified as trucks and a series of illuminated spots as street lights or guide posts. For individual light sources, such. For example, the tail light or front headlamp of motorcycles or cars or trucks with only one working taillight or only one functioning headlamp can not be analyzed more accurately using 3D structural analysis so that 3D structural analysis can not determine any further information for these objects. The analysis function 64 to determine the 3D structure can also be used as part of a so-called Lane Departure Warning (LDW function).

A tracking can then preferably take place for all points of light associated with an object. Using the power indicator function 56 For example, mains operated light sources such as traffic lights, street lighting, illuminated billboards, and building leaked light may be distinguished from non-mains powered light sources. The mains-operated light sources are fixed light sources, which are irrelevant for a light control according to the invention, since these lights are not attributable to road users, in the light distribution of the motor vehicle 18 radiated light would have to be considered. The sampling frequency, ie the image acquisition frequency, which is determined by means of the power indicator function 66 Evaluated images can be well below the mains frequency of 50 or 60 Hz, with which the mains-powered light sources are supplied with energy. A concrete embodiment of the power indicator is detailed in the document WO 2006/069978 A2 described.

With the help of the analysis function 68 a distinction can be made from stationary, ie stationary, and moving objects, by the position of a light-emitting object in space with the aid of the image acquisition unit 52 taken pictures in a known relative movement of the image acquisition unit 52 is determined to the object. Such a position determination is with the aid of an image acquisition unit 52 , which has only a monocamera system and no stereo camera system, only possible for fixed objects. Can for such an object on at least three successive recorded images, between which a relative movement of the image acquisition unit 52 If a single position has been plausibly determined, the object is a stationary object. In this analysis function 68 is preferential, as a hypothesis, that the object to be analyzed is a stationary stationary object. The position of the object is thereby when using a mono camera as an image capture unit 52 is determined by means of two successive recorded images and checked with at least one third image by the position of the object is further determined using the first and third and / or second and third image. If the determined positions match, the object is stationary and stationary in the period considered. Thus, the hypothesis that the object is stationary is checked and verified with the aid of the third and / or further images. If there are other positions for the object, so that the hypothesis can not be verified, the object is a moving object. The analysis function 68 In addition to model knowledge, information about a vehicle dynamics model is also provided for the determination of stationary objects 68a , via the CAN bus system 69 of the motor vehicle 18 current vehicle data is made available, in particular the speed and / or position of the vehicle 18 affect. From this data, the position change of the image acquisition unit 52 between the recording of two used for determining position images.

The analysis results of the analysis function 62 to 68 become the classification function 70 fed by a summary of the through the individual analysis functions 62 to 68 carried out individual evaluations. In this case, an assignment and a differentiated evaluation are carried out in predefined object classes. Such object classes may be, for example, taillight, headlights, street lamp, reflector, road sign, etc. On the basis of preset rules, by means of which the functional rules of the overall system for controlling the light output are converted by the function categorization, an overall evaluation of the analysis results of the analysis functions takes place. Specifically, specifications and legal regulations can be taken into account and actions for lighting control can be defined. Subsequently, due to the adjustment possibilities of the lighting system or the headlights 20 . 22 of the motor vehicle 18 the optimal illumination 51 the relevant traffic space in front of the vehicle 18 taking into account the other road users 24 . 26 . 28 certainly. This information is used as a parameter or control signal via the CAN bus system of the driver zeugs 18 transmitted to the light system, through which the light output of the headlights 20 . 22 is adjusted accordingly. About a human-machine interface information about the current setting of the lighting system of the motor vehicle 18 to the driver of the motor vehicle 18 be issued.

In the 3 to 8th is one each with the help of the image acquisition unit 52 of the motor vehicle 18 recorded image in different traffic situations, where in each case the analysis result of the analysis function 62 is specified by which the determined object is more precisely determined and assigned to an object class. At the in 3 The light-emitting elements shown are the taillights and license plate illumination of a vehicle ahead 24 , At the in 4 shown light emitting area is a headlight of an oncoming vehicle. At the in 5 shown light emitting area is a remote from the motor vehicle 18 or removed from the image capture unit 52 arranged street lamp. At the in 6 shown light emitting area is a close to the motor vehicle 18 or near the image capture unit 52 arranged street lamp. At the in 7 illustrated Lichtabstrahlenden Berei chen is a close to the motor vehicle 18 arranged first guide post and one away from the motor vehicle 18 arranged second guide post. At the in 8th shown light emitting areas are remote from the motor vehicle 18 arranged headlights oncoming motor vehicles.

In 9 is the analysis result of the 3D structure analysis function 64 for a total of 12 Street lamps are shown, wherein the street lamps in the camera coordinates of the image acquisition unit 52 provided right-hand diagram as points of light and in the left diagram as points in the coordinate system of a plane are shown. The positions of the light points or the street lamps in the plane are in the left diagram of 9 starting from the image acquisition unit 52 or to the motor vehicle 18 indicated, wherein the image acquisition unit 52 is arranged in the coordinate origin.

In 10 is the position determination of a stationary object 80 with the help of the analysis function 68 shown. The image capture unit 52 is with the vehicle 18 emotional. The movement of the image acquisition unit 52 in the plane is represented by several points, which are arranged on a straight line parallel to the Y-axis. The relative movement of the image acquisition unit 52 to the object 80 is due to the movement of the vehicle 18 set because the object 80 is assumed to be stationary. Will for the object 80 With the help of several position determinations with different recorded pictures the same position is determined, the assumption is correct, that it is the object 80 is a fixed object. If different positions or non-plausible positions are determined, this is the object 80 not a stationary object.

In this analysis, then the distance between the motor vehicle 18 and the object 80 be determined with the help of a mono camera, if it is the object 80 is a fixed object. The classification of objects is preferably carried out by means of an evaluation method which carries out the evaluation of the objects to be detected on the basis of the analysis results output by the analysis functions. In particular, a standard classification method can be used as the evaluation method, in particular using the Bayes classification, a fuzzy logic, a support vector machine and / or another suitable evaluation method.

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• DE 102004063836 A1 [0002]
• EP 0935728 B1 [0003]
• - EP 0971829 B1 [0004]
• - WO 2006/069978 A2 [0033]

Claims (11)

A method for controlling the light output of a vehicle, in which a plurality of images are sequentially acquired as a sequence of images; at least a part of the images of the image sequence with the aid of a first analysis method ( 62 ) is analyzed; at least a part of the images of the image sequence using at least one of the first analysis method ( 62 ) different second analysis method ( 62 to 68 ), whereby each analytical method ( 62 to 68 ) at least one analysis result is generated; the analysis results are evaluated by means of an evaluation procedure, the evaluation process issuing at least one evaluation result; and in which depending on the evaluation result, the light output by at least one headlamp ( 20 . 22 ) of the vehicle ( 18 ) is controlled. A method according to claim 1, characterized in that the analysis methods analyze the respective part of the images independently of one another, wherein at least a part of the method of the first analysis ( 62 ) also for analysis using the second analysis method ( 64 to 68 ) is being used. Method according to one of the preceding claims, characterized in that the images of the image sequence with the aid of a single camera ( 52 ) or a stereo camera, whereby at least those with the aid of the first analysis method ( 62 ) are preferably grayscale images. Method according to one of the preceding claims, characterized in that by the headlight ( 20 . 22 ) emitted light beams is controlled, wherein the at least one headlight ( 20 . 22 ) of the vehicle ( 18 ) emitted light beams by changing the inclination angle, the yaw angle and / or an optical system for shaping the emitted light beams of at least one headlamp ( 20 . 22 ) and / or at least one light source is controlled. Method according to one of the preceding claims, characterized in that the evaluation method with the aid of the analysis results a classification with the aid of features contained in the analysis results of detected objects ( 80 ), preferably by means of a standard classification method, in particular using the Bayes classification, a fuzzy logic or a support vector machine. A method according to claim 5, characterized in that in the classification further by the vehicle ( 18 ) ( 68a ). Method according to one of the preceding claims, characterized in that by means of the first analysis method ( 62 ), the second analysis procedure ( 64 to 68 ) and / or the evaluation method, a categorization of objects determined with the aid of the images ( 80 ) is carried out. Method according to one of the preceding claims, characterized in that the analysis methods ( 62 to 68 ) An analysis method for detecting the luminous flux, an analysis method for three-dimensional structure analysis for detecting related objects, an analysis method for determining two-dimensional properties of an object, such as shape, structure and / or size, an analysis method for determining three-dimensional properties of an object, preferably for determining the Object status moved or unmoved, and / or at least one further analysis method comprises. Method according to claim 8, characterized in that the determined properties of an object ( 80 ) by at least one of the analytical methods ( 62 . 60 ) with properties of an object model ( 62a to 66a ) due to the matching and / or deviating properties between the actual properties of the object ( 80 ) and an object model ( 62a to 66a ) an evaluation criterion as an analysis result is provided to the evaluation process. Method according to one of the preceding claims, characterized in that the evaluation method during processing the analysis results perform a weighting of the analysis results and / or fault tolerances in the evaluation of the analysis results includes. Device for controlling the emission of light from a vehicle, comprising an image acquisition unit ( 52 ) for capturing images of a sequence of images; with an evaluation unit, which extracts part of the images of the image sequence with the aid of a first analysis method ( 62 ) analyzes at least part of the images of the image sequence using at least one of the first analysis methods ( 62 ) different second analysis method ( 64 to 68 ), which uses a rating procedure to evaluate the analysis results generated by each analysis method and output an evaluation result, and which adjusts according to the evaluation result generated by the emission of light rays of at least one headlamp ( 20 . 22 ) of a vehicle ( 18 ) is controlled