[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

USRE48914E1 - System and method for multipurpose traffic detection and characterization - Google Patents

System and method for multipurpose traffic detection and characterization Download PDF

Info

Publication number
USRE48914E1
USRE48914E1 US15/867,995 US201315867995A USRE48914E US RE48914 E1 USRE48914 E1 US RE48914E1 US 201315867995 A US201315867995 A US 201315867995A US RE48914 E USRE48914 E US RE48914E
Authority
US
United States
Prior art keywords
vehicle
detection
vehicles
detection zone
optical receiver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US15/867,995
Inventor
Yvan Mimeault
Samuel Gidel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leddartech Holdings Inc
Original Assignee
Leddartech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leddartech Inc filed Critical Leddartech Inc
Priority to US15/867,995 priority Critical patent/USRE48914E1/en
Assigned to LEDDARTECH INC. reassignment LEDDARTECH INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GIDEL, Samuel, MIMEAULT, YVAN
Assigned to INVESTISSEMENT QUÉBEC reassignment INVESTISSEMENT QUÉBEC SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LEDDARTECH INC.
Assigned to FEDERATION DES CAISSES DESJARDINS DU QUEBEC reassignment FEDERATION DES CAISSES DESJARDINS DU QUEBEC SECURITY CONFIRMATION AGREEMENT Assignors: LEDDARTECH INC.
Assigned to INVESTISSEMENT QUÉBEC reassignment INVESTISSEMENT QUÉBEC SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LEDDARTECH INC.
Application granted granted Critical
Publication of USRE48914E1 publication Critical patent/USRE48914E1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/50Systems of measurement based on relative movement of target
    • G01S17/58Velocity or trajectory determination systems; Sense-of-movement determination systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/66Tracking systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4802Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808Evaluating distance, position or velocity data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483Details of pulse systems
    • G01S7/484Transmitters
    • G06K9/00785
    • G06K9/3241
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/277Analysis of motion involving stochastic approaches, e.g. using Kalman filters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/255Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0125Traffic data processing
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/015Detecting movement of traffic to be counted or controlled with provision for distinguishing between two or more types of vehicles, e.g. between motor-cars and cycles
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/052Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed
    • G08G1/054Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed photographing overspeeding vehicles
    • G06K2209/23
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30236Traffic on road, railway or crossing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Definitions

  • the present invention relates to a system and method for traffic detection and more particularly to an optical system that detects the presence, location, lane position, direction and speed of vehicles in a traffic zone using an active three-dimensional sensor based on the time-of-flight ranging principle and an image sensor.
  • Traffic monitoring can consist in different activities such as detecting the presence of a vehicle in a specific zone, counting the number of vehicles (volume), determining the lane position, classifying each vehicle, determining the direction of travel, estimating the occupancy and determining the speed.
  • the FHWA has defined a vehicle classification based on 13 categories of vehicles from motorcycles, passenger cars, buses, two-axle-six-tire-single unit trucks, and up to a seven or more axle multi-trailer trucks classes.
  • Several alternative classification schemes are possible. Often, the aggregation of the FHWA 13 classes is split into 3 or 4 classes. Other countries have their own way to define a classification for vehicles.
  • a red light enforcement system has comparable requirements. There is a need for an automatic red light enforcement system but the high reliability required for this application is also challenging. It implies the detection of vehicles at specific locations, the tracking of each of these vehicles in dense traffic at the intersection, the identification of each of these vehicles with the ALPR system, the confirmation of a red light violation by a specific vehicle and the collection of all information to support the issuance of a traffic violation ticket to the registered owner of the vehicle without any ambiguity.
  • Intrusive detectors such as inductive loop detectors are still common for detecting the presence of vehicles but have some disadvantages such as lengthy disruption to the traffic flow during installation and maintenance, inflexibility and inability to track a vehicle.
  • Cameras with video processing have some drawbacks notably for speed measurement.
  • Radar technology is known to perform well for speed measurement but has some limitations in terms of lateral resolution making difficult the association between a speed measurement and the identification of a specific vehicle in dense traffic, for example, at an intersection. Radar technology presents difficulties in the correlation of a specific speed measurement to a specific vehicle when two or more vehicles traveling at different speeds simultaneously enter into the measurement beam. This limitation has an impact for speed enforcement applications. In some countries, legislation requires that ambiguous situations simply be discarded to reduce errors in the process. Installation of radar technology for speed enforcement is demanding because it requires adjusting the angle of the axis of the main lobe of emission in both the horizontal and vertical directions with respect to the axis of the road, with accuracy typically less than one-half degree angle to limit the cosine effect.
  • a method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment comprises providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in the environment; providing a 3D optical receiver oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channels in the field of view; driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform; receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at the 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles in the 3D detection zone, a position of at least part of each the vehicle in the 3D
  • detecting the presence includes extracting observations in the individual digital full-waveform LIDAR trace; using the location for the observations to remove observations coming from a surrounding environment; extracting lines using an estimate line and a covariance matrix using polar coordinates; removing observations located on lines parallel to the x axis.
  • detecting the presence includes extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations; finding at least one blob in the observations; computing an observation weight depending on the intensity of the observations in the blob; computing a blob gravity center based on the weight and a position of the observations in the blob.
  • the method further comprises setting at least one trigger line location and recording trigger line trespassing data with the unique identifier.
  • the method further comprises setting the trigger line location relative to a visible landmark in the environment.
  • detecting the time at which the position is detected includes assigning a timestamp for the detecting the presence and wherein the timestamp is adapted to be synchronized with an external controller.
  • the method further comprises obtaining a classification for each detected vehicles using a plurality of detections in the 3D detection zone caused by the same vehicle.
  • detecting the presence further comprises detecting a presence of a pedestrian in the environment.
  • the part of the vehicle is one of a front, a side and a rear of the vehicle.
  • emitting short light pulses includes emitting short light pulses of a duration of less than 50 ns.
  • the 3D optical emitter is at least one of an infrared LED source, a visible-light LED source and a laser.
  • providing the 3D optical receiver to have a wide and deep field of view includes providing the 3D optical receiver to have a horizontal field of view angle of at least 20° and a vertical field of view angle of at least 4°.
  • the method further comprises determining and recording a speed for each the vehicle using the position and the updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the updated time of the updated position, with the unique identifier.
  • the method further comprises using a Kalman filter to determine an accuracy for the speed to validate the speed; comparing the accuracy to a predetermined accuracy threshold; if the accuracy is lower than the predetermined accuracy threshold, rejecting the speed.
  • the method further comprises retrieving a speed limit and identifying a speed limit infraction by comparing the speed recorded for each the vehicle to the speed limit.
  • the vehicle identification data is at least one of a picture of the vehicle and a license plate alphanumerical code present on the vehicle.
  • the vehicle identification data includes the 2D image showing a traffic violation.
  • the method further comprises extracting at least one of a size of characters on the license plate and a size of the license plate and comparing one of the size among different instances of the repeating to determine an approximate speed value.
  • the method further comprises providing a 2D illumination source oriented to allow illumination of a 2D detection zone in the 3D detection zone and driving the 2D illumination source to emit pulses to illuminate the 2D detection zone and synchronizing the driving the 2D optical receiver to capture images with the driving the 2D illumination source to emit pulses to allow capture of the images during the illumination.
  • the 3D optical emitter and the 2D illumination source are provided by a common infrared LED light source.
  • the vehicle identification data is at least two areas of high retroreflectivity apparent on the images
  • the detecting a presence includes extracting observations in the individual digital signals and intensity data for the observations, the method further comprising correlating locations for the areas of high retroreflectivity and high intensity data locations in the observations, wherein each the area of high retroreflectivity is created from one of a retroreflective license plate, a retro-reflector affixed on a vehicle and a retro-reflective lighting module provided on a vehicle.
  • the method further comprises combining multiples ones of the captured images into a combined image with the vehicle and the vehicle identification data apparent.
  • a system for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment comprising: a 3D optical emitter provided at an installation height and oriented to allow illumination of a 3D detection zone in the environment; a 3D optical receiver provided and oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channels in the field of view; a controller for driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform; the 3D optical receiver receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone, thereby acquiring an individual digital full-waveform LIDAR trace for each channel of the 3D optical receiver; a processor for detecting a presence of a plurality of vehicles in the 3D detection zone using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a position of
  • the processor is further for determining and recording a speed for each the vehicle using the position and the updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the updated time of the updated position, with the unique identifier.
  • the system further comprises a 2D optical receiver, wherein the 2D optical receiver is an image sensor adapted to provide images of the 2D detection zone; and a driver for driving the 2D optical receiver to capture a 2D image; the processor being further adapted for using image registration to correlate corresponding locations between the 2D image and the detection channels and extracting vehicle identification data from the 2D image at a location corresponding to the location for the detected vehicle; and assigning the vehicle identification data to the unique identifier.
  • the 2D optical receiver is an image sensor adapted to provide images of the 2D detection zone; and a driver for driving the 2D optical receiver to capture a 2D image
  • the processor being further adapted for using image registration to correlate corresponding locations between the 2D image and the detection channels and extracting vehicle identification data from the 2D image at a location corresponding to the location for the detected vehicle; and assigning the vehicle identification data to the unique identifier.
  • the system further comprises a 2D illumination source provided and oriented to allow illumination of a 2D detection zone in the 3D detection zone; a source driver for driving the 2D illumination source to emit pulses; a synchronization module for synchronizing the source driver and the driver to allow capture of the images while the 2D detection zone is illuminated.
  • a 2D illumination source provided and oriented to allow illumination of a 2D detection zone in the 3D detection zone
  • a source driver for driving the 2D illumination source to emit pulses
  • a synchronization module for synchronizing the source driver and the driver to allow capture of the images while the 2D detection zone is illuminated.
  • a method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment comprising: providing a 3D optical emitter; providing a 3D optical receiver with a wide and deep field of view; driving the 3D optical emitter into emitting short light pulses; receiving a reflection/backscatter of the emitted light, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles, a position of at least part of each vehicle and a time at which the position is detected; assigning a unique identifier to each vehicle; repeating the steps of driving, receiving, acquiring and detecting, at a predetermined frequency; tracking and recording an updated position of each vehicle and an updated time at which the updated position is detected.
  • object is intended to include a moving object and a stationary object.
  • object can be a vehicle, an environmental particle, a person, a pedestrian, a passenger, an animal, a gas, a liquid, a particle such as dust, a pavement, a wall, a post, a sidewalk, a ground surface, a tree, etc.
  • vehicle is intended to include any movable means of transportation for cargo, humans and animals, not necessarily restricted to ground transportation, including wheeled and unwheeled vehicles, such as, for example, a truck, a bus, a boat, a subway car, a train wagon, an aerial tramway car, a ski lift, a plane, a car, a motorcycle, a tricycle, a bicycle, a SegwayTM, a carriage, a wheelbarrow, a stroller, etc.
  • wheeled and unwheeled vehicles such as, for example, a truck, a bus, a boat, a subway car, a train wagon, an aerial tramway car, a ski lift, a plane, a car, a motorcycle, a tricycle, a bicycle, a SegwayTM, a carriage, a wheelbarrow, a stroller, etc.
  • the term “environmental particle” is intended to include any particle detectable in the air or on the ground and which can be caused by an environmental, chemical or natural phenomenon or by human intervention. It includes fog, water, rain, liquid, dust, dirt, vapor, snow, smoke, gas, smog, pollution, black ice, hail, etc.
  • red light is intended to mean a traffic light (traffic signal, traffic lamp or signal light) which is currently signaling users of a road, at a road intersection, that they do not have the right of way into the intersection and that they should stop before entering the intersection. Another color and/or symbol could be used to signal the same information to the user depending on the jurisdiction.
  • green light is intended to mean a traffic light (traffic signal, traffic lamp or signal light) which is currently signaling users of a road, at a road intersection, that they have the right of way into the intersection and that they should enter the intersection if it is safe to do so. Another color and/or symbol could be used to signal the same information to the user depending on the jurisdiction.
  • traffic light traffic signal, traffic lamp or signal light
  • FIG. 1 is a functional bloc diagram of an example of the multipurpose traffic detection system showing its main components and the way they are interconnected;
  • FIG. 2 is an example installation of the traffic detection system on the side of a 3-lane highway
  • FIG. 3 shows an example installation of the traffic detection system on a gantry
  • FIG. 4 shows the impact on the depth of a detection zone of the height of installation of the system
  • FIG. 5 shows an example casing for the multipurpose traffic detector
  • FIG. 7 shows a top view of the detection zone in a red light enforcement application
  • FIG. 9A is a photograph showing an example snapshot taken by the image sensor with the overlay of the 3D sensor at an intersection for red light enforcement application and FIG. 9B is a graph of data acquired by the detection system showing the range of detection of vehicles on 3 lanes in Cartesian coordinates;
  • FIG. 10 is a top view of an example road side installation with the tracking system being installed next to a one-directional three-lane highway and for which the detection zone is apparent and covers, at least partly, each of the lanes, all vehicles traveling in the same direction;
  • FIG. 11 is a top view of the example installation of FIG. 10 on which four vehicle detections are visible in some of the 16 separate channels with simultaneous acquisition capability;
  • FIG. 12 is a top view of the example installation of FIG. 10 on which a detection is visible between two trigger lines;
  • FIG. 13 includes FIGS. 13A, 13B, 13C, 13D, 13E and 13F , in which FIGS. 13A, 13C and 13E are photographs which show a few frames of vehicle tracking when vehicles arrive at an intersection with a red light and FIGS. 13B, 13D , and 13 F show a graph of data acquired by the detection system for each corresponding frame;
  • FIG. 14 includes FIGS. 14A, 14B, 14C, 14D, 14E and 14F , in which FIGS. 14A, 14C and 14E are photographs which show a few frames of vehicle tracking when vehicles depart the intersection of FIG. 13 at the green light and FIGS. 14B, 14D, and 14F show a graph of data acquired by the detection system for each corresponding frame;
  • FIG. 15 is a flowchart illustrating an example method for tracking several vehicles based on a space-based tracking disjoint
  • FIG. 17 is a flowchart illustrating the selection of appropriate measures among the detections
  • FIG. 19 is a state diagram illustrating the tracking system used without a traffic light state
  • FIG. 20 is a state diagram illustrating the tracking system used with a traffic light state
  • FIG. 21 is a flowchart showing example steps performed to compute the vehicle position
  • FIG. 22 is a flowchart showing example steps performed for object tracking without a traffic light state
  • FIG. 23 is a flowchart showing example steps performed for object tracking with a traffic light state
  • FIG. 24 is a flowchart illustrating an example classification process
  • FIG. 26 illustrates the direct geometric relationship between height of the vehicle and distance of vehicle detection
  • FIG. 28 includes FIGS. 28A, 28B, 28C and 28D which show corresponding side view frames of the vehicle of FIG. 27 ;
  • FIG. 29 is a flowchart illustrating an example segmentation algorithm based on a 3D bounding box
  • FIG. 30 is a top view of an example scenario used for the analysis of Posterior Cramer-Rao lower bound
  • FIG. 31 is a graph showing theoretical performance of the tracking algorithm given by the PCRB.
  • FIG. 32 includes FIGS. 32A, 32B, 32C and 32D in which FIG. 32A is a photograph showing an example snapshot taken by the image sensor during the day, FIGS. 32B, 32C and 32D are photographs showing a zoom in on license plates in the snapshot of FIG. 32A ;
  • FIG. 33 includes FIGS. 33A, 33B and 33C in which FIG. 33A is a photograph showing an example snapshot taken by the image sensor at night without any light, FIG. 33B is a photograph showing the same scene as FIG. 33A taken by the image sensor at night with an infrared light illumination, FIG. 33C is a photograph showing a zoom in on a license plate extracted from the image of FIG. 33B ;
  • FIG. 34 includes FIGS. 34A, 34B, 34C and 34D in which FIG. 34A is a photograph showing another example snapshot taken by the image sensor at night with infrared light, FIG. 34B is a photograph showing a zoom in on a license plate extracted from the image of FIG. 34A , FIG. 34C is a photograph showing an example snapshot taken by the image sensor with a shorter integration time at night with infrared light, FIG. 34D is a photograph showing a zoom in on a license plate extracted from the image of FIG. 34C ; and
  • FIG. 35 is a photograph showing an example panoramic snapshot taken by the image sensor using infrared illumination in which two vehicles are present in the detection zone and on which the overlay of the 3D sensor is shown with dashed lines.
  • the functionalities of the various components integrated in an example multipurpose traffic detection system 10 can be better understood by referring to the functional block diagram shown in FIG. 1 .
  • the 3D Optical Emitter 12 (3DOE) emits short pulses of light, for example of a length less than 50 ns, within a predetermined zone.
  • the 3DOE 12 is an IR LED illumination source determining a Field-of-Illumination FOI 3D covering the 3D detection zone FOV 3D .
  • the optical source of the 3DOE can also be based on Laser technology.
  • the horizontal angles of the FOI 3D and FOV 3D are wide enough to cover at least one lane. For example, a system with a horizontal FOI/FOV of 35° would be able to cover 3 lanes, each lane having a width of 3.5 m, when installed at 15 m from the side of the detection zone.
  • FIG. 2 depicts a schematic view of a roadway with 3 lanes being shown.
  • the traffic detection system 10 is shown mounted on a pole 27 with an orientation towards traffic direction.
  • Pole 27 can be a new dedicated road infrastructure for the sensor installation or an already existing road infrastructure streetlight assembly or other types of infrastructures like gantries or buildings.
  • This exemplary roadway comprises three adjacent traffic lanes for vehicles.
  • the traffic detection system is intended to detect any type of objects that may be present within the predetermined 3D detection zone.
  • the mounting height of the traffic detection system 10 is, for example, between 1 to 10 m with a lateral distance from the nearest traffic lane of, for example, between 1 to 5 m.
  • three vehicles travelling in the same direction on the traffic lanes enter in the 3D detection zone.
  • the multipurpose traffic detection system is used for detection, localization, classification and measurement of the speed of the vehicles through the zone.
  • the system can also be installed over the roadway on a gantry as shown in FIG. 3 .
  • the system can also detect vehicles traveling in opposite directions.
  • the detection system can be installed at different heights, from the ground up to 10 m.
  • FIG. 4 shows the impact of the installation height on the longitudinal length of the detection zone.
  • the vertical angles of the FOI 3D and FOV 3D have to be wide enough to detect and track vehicles over several meters, for example over at least 8 m.
  • a system installed at a height of 3.5 m with a vertical FOI/FOV of 6° and a detection zone beginning at 15 m from the detector will have a detection zone depth of approximately 13 m.
  • part of the light diffusively reflected by the vehicles and objects in the FOI 3D is directed towards the collecting aperture of the 3D Optical Receiver 14 (3DOR) for its 3D optical detection and subsequent conversion into digital waveforms.
  • an object should appear within the FOV 3D of the 3DOR, which is defined by its optics as well as by the dimensions of its optically sensitive device.
  • the 3DOR is composed of one or more optical lenses, multichannel optical detectors, for example photodiode arrays, an analog frontend and analog-to-digital converter.
  • the channels are digitalized in parallel and the system implements a full-waveform signal processing of the signal waveforms generated by the plurality of optical detection channels.
  • the multipurpose traffic detection system provides a good accuracy in terms of lateral resolution and is less dependent on the angle of installation than Radar technology.
  • the 2D Optical Receiver 16 is at least one image sensor, for example a CMOS or CCD (including front end and AD conversion) which provides images of the portion of the roadway area that encompasses or overlaps at least a section of the FOI 3D of the 3DOE and the FOV 3D of the 3DOR.
  • the 2DOR will be used during installation, to transmit video data, and, for some applications, to help identify vehicles using, for example, Automatic License Plate Recognition (ALPR) techniques.
  • APR Automatic License Plate Recognition
  • An external image sensor or camera can also be used for this function.
  • the average size of a character on a license plate is between 50 mm to 80 mm.
  • OCR Optical Character Recognition
  • the 2D Illumination 18 is an optical source emitting infrared and/or visible light.
  • the 2DI can be embedded in the sensor enclosure or can be an external module.
  • the optical source of 2DI 18 is at least one LED. LEDs are efficient and the FOI can be optimized with optical collimators and diffusers.
  • the pulse width of 2DOE can be in the range of 10 ⁇ s to 10 ms and can be synchronized with the image capture (integration time) of the image sensor(s). For vehicles traveling at high speed, the integration time can be in the range of 500 ⁇ s and less. A vehicle moving at 150 km/h will travel 21 cm in 500 ⁇ s.
  • a single set of infrared LEDs can be used for both the 3DOE and 2DOE.
  • Very high-short intensity pulses for example ⁇ 50 ns
  • longer pulses for example 10 ⁇ s to 10 ms
  • the LEDs can have a wavelength between 800 and 1000 ⁇ m, for example.
  • Source Driver Electronics (SDE) 20 uses dedicated electronics for driving the 3DOE 12 with current pulses having peak amplitude and duration suitable for effective implementation of the optical ranging principle on which the operation of the multipurpose traffic detection system is based.
  • a pulsed voltage trig signal forwarded by the Control and Processing Unit 22 commands the generation of each current pulse by the drive electronics.
  • the operating conditions and performance requirements for the multipurpose traffic detection system call for the emission of short optical pulses having a duration in the range of 5 to 50 ns, for example.
  • the duty cycle (relative ON time) of the optical emission can be as low as 0.1%.
  • any lowering of the peak drive level of the LEDs or Laser can be compensated by mounting additional LED or Laser sources in the 3DOE 12 and appropriately duplicating their drive electronics.
  • the SDE 20 can also drive 2D illumination with current pulses having peak amplitude and duration suitable for effective illumination of the scene for the 2DOR 16 .
  • a pulsed voltage trig signal forwarded by the Control and Processing Unit 22 commands the generation of each current pulse by the drive electronics.
  • the operating conditions and performance requirements for the multipurpose traffic detection system call for the emission of 2D optical pulses having a duration in the range of 10 ⁇ s to 10 ms, for example.
  • the SDE 20 can control and receive information from 3DOE and 2D illumination about the intensity of the current pulse, LEDs/Laser temperature, etc.
  • the Control and processing unit 22 can include digital logic (for example by a Field-Programmable Gated Array (FPGA)) for pre-processing the 3D raw data and for the synchronization and control, a memory, and a processing unit.
  • the processing unit can be a digital signal processing (DSP) unit, a microcontroller or an embarked personal computer (PC) board as will be readily understood.
  • DSP digital signal processing
  • PC personal computer
  • the primary objective of the 3D full-waveform processing is to detect, within a prescribed minimum detection probability, the presence of vehicles in a lane that is mapped to a number of adjacent detection channels. Because of the usual optical reflection characteristics of the vehicle bodies and of various constraints that limit the performances of the modules implemented in a traffic detection system, the optical return signals captured by the 3DOR are optimized by acquisition shifting techniques, accumulation techniques and filtering and correlation technique to enhance the signal-to-noise ratio (SNR) of the useful signal echoes and detect a digital replica of the pulse emitted by the 3DPE.
  • SNR signal-to-noise ratio
  • the properties (peak amplitude, shape, time/distance location) of the useful features present in the waveforms should remain ideally unchanged during the time period required to capture a complete set of waveforms that will be averaged. This condition may cause issues when attempting to detect vehicles that move rapidly, this situation leading to signal echoes that drift more or less appreciably from waveform to waveform.
  • the detrimental impacts of this situation can be alleviated by designing the traffic detection system so that it radiates light pulses at a high repetition rate (e.g., in the tens to hundreds of kHz range). Such high repetition rates will enable the capture of a very large number of waveforms during a time interval sufficiently short to keep the optical echoes associated to a moving vehicle stationary.
  • Detection information on each channel can then be upgraded, for example between a few tens to a few hundred times per second. For example, with a multipurpose traffic detection system using a frame rate at 200 Hz, a car at 250 km/h would have moved forward by 35 cm between each frame.
  • the Control and processing unit 22 has numerous functions in the operation of the multipurpose traffic detection system, one of these being the calibration of the system. This calibration process can be done by connecting a remote computer to the Control and processing unit 22 and communicating using a Power management and data Interface 24 .
  • Power management and data Interface 24 receives information from the external controller (including parameters like a speed limit) and also allows the Control and processing unit 22 to send data.
  • the data sent can be related to the detection of each vehicle and can comprise information such as an accurate timestamp of the detection time synchronized with the external controller, a unique identifier (ID number), the lane and position of the vehicle (lateral and longitudinal) for each trigger event, the position of the vehicle in an image, video streaming, identification by ALPR, speed, classification, weather information, etc., to the external controller.
  • part of the process and algorithms can be integrated in the external controller which receives the raw data from the Control and processing unit by the Power Management and Interface.
  • Ethernet Several types of interfaces can be used to communicate with the external controller: Ethernet, RS-485, wireless link, etc.
  • Power over Ethernet may be used for its simplicity of connection including power, data and distance (up to 100 m).
  • the data information can also be stored in memory and retrieved later.
  • Power management and data Interface 24 can also send electrical trigger signals to synchronize events like the detection of the front or the rear of a vehicle at a specific position to other devices like an external camera, an external illuminator or other interface and external controller.
  • the Power Supply Management and Data Interface 24 can also be useful in transmitting images and videos to an external system or network to allow a remote operator to monitor different traffic events (ex.: accident, congestion, etc.).
  • Video compression (ex.: MPEG) can be done by a processor to limit the bandwidth required for the video transmission.
  • the four optical modules can be rigidly secured to the attachment surface of an actuator assembly (not shown).
  • the modules can then pivot in a controlled manner about up to three orthogonal axes to allow a precise alignment of their common line of sight after the multipurpose traffic detection unit has been installed in place and aligned in a coarse manner.
  • the fine-tuning of the orientation of the line of sight is, for example, performed remotely by an operator via a computer device connected to the multipurpose traffic detection system, for example through PoE or a wireless data link.
  • FIG. 1 also shows a functional bloc labeled Sensors 26 for measuring different parameters.
  • the internal temperature in the system enclosure can be monitored with a temperature sensor which can be used to control a heating/cooling device, not shown.
  • the current orientation of the system can be monitored using an inclinometer/compass assembly. Such information may be useful for timely detection of the line of sight that may become misaligned.
  • the sensor suite may also include an accelerometer for monitoring in real-time the vibration level to which the system is submitted to as well as a global positioning system (GPS) unit for real-time tracking of the location of the system and/or for having access to a real-time clock.
  • GPS global positioning system
  • FIG. 5 shows an example casing with a window 28 for the multipurpose traffic detection system.
  • the casing can house a more or less complete suite of monitoring instruments, each of them forwarding its output data signals to the control and processing unit for further processing or relay.
  • lateral sections can be integrated to protect the window from the road dust.
  • FIG. 6 shows a top view of an installation of the multipurpose detection system.
  • the multichannel 3DOR detects vehicles present within a two-dimensional detection zone, the active nature of the traffic detection system provides an optical ranging capability that enables measurement of the instantaneous distances of the detected vehicles from the system.
  • This optical ranging capability is implemented via the emission of light in the form of very brief pulses along with the recordal of the time it takes to the pulses to travel from the system to the vehicle and then to return to the system.
  • TOF time-of-flight
  • the traffic detection system numerically processes the signal waveform acquired for a certain period of time after the emission of a light pulse.
  • the traffic detection system can therefore be categorized as a full-waveform LIDAR (Light Detection and Ranging) instrument.
  • the system analyses the detection and distance measurements on several 3D channels and is able to track several vehicles at the same time in the detection zone. The system can determine the lane position, the distance from the detector and the speed, for each individual vehicle.
  • the detection system 10 is installed at a reference line 60 , has a wide FOV 61 , has a large and wide detection and tracking zone 62 covering several lanes and several meters of depth and detects several vehicles on several lanes in a roadway.
  • the detection system can be configured with two trigger positions.
  • the first trigger 63 is set in the first section of the detection zone and the second trigger 64 is set a few meters away, in this case close to the end of the detection zone.
  • a first vehicle 65 was detected when entering the detection zone on lane 1, was tracked, was detected at the position of the first trigger 63 , was continuously tracked and is now being detected at the position of the second trigger 64 .
  • Information about its lane position, speed, etc., can be constantly sent or can be sent only when the vehicle reaches pre-established trigger positions.
  • a second vehicle 66 was detected when entering the detection zone on lane 2, was tracked, was detected at the position of the first trigger 63 , and is continuously tracked until it reaches the position of the second trigger 64 .
  • a third vehicle 67 was detected when entering the detection zone on lane 3, was tracked, is detected at the position of the first trigger 63 , will continue to be tracked and will reach the position of the second trigger 64 .
  • the system can capture several snapshots using the 2DOR at different levels of illumination using the 2DOE.
  • Information about each vehicle can be sent to the external controller. This is useful for applications like traffic management (for vehicle detection, volume, occupancy, speed measurement and classification), speed enforcement, red light enforcement, etc.
  • the system can be permanently or temporarily installed. It can even be a mobile system, for example a system installed on a vehicle.
  • detection rates should be high, for example of the order of 95% and more (without occlusion), and false detections should occur only very rarely.
  • Images and information about the date and time of the infraction will allow the authorities to transmit a traffic infraction ticket. Identification of the driver and/or owner of the vehicle is generally made by the authorities using the information from the license plate of the vehicle. Since speed information is available, speed infractions can also be detected when the traffic light is green. As will be readily understood, the detection system can also be used for other detection applications such as stop line crossing and railway crossing.
  • the detection system is installed on the side of the road at an example distance of 15 to 25 m from the stop bar 70 .
  • the detection and tracking zone 71 starts few meters before the stop bar 70 and covers several meters after the bar, allowing a large and deep zone for detecting and tracking any vehicle on several lanes (three lanes in that example), at different speeds (from 0 to more than 100 km/h), at a rate of up to ten vehicles detected per second.
  • the detection system can take several images of a red light infraction including, for example, when the vehicle is located at a predetermined trigger distance, for example at first trigger 72 when the back of the vehicle is close to the stop bar 70 and at second trigger 73 when the back of the vehicle is few meters away from the stop bar 70 .
  • Optional detection of the lane position is useful when a right turn on red is allowed at the intersection.
  • Speed enforcement is another application that requires providing evidence that a speed violation occurred.
  • the correlation between the detected speed and the actual vehicle guilty of the infraction needs to be trustworthy.
  • Sufficient information should be provided to allow identification of the vehicle owner, using information from the license plate, for example.
  • the capability of the detection system to measure the speed of several vehicles at the same time with high accuracy and to make the association between each speed measurement and the specific identified vehicle is useful for traffic enforcement applications. This is made possible by, among others, the multiple FOV, the robustness and accuracy of the sensor and the capability to store several images of a violation.
  • the detector can store speed limit data (which can be different for each lane) and determine the occurrence of the infraction.
  • the detector can be mounted on a permanent installation or can also be temporary, provided on a movable tripod for example. Detectors can also be installed at the entry and at the exit of a point-to-point enforcement system allowing the measurement of the average speed of a vehicle by determining the amount of time it takes to displace the vehicle between the two points. The position of each vehicle and its classification are also information that the detector can transmit to the external controller. In some countries, lane restriction can be determined for specific vehicles, such as trucks for example.
  • the multipurpose traffic detection system can fulfill more than one application at a time.
  • the system used for traffic management near an intersection can also be used for red light enforcement at that intersection.
  • FIGS. 8A and B show examples images of a roadway captured by the 2DOR during the day. The image is overlaid with the perimeters of a set of 16 contiguous detection zones of the 3DOR.
  • a vehicle present in the first lane 32 would be detected by several adjacent channels at a respective detected distance between 17.4 m to 17.6 m (see the numbers at the bottom of the overlay).
  • the vehicle is detected in the second lane 34 between 24.0 m to 24.4 m. Note that the overall detection zone is wide enough to cover more than two lanes. In some situations depending on the context of the installation, some objects or even the ground can be detected by the system but can be filtered out and not be considered as an object of interest.
  • FIG. 9A shows a photograph of a red light enforcement application installation. Some channels detect echo back signals from the ground (see the numbers at the bottom of the overlay) but the system is able to discriminate them as static objects.
  • FIG. 9B is a graph showing a top view of the 3D 16 field of view of a road with 3 lanes. In a Cartesian coordinate system, if the detection system represents the origin, the horizontal direction from left to right is taken as the positive x-axis and represents the width of the 3 lanes in meters, and the vertical direction from bottom to top is taken as the positive y-axis and represents the longitudinal distance from the sensor. To facilitation installation, the installation software will indicate the beginning and the end of the detection zone by showing a detection line as seen in FIG. 9B .
  • FIG. 10 shows a top view of an example road facility equipped with a multipurpose traffic detection system 10 .
  • the system 10 mounted on an existing traffic infrastructure is used to illuminate a detection zone 42 .
  • the mounting height is between 1 and 10 m with a distance from the road between 1 and 5 m.
  • the vehicles 46 travel in lanes 43 , 44 and 45 in a direction indicated by arrow A through the detection system illumination zone 42 .
  • the detection system 10 is used for detecting information of the rear surface of vehicles 46 coming in the illumination zone 42 .
  • the detection system 10 is based on IR LED illumination source with a multiple field-of-view detector.
  • each 3D detection 53 gives the distance between an object and the sensor.
  • FIG. 12 shows the system in an example configuration with two trigger lines 56 and 57 located at a distance from the sensor between 10 and 50 m, for example.
  • the two trigger lines 56 and 57 are configured by the user.
  • Blob 55 illustrates a detectable vehicle rear. When the blob reaches the trigger line, the system returns a trigger message.
  • FIG. 13 and FIG. 14 show example data for vehicle tracking in the context of traffic light enforcement. Thanks to a projection of the field-of-view of the detection system on the real 2D image, the relationship between the top view ( FIGS. 13B, 13D, 13F ) and the scene ( FIGS. 13A, 13C, 13E ) is made apparent.
  • the 3D detections are represented by dots in the top views. In this example, a small diamond in the top views shows the estimated position of the rear of each vehicle based on the 3D detections. In this example, the small diamond represents the middle of the rear of the vehicle.
  • the distance of detection is indicated under each detection channel in the scene image. The amplitude of the detection is also indicated below the distance of detection.
  • thin lines define the limits of the tracking area and dotted lines define two trigger lines configured by the user.
  • a new vehicle is labeled with a unique identifier.
  • its estimated position is shown using a small diamond.
  • the interactions between vehicle detections are managed by the tracking algorithm allowing distinguishing vehicles located in the detection area.
  • step 100 the tracking algorithm reads the available observations.
  • step 101 the tracking algorithm removes each detection that is not located on the road.
  • step 101 is followed by step 102 where the tracking algorithm recognizes lines by a feature-based approach.
  • Step 103 eliminates the points located on lines parallel to the x-axis 50 with the aim of extracting the characteristics relating to the side(s) of vehicles and to keep only the objects having a “vehicle rear signature”.
  • FIG. 18 The estimation of a line based on the covariance matrix using polar coordinate 102 is illustrated in FIG. 18 .
  • This estimation is based on feature extraction.
  • the strength of the feature-based approach lies in its abstraction from data type, origin and amount.
  • line segments will be considered as a basic primitive which later serves to identify and then remove the side of vehicles.
  • Feature extraction is divided into two sub-problems: (i) segmentation to determine which data points contribute to the line model, and (ii) fitting to give an answer as to how these points contribute.
  • is the angle between the x axis and the normal of the line, r ⁇ 0 is the perpendicular distance of the line to the origin; (x, y) is the Cartesian coordinates of a point on the line.
  • the covariance matrix of line parameters is:
  • FIG. 19 shows a state diagram for the 3D real-time detection multi-object tracker.
  • the core of the tracker 91 A is based on a Kalman Filter in all weather and lighting conditions.
  • the observation model 90 is illustrated in FIG. 21 which presents an example method to compute the vehicle position by weighting each 3D observation according to its height amplitude. This method permits to improve the accuracy of the estimated position with respect to using only the x and y Cartesian positions.
  • Step 301 is followed by computing the observation weight depending on the intensity at step 302 .
  • the function 300 normalizes the weight ⁇ n according to the amplitude A n of the observation P n :
  • ⁇ n A n ⁇ ⁇ A n
  • Z k (x obs k ,y obs k ) t is the measurement vector, H the measurement sensitivity matrix, and R k the covariance matrix of W k .
  • the state space model 93 A is based on probabilistic framework where the evolution model is supposed to be linear and the observation model is supposed to be Gaussian noise.
  • FIG. 20 shows a state diagram for 3D real-time detection multi-object joint tracker.
  • the core of 91 B is based on a Kalman Filter which addresses the issue of interacting targets, which cause occlusion issues. When an occlusion is present, 3D data alone can be unreliable, and is not sufficient to detect, at each frame, the object of interest.
  • occlusions can be modeled with a joint state space model 93 B.
  • the multi-object joint tracker includes a multi-object interaction distance which is implemented by including an additional interaction factor in the vehicle position.
  • the state space model 93 B encodes the observations detected in the scene, e.g.
  • the validation gate is the ellipsoid of size N z (dimension of vector) defined such as: ⁇ t ⁇ S ⁇ 1 ⁇
  • Step 400 is followed by step 401 A/B which makes the matching between a blob and a hypothesis. Then, (i) consider all entries as new blobs; (ii) find the corresponding entries to each blob by considering gating intervals around the predicted position of each hypothesis, (iii) choose the nearest entry of each interval as the corresponding final observation of each blob.
  • the tracking algorithm uses a track management module in order to change the number of hypothesis.
  • step 403 uses a Kalman framework to estimate the final position of the vehicle.
  • l[m] s[m/S]*(X 1 (t)[s] ⁇ X 0 (t)[s]) ⁇ (X 1 (x)[m]) ⁇ X 0 (x)[m])+Seg[m]+TH[m]
  • s is the vehicle speed
  • Seg is the length of the detected line
  • TH is a calibration threshold determined from a large dataset.
  • step 500 is followed by step 502 which computes the vehicle height.
  • the vehicle height is estimated during the entry into the sensor field of view. As shown in FIG. 26 , for a known configuration of the detection system, there is a direct geometric relationship between the height of a vehicle 601 and the detection distance 600 .
  • the accuracy 602 is dependent on the half-size of the vertical FOV angle 603 . Height measurement is validated if the accuracy is lower than a threshold.
  • step 502 is followed by step 503 which computes the vehicle width.
  • (y l , x) be leftmost pixel and (y r , x) be the rightmost pixel in the vehicle blob for a given x.
  • FIGS. 25A, 25B and 25C show a result of vehicle classification based on the classification algorithm.
  • the classification result is a heavy vehicle; in FIG. 25B , it is a four-wheeled lightweight vehicle and in FIG. 25C , it is a two-wheeled lightweight vehicle.
  • the information from the detection system is flexible and can be adapted to different schemes of classification.
  • FIG. 25 illustrates graphically the basic elements of the concept of an object-box approach which is detailed below and in FIG. 27 and FIG. 28 .
  • the object-box approach is mainly intended for vehicles because this approach uses the vehicle geometry in a LEDDAR image.
  • the vehicles are represented by a 3D rectangular box of detected length, width and height.
  • the 3D size of the rectangular box will vary depending on the detections in the FOV.
  • FIGS. 27A, 27B, 27C and 27D show top view frames of a vehicle detected by the LEDDAR sensor.
  • FIGS. 28A, 28B, 28C and 28D show corresponding side view frames of the vehicle of FIG. 27 .
  • FIGS. 27A, 27B, 27C, 27D and FIGS. 28A, 28B, 28C, 28D show the changing 3D size of the rectangle 701 for four example positions of a vehicle 702 in the 3D sensor FOV 703 .
  • a vehicle 702 enters the 3D sensor FOV 703 two detections are made on the side of the vehicle (see FIG. 27A ) and one detection is made for the top of the vehicle (see FIG. 28A ).
  • H s is the sensor height 704
  • dist is the distance of the detected vehicle
  • is sensor pitch
  • FIG. 27B and FIG. 28B represent detections when the vehicle is three-fourths of the way in the detection FOV. Eight side detections are apparent on FIG. 27B and one top detection is apparent on FIG. 28B .
  • the dimensions of the 3D rectangle are calculated as follows:
  • O l (k) and O h (k) are respectively the current length and height value at time k.
  • FIG. 27C and FIG. 28C represent detections when the back of the vehicle begins to enter in the detection FOV. Eight side detections and two rear detections are apparent on FIG. 27C while one detection is apparent on FIG. 28C .
  • the points of the vertical segment representing the rear and/or the top of the vehicle are clockwise angle sorted, so L 4 is the point with the smallest angle and L 3 is the segment-point with the largest angle.
  • O l (k), O h (k) and O w (k) are respectively the current length, height and width value at time k.
  • FIG. 27D and FIG. 28D represent detections when the back of the vehicle is fully in the detection FOV. Six side detections and four rear detections are apparent on FIG. 27D while one detection is apparent on FIG. 28D .
  • O lm (k) is the current width at time k and ⁇ is the filtering rate.
  • the size of the vehicle can then be determined fully.
  • the segmentation algorithm 800 based on a 3D bounding box for selection of the relevant measures is illustrated in FIG. 29 .
  • the first three steps are identical to that of FIG. 17 . If step 120 finds horizontal lines, then step 120 is followed by step 121 . As explained above, the points of a segment are clockwise angle sorted with L 2 , the smallest angle and L 1 the largest angle. This segment length is given by L 2 ⁇ L 1 . Otherwise, the next step 123 initializes the 3D bounding box with a default vehicle length.
  • Step 121 is followed by step 122 which considers that two segments have a common corner if there is a point of intersection P i between the two segments with
  • the vehicle 130 is moving at a speed of 60 m/s along a straight line in lane 3 .
  • the PCRB was applied.
  • the multipurpose traffic detection system uses a high-resolution image sensor or more than one image sensor with lower resolution.
  • the control and processing unit has to process an image stitching by combining multiple images with different FOVs with some overlapping sections in order to produce a high-resolution image.
  • the system can determine exact overlaps between images sensors and produce seamless results by controlling and synchronizing the integration time of each image sensor and the illumination timing and analyzing overlap sections.
  • Infrared and color image sensors can be used with optical filters.
  • a NIR flash is not visible to the human eye and does not blind drivers, so it can be used at any time of the day and night.
  • Image sensors can use electronic shutters (global or rolling) or mechanical shutters.
  • rolling shutters compensation for the distortions of fast-moving objects (skew effect) can be processed based on the information of the position and the speed of the vehicle.
  • Other controls of the image sensor like Gamma and gain control can be used to improve the quality of the image in different contexts of illumination.
  • FIG. 33A is a photograph showing an example snapshot taken by the image sensor at night without any light. This image is completely dark.
  • FIG. 33B shows the same scene with infrared light. Two vehicles can be seen but the license plates are not readable even when zooming in as seen in FIG. 33C .
  • the license plate acts as a retro-reflector and saturates the image sensing.
  • FIGS. 34A and 34B use the same lighting with a lower integration time. The vehicle is less clear but the image shows some part of the license plate becoming less saturated.
  • FIGS. 34C and 34D decrease a little more the integration time and produce a readable license plate.
  • HDR high dynamic range
  • the system can use Automatic License Plate Recognition (ALPR), based on Optical Character Recognition (OCR) technology, to identify vehicle license plates.
  • ALPR Automatic License Plate Recognition
  • OCR Optical Character Recognition
  • the multipurpose traffic detection system can be used day or night, in good or bad weather condition, and also offers the possibility of providing weather information like the presence of fog or snowing conditions.
  • Fog and snow have an impact on the reflection of the radiated light pulses of the protective window.
  • the peak amplitude of the first pulse exhibits sizable time fluctuations, by a factor that may reach 2 to 3 when compared to its mean peak amplitude level.
  • the width of the first pulse also shows time fluctuations during these adverse weather conditions, but with a reduced factor, for example, by about 10 to 50%.
  • the peak amplitude of the first pulse visible in the waveforms generally shows faster time fluctuations while the fluctuations of the pulse width are less intense.
  • a long-lasting change in the peak amplitude of the first pulse can be simply due to the presence of dirt or snow deposited on the exterior surface of the protective window.
  • FIG. 35 shows an example image taken with infrared illumination with the overlay (dashed lines) representing the perimeter of the 16 contiguous detection zones of the 3DOR.
  • Apparent on FIG. 35 are high intensity spots 140 coming from a section of the vehicle having a high retro-reflectivity characteristic.
  • Such sections having a high retro-reflectivity characteristic include the license plate, retro-reflectors installed one the car and lighting modules that can include retro-reflectors.
  • An object with retro-reflectivity characteristic reflects light back to its source with minimum scattering. The return signal can be as much as 100 times stronger than a signal coming from a surface with Lambertian reflectance. This retro-reflectivity characteristic has the same kind of impact on the 3DOR.
  • Each 3D channel detecting a retro-reflector at a certain distance in its FOV will acquire a waveform with high peak amplitude at the distance of the retro-reflector.
  • the numbers at the bottom of the overlay represent the distance measured by the multipurpose traffic detection system in each channel which contains a high peak in its waveform. Then, with a good image registration between the 2D image sensor and the 3D sensor, the 2D information (spot with high intensity) can be correlated with the 3D information (high amplitude at a certain distance).
  • This link between 2D images and 3D detection ensures a match between the identification data based on reading license plates and measurements of position and velocity from the 3D sensor.
  • the license plate identification process can also be used as a second alternative to determine the speed of the vehicle with lower accuracy but useful as a validation or confirmation.
  • the progression of the vehicle in the detection zone can be estimated and used to confirm the measured displacement.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Traffic Control Systems (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, comprising: providing a 3D optical emitter; providing a 3D optical receiver with a wide and deep field of view; driving the 3D optical emitter into emitting short light pulses; receiving a reflection/backscatter of the emitted light, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles, a position of at least part of each vehicle and a time at which the position is detected; assigning a unique identifier to each vehicle; repeating the steps of driving, receiving, acquiring and detecting, at a predetermined frequency; tracking and recording an updated position of each vehicle and an updated time at which the updated position is detected.

Description

Notice: More than one reissue application has been filed for the reissue of U.S. Pat. No. 9,235,988. The reissue applications are application Ser. No. 15/867,995 (the present application) filed Jan. 18, 2018 and Ser. No. 17/412,092 filed Aug. 25, 2021.
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a reissue application based on U.S. application Ser. No. 14/115,244 filed on Nov. 1, 2013, which previously issued as U.S. Pat. No. 9,235,998, which is a national stage entry of PCT/IB2013/051667 filed Mar. 1, 2013, which claimed the benefit of provisional application 61/605,896 filed on Mar. 2, 2012.
TECHNICAL FIELD
The present invention relates to a system and method for traffic detection and more particularly to an optical system that detects the presence, location, lane position, direction and speed of vehicles in a traffic zone using an active three-dimensional sensor based on the time-of-flight ranging principle and an image sensor.
BACKGROUND OF THE ART
Growth in transportation demand has a major impact on traffic congestion and safety. To enhance the on-road safety and efficiency, major investments in transport infrastructures, including capital, operation and maintenance, are made all over the world. Intelligent systems collecting and disseminating real time traffic information is a key element for the optimization of traffic management.
Traffic monitoring can consist in different activities such as detecting the presence of a vehicle in a specific zone, counting the number of vehicles (volume), determining the lane position, classifying each vehicle, determining the direction of travel, estimating the occupancy and determining the speed.
Other traffic surveillance applications such as electronic toll collection and traffic enforcement require the same kind of information with a very high level of reliability.
In the United States, the FHWA has defined a vehicle classification based on 13 categories of vehicles from motorcycles, passenger cars, buses, two-axle-six-tire-single unit trucks, and up to a seven or more axle multi-trailer trucks classes. Several alternative classification schemes are possible. Often, the aggregation of the FHWA 13 classes is split into 3 or 4 classes. Other countries have their own way to define a classification for vehicles.
In the case of speed infringement, determining the position and the lane, measuring accurately the speed of a specific vehicle in a multi-lane high-density highway, and associating this information without any ambiguity with the vehicle identified using an Automatic License Plate Recognition (ALPR) system is quite challenging.
A red light enforcement system has comparable requirements. There is a need for an automatic red light enforcement system but the high reliability required for this application is also challenging. It implies the detection of vehicles at specific locations, the tracking of each of these vehicles in dense traffic at the intersection, the identification of each of these vehicles with the ALPR system, the confirmation of a red light violation by a specific vehicle and the collection of all information to support the issuance of a traffic violation ticket to the registered owner of the vehicle without any ambiguity.
Different kinds of detectors are used to collect data for these applications. Intrusive detectors such as inductive loop detectors are still common for detecting the presence of vehicles but have some disadvantages such as lengthy disruption to the traffic flow during installation and maintenance, inflexibility and inability to track a vehicle. Cameras with video processing have some drawbacks notably for speed measurement.
Radar technology is known to perform well for speed measurement but has some limitations in terms of lateral resolution making difficult the association between a speed measurement and the identification of a specific vehicle in dense traffic, for example, at an intersection. Radar technology presents difficulties in the correlation of a specific speed measurement to a specific vehicle when two or more vehicles traveling at different speeds simultaneously enter into the measurement beam. This limitation has an impact for speed enforcement applications. In some countries, legislation requires that ambiguous situations simply be discarded to reduce errors in the process. Installation of radar technology for speed enforcement is demanding because it requires adjusting the angle of the axis of the main lobe of emission in both the horizontal and vertical directions with respect to the axis of the road, with accuracy typically less than one-half degree angle to limit the cosine effect.
Thus, there is a need for a method and system for reliable multipurpose traffic detection for traffic management and enforcement applications.
SUMMARY
According to one broad aspect of the present invention, there is provided a method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment. The method comprises providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in the environment; providing a 3D optical receiver oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channels in the field of view; driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform; receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at the 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles in the 3D detection zone, a position of at least part of each the vehicle in the 3D detection zone and a time at which the position is detected; assigning a unique identifier to each vehicle of the plurality of vehicles detected; repeating the steps of driving, receiving, acquiring and detecting, at a predetermined frequency; at each instance of the repeating step, tracking and recording an updated position of each vehicle of the plurality of vehicles detected and an updated time at which the updated position is detected, with the unique identifier.
In one embodiment, the traffic control environment is at least one of a traffic management environment and a traffic enforcement environment.
In one embodiment, detecting the presence includes extracting observations in the individual digital full-waveform LIDAR trace; using the location for the observations to remove observations coming from a surrounding environment; extracting lines using an estimate line and a covariance matrix using polar coordinates; removing observations located on lines parallel to the x axis.
In one embodiment, detecting the presence includes extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations; finding at least one blob in the observations; computing an observation weight depending on the intensity of the observations in the blob; computing a blob gravity center based on the weight and a position of the observations in the blob.
In one embodiment, the method further comprises setting at least one trigger line location and recording trigger line trespassing data with the unique identifier.
In one embodiment, the method further comprises setting the trigger line location relative to a visible landmark in the environment.
In one embodiment, detecting the time at which the position is detected includes assigning a timestamp for the detecting the presence and wherein the timestamp is adapted to be synchronized with an external controller.
In one embodiment, the method further comprises obtaining a classification for each detected vehicles using a plurality of detections in the 3D detection zone caused by the same vehicle.
In one embodiment, detecting the presence further comprises detecting a presence of a pedestrian in the environment.
In one embodiment, the part of the vehicle is one of a front, a side and a rear of the vehicle.
In one embodiment, emitting short light pulses includes emitting short light pulses of a duration of less than 50 ns.
In one embodiment, the 3D optical emitter is at least one of an infrared LED source, a visible-light LED source and a laser.
In one embodiment, providing the 3D optical receiver to have a wide and deep field of view includes providing the 3D optical receiver to have a horizontal field of view angle of at least 20° and a vertical field of view angle of at least 4°.
In one embodiment, the method further comprises determining and recording a speed for each the vehicle using the position and the updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the updated time of the updated position, with the unique identifier.
In one embodiment, the method further comprises using a Kalman filter to determine an accuracy for the speed to validate the speed; comparing the accuracy to a predetermined accuracy threshold; if the accuracy is lower than the predetermined accuracy threshold, rejecting the speed.
In one embodiment, the method further comprises retrieving a speed limit and identifying a speed limit infraction by comparing the speed recorded for each the vehicle to the speed limit.
In one embodiment, the method further comprises providing a 2D optical receiver, wherein the 2D optical receiver being an image sensor adapted to provide images of the 2D detection zone; driving the 2D optical receiver to capture a 2D image; using image registration to correlate corresponding locations between the 2D image and the detection channels; extracting vehicle identification data from the 2D image at a location corresponding to the location for the detected vehicle; assigning the vehicle identification data to the unique identifier.
In one embodiment, the vehicle identification data is at least one of a picture of the vehicle and a license plate alphanumerical code present on the vehicle.
In one embodiment, the vehicle identification data includes the 2D image showing a traffic violation.
In one embodiment, the method further comprises extracting at least one of a size of characters on the license plate and a size of the license plate and comparing one of the size among different instances of the repeating to determine an approximate speed value.
In one embodiment, the method further comprises providing a 2D illumination source oriented to allow illumination of a 2D detection zone in the 3D detection zone and driving the 2D illumination source to emit pulses to illuminate the 2D detection zone and synchronizing the driving the 2D optical receiver to capture images with the driving the 2D illumination source to emit pulses to allow capture of the images during the illumination.
In one embodiment, driving the 2D illumination source includes driving the 2D illumination source to emit pulses of a duration between 10 μs and 10 ms.
In one embodiment, the 2D illumination source is at least one of a visible light LED source, an infrared LED light source and laser.
In one embodiment, the 3D optical emitter and the 2D illumination source are provided by a common infrared LED light source.
In one embodiment, the vehicle identification data is at least two areas of high retroreflectivity apparent on the images, the detecting a presence includes extracting observations in the individual digital signals and intensity data for the observations, the method further comprising correlating locations for the areas of high retroreflectivity and high intensity data locations in the observations, wherein each the area of high retroreflectivity is created from one of a retroreflective license plate, a retro-reflector affixed on a vehicle and a retro-reflective lighting module provided on a vehicle.
In one embodiment, the method further comprises combining multiples ones of the captured images into a combined image with the vehicle and the vehicle identification data apparent.
According to another broad aspect of the present invention, there is provided a system for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the system comprising: a 3D optical emitter provided at an installation height and oriented to allow illumination of a 3D detection zone in the environment; a 3D optical receiver provided and oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channels in the field of view; a controller for driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform; the 3D optical receiver receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone, thereby acquiring an individual digital full-waveform LIDAR trace for each channel of the 3D optical receiver; a processor for detecting a presence of a plurality of vehicles in the 3D detection zone using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a position of at least part of each the vehicle in the 3D detection zone, recording a time at which the position is detected, assigning a unique identifier to each vehicle of the plurality of vehicles detected and tracking and recording an updated position of each vehicle of the plurality of vehicles detected and an updated time at which the updated position is detected, with the unique identifier.
In one embodiment, the processor is further for determining and recording a speed for each the vehicle using the position and the updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the updated time of the updated position, with the unique identifier.
In one embodiment, the system further comprises a 2D optical receiver, wherein the 2D optical receiver is an image sensor adapted to provide images of the 2D detection zone; and a driver for driving the 2D optical receiver to capture a 2D image; the processor being further adapted for using image registration to correlate corresponding locations between the 2D image and the detection channels and extracting vehicle identification data from the 2D image at a location corresponding to the location for the detected vehicle; and assigning the vehicle identification data to the unique identifier.
In one embodiment, the system further comprises a 2D illumination source provided and oriented to allow illumination of a 2D detection zone in the 3D detection zone; a source driver for driving the 2D illumination source to emit pulses; a synchronization module for synchronizing the source driver and the driver to allow capture of the images while the 2D detection zone is illuminated.
According to another broad aspect of the present invention, there is provided a method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, comprising: providing a 3D optical emitter; providing a 3D optical receiver with a wide and deep field of view; driving the 3D optical emitter into emitting short light pulses; receiving a reflection/backscatter of the emitted light, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles, a position of at least part of each vehicle and a time at which the position is detected; assigning a unique identifier to each vehicle; repeating the steps of driving, receiving, acquiring and detecting, at a predetermined frequency; tracking and recording an updated position of each vehicle and an updated time at which the updated position is detected.
Throughout this specification, the term “object” is intended to include a moving object and a stationary object. For example, it can be a vehicle, an environmental particle, a person, a pedestrian, a passenger, an animal, a gas, a liquid, a particle such as dust, a pavement, a wall, a post, a sidewalk, a ground surface, a tree, etc.
Throughout this specification, the term “vehicle” is intended to include any movable means of transportation for cargo, humans and animals, not necessarily restricted to ground transportation, including wheeled and unwheeled vehicles, such as, for example, a truck, a bus, a boat, a subway car, a train wagon, an aerial tramway car, a ski lift, a plane, a car, a motorcycle, a tricycle, a bicycle, a Segway™, a carriage, a wheelbarrow, a stroller, etc.
Throughout this specification, the term “environmental particle” is intended to include any particle detectable in the air or on the ground and which can be caused by an environmental, chemical or natural phenomenon or by human intervention. It includes fog, water, rain, liquid, dust, dirt, vapor, snow, smoke, gas, smog, pollution, black ice, hail, etc.
Throughout this specification, the term “red light” is intended to mean a traffic light (traffic signal, traffic lamp or signal light) which is currently signaling users of a road, at a road intersection, that they do not have the right of way into the intersection and that they should stop before entering the intersection. Another color and/or symbol could be used to signal the same information to the user depending on the jurisdiction.
Throughout this specification, the term “green light” is intended to mean a traffic light (traffic signal, traffic lamp or signal light) which is currently signaling users of a road, at a road intersection, that they have the right of way into the intersection and that they should enter the intersection if it is safe to do so. Another color and/or symbol could be used to signal the same information to the user depending on the jurisdiction.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a better understanding of the main aspects of the system and method and are incorporated in and constitute a part of this specification, illustrate different example embodiments. The accompanying drawings are not intended to be drawn to scale. In the drawings:
FIG. 1 is a functional bloc diagram of an example of the multipurpose traffic detection system showing its main components and the way they are interconnected;
FIG. 2 is an example installation of the traffic detection system on the side of a 3-lane highway;
FIG. 3 shows an example installation of the traffic detection system on a gantry;
FIG. 4 shows the impact on the depth of a detection zone of the height of installation of the system;
FIG. 5 shows an example casing for the multipurpose traffic detector;
FIG. 6 shows a top view of the detection zone on a 3-lane highway;
FIG. 7 shows a top view of the detection zone in a red light enforcement application;
FIGS. 8A and 8B are photographs showing example snapshots taken by the image sensor with the overlay of the 3D sensor displaying a vehicle in the detected zone with distance measurements;
FIG. 9A is a photograph showing an example snapshot taken by the image sensor with the overlay of the 3D sensor at an intersection for red light enforcement application and FIG. 9B is a graph of data acquired by the detection system showing the range of detection of vehicles on 3 lanes in Cartesian coordinates;
FIG. 10 is a top view of an example road side installation with the tracking system being installed next to a one-directional three-lane highway and for which the detection zone is apparent and covers, at least partly, each of the lanes, all vehicles traveling in the same direction;
FIG. 11 is a top view of the example installation of FIG. 10 on which four vehicle detections are visible in some of the 16 separate channels with simultaneous acquisition capability;
FIG. 12 is a top view of the example installation of FIG. 10 on which a detection is visible between two trigger lines;
FIG. 13 includes FIGS. 13A, 13B, 13C, 13D, 13E and 13F, in which FIGS. 13A, 13C and 13E are photographs which show a few frames of vehicle tracking when vehicles arrive at an intersection with a red light and FIGS. 13B, 13D, and 13F show a graph of data acquired by the detection system for each corresponding frame;
FIG. 14 includes FIGS. 14A, 14B, 14C, 14D, 14E and 14F, in which FIGS. 14A, 14C and 14E are photographs which show a few frames of vehicle tracking when vehicles depart the intersection of FIG. 13 at the green light and FIGS. 14B, 14D, and 14F show a graph of data acquired by the detection system for each corresponding frame;
FIG. 15 is a flowchart illustrating an example method for tracking several vehicles based on a space-based tracking disjoint;
FIG. 16 is a flowchart illustrating an example method for tracking several vehicles for a red-light enforcement application, this algorithm uses a space-based tracking joint;
FIG. 17 is a flowchart illustrating the selection of appropriate measures among the detections;
FIG. 18 shows an example segment extraction line for a long vehicle;
FIG. 19 is a state diagram illustrating the tracking system used without a traffic light state;
FIG. 20 is a state diagram illustrating the tracking system used with a traffic light state;
FIG. 21 is a flowchart showing example steps performed to compute the vehicle position;
FIG. 22 is a flowchart showing example steps performed for object tracking without a traffic light state;
FIG. 23 is a flowchart showing example steps performed for object tracking with a traffic light state;
FIG. 24 is a flowchart illustrating an example classification process;
FIG. 25 includes FIGS. 25A, 25B and 25C which illustrate the relationship between the detections of a vehicle and its geometric features of width and length;
FIG. 26 illustrates the direct geometric relationship between height of the vehicle and distance of vehicle detection;
FIG. 27 includes FIGS. 27A, 27B, 27C and 27D which show top view frames of a vehicle detected by the LEDDAR sensor;
FIG. 28 includes FIGS. 28A, 28B, 28C and 28D which show corresponding side view frames of the vehicle of FIG. 27;
FIG. 29 is a flowchart illustrating an example segmentation algorithm based on a 3D bounding box;
FIG. 30 is a top view of an example scenario used for the analysis of Posterior Cramer-Rao lower bound;
FIG. 31 is a graph showing theoretical performance of the tracking algorithm given by the PCRB;
FIG. 32 includes FIGS. 32A, 32B, 32C and 32D in which FIG. 32A is a photograph showing an example snapshot taken by the image sensor during the day, FIGS. 32B, 32C and 32D are photographs showing a zoom in on license plates in the snapshot of FIG. 32A;
FIG. 33 includes FIGS. 33A, 33B and 33C in which FIG. 33A is a photograph showing an example snapshot taken by the image sensor at night without any light, FIG. 33B is a photograph showing the same scene as FIG. 33A taken by the image sensor at night with an infrared light illumination, FIG. 33C is a photograph showing a zoom in on a license plate extracted from the image of FIG. 33B;
FIG. 34 includes FIGS. 34A, 34B, 34C and 34D in which FIG. 34A is a photograph showing another example snapshot taken by the image sensor at night with infrared light, FIG. 34B is a photograph showing a zoom in on a license plate extracted from the image of FIG. 34A, FIG. 34C is a photograph showing an example snapshot taken by the image sensor with a shorter integration time at night with infrared light, FIG. 34D is a photograph showing a zoom in on a license plate extracted from the image of FIG. 34C; and
FIG. 35 is a photograph showing an example panoramic snapshot taken by the image sensor using infrared illumination in which two vehicles are present in the detection zone and on which the overlay of the 3D sensor is shown with dashed lines.
DETAILED DESCRIPTION
Description of the Multipurpose Traffic Detection System
Reference will now be made in detail to example embodiments. The system and method may however, be embodied in many different forms and should not be construed as limited to the example embodiments set forth in the following description.
The functionalities of the various components integrated in an example multipurpose traffic detection system 10 can be better understood by referring to the functional block diagram shown in FIG. 1. The 3D Optical Emitter 12 (3DOE) emits short pulses of light, for example of a length less than 50 ns, within a predetermined zone. In the example embodiment, the 3DOE 12 is an IR LED illumination source determining a Field-of-Illumination FOI3D covering the 3D detection zone FOV3D. The optical source of the 3DOE can also be based on Laser technology. The horizontal angles of the FOI3D and FOV3D are wide enough to cover at least one lane. For example, a system with a horizontal FOI/FOV of 35° would be able to cover 3 lanes, each lane having a width of 3.5 m, when installed at 15 m from the side of the detection zone.
An example mounting configuration of the multipurpose traffic detection system 10 can be seen in FIG. 2, which depicts a schematic view of a roadway with 3 lanes being shown. The traffic detection system 10 is shown mounted on a pole 27 with an orientation towards traffic direction. Pole 27 can be a new dedicated road infrastructure for the sensor installation or an already existing road infrastructure streetlight assembly or other types of infrastructures like gantries or buildings. This exemplary roadway comprises three adjacent traffic lanes for vehicles. The traffic detection system is intended to detect any type of objects that may be present within the predetermined 3D detection zone.
The mounting height of the traffic detection system 10 is, for example, between 1 to 10 m with a lateral distance from the nearest traffic lane of, for example, between 1 to 5 m. In FIG. 2, three vehicles travelling in the same direction on the traffic lanes enter in the 3D detection zone. When the vehicles reach the 3D detection zone, the multipurpose traffic detection system is used for detection, localization, classification and measurement of the speed of the vehicles through the zone. The system can also be installed over the roadway on a gantry as shown in FIG. 3. The system can also detect vehicles traveling in opposite directions.
The detection system can be installed at different heights, from the ground up to 10 m. FIG. 4 shows the impact of the installation height on the longitudinal length of the detection zone. With a fixed starting distance of detection, the longitudinal length of the detection zone will be shorter with a system installed higher. The vertical angles of the FOI3D and FOV3D have to be wide enough to detect and track vehicles over several meters, for example over at least 8 m. For example, a system installed at a height of 3.5 m with a vertical FOI/FOV of 6° and a detection zone beginning at 15 m from the detector will have a detection zone depth of approximately 13 m.
Referring back to FIG. 1, part of the light diffusively reflected by the vehicles and objects in the FOI3D is directed towards the collecting aperture of the 3D Optical Receiver 14 (3DOR) for its 3D optical detection and subsequent conversion into digital waveforms. To be detected, an object should appear within the FOV3D of the 3DOR, which is defined by its optics as well as by the dimensions of its optically sensitive device. The 3DOR is composed of one or more optical lenses, multichannel optical detectors, for example photodiode arrays, an analog frontend and analog-to-digital converter. Usually, the channels are digitalized in parallel and the system implements a full-waveform signal processing of the signal waveforms generated by the plurality of optical detection channels.
The multipurpose traffic detection system provides a good accuracy in terms of lateral resolution and is less dependent on the angle of installation than Radar technology.
In FIG. 1, the 2D Optical Receiver 16 (2DOR) is at least one image sensor, for example a CMOS or CCD (including front end and AD conversion) which provides images of the portion of the roadway area that encompasses or overlaps at least a section of the FOI3D of the 3DOE and the FOV3D of the 3DOR. The 2DOR will be used during installation, to transmit video data, and, for some applications, to help identify vehicles using, for example, Automatic License Plate Recognition (ALPR) techniques. For applications requiring vehicle identification, the requirement for the image sensor in terms of resolution is high. An external image sensor or camera can also be used for this function. The average size of a character on a license plate is between 50 mm to 80 mm. It takes at least 16 pixels per character (height) to obtain good results with an Optical Character Recognition (OCR) processing within an ALPR system. Based on that criterion, the identification of a license plate of a vehicle circulating on a 3-lane highway (3.5 m×3 m) requires an image sensor with a least 5 Mpixels (2.5K×2K). High resolution image sensors are expensive. One way to reduce the cost is to use at least two image sensors each with lower resolution and to combine the information coming from both images using image stitching techniques. The synchronization, acquisition and image processing are performed by Control and processing unit 22.
The 2D Illumination 18 (2DI) is an optical source emitting infrared and/or visible light. The 2DI can be embedded in the sensor enclosure or can be an external module. In one example embodiment, the optical source of 2DI 18 is at least one LED. LEDs are efficient and the FOI can be optimized with optical collimators and diffusers. The pulse width of 2DOE can be in the range of 10 μs to 10 ms and can be synchronized with the image capture (integration time) of the image sensor(s). For vehicles traveling at high speed, the integration time can be in the range of 500 μs and less. A vehicle moving at 150 km/h will travel 21 cm in 500 μs.
A single set of infrared LEDs can be used for both the 3DOE and 2DOE. Very high-short intensity pulses (for example <50 ns) for 3D detection can be mixed with longer pulses (for example 10 μs to 10 ms) for 2D sensor(s). The LEDs can have a wavelength between 800 and 1000 μm, for example.
Source Driver Electronics (SDE) 20 uses dedicated electronics for driving the 3DOE 12 with current pulses having peak amplitude and duration suitable for effective implementation of the optical ranging principle on which the operation of the multipurpose traffic detection system is based. A pulsed voltage trig signal forwarded by the Control and Processing Unit 22 commands the generation of each current pulse by the drive electronics. The operating conditions and performance requirements for the multipurpose traffic detection system call for the emission of short optical pulses having a duration in the range of 5 to 50 ns, for example. Depending on the repetition rate at which the pulses are emitted, the duty cycle (relative ON time) of the optical emission can be as low as 0.1%. In order to get the desired peak optical output power for the radiated light pulses, any lowering of the peak drive level of the LEDs or Laser can be compensated by mounting additional LED or Laser sources in the 3DOE 12 and appropriately duplicating their drive electronics.
The SDE 20 can also drive 2D illumination with current pulses having peak amplitude and duration suitable for effective illumination of the scene for the 2DOR 16. A pulsed voltage trig signal forwarded by the Control and Processing Unit 22 commands the generation of each current pulse by the drive electronics. The operating conditions and performance requirements for the multipurpose traffic detection system call for the emission of 2D optical pulses having a duration in the range of 10 μs to 10 ms, for example.
The SDE 20 can control and receive information from 3DOE and 2D illumination about the intensity of the current pulse, LEDs/Laser temperature, etc.
All of these modules exchange data and receive commands and signals from the control and processing unit 22. The Control and processing unit 22 can include digital logic (for example by a Field-Programmable Gated Array (FPGA)) for pre-processing the 3D raw data and for the synchronization and control, a memory, and a processing unit. The processing unit can be a digital signal processing (DSP) unit, a microcontroller or an embarked personal computer (PC) board as will be readily understood.
The primary objective of the 3D full-waveform processing is to detect, within a prescribed minimum detection probability, the presence of vehicles in a lane that is mapped to a number of adjacent detection channels. Because of the usual optical reflection characteristics of the vehicle bodies and of various constraints that limit the performances of the modules implemented in a traffic detection system, the optical return signals captured by the 3DOR are optimized by acquisition shifting techniques, accumulation techniques and filtering and correlation technique to enhance the signal-to-noise ratio (SNR) of the useful signal echoes and detect a digital replica of the pulse emitted by the 3DPE. The properties (peak amplitude, shape, time/distance location) of the useful features present in the waveforms should remain ideally unchanged during the time period required to capture a complete set of waveforms that will be averaged. This condition may cause issues when attempting to detect vehicles that move rapidly, this situation leading to signal echoes that drift more or less appreciably from waveform to waveform. The detrimental impacts of this situation can be alleviated by designing the traffic detection system so that it radiates light pulses at a high repetition rate (e.g., in the tens to hundreds of kHz range). Such high repetition rates will enable the capture of a very large number of waveforms during a time interval sufficiently short to keep the optical echoes associated to a moving vehicle stationary. Detection information on each channel can then be upgraded, for example between a few tens to a few hundred times per second. For example, with a multipurpose traffic detection system using a frame rate at 200 Hz, a car at 250 km/h would have moved forward by 35 cm between each frame.
The Control and processing unit 22 has numerous functions in the operation of the multipurpose traffic detection system, one of these being the calibration of the system. This calibration process can be done by connecting a remote computer to the Control and processing unit 22 and communicating using a Power management and data Interface 24.
During normal operation of the multipurpose traffic detection system, Power management and data Interface 24 receives information from the external controller (including parameters like a speed limit) and also allows the Control and processing unit 22 to send data. The data sent can be related to the detection of each vehicle and can comprise information such as an accurate timestamp of the detection time synchronized with the external controller, a unique identifier (ID number), the lane and position of the vehicle (lateral and longitudinal) for each trigger event, the position of the vehicle in an image, video streaming, identification by ALPR, speed, classification, weather information, etc., to the external controller.
In another embodiment, part of the process and algorithms can be integrated in the external controller which receives the raw data from the Control and processing unit by the Power Management and Interface.
Several types of interfaces can be used to communicate with the external controller: Ethernet, RS-485, wireless link, etc. Power over Ethernet (PoE) may be used for its simplicity of connection including power, data and distance (up to 100 m).
The data information can also be stored in memory and retrieved later.
Power management and data Interface 24 can also send electrical trigger signals to synchronize events like the detection of the front or the rear of a vehicle at a specific position to other devices like an external camera, an external illuminator or other interface and external controller.
The Power Supply Management and Data Interface 24 can also be useful in transmitting images and videos to an external system or network to allow a remote operator to monitor different traffic events (ex.: accident, congestion, etc.). Video compression (ex.: MPEG) can be done by a processor to limit the bandwidth required for the video transmission.
The four optical modules can be rigidly secured to the attachment surface of an actuator assembly (not shown). The modules can then pivot in a controlled manner about up to three orthogonal axes to allow a precise alignment of their common line of sight after the multipurpose traffic detection unit has been installed in place and aligned in a coarse manner. The fine-tuning of the orientation of the line of sight is, for example, performed remotely by an operator via a computer device connected to the multipurpose traffic detection system, for example through PoE or a wireless data link.
FIG. 1 also shows a functional bloc labeled Sensors 26 for measuring different parameters. The internal temperature in the system enclosure can be monitored with a temperature sensor which can be used to control a heating/cooling device, not shown. The current orientation of the system can be monitored using an inclinometer/compass assembly. Such information may be useful for timely detection of the line of sight that may become misaligned. The sensor suite may also include an accelerometer for monitoring in real-time the vibration level to which the system is submitted to as well as a global positioning system (GPS) unit for real-time tracking of the location of the system and/or for having access to a real-time clock.
FIG. 5 shows an example casing with a window 28 for the multipurpose traffic detection system. The casing can house a more or less complete suite of monitoring instruments, each of them forwarding its output data signals to the control and processing unit for further processing or relay. In other configurations of the casing, lateral sections can be integrated to protect the window from the road dust.
Use, Set-Up, Basic Principles, Features and Applications
FIG. 6 shows a top view of an installation of the multipurpose detection system. The multichannel 3DOR detects vehicles present within a two-dimensional detection zone, the active nature of the traffic detection system provides an optical ranging capability that enables measurement of the instantaneous distances of the detected vehicles from the system. This optical ranging capability is implemented via the emission of light in the form of very brief pulses along with the recordal of the time it takes to the pulses to travel from the system to the vehicle and then to return to the system. Those skilled in the art will readily recognize that the optical ranging is performed via the so-called time-of-flight (TOF) principle, of widespread use in optical rangefinder devices. However, most optical rangefinders rely on analog peak detection of the light pulse signal reflected from a remote object followed by its comparison with a predetermined amplitude threshold level. In the present system, the traffic detection system numerically processes the signal waveform acquired for a certain period of time after the emission of a light pulse. The traffic detection system can therefore be categorized as a full-waveform LIDAR (Light Detection and Ranging) instrument. The system analyses the detection and distance measurements on several 3D channels and is able to track several vehicles at the same time in the detection zone. The system can determine the lane position, the distance from the detector and the speed, for each individual vehicle.
As can be seen in FIG. 6, the detection system 10 is installed at a reference line 60, has a wide FOV 61, has a large and wide detection and tracking zone 62 covering several lanes and several meters of depth and detects several vehicles on several lanes in a roadway.
The detection system can be configured with two trigger positions. The first trigger 63 is set in the first section of the detection zone and the second trigger 64 is set a few meters away, in this case close to the end of the detection zone. In this example, a first vehicle 65 was detected when entering the detection zone on lane 1, was tracked, was detected at the position of the first trigger 63, was continuously tracked and is now being detected at the position of the second trigger 64. Information about its lane position, speed, etc., can be constantly sent or can be sent only when the vehicle reaches pre-established trigger positions. A second vehicle 66 was detected when entering the detection zone on lane 2, was tracked, was detected at the position of the first trigger 63, and is continuously tracked until it reaches the position of the second trigger 64. A third vehicle 67 was detected when entering the detection zone on lane 3, was tracked, is detected at the position of the first trigger 63, will continue to be tracked and will reach the position of the second trigger 64.
The detection system has the capability to identify, track and send information about multiple vehicles at the same time and its multiple receiver channels greatly reduce the cosine effect for speed measurement.
The system can capture several snapshots using the 2DOR at different levels of illumination using the 2DOE. Information about each vehicle (date/hour of an event, speed, position, photographs and identification based on Automatic License Plate Recognition) can be sent to the external controller. This is useful for applications like traffic management (for vehicle detection, volume, occupancy, speed measurement and classification), speed enforcement, red light enforcement, etc. The system can be permanently or temporarily installed. It can even be a mobile system, for example a system installed on a vehicle.
An example of configuration for Red Light Enforcement is shown in FIG. 7. The capability of the system to detect, track, determine the lane position, measure the speed and take photographs (or videos) for each vehicle several meters away from the stop bar has great value for this application. Red light enforcement applications require the detection of a vehicle entering an intersection when the traffic light is at the red state and the automatic capture of several images of the vehicle as it crosses the stop bar and runs the red light. The detection system needs to provide evidence that a violation occurred without ambiguity.
For most applications, detection rates should be high, for example of the order of 95% and more (without occlusion), and false detections should occur only very rarely. Images and information about the date and time of the infraction will allow the authorities to transmit a traffic infraction ticket. Identification of the driver and/or owner of the vehicle is generally made by the authorities using the information from the license plate of the vehicle. Since speed information is available, speed infractions can also be detected when the traffic light is green. As will be readily understood, the detection system can also be used for other detection applications such as stop line crossing and railway crossing.
In FIG. 7, the detection system is installed on the side of the road at an example distance of 15 to 25 m from the stop bar 70. The detection and tracking zone 71 starts few meters before the stop bar 70 and covers several meters after the bar, allowing a large and deep zone for detecting and tracking any vehicle on several lanes (three lanes in that example), at different speeds (from 0 to more than 100 km/h), at a rate of up to ten vehicles detected per second. The detection system can take several images of a red light infraction including, for example, when the vehicle is located at a predetermined trigger distance, for example at first trigger 72 when the back of the vehicle is close to the stop bar 70 and at second trigger 73 when the back of the vehicle is few meters away from the stop bar 70. Optional detection of the lane position is useful when a right turn on red is allowed at the intersection.
Speed enforcement is another application that requires providing evidence that a speed violation occurred. The correlation between the detected speed and the actual vehicle guilty of the infraction needs to be trustworthy. Sufficient information should be provided to allow identification of the vehicle owner, using information from the license plate, for example. The capability of the detection system to measure the speed of several vehicles at the same time with high accuracy and to make the association between each speed measurement and the specific identified vehicle is useful for traffic enforcement applications. This is made possible by, among others, the multiple FOV, the robustness and accuracy of the sensor and the capability to store several images of a violation.
The detector can store speed limit data (which can be different for each lane) and determine the occurrence of the infraction.
The detector can be mounted on a permanent installation or can also be temporary, provided on a movable tripod for example. Detectors can also be installed at the entry and at the exit of a point-to-point enforcement system allowing the measurement of the average speed of a vehicle by determining the amount of time it takes to displace the vehicle between the two points. The position of each vehicle and its classification are also information that the detector can transmit to the external controller. In some countries, lane restriction can be determined for specific vehicles, such as trucks for example.
Moreover, the multipurpose traffic detection system can fulfill more than one application at a time. For example, the system used for traffic management near an intersection can also be used for red light enforcement at that intersection.
Methods for Alignment and Detection of the Traffic Detection System
A method that allows a rapid and simple alignment step for the multipurpose traffic detection system after it has been set in place is provided.
FIGS. 8A and B show examples images of a roadway captured by the 2DOR during the day. The image is overlaid with the perimeters of a set of 16 contiguous detection zones of the 3DOR. In FIG. 8A, a vehicle present in the first lane 32 would be detected by several adjacent channels at a respective detected distance between 17.4 m to 17.6 m (see the numbers at the bottom of the overlay). In FIG. 8B, the vehicle is detected in the second lane 34 between 24.0 m to 24.4 m. Note that the overall detection zone is wide enough to cover more than two lanes. In some situations depending on the context of the installation, some objects or even the ground can be detected by the system but can be filtered out and not be considered as an object of interest.
FIG. 9A shows a photograph of a red light enforcement application installation. Some channels detect echo back signals from the ground (see the numbers at the bottom of the overlay) but the system is able to discriminate them as static objects. FIG. 9B is a graph showing a top view of the 3D 16 field of view of a road with 3 lanes. In a Cartesian coordinate system, if the detection system represents the origin, the horizontal direction from left to right is taken as the positive x-axis and represents the width of the 3 lanes in meters, and the vertical direction from bottom to top is taken as the positive y-axis and represents the longitudinal distance from the sensor. To facilitation installation, the installation software will indicate the beginning and the end of the detection zone by showing a detection line as seen in FIG. 9B.
Multi-Vehicle Simultaneous Detection and Tracking for Position Determination, Speed Measurement and Classification
FIG. 10 shows a top view of an example road facility equipped with a multipurpose traffic detection system 10. The system 10 mounted on an existing traffic infrastructure is used to illuminate a detection zone 42. In this example, the mounting height is between 1 and 10 m with a distance from the road between 1 and 5 m. In FIG. 10, the vehicles 46 travel in lanes 43, 44 and 45 in a direction indicated by arrow A through the detection system illumination zone 42. The detection system 10 is used for detecting information of the rear surface of vehicles 46 coming in the illumination zone 42. The detection system 10 is based on IR LED illumination source with a multiple field-of-view detector.
In FIG. 11, the 16 fields of view 52 covering a section of the road are shown. In a Cartesian coordinate system, if the detection system represents the origin 49, the horizontal direction from left to right is taken as the positive x-axis 50, and the vertical direction from bottom to top is taken as the positive y-axis 51 then, each 3D detection 53 gives the distance between an object and the sensor.
FIG. 12 shows the system in an example configuration with two trigger lines 56 and 57 located at a distance from the sensor between 10 and 50 m, for example. The two trigger lines 56 and 57 are configured by the user. Blob 55 illustrates a detectable vehicle rear. When the blob reaches the trigger line, the system returns a trigger message.
FIG. 13 and FIG. 14 show example data for vehicle tracking in the context of traffic light enforcement. Thanks to a projection of the field-of-view of the detection system on the real 2D image, the relationship between the top view (FIGS. 13B, 13D, 13F) and the scene (FIGS. 13A, 13C, 13E) is made apparent. The 3D detections are represented by dots in the top views. In this example, a small diamond in the top views shows the estimated position of the rear of each vehicle based on the 3D detections. In this example, the small diamond represents the middle of the rear of the vehicle. The distance of detection is indicated under each detection channel in the scene image. The amplitude of the detection is also indicated below the distance of detection. On the top view, thin lines define the limits of the tracking area and dotted lines define two trigger lines configured by the user. When entering this area, a new vehicle is labeled with a unique identifier. In each frame, its estimated position is shown using a small diamond. As shown, the interactions between vehicle detections are managed by the tracking algorithm allowing distinguishing vehicles located in the detection area.
FIG. 15 shows the steps performed during the execution of an example tracking algorithm. At step 80, the tracking algorithm selects the reliable measurements located on the road. At step 81A, the generic Kalman Filter for tracking a variable number of objects is used. At step 82, a road user classification based on geometric features is computed. Finally, step 83 sends to each frame, a message with position, speed, class and trigger if necessary for the vehicles located in the detection zone.
FIG. 16 shows the steps performed during the execution of the tracking algorithm if the traffic light state 85 is known. Steps 80/800, 82 and 83 are unchanged. However, step 81B is different because the additional information allows working in a space-based tracking joint.
The selection of relevant measures 80 is described in FIG. 17. At step 100 the tracking algorithm reads the available observations. At step 101, the tracking algorithm removes each detection that is not located on the road. Step 101 is followed by step 102 where the tracking algorithm recognizes lines by a feature-based approach. Step 103 eliminates the points located on lines parallel to the x-axis 50 with the aim of extracting the characteristics relating to the side(s) of vehicles and to keep only the objects having a “vehicle rear signature”.
The estimation of a line based on the covariance matrix using polar coordinate 102 is illustrated in FIG. 18. This estimation is based on feature extraction. The strength of the feature-based approach lies in its abstraction from data type, origin and amount. In this application, line segments will be considered as a basic primitive which later serves to identify and then remove the side of vehicles. Feature extraction is divided into two sub-problems: (i) segmentation to determine which data points contribute to the line model, and (ii) fitting to give an answer as to how these points contribute.
The polar form is chosen to represent a line model:
x cos α+y sin α=r
where −π<α≤π is the angle between the x axis and the normal of the line, r≥0 is the perpendicular distance of the line to the origin; (x, y) is the Cartesian coordinates of a point on the line. The covariance matrix of line parameters is:
cov ( r , α ) = [ σ r 2 σ r α σ r α σ α 2 ]
FIG. 19 shows a state diagram for the 3D real-time detection multi-object tracker. The core of the tracker 91A is based on a Kalman Filter in all weather and lighting conditions. The observation model 90 is illustrated in FIG. 21 which presents an example method to compute the vehicle position by weighting each 3D observation according to its height amplitude. This method permits to improve the accuracy of the estimated position with respect to using only the x and y Cartesian positions.
Expression 301 computes the blob position as follows:
Pblobn=1 Nπn·Pn
where πn is the intensity weight for the observation n, nϵ{1, . . . , N}, and N is the number of observation grouped together. Step 301 is followed by computing the observation weight depending on the intensity at step 302.
The function 300 normalizes the weight πn according to the amplitude An of the observation Pn:
π n = A n Σ A n
The state evolution model 92 is represented by the classical model called speed constant. Kinematics model can be represented in a matrix form by:
pk+1=F·pk+G·Vk, Vk˜N(0,Qk)
where pk=(xobs,{dot over (x)}obs,yobs,{dot over (y)}obs) is the target state vector, F the transition matrix which models the evolution of pk, Qk the covariance matrix of Vk, and G the noise matrix which is modeled by acceleration.
F = [ 1 ΔT 0 0 0 1 0 0 0 0 1 Δ T 0 0 0 1 ] G = [ Δ T 2 2 0 ΔT 0 0 Δ T 2 2 0 ΔT ] Q k = [ σ x 2 0 0 σ y 2 ]
The equation observation can be written as:
Zk=H·pk+Wk, Wk˜N(0,Rk)
where Zk=(xobs k ,yobs k )t is the measurement vector, H the measurement sensitivity matrix, and Rk the covariance matrix of Wk.
H = [ 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 ] R k = [ σ obs x 2 0 0 σ obs y 2 ]
The state space model 93A is based on probabilistic framework where the evolution model is supposed to be linear and the observation model is supposed to be Gaussian noise. In a 3D image, the system state encodes the information observed in the scene, e.g. the number of vehicles and their characteristics is xk N=(pk N, lk N) with N as the number of detected vehicles, where pk N denotes the 2D position of object N at iteration k, lk N gives identification, age, lane and the object classification.
FIG. 20 shows a state diagram for 3D real-time detection multi-object joint tracker. The core of 91B is based on a Kalman Filter which addresses the issue of interacting targets, which cause occlusion issues. When an occlusion is present, 3D data alone can be unreliable, and is not sufficient to detect, at each frame, the object of interest. If the algorithm uses the traffic light state 85, occlusions can be modeled with a joint state space model 93B. The multi-object joint tracker includes a multi-object interaction distance which is implemented by including an additional interaction factor in the vehicle position. The state space model 93B encodes the observations detected in the scene, e.g. the number of vehicles, the traffic light state and the interaction between the vehicles located in the same lane by concatenating their configurations into a single super-state vector such as: Xk=(Ok, xk 1, . . . , xk N) with Ok the size of state space at iteration k and xk N=(pk N, lk N) the state vector associated with the object N, where pk N denotes the 2D position of the object N at iteration k, lk N gives identification, age, lane, class, traffic light state and the object interaction.
Before integrating measures into the filter, a selection is made by a two-step procedure shown in FIGS. 22 and 23: first at step 400 validation gate, then at step 401A/B data association. The validation gate is the ellipsoid of size Nz (dimension of vector) defined such as:
θt·S−1·θ≤γ
where θt=Zk
Figure USRE048914-20220201-P00001
is the innovation, S the covariance matrix of the predicted value of the measurement vector and γ is obtained from the chi-square tables for Nz degree of freedom. This threshold represents the probability that the (true) measurement will fall in the gate. Step 400 is followed by step 401A/B which makes the matching between a blob and a hypothesis. Then, (i) consider all entries as new blobs; (ii) find the corresponding entries to each blob by considering gating intervals around the predicted position of each hypothesis, (iii) choose the nearest entry of each interval as the corresponding final observation of each blob. At step 402, the tracking algorithm uses a track management module in order to change the number of hypothesis. This definition is: (i) if, considering the existing assumption, there occurs an observation that cannot be explained, the track management module proposes a new observation; (ii) if an assumption does not find any observation after 500 ms, the track management module proposes to suppress the assumption. In this case, of course, an evolution model helps to guide state space exploration of the Kalman filter algorithm with a prediction of the state. Finally, step 403 uses a Kalman framework to estimate the final position of the vehicle.
In a 3D image, the system state encodes the information observed in the scene, the number of vehicles and their characteristics is Xk=(Ok, xk 1, . . . , xk N) with Ok the size of state space (number of detected vehicles) at iteration k and xk N=(pk N, lk N) the state vector associated with object N, where pk N denotes the 2D position of object N at iteration k, lk N gives identification, age, lane and the object classification. Step 90 and 92 are unchanged.
FIG. 24 shows the steps performed during the execution of the classification algorithm. At step 500, the algorithm checks if a line is detected in the 3D image. If a line is detected, step 500 is followed by step 501 which computes vehicle length. Vehicle length is defined as the overall length of the vehicle (including attached trailers) from the front to the rear. In order to calculate the length, two different positions are used: X0 and X1 . . . X0 is given by the position of the first detected line and X1 is given by the trigger line 1 (for example). Once the speed has been estimated, the vehicle length l can be determined such as:
l[m]=s[m/S]*(X1(t)[s]−X0(t)[s])−(X1(x)[m])−X0(x)[m])+Seg[m]+TH[m] where s is the vehicle speed, Seg is the length of the detected line and TH is a calibration threshold determined from a large dataset.
If the line is not detected at step 500, step 500 is followed by step 502 which computes the vehicle height. The vehicle height is estimated during the entry into the sensor field of view. As shown in FIG. 26, for a known configuration of the detection system, there is a direct geometric relationship between the height of a vehicle 601 and the detection distance 600. The accuracy 602 is dependent on the half-size of the vertical FOV angle 603. Height measurement is validated if the accuracy is lower than a threshold.
Finally, step 502 is followed by step 503 which computes the vehicle width. Over the vehicle blob, let (yl, x) be leftmost pixel and (yr, x) be the rightmost pixel in the vehicle blob for a given x. Then the width w of the object is determined from the following formula:
w=|yr−yl|
FIGS. 25A, 25B and 25C show a result of vehicle classification based on the classification algorithm. For example, in FIG. 25A, the classification result is a heavy vehicle; in FIG. 25B, it is a four-wheeled lightweight vehicle and in FIG. 25C, it is a two-wheeled lightweight vehicle. The information from the detection system is flexible and can be adapted to different schemes of classification. FIG. 25 illustrates graphically the basic elements of the concept of an object-box approach which is detailed below and in FIG. 27 and FIG. 28.
The object-box approach is mainly intended for vehicles because this approach uses the vehicle geometry in a LEDDAR image. The vehicles are represented by a 3D rectangular box of detected length, width and height. The 3D size of the rectangular box will vary depending on the detections in the FOV. FIGS. 27A, 27B, 27C and 27D show top view frames of a vehicle detected by the LEDDAR sensor. FIGS. 28A, 28B, 28C and 28D show corresponding side view frames of the vehicle of FIG. 27.
FIGS. 27A, 27B, 27C, 27D and FIGS. 28A, 28B, 28C, 28D show the changing 3D size of the rectangle 701 for four example positions of a vehicle 702 in the 3D sensor FOV 703. When a vehicle 702 enters the 3D sensor FOV 703, two detections are made on the side of the vehicle (see FIG. 27A) and one detection is made for the top of the vehicle (see FIG. 28A). The 3D rectangle is initialized with a length equal to 4 m, a width of 1.5 m and a height OHm given by:
OHm=Hs−dist*tan(θ)
where Hs is the sensor height 704, dist is the distance of the detected vehicle and θ is sensor pitch.
FIG. 27B and FIG. 28B represent detections when the vehicle is three-fourths of the way in the detection FOV. Eight side detections are apparent on FIG. 27B and one top detection is apparent on FIG. 28B. The dimensions of the 3D rectangle are calculated as follows:
The width is not yet adjusted because the vehicle back is not yet detected.
Ol(k)=max(L2−L1,Ol(k−1))
Oh(k)=max(OHm,Oh(k−1))
where the points of a segment are clockwise angle sorted so L2 is the point with the smallest angle and L1 is the segment-point with the largest angle. Ol(k) and Oh(k) are respectively the current length and height value at time k.
FIG. 27C and FIG. 28C represent detections when the back of the vehicle begins to enter in the detection FOV. Eight side detections and two rear detections are apparent on FIG. 27C while one detection is apparent on FIG. 28C. The dimensions of the 3D rectangle are calculated as follows:
Ol(k)=max(L2−L1,Ol(k−1))
Oh(k)=max(OHm,Oh(k−1))
Ow(k)=max(L4−L3,Ow(k−1))
As for the horizontal segment representing the side of the vehicle, the points of the vertical segment representing the rear and/or the top of the vehicle are clockwise angle sorted, so L4 is the point with the smallest angle and L3 is the segment-point with the largest angle. Ol(k), Oh(k) and Ow(k) are respectively the current length, height and width value at time k.
FIG. 27D and FIG. 28D represent detections when the back of the vehicle is fully in the detection FOV. Six side detections and four rear detections are apparent on FIG. 27D while one detection is apparent on FIG. 28D. The width Olm dimension is calculated as follows:
Olm(k)=α*(L4−L3)+(1−α)*Olm(k−1)
where Olm(k) is the current width at time k and α is the filtering rate.
The size of the vehicle can then be determined fully.
The segmentation algorithm 800 based on a 3D bounding box for selection of the relevant measures is illustrated in FIG. 29. The first three steps are identical to that of FIG. 17. If step 120 finds horizontal lines, then step 120 is followed by step 121. As explained above, the points of a segment are clockwise angle sorted with L2, the smallest angle and L1 the largest angle. This segment length is given by L2−L1. Otherwise, the next step 123 initializes the 3D bounding box with a default vehicle length. Step 121 is followed by step 122 which considers that two segments have a common corner if there is a point of intersection Pi between the two segments with |Pi−L1| and |Pi−L4| less than a distance threshold. If no corner is found, step 123 initializes the 3D bounding box with default values. Otherwise, step 124 computes the 3D bounding box dimensions from equations presented above with respect to FIG. 27C.
It is of interest to derive minimum variance bounds on estimation errors to have an idea of the maximum knowledge on the speed measurement that can be expected and to assess the quality of the results of the proposed algorithms compared with the bounds. In time-invariant statistical models, a commonly used lower bound is the Cramer-Rao Lower Bound (CRLB), given by the inverse of the Fisher information matrix. The PCRB can be used for estimating kinematic characteristics of the target.
A simulation was done according to the scenario shown in FIG. 30. The vehicle 130 is moving at a speed of 60 m/s along a straight line in lane 3. The PCRB was applied. As shown in FIG. 31, the tracking algorithm converges at point 903 at about σ{dot over (K)}F=0.48 km/h after 80 samples. From point 900, it is apparent that after 16 samples, σ{dot over (K)}F<3 km/h, from point 901 that after 28 samples, σ{dot over (K)}F<1.5 km/h and from point 902 that after 39 samples, σ{dot over (K)}F<1 km/h. Experimental tests confirmed the utility and viability of this approach.
Image Processing and Applications
The multipurpose traffic detection system uses a high-resolution image sensor or more than one image sensor with lower resolution. In the latter case, the control and processing unit has to process an image stitching by combining multiple images with different FOVs with some overlapping sections in order to produce a high-resolution image. Normally during the calibration process, the system can determine exact overlaps between images sensors and produce seamless results by controlling and synchronizing the integration time of each image sensor and the illumination timing and analyzing overlap sections. Infrared and color image sensors can be used with optical filters.
At night, a visible light is required to enhance the color of the image. A NIR flash is not visible to the human eye and does not blind drivers, so it can be used at any time of the day and night.
Image sensors can use electronic shutters (global or rolling) or mechanical shutters. In the case of rolling shutters, compensation for the distortions of fast-moving objects (skew effect) can be processed based on the information of the position and the speed of the vehicle. Other controls of the image sensor like Gamma and gain control can be used to improve the quality of the image in different contexts of illumination.
FIG. 32A is a photograph showing an example snapshot taken by a 5 Mpixels image sensor during the day. Vehicles are at a distance of approximately 25 m and the FOV at that distance covers approximately 9 m (almost equivalent to 3 lanes). FIGS. 32B, 32C and 32D show the quality of the image and resolution of FIG. 32A by zooming in on the three license plates.
FIG. 33A is a photograph showing an example snapshot taken by the image sensor at night without any light. This image is completely dark. FIG. 33B shows the same scene with infrared light. Two vehicles can be seen but the license plates are not readable even when zooming in as seen in FIG. 33C. The license plate acts as a retro-reflector and saturates the image sensing. FIGS. 34A and 34B use the same lighting with a lower integration time. The vehicle is less clear but the image shows some part of the license plate becoming less saturated. FIGS. 34C and 34D decrease a little more the integration time and produce a readable license plate.
One way to get a visible license plate at night and an image of the vehicle is to process several snapshots with different integration times (Ti). For example, when the 3D detection confirms the position of a vehicle in the detection zone, a sequence of acquisition of several snapshots (ex.: 4 snapshots with Ti1=50 μs, Ti2=100 μs, Ti3=250 μs and Ti4=500 μs), each snapshot taken at a certain frame rate (ex.: each 50 ms), will permit to get the information on a specific vehicle: information from the 3D sensor, a readable license plate of the tracked vehicle and an image from the context including the photo of the vehicle. If the system captures 4 images during 150 ms, a vehicle at 150 km/h would travel during 6.25 m (one snapshot every 1.5 m).
To enhance the quality of the image, high dynamic range (HDR) imaging techniques can be used to improve the dynamic range between the lightest and darkest areas of an image. HDR notably compensates for loss of information by a saturated section by taking multiple pictures at different integration times and using stitching process to make a better quality image.
The system can use Automatic License Plate Recognition (ALPR), based on Optical Character Recognition (OCR) technology, to identify vehicle license plates. This information of the vehicle identification and measurements is digitally transmitted to the external controller or by the network to back-office servers, which process the information and can traffic violation alerts.
The multipurpose traffic detection system can be used day or night, in good or bad weather condition, and also offers the possibility of providing weather information like the presence of fog or snowing conditions. Fog and snow have an impact on the reflection of the radiated light pulses of the protective window. In the presence of fog, the peak amplitude of the first pulse exhibits sizable time fluctuations, by a factor that may reach 2 to 3 when compared to its mean peak amplitude level. Likewise, the width of the first pulse also shows time fluctuations during these adverse weather conditions, but with a reduced factor, for example, by about 10 to 50%. During snow falls, the peak amplitude of the first pulse visible in the waveforms generally shows faster time fluctuations while the fluctuations of the pulse width are less intense. Finally, it can be noted that a long-lasting change in the peak amplitude of the first pulse can be simply due to the presence of dirt or snow deposited on the exterior surface of the protective window.
FIG. 35 shows an example image taken with infrared illumination with the overlay (dashed lines) representing the perimeter of the 16 contiguous detection zones of the 3DOR. Apparent on FIG. 35 are high intensity spots 140 coming from a section of the vehicle having a high retro-reflectivity characteristic. Such sections having a high retro-reflectivity characteristic include the license plate, retro-reflectors installed one the car and lighting modules that can include retro-reflectors. An object with retro-reflectivity characteristic reflects light back to its source with minimum scattering. The return signal can be as much as 100 times stronger than a signal coming from a surface with Lambertian reflectance. This retro-reflectivity characteristic has the same kind of impact on the 3DOR. Each 3D channel detecting a retro-reflector at a certain distance in its FOV will acquire a waveform with high peak amplitude at the distance of the retro-reflector. The numbers at the bottom of the overlay (in dashed lines) represent the distance measured by the multipurpose traffic detection system in each channel which contains a high peak in its waveform. Then, with a good image registration between the 2D image sensor and the 3D sensor, the 2D information (spot with high intensity) can be correlated with the 3D information (high amplitude at a certain distance). This link between 2D images and 3D detection ensures a match between the identification data based on reading license plates and measurements of position and velocity from the 3D sensor.
The license plate identification process can also be used as a second alternative to determine the speed of the vehicle with lower accuracy but useful as a validation or confirmation. By analyzing the size of the license plate and/or character on successive images, the progression of the vehicle in the detection zone can be estimated and used to confirm the measured displacement.
The embodiments described above are intended to be exemplary only. The scope of the invention is therefore intended to be limited solely by the appended claims.

Claims (40)

We claim:
1. A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the method comprising:
providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in said environment;
providing a 3D optical receiver oriented to have a wide and deep field of view within said 3D detection zone, said 3D optical receiver having a plurality of detection channels in said field of view;
driving the 3D optical emitter into emitting short light pulses toward the detection zone, said light pulses having an emitted light waveform;
receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at said 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of said 3D optical receiver;
using said individual digital full-waveform LIDAR trace and said emitted light waveform, detecting a presence of a plurality of vehicles in said 3D detection zone, a position of at least part of each said vehicle in said 3D detection zone and a time at which said position is detected;
assigning a unique identifier to each vehicle of said plurality of vehicles detected;
repeating said steps of driving, receiving, acquiring and detecting, at a predetermined frequency;
at each instance of said repeating step, tracking and recording an updated position of each vehicle of said plurality of vehicles detected and an updated time at which said updated position is detected, with said unique identifier;
wherein said detecting said presence includes:
extracting observations in the individual digital full-waveform LIDAR trace;
using the location for the observations to remove observations coming from a surrounding environment;
extracting lines using an estimate line and a covariance matrix using polar coordinates;
removing observations located on lines parallel to the x axis.
2. The method as claimed in claim 1, wherein said traffic control environment is at least one of a traffic management environment and a traffic enforcement environment.
3. The method as claimed in claim 1, wherein said detecting said presence includes
extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations;
finding at least one blob in the observations;
computing an observation weight depending on the intensity of the observations in the blob;
computing a blob gravity center based on the weight and a position of the observations in the blob.
4. The method as claimed in claim 1, further comprising setting at least one trigger line location and recording trigger line trespassing data with the unique identifier.
5. The method as claimed in claim 4, further comprising setting said trigger line location relative to a visible landmark in said environment.
6. The method as claimed in claim 1, wherein said detecting said time at which said position is detected includes assigning a timestamp for said detecting said presence and wherein said timestamp is adapted to be synchronized with an external controller.
7. The method as claimed in claim 1, further comprising obtaining a classification for each detected vehicles using a plurality of detections in the 3D detection zone caused by the same vehicle.
8. The method as claimed in claim 1, wherein said detecting said presence further comprises detecting a presence of a pedestrian in said environment.
9. The method as claimed in claim 1, wherein said part of said vehicle is one of a front, a side and a rear of the vehicle.
10. The method as claimed in claim 1, wherein emitting short light pulses includes emitting short light pulses of a duration of less than 50 ns.
11. The method as claimed in claim 1, wherein said 3D optical emitter is at least one of an infrared LED source, a visible-light LED source and a laser.
12. The method as claimed in claim 1, wherein said providing said 3D optical receiver to have a wide and deep field of view includes providing said 3D optical receiver to have a horizontal field of view angle of at least 20° and a vertical field of view angle of at least 4°.
13. The method as claimed in claim 1, further comprising determining and recording a speed for each said vehicle using said position and said updated position of one of said instances of said repeating step and an elapsed time between said time of said position and said updated time of said updated position, with said unique identifier.
14. The method as claimed in claim 13, further comprising using a Kalman filter to determine an accuracy for said speed to validate said speed; comparing said accuracy to a predetermined accuracy threshold; if said accuracy is lower than said predetermined accuracy threshold, rejecting said speed.
15. The method as claimed in claim 14, further comprising retrieving a speed limit and identifying a speed limit infraction by comparing said speed recorded for each said vehicle to said speed limit.
16. The method as claimed in claim 1, further comprising:
providing a 2D optical receiver, wherein said 2D optical receiver being an image sensor adapted to provide images of said 2D detection zone;
driving the 2D optical receiver to capture a 2D image;
using image registration to correlate corresponding locations between said 2D image and said detection channels;
extracting vehicle identification data from said 2D image at a location corresponding to said location for said detected vehicle;
assigning said vehicle identification data to said unique identifier.
17. The method as claimed in claim 16, wherein the vehicle identification data is at least one of a picture of the vehicle and a license plate alphanumerical code present on the vehicle.
18. The method as claimed in claim 17, wherein the vehicle identification data includes said 2D image showing a traffic violation.
19. The method as claimed in claim 17, further comprising extracting at least one of a size of characters on the license plate and a size of the license plate and comparing one of said size among different instances of the repeating to determine an approximate speed value.
20. The method as claimed in claim 16, further comprising providing a 2D illumination source oriented to allow illumination of a 2D detection zone in said 3D detection zone and driving the 2D illumination source to emit pulses to illuminate said 2D detection zone and synchronizing said driving the 2D optical receiver to capture images with said driving the 2D illumination source to emit pulses to allow capture of said images during said illumination.
21. The method as claimed in claim 20, wherein driving the 2D illumination source includes driving the 2D illumination source to emit pulses of a duration between 10 μs and 10 ms.
22. The method as claimed in claim 19, wherein the 2D illumination source is at least one of a visible light LED source, an infrared LED light source and laser.
23. The method as claimed in claim 19, wherein the 3D optical emitter and the 2D illumination source are provided by a common infrared LED light source.
24. The method as claimed in claim 19, wherein the vehicle identification data is at least two areas of high retroreflectivity apparent on the images, said detecting a presence includes extracting observations in the individual digital signals and intensity data for the observations, the method further comprising correlating locations for the areas of high retroreflectivity and high intensity data locations in the observations, wherein each said area of high retroreflectivity is created from one of a retroreflective license plate, a retro-reflector affixed on a vehicle and a retro-reflective lighting module provided on a vehicle.
25. The method as claimed in claim 16, further comprising combining multiples ones of said captured images into a combined image with the vehicle and the vehicle identification data apparent.
26. A vehicle detection system for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the system comprising:
a 3D optical emitter provided at an installation height and oriented to allow illumination of a 3D detection zonein the environment;
a 3D optical receiver provided and oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channelsin said field of view;
a controller for driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform;
the 3D optical receiver for receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone, thereby for acquiring an individual digital full-waveform light detection and ranging (LIDAR) trace for each channel of the 3D optical receiver;
a processor configured for detecting a presence of a plurality of vehicles in the 3D detection zone using the individual digital full-waveform LIDAR traceand the emitted light waveform, capturing a series of vehicle measurements from the LIDAR trace, detecting a position of at least part of each the vehicle in the 3D detection zone, recording a time at which the position is detected, and assigning a unique identifier to each vehicle of the plurality of vehicles detectedand tracking and recording an updated position of each vehicle of the plurality of vehicles detected and an updated time at which the updated position is detected, with the unique identifier;
a 2D optical receiver, wherein the 2D optical receiver is an image sensor adapted to provide images of the 2D detection zone; and
a driver for driving the 2D optical receiver image sensor to capture a 2D image the images;
the processor being further adapted configured for using image registration to correlate corresponding locations between said 2D image images and said detection channels, estimating a length of a vehicle by fitting a first line to a first subset of said series of vehicle measurements, estimating a width of a vehicle by fitting a second line to a second subset of the vehicle measurements, and extracting vehicle identification data from the 2D image at a location corresponding to the location for the a detected vehicle; and assigning the vehicle identification data to the unique identifier.
27. The system as claimed in claim 26, wherein said processor is further for determining and recording a speed for each the vehicle using the position and the an updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the an updated time of the updated position, with the unique identifier.
28. The system as claimed in claim 26, further comprising a 2D illumination source provided and oriented to allow illumination of a 2D detection zone in the 3D detection zone;
a source driver for driving the 2D illumination source to emit pulses;
a synchronization module for synchronizing said source driver and said driver to allow capture of said images while said 2D detection zone is illuminated.
29. A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the method comprising:
providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in said environment;
providing a 3D optical receiver oriented to have a wide and deep field of view within said 3D detection zone, said 3D optical receiver having a plurality of detection channels in said field of view;
driving the 3D optical emitter into emitting short light pulses toward the detection zone, said light pulses having an emitted light waveform;
receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at said 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of said 3D optical receiver;
using said individual digital full-waveform LIDAR trace and said emitted light waveform, detecting a presence of a plurality of vehicles in said 3D detection zone, a position of at least part of each said vehicle in said 3D detection zone and a time at which said position is detected;
assigning a unique identifier to each vehicle of said plurality of vehicles detected;
repeating said steps of driving, receiving, acquiring and detecting, at a predetermined frequency;
at each instance of said repeating step, tracking and recording an updated position of each vehicle of said plurality of vehicles detected and an updated time at which said updated position is detected, with said unique identifier,
wherein said detecting said presence includes:
extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations;
finding at least one blob in the observations;
computing an observation weight depending on the intensity of the observations in the blob;
computing a blob gravity center based on the weight and a position of the observations in the blob.
30. The vehicle detection system of claim 26, wherein the processor is further configured to estimate a height of the vehicle.
31. The vehicle detection system of claim 26, wherein the processor is configured to estimate a volume of the vehicle based at least in part on the vehicle measurements.
32. The vehicle detection system of claim 26 wherein the processor is configured to identify a corner point of the vehicle less than a threshold distance from points on both of the first and second lines.
33. The vehicle detection system of claim 32, wherein the processor is configured to define a three-dimensional bounding box corresponding to the vehicle based on detection of corners.
34. The vehicle detection system of claim 33, wherein the three-dimensional bounding box represents an estimate of bounding dimensions of the vehicle.
35. The vehicle detection system of claim 34, wherein the processor is further configured to refine the estimate of the bounding dimensions as the light detection and ranging (LIDAR) trace is produced by reflection of the illumination signals from an increasing number of sides of the vehicle.
36. The vehicle detection system of claim 26, wherein the light detection and ranging (LIDAR) trace includes reflection of the illumination signals from a complete side of the vehicle, and wherein the processor is configured to determine dimensions of a three-dimensional bounding box corresponding to the vehicle based at least on full-waveform signal processing of the signal waveforms from the vehicle measurements for a complete side of the vehicle.
37. The vehicle detection system of claim 26, wherein the processor is configured to account for changes in the distance between the vehicle and the 3D optical emitter due to relative movement between the 3D optical emitter and the vehicle.
38. The vehicle detection system of claim 26, wherein the processor is configured to assign a classification to the vehicle based on a dimension of the vehicle.
39. The vehicle detection system of claim 38, wherein the classification is according to a classification scheme distinguishing two-wheeled and four-wheeled vehicles.
40. The vehicle detection system of claim 26, wherein the processor is configured to trigger an event based at least in part on a dimension of the vehicle.
US15/867,995 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization Active 2033-04-13 USRE48914E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/867,995 USRE48914E1 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261605896P 2012-03-02 2012-03-02
US15/867,995 USRE48914E1 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization
US14/115,244 US9235988B2 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization
PCT/IB2013/051667 WO2013128427A1 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization

Publications (1)

Publication Number Publication Date
USRE48914E1 true USRE48914E1 (en) 2022-02-01

Family

ID=49081727

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/115,244 Ceased US9235988B2 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization
US15/867,995 Active 2033-04-13 USRE48914E1 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/115,244 Ceased US9235988B2 (en) 2012-03-02 2013-03-01 System and method for multipurpose traffic detection and characterization

Country Status (4)

Country Link
US (2) US9235988B2 (en)
EP (1) EP2820632B8 (en)
CA (4) CA2865733C (en)
WO (1) WO2013128427A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11668830B1 (en) 2018-06-01 2023-06-06 Vayavision Sensing Ltd. System and method for performing active distance measurements
US11725956B2 (en) 2015-04-01 2023-08-15 Vayavision Sensing Ltd. Apparatus for acquiring 3-dimensional maps of a scene
US12093834B2 (en) 2019-09-22 2024-09-17 Vaya Vision Sensing Ltd. Methods and systems for training and validating a perception system

Families Citing this family (81)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012172526A1 (en) 2011-06-17 2012-12-20 Leddartech Inc. System and method for traffic side detection and characterization
CA2865733C (en) 2012-03-02 2023-09-26 Leddartech Inc. System and method for multipurpose traffic detection and characterization
US9336450B2 (en) * 2013-06-05 2016-05-10 Xerox Corporation Methods and systems for selecting target vehicles for occupancy detection
RU2559418C2 (en) * 2013-10-15 2015-08-10 Общество с ограниченной ответственностью "Симикон" Method of determination of vehicle position and motion speed and complex to this end
KR101551026B1 (en) * 2013-12-24 2015-09-07 현대자동차주식회사 Method of tracking vehicle
US9495606B2 (en) * 2014-02-28 2016-11-15 Ricoh Co., Ltd. Method for product recognition from multiple images
DE102014103010A1 (en) * 2014-03-06 2015-09-10 Skidata Ag digital camera
US9767371B2 (en) 2014-03-27 2017-09-19 Georgia Tech Research Corporation Systems and methods for identifying traffic control devices and testing the retroreflectivity of the same
US9396553B2 (en) * 2014-04-16 2016-07-19 Xerox Corporation Vehicle dimension estimation from vehicle images
DE102014010937A1 (en) * 2014-07-28 2016-01-28 S.M.S, Smart Microwave Sensors Gmbh Method for determining a position and / or orientation of a sensor
DE102014012285A1 (en) * 2014-08-22 2016-02-25 Jenoptik Robot Gmbh Method and axle counting device for non-contact axle counting of a vehicle and axle counting system for road traffic
CA2960123C (en) 2014-09-09 2021-04-13 Leddartech Inc. Discretization of detection zone
US9821813B2 (en) * 2014-11-13 2017-11-21 Nec Corporation Continuous occlusion models for road scene understanding
EP3026653A1 (en) * 2014-11-27 2016-06-01 Kapsch TrafficCom AB Method of controlling a traffic surveillance system
US10043091B2 (en) * 2014-12-05 2018-08-07 Magna Electronics Inc. Vehicle vision system with retroreflector pattern recognition
US10032370B2 (en) * 2015-03-03 2018-07-24 Honda Motor Co., Ltd. Methods and apparatus for enabling mobile communication device based secure interaction from vehicles through motion signatures
EP3082119B1 (en) * 2015-04-15 2022-11-23 VITRONIC Dr.-Ing. Stein Bildverarbeitungssysteme GmbH Distance measurement of vehicles
EP3104357A1 (en) * 2015-06-09 2016-12-14 Kapsch TrafficCom AG A device for detecting vehicles on a traffic area
US9847022B2 (en) * 2015-07-22 2017-12-19 Ace/Avant Concrete Construction Co., Inc. Vehicle detection system and method
US10331956B2 (en) 2015-09-23 2019-06-25 Magna Electronics Inc. Vehicle vision system with detection enhancement using light control
US10965099B2 (en) * 2015-10-06 2021-03-30 Pioneer Corporation Light control device, control method, program and storage medium
GB2543338B (en) * 2015-10-15 2021-09-15 Nal Ltd Detector access chamber
CN108351417B (en) 2015-10-19 2022-05-24 斯堪森斯公司 Obtaining data from a target using imagery and other remotely sensed data
CN105335723B (en) * 2015-11-02 2019-04-19 招商局重庆交通科研设计院有限公司 A kind of model recognizing method based on infrared structure light
JP6452596B2 (en) * 2015-11-30 2019-01-16 古河電気工業株式会社 Radar device and radar device detection method
CN105522988B (en) * 2015-12-29 2018-01-30 同方威视技术股份有限公司 Vehicle guidance system, the method for vehicle directional and safety check vehicle
JP6672915B2 (en) * 2016-03-15 2020-03-25 オムロン株式会社 Object detection device, object detection method, and program
US9747793B1 (en) * 2016-08-21 2017-08-29 International Business Machines Corporation Transportation vehicle traffic management
US11017663B2 (en) 2016-10-03 2021-05-25 Murata Manufacturing Co., Ltd. Ultra-low-power traffic-monitoring system
KR20180060784A (en) 2016-11-29 2018-06-07 삼성전자주식회사 Method and apparatus for determining abnormal object
US20180172807A1 (en) * 2016-12-20 2018-06-21 Analog Devices Global Method of Providing Enhanced Range Accuracy
US10114111B2 (en) 2017-03-28 2018-10-30 Luminar Technologies, Inc. Method for dynamically controlling laser power
US10254388B2 (en) * 2017-03-28 2019-04-09 Luminar Technologies, Inc. Dynamically varying laser output in a vehicle in view of weather conditions
US10677897B2 (en) 2017-04-14 2020-06-09 Luminar Technologies, Inc. Combining lidar and camera data
US10360796B2 (en) * 2017-04-24 2019-07-23 Futurewei Technologies, Inc. Ticket-based traffic flow control at intersections for internet of vehicles
US11288519B2 (en) * 2017-06-30 2022-03-29 FLIR Belgium BVBA Object counting and classification for image processing
US11250699B2 (en) 2017-08-14 2022-02-15 Cubic Corporation System and method of adaptive traffic management at an intersection
US11100336B2 (en) * 2017-08-14 2021-08-24 Cubic Corporation System and method of adaptive traffic management at an intersection
WO2019079211A1 (en) 2017-10-19 2019-04-25 DeepMap Inc. Lidar to camera calibration for generating high definition maps
US10690773B2 (en) * 2017-12-07 2020-06-23 Velodyne Lidar, Inc. Systems and methods for efficient multi-return light detectors
US10705216B2 (en) 2017-12-07 2020-07-07 Institute For Information Industry Three-dimensional point cloud tracking apparatus and method using recurrent neural network
US10803340B2 (en) 2017-12-08 2020-10-13 Hunter Engineering Company Method and apparatus for license plate recognition using multiple fields of view
US11417111B2 (en) 2017-12-22 2022-08-16 Terra Scientia, Llc Method, system and material for detecting objects of high interest with laser scanning systems
EP3732665A4 (en) * 2017-12-31 2021-09-01 Axilion Ltd. Method, device, and system of dynamic allocation of traffic resources
US11341350B2 (en) 2018-01-05 2022-05-24 Packsize Llc Systems and methods for volumetric sizing
US11110895B2 (en) * 2018-04-09 2021-09-07 Cisco Technology, Inc. Vehicle network intrusion detection system (IDS) using vehicle state predictions
DE102018206751A1 (en) * 2018-05-02 2019-11-07 Continental Automotive Gmbh CONTOUR RECOGNITION OF A VEHICLE BASED ON MEASUREMENT DATA OF A UMFELDSENSORIK
JP7028066B2 (en) 2018-05-30 2022-03-02 株式会社Ihi Detection device and detection system
JP7024610B2 (en) * 2018-05-30 2022-02-24 株式会社Ihi Detection device and detection system
US10627516B2 (en) 2018-07-19 2020-04-21 Luminar Technologies, Inc. Adjustable pulse characteristics for ground detection in lidar systems
US10746898B2 (en) 2018-08-01 2020-08-18 Infineon Technologies Ag Method and device for object recognition and analysis
TWI680898B (en) * 2018-11-23 2020-01-01 財團法人車輛研究測試中心 Light reaching detection device and method for close obstacles
JP2020118567A (en) * 2019-01-24 2020-08-06 ソニーセミコンダクタソリューションズ株式会社 Distance measurement device, on-vehicle system, and distance measurement method
CN111696365A (en) * 2019-03-11 2020-09-22 杭州海康威视数字技术股份有限公司 Vehicle tracking system
JP7050020B2 (en) * 2019-03-14 2022-04-07 Kddi株式会社 Vehicle detection device, vehicle detection method, and program
DE102019206480A1 (en) * 2019-05-06 2020-11-12 Audi Ag Motor vehicle having an outer surface and method of operating a motor vehicle
US11531111B2 (en) 2019-05-21 2022-12-20 Northrop Grumman Systems Corporation 360 degrees field of view scanning lidar with no movable parts
US11555891B2 (en) 2019-05-21 2023-01-17 Northrop Grumman Systems Corporation Methods for large angle field of view scanning LIDAR with no movable parts
US11448732B2 (en) 2019-05-21 2022-09-20 Northrop Grumman Systems Corporation Frequency modulated scanning LIDAR with 360 degrees field of view
EP3754535A1 (en) * 2019-06-17 2020-12-23 Kapsch TrafficCom AG Apparatus for recording license plates of vehicles
KR102137038B1 (en) * 2019-07-08 2020-07-23 엘지전자 주식회사 System for identifying vehicle using laser sensor
CN110533921B (en) * 2019-08-06 2021-06-18 北京万集科技股份有限公司 Triggering snapshot method and system for vehicle
EP3789794A1 (en) * 2019-09-04 2021-03-10 Ibeo Automotive Systems GmbH Method and device for distance-measuring
CA3113473A1 (en) * 2020-03-24 2021-09-24 Arudi Srinivas Rajagopal Traffic warning and data capture devices and methods
CN111507427A (en) * 2020-05-08 2020-08-07 湖南车路协同智能科技有限公司 Vehicle classification method
WO2022003343A1 (en) * 2020-06-29 2022-01-06 I R Kinetics Limited Systems and methods for interactive vehicle transport networks
US11328519B2 (en) 2020-07-23 2022-05-10 Waymo Llc Detecting traffic signaling states with neural networks
US11956693B2 (en) * 2020-12-03 2024-04-09 Mitsubishi Electric Corporation Apparatus and method for providing location
MX2023001144A (en) 2020-12-15 2023-04-14 Selex Es Inc Systems and methods for electronic signature tracking.
US11393227B1 (en) * 2021-02-02 2022-07-19 Sony Group Corporation License plate recognition based vehicle control
US11482099B2 (en) * 2021-02-02 2022-10-25 Here Global B.V. Method and apparatus for preventing traffic over-reporting via identifying misleading probe data
KR20220126031A (en) * 2021-03-08 2022-09-15 현대모비스 주식회사 Vehicle tracking system and tracking method
JP7345706B2 (en) * 2021-06-08 2023-09-15 三菱電機株式会社 laser radar equipment
CN117751391A (en) 2021-07-16 2024-03-22 华为技术有限公司 Privacy compliance monitoring of objects
US20230039656A1 (en) * 2021-08-04 2023-02-09 Palo Alto Research Center Incorporated Traffic monitoring using optical sensors
EP4134933A1 (en) * 2021-08-11 2023-02-15 MOVYON S.p.A. SYSTEM AND METHOD FOR DETECTING THE CLASS OF A&#xA;VEHICLE IN TRANSIT
US20230070108A1 (en) * 2021-09-09 2023-03-09 Selex Es Inc. Systems And Methods For Electronic Signature Tracking And Analysis
US11842635B2 (en) * 2021-10-22 2023-12-12 Richard Wohler Traffic light control assembly
CN118786360A (en) * 2022-03-08 2024-10-15 日本先锋公司 Information processing device, control method, program, and storage medium
FR3137483A1 (en) * 2022-06-30 2024-01-05 Idemia Identity & Security Method for measuring the semi-automatic speed of a vehicle from an image bank, computer program product and associated device
WO2024211974A1 (en) * 2023-04-11 2024-10-17 Velsis Sistemas E Tecnologia Viaria S.A System for identifying high-occupancy vehicles and occupant behaviour

Citations (293)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3680085A (en) 1969-01-21 1972-07-25 Giovanni Del Signore Anti-collision apparatus for vehicles
US3967111A (en) 1974-12-20 1976-06-29 Scientific Technology Incorporated Pulsed light source discriminator system
US4533242A (en) 1982-09-28 1985-08-06 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Ranging system which compares an object-reflected component of a light beam to a reference component of the light beam
US4634272A (en) 1982-06-02 1987-01-06 Nissan Motor Company, Limited Optical radar system with an array of photoelectric sensors
WO1987005138A1 (en) 1986-02-19 1987-08-27 George Beggs Object detection method and apparatus employing electro-optics
US4717862A (en) 1984-11-19 1988-01-05 The United States Government As Represented By The Secretary Of The Navy Pulsed illumination projector
US4733961A (en) 1983-03-07 1988-03-29 Texas Instruments Incorporated Amplifier for integrated laser/FLIR rangefinder
US4808997A (en) 1987-05-21 1989-02-28 Barkley George J Photoelectric vehicle position indicating device for use in parking and otherwise positioning vehicles
EP0318260A2 (en) 1987-11-27 1989-05-31 Combustion Developments Limited Monitoring means
US4891624A (en) 1987-06-12 1990-01-02 Stanley Electric Co., Ltd. Rearward vehicle obstruction detector using modulated light from the brake light elements
US4928232A (en) 1988-12-16 1990-05-22 Laser Precision Corporation Signal averaging for optical time domain relectometers
WO1992003808A1 (en) 1990-08-17 1992-03-05 The Secretary Of State For Defence In Her Britannic Majesty's Government Of The United Kingdom Of Great Britain And Northern Ireland Surveillance apparatus particularly for use in viewing vehicle number-plates
EP0476562A2 (en) 1990-09-19 1992-03-25 Hitachi, Ltd. Method and apparatus for controlling moving body and facilities
US5102218A (en) 1991-08-15 1992-04-07 The United States Of America As Represented By The Secretary Of The Air Force Target-aerosol discrimination by means of digital signal processing
JPH04145391A (en) 1990-10-05 1992-05-19 Mitsubishi Electric Corp Distance measuring device
JPH04145390A (en) 1990-10-05 1992-05-19 Mitsubishi Electric Corp Distance measuring device
JPH04172285A (en) 1990-11-02 1992-06-19 Mitsubishi Electric Corp Distance measuring apparatus
EP0494815A1 (en) 1991-01-11 1992-07-15 Regie Nationale Des Usines Renault S.A. Motor vehicles traffic measuring system
US5134393A (en) 1990-04-02 1992-07-28 Henson H Keith Traffic control system
US5179286A (en) 1990-10-05 1993-01-12 Mitsubishi Denki K.K. Distance measuring apparatus receiving echo light pulses
GB2264411A (en) 1992-02-13 1993-08-25 Roke Manor Research Active infrared vehicle detector system
FR2690519A1 (en) 1992-04-23 1993-10-29 Est Centre Etu Tech Equipement Road traffic speed and distance monitoring system - uses pair of optical transceivers and ultra-sonic telemetry
US5270780A (en) 1991-09-13 1993-12-14 Science Applications International Corporation Dual detector lidar system and method
US5317311A (en) 1988-11-14 1994-05-31 Martell David K Traffic congestion monitoring system
EP0612049A1 (en) 1993-02-15 1994-08-24 STN ATLAS Elektronik GmbH Method for classifying vehicles passing a predetermined point on the road
US5357331A (en) 1991-07-02 1994-10-18 Flockencier Stuart W System for processing reflected energy signals
US5381155A (en) 1993-12-08 1995-01-10 Gerber; Eliot S. Vehicle speeding detection and identification
US5389921A (en) 1993-05-17 1995-02-14 Whitton; John M. Parking lot apparatus and method
JPH07280940A (en) 1994-04-12 1995-10-27 Mitsubishi Electric Corp Radar for vehicle
DE19604338A1 (en) 1995-02-18 1996-08-29 Univ Dresden Tech Vehicle counting and classification sensor
WO1996034252A1 (en) 1995-04-28 1996-10-31 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system sensor and method
DE29617413U1 (en) 1996-10-07 1996-11-21 Mekra Lang Gmbh & Co Kg Monitoring device for difficult or invisible zones around motor vehicles
US5621518A (en) 1994-11-26 1997-04-15 Hewlett-Packard Company Optical time domain reflectometer (OTDR) with improved dynamic range and linearity
US5629704A (en) 1994-09-12 1997-05-13 Nissan Motor Co., Ltd. Target position detecting apparatus and method utilizing radar
US5633629A (en) 1995-02-08 1997-05-27 Hochstein; Peter A. Traffic information system using light emitting diodes
US5633801A (en) 1995-10-11 1997-05-27 Fluke Corporation Pulse-based impedance measurement instrument
EP0779990A1 (en) 1994-09-06 1997-06-25 The Regents Of The University Of California Time-of-flight radio location system
FR2743150A1 (en) 1996-01-02 1997-07-04 Renault Parking Space Size Measurement System for Cars
FR2743151A1 (en) 1996-01-02 1997-07-04 Renault Parking Space Size Measurement System for Cars
EP0784302A1 (en) 1996-01-10 1997-07-16 Toyota Jidosha Kabushiki Kaisha System and method for detecting vehicle types by utilizing information of vehicle height, and debiting system utilizing this system and method
EP0789342A1 (en) 1996-02-08 1997-08-13 Toyota Jidosha Kabushiki Kaisha Moving object detection method and apparatus
GB2311265A (en) 1996-03-22 1997-09-24 Donnelly Corp Vehicle blind spot detection and display system
EP0798684A1 (en) 1996-03-25 1997-10-01 MANNESMANN Aktiengesellschaft Method and system to obtain the traffic situation through fixed data-acquisition device
FR2749670A1 (en) 1996-06-11 1997-12-12 Renault DEVICE AND METHOD FOR MEASURING PARKING SPOTS OF A MOTOR VEHICLE
US5714754A (en) 1994-03-04 1998-02-03 Nicholas; John Jacob Remote zone operation of lighting systems for above-ground enclosed or semi-enclosed parking structures
EP0838695A1 (en) 1996-10-22 1998-04-29 LAP GmbH Laser Applikationen Speed measuring method according to the laser-doppler principle
US5760686A (en) 1994-02-14 1998-06-02 Toman; John R. Assembly and method for detecting errant vehicles and warning work zone personnel thereof
US5760887A (en) 1996-04-30 1998-06-02 Hughes Electronics Multi-pulse, multi-return, modal range processing for clutter rejection
US5764163A (en) 1995-09-21 1998-06-09 Electronics & Space Corp. Non-imaging electro-optic vehicle sensor apparatus utilizing variance in reflectance
US5777564A (en) 1996-06-06 1998-07-07 Jones; Edward L. Traffic signal system and method
US5793491A (en) * 1992-12-30 1998-08-11 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system multi-lane sensor and method
US5805468A (en) 1995-05-09 1998-09-08 Erwin Sick Gmbh Optik-Elektronik Method and apparatus for determining the light transit time over a measurement path arranged between a measuring apparatus and a reflecting object
US5812249A (en) 1996-09-26 1998-09-22 Envirotest Systems Corporation Speed and acceleration monitoring device using visible laser beams
EP0866434A1 (en) 1997-02-19 1998-09-23 MANNESMANN Aktiengesellschaft Device to collect data about moving objects
US5828320A (en) 1997-09-26 1998-10-27 Trigg Industries, Inc. Vehicle overheight detector device and method
US5838116A (en) 1996-04-15 1998-11-17 Jrs Technology, Inc. Fluorescent light ballast with information transmission circuitry
US5836583A (en) 1994-04-26 1998-11-17 Technical Casino Services Ltd. Detection system for detecting a position of a ball on a roulette wheel
WO1999004378A1 (en) 1997-07-19 1999-01-28 Footfall Limited Video imaging systems
US5896190A (en) 1992-11-23 1999-04-20 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system sensor and method
EP0912970A1 (en) 1996-07-26 1999-05-06 Paolo Sodi Machine and method for detecting traffic offenses with dynamic aiming systems
EP0935764A1 (en) 1996-04-01 1999-08-18 Gatsometer B.V. Method and apparatus for determining the speed and location of a vehicle
US5942753A (en) 1997-03-12 1999-08-24 Remote Sensing Technologies Infrared remote sensing device and system for checking vehicle brake condition
US5953110A (en) 1998-04-23 1999-09-14 H.N. Burns Engineering Corporation Multichannel laser radar
DE19823135A1 (en) 1998-05-23 1999-11-25 Bosch Gmbh Robert Traffic data acquisition for respective control of light signal system
US5995900A (en) 1997-01-24 1999-11-30 Grumman Corporation Infrared traffic sensor with feature curve generation
US6044336A (en) 1998-07-13 2000-03-28 Multispec Corporation Method and apparatus for situationally adaptive processing in echo-location systems operating in non-Gaussian environments
EP0988624A2 (en) 1998-04-09 2000-03-29 DaimlerChrysler AG System for recognizing road conditions
US6094159A (en) 1998-02-07 2000-07-25 Itt Manufacturing Enterprises, Inc. Process for measuring distance with adaptive amplification
US6100539A (en) 1997-01-20 2000-08-08 Sick Ag Light sensor with evaluation of the light transit time
US6104314A (en) 1998-02-10 2000-08-15 Jiang; Jung-Jye Automatic parking apparatus
US6107942A (en) 1999-02-03 2000-08-22 Premier Management Partners, Inc. Parking guidance and management system
US6115113A (en) 1998-12-02 2000-09-05 Lockheed Martin Corporation Method for increasing single-pulse range resolution
EP1034522A1 (en) 1997-11-24 2000-09-13 Michel Cuvelier Device for detection by photoelectric cells
EP1049064A2 (en) 1999-04-27 2000-11-02 ROBOT FOTO UND ELECTRONIC GmbH Traffic monitoring device with polarisation filters
EP1048961A2 (en) 1999-04-30 2000-11-02 Siemens Aktiengesellschaft Apparatus and method for simultaneous measurement of the speed and surface characteristics of moving objects
US6142702A (en) 1998-11-25 2000-11-07 Simmons; Jason Parking space security and status indicator system
US6147624A (en) 2000-01-31 2000-11-14 Intel Corporation Method and apparatus for parking management system for locating available parking space
EP1052143A2 (en) 1999-05-08 2000-11-15 DaimlerChrysler AG Driving assistance for vehicle lane changing
US6166645A (en) 1999-01-13 2000-12-26 Blaney; Kevin Road surface friction detector and method for vehicles
GB2354898A (en) 1999-07-07 2001-04-04 Pearpoint Ltd Vehicle licence plate imaging using two-part optical filter
WO2001039153A1 (en) 1999-11-24 2001-05-31 Adt Services Ag An illumination source
US6259515B1 (en) 1998-02-07 2001-07-10 Itt Manufacturing Enterprises, Inc. Evaluation concept for distance measuring processes
US6259862B1 (en) 1995-04-11 2001-07-10 Eastman Kodak Company Red-eye reduction using multiple function light source
US6266609B1 (en) 1998-12-02 2001-07-24 DDG GESELLSCHAFT FüR VERKEHRSDATEN MBH Parking space detection
US6281632B1 (en) 1998-09-18 2001-08-28 Gentex Corporation Continuously variable headlamp control
US6285297B1 (en) 1999-05-03 2001-09-04 Jay H. Ball Determining the availability of parking spaces
US6304321B1 (en) * 1992-11-23 2001-10-16 Schwartz Electro-Optics, Inc. Vehicle classification and axle counting sensor system and method
WO2001085491A1 (en) 2000-05-08 2001-11-15 Automotive Technologies International, Inc. Vehicular blind spot identification and monitoring system
US6340935B1 (en) 1999-02-05 2002-01-22 Brett O. Hall Computerized parking facility management system
WO2002015334A1 (en) 2000-08-16 2002-02-21 Raytheon Company Switched beam antenna architecture
US20020033884A1 (en) 2000-05-03 2002-03-21 Schurr George W. Machine vision-based sorter verification
US6363326B1 (en) 1997-11-05 2002-03-26 Robert Lawrence Scully Method and apparatus for detecting an object on a side of or backwards of a vehicle
US6377167B1 (en) 1997-07-22 2002-04-23 Auto-Sense Llc Multi frequency photoelectric detection system
US6404506B1 (en) 1998-03-09 2002-06-11 The Regents Of The University Of California Non-intrusive laser-based system for detecting objects moving across a planar surface
US6411221B2 (en) 1997-02-27 2002-06-25 Hoerber Ernst Device and method to detect an object in a given area, especially vehicles, for the purpose of traffic control
EP1220181A1 (en) 2000-12-30 2002-07-03 Goddert Peters Tunnel monitoring system in a tunnel
US6417783B1 (en) 1997-02-05 2002-07-09 Siemens Aktiengesellschaft Motor vehicle detector
EP1224632A1 (en) 2000-07-13 2002-07-24 Iris-Gmbh Infrared &amp; Intelligent Sensors Detection device
US6426708B1 (en) 2001-06-30 2002-07-30 Koninklijke Philips Electronics N.V. Smart parking advisor
US20020117340A1 (en) 2001-01-31 2002-08-29 Roger Stettner Laser radar based collision avoidance system for stationary or moving vehicles, automobiles, boats and aircraft
US20020141618A1 (en) * 1998-02-24 2002-10-03 Robert Ciolli Automated traffic violation monitoring and reporting system
US6502011B2 (en) 1999-07-30 2002-12-31 Gerhard Haag Method and apparatus for presenting and managing information in an automated parking structure
US6502053B1 (en) 2000-06-12 2002-12-31 Larry Hardin Combination passive and active speed detection system
WO2003000520A1 (en) 2001-06-21 2003-01-03 Tis, Inc. Parking guidance and vehicle control system
WO2003007269A1 (en) 2001-07-12 2003-01-23 Tenix Solutions Pty Ltd Method and apparatus for measuring speed
US6516286B1 (en) 1999-04-06 2003-02-04 Leica Geosystems Ag Method for measuring the distance to at least one target
EP1296302A1 (en) 2001-09-20 2003-03-26 Alma Mater Studiorum -Universita' di Bologna Vehicle traffic monitoring system, central control unit, and method
US6548967B1 (en) 1997-08-26 2003-04-15 Color Kinetics, Inc. Universal lighting network methods and systems
US6556916B2 (en) 2001-09-27 2003-04-29 Wavetronix Llc System and method for identification of traffic lane positions
US6559776B2 (en) 2001-02-15 2003-05-06 Yoram Katz Parking status control system and method
US6580385B1 (en) 1999-05-26 2003-06-17 Robert Bosch Gmbh Object detection system
EP1334869A2 (en) 2002-02-07 2003-08-13 Toyota Jidosha Kabushiki Kaisha Vehicle operation supporting device and vehicle operation supporting system
US20030154017A1 (en) 1996-09-25 2003-08-14 Ellis Christ G. Apparatus and method for vehicle counting, tracking and tagging
US20030189500A1 (en) 2002-04-04 2003-10-09 Lg Industrial Systems Co., Ltd. System for determining kind of vehicle and method therefor
US6642854B2 (en) 2000-06-14 2003-11-04 Mcmaster Steven James Electronic car park management system
US6650250B2 (en) 2001-05-21 2003-11-18 Seiko Epson Corporation Parking lot guidance system and parking lot guidance program
US6665621B2 (en) 2000-11-28 2003-12-16 Scientific Technologies Incorporated System and method for waveform processing
US6674394B1 (en) 2003-03-28 2004-01-06 Visteon Global Technologies, Inc. Method for determining object location from side-looking sensor data
WO2004010402A1 (en) 2002-07-17 2004-01-29 Fico Mirrors, Sa Device and method for the active monitoring of the safety perimeter of a motor vehicle
US20040035620A1 (en) 2002-08-26 2004-02-26 Mckeefery James Single wire automatically navigated vehicle systems and methods for toy applications
US20040051859A1 (en) 2002-09-12 2004-03-18 Flockencier Stuart W. Programmable pulse capture device with automatic gain control
WO2004027451A2 (en) 2002-09-18 2004-04-01 Bendix Commercial Vehicle Systems, Llc Vehicular situational awareness system
JP2004102889A (en) 2002-09-12 2004-04-02 Honda Motor Co Ltd Vehicle detection device
DE10247290A1 (en) 2002-10-10 2004-04-22 Volkswagen Ag Warning system installed on road vehicle detects presence of other vehicle in blind zone of first vehicle and calculates relative speed of two vehicles
US20040083035A1 (en) 1996-09-25 2004-04-29 Ellis Christ G. Apparatus and method for automatic vision enhancement in a traffic complex
WO2004039631A1 (en) 2002-10-31 2004-05-13 Gerd Reime Device for controlling lighting, especially inside the passenger compartments of vehicles and control method therefor
US6753766B2 (en) 2001-01-15 2004-06-22 1138037 Ontario Ltd. (“Alirt”) Detecting device and method of using same
US6753950B2 (en) 2000-01-26 2004-06-22 Instro Precision Limited Optical distance measurement
US20040118624A1 (en) 2002-12-20 2004-06-24 Motorola, Inc. CMOS camera with integral laser ranging and velocity measurement
US20040135992A1 (en) 2002-11-26 2004-07-15 Munro James F. Apparatus for high accuracy distance and velocity measurement and methods thereof
US6765495B1 (en) 2000-06-07 2004-07-20 Hrl Laboratories, Llc Inter vehicle communication system
US6771185B1 (en) 1999-02-03 2004-08-03 Chul Jin Yoo Parking guidance and management system
US6794831B2 (en) 1998-04-15 2004-09-21 Talking Lights Llc Non-flickering illumination based communication
WO2004100103A1 (en) 2003-05-07 2004-11-18 Koninklijke Philips Electronics N.V. Event detection system
US6821003B2 (en) 2002-07-16 2004-11-23 Visteon Global Technologies, Inc. Vehicle lamp and vehicle illumination and data transmission system incorporating same
US6825778B2 (en) 2002-10-21 2004-11-30 International Road Dynamics Inc. Variable speed limit system
US6831576B2 (en) 2002-11-13 2004-12-14 Robert Bosch Gmbh A/D converter with improved resolution by sampling a superposed signal
US20040254728A1 (en) * 2002-10-25 2004-12-16 Poropat George Vladimir Collision warning system and method
US6836317B1 (en) 1998-05-19 2004-12-28 Andreas Perger Method for optically measuring distance
US6842231B2 (en) 2002-09-30 2005-01-11 Raytheon Company Method for improved range accuracy in laser range finders
US6850156B2 (en) 1999-11-15 2005-02-01 Donnelly Corporation Anti-collision safety system for vehicle
US20050046597A1 (en) 2003-08-18 2005-03-03 Hutchison Michael C. Traffic light signal system using radar-based target detection and tracking
DE102004035856A1 (en) 2003-08-14 2005-03-10 Roland Bittner Electrical auxiliary device for use in a traffic system, e.g. a traffic data collection system or traffic warning system, whereby the device is mounted at least partially in a mounting tube or pipe of existing infrastructure
EP1521226A1 (en) 2003-10-02 2005-04-06 C.R.F. Società Consortile per Azioni Device for detecting environmental conditions and monitoring and controlling traffic
US20050078297A1 (en) 2001-12-21 2005-04-14 Gunter Doemens Device for monitoring spatial areas
US6885311B2 (en) 2001-02-07 2005-04-26 Vehiclesense, Inc. Parking management systems
US6885312B1 (en) 2002-05-28 2005-04-26 Bellsouth Intellectual Property Corporation Method and system for mapping vehicle parking
US20050117364A1 (en) 2003-10-27 2005-06-02 Mark Rennick Method and apparatus for projecting a turn signal indication
JP2005170184A (en) 2003-12-10 2005-06-30 Nissan Motor Co Ltd Light emitting diode lamp device with radar function
US6917307B2 (en) 2003-05-08 2005-07-12 Shih-Hsiung Li Management method and system for a parking lot
US6927700B1 (en) 2000-01-04 2005-08-09 Joseph P. Quinn Method and apparatus for detection and remote notification of vehicle parking space availability data
WO2005072358A2 (en) 2004-01-28 2005-08-11 Canesta, Inc. Single chip red, green, blue, distance (rgb-z) sensor
US20050187701A1 (en) 2004-02-23 2005-08-25 Baney Douglas M. Traffic communication system
US6946974B1 (en) 1999-09-28 2005-09-20 Racunas Jr Robert Vincent Web-based systems and methods for internet communication of substantially real-time parking data
US20050232469A1 (en) 2004-04-15 2005-10-20 Kenneth Schofield Imaging system for vehicle
US20050231384A1 (en) 2004-04-15 2005-10-20 Denso Corporation Vehicle information system for a loop intersection
DE202005010816U1 (en) 2005-07-09 2005-11-03 Owzar, Houtan, Dipl.-Ing.(FH) Alarm system for dead angle area of motor vehicle has sensors mounted on side mirror or roof edge of both sides of vehicle
US20050269481A1 (en) 2002-08-05 2005-12-08 Elbit Systems Ltd. Vehicle mounted night vision imaging system and method
US20050270175A1 (en) 2003-09-18 2005-12-08 Spot Devices, Inc. Methods, systems and devices related to road mounted indicators for providing visual indications to approaching traffic
US20050285738A1 (en) 2004-06-28 2005-12-29 Antonios Seas Compact single lens laser system for object/vehicle presence and speed determination
EP1611458A2 (en) 2003-01-10 2006-01-04 Wavetronix LLC Systems and methods for monitoring speed
JP2006021720A (en) 2004-07-09 2006-01-26 Nissan Motor Co Ltd Lamp device with distance measuring function
US20060033641A1 (en) 2004-08-16 2006-02-16 Alcatel Methods and system for detecting available parking places
JP2006507180A (en) 2002-11-25 2006-03-02 ダイムラークライスラー・アクチェンゲゼルシャフト Broadband lighting device
WO2006031220A2 (en) 2004-09-10 2006-03-23 Darryll Anderson Blind spot detector system
US20060066472A1 (en) 2004-09-10 2006-03-30 Gatsometer B.V. Method and system for detecting with radar the passage by a vehicle of a point for monitoring on a road
US7026954B2 (en) 2003-06-10 2006-04-11 Bellsouth Intellectual Property Corporation Automated parking director systems and related methods
WO2006044758A2 (en) 2004-10-15 2006-04-27 Trico Products Corporation Of Tennessee Object detection system with a vcsel diode array
JP2006172210A (en) 2004-12-16 2006-06-29 Matsushita Electric Works Ltd Distance image sensor for vehicle, and obstacle monitoring device using the same
US20060149472A1 (en) 2005-01-04 2006-07-06 Deere & Company, A Delaware Corporation. Vision-aided system and method for guiding a vehicle
US20060145824A1 (en) 2003-05-08 2006-07-06 Henryk Frenzel Method and device for detecting an object or a person
US20060147089A1 (en) 2005-01-04 2006-07-06 Deere & Company, A Delaware Corporation Method and system for guiding a vehicle with vision-based adjustment
US7081832B2 (en) 2003-04-25 2006-07-25 General Electric Capital Corporation Method and apparatus for obtaining data regarding a parking location
WO2006082502A1 (en) 2005-02-04 2006-08-10 Fico Mirrors, Sa Method and system for improving the monitoring of the external environment of a motor vehicle
US20060180670A1 (en) 2004-12-01 2006-08-17 Psc Scanning, Inc. Triggering illumination for a data reader
WO2006092659A2 (en) 2005-03-04 2006-09-08 C.R.F. Società Consortile Per Azioni System and method for monitoring road traffic
US7106214B2 (en) 2004-04-06 2006-09-12 Mongkol Jesadanont Apparatus and method of finding an unoccupied parking space in a parking lot
JP2006258598A (en) 2005-03-17 2006-09-28 Honda Motor Co Ltd Object detection apparatus for vehicle
US7116246B2 (en) 2001-10-03 2006-10-03 Maryann Winter Apparatus and method for sensing the occupancy status of parking spaces in a parking lot
US7119715B2 (en) 2004-03-31 2006-10-10 Honda Motor Co., Ltd. Parking lot attendant robot system
US7119674B2 (en) 2003-05-22 2006-10-10 Pips Technology, Inc. Automated site security, monitoring and access control system
US7123166B1 (en) 2000-11-17 2006-10-17 Haynes Michael N Method for managing a parking lot
US7148813B2 (en) 2003-03-20 2006-12-12 Gentex Corporation Light emitting traffic sign having vehicle sensing capabilities
CN2857132Y (en) 2005-12-12 2007-01-10 上海高德威智能交通系统有限公司 Central mode type vehicle information acquisition system
WO2007005942A2 (en) 2005-07-06 2007-01-11 Donnelly Corporation Vehicle exterior mirror assembly with blind spot indicator
US20070018106A1 (en) 2005-03-21 2007-01-25 Visonic Ltd. Passive infra-red detectors
US20070061192A1 (en) 2003-09-03 2007-03-15 Stratech Systems Limited Apparatus And Method For Locating, Identifying And Tracking Vehicles In A Parking Area
US7209221B2 (en) 1994-05-23 2007-04-24 Automotive Technologies International, Inc. Method for obtaining and displaying information about objects in a vehicular blind spot
GB2431498A (en) 2005-04-02 2007-04-25 Agd Systems Ltd Traffic detector that is programmed using a short range wireless configuration device.
US20070091294A1 (en) 2003-10-06 2007-04-26 Triple-In Holding Ag Distance measurement
US20070096943A1 (en) 2005-10-31 2007-05-03 Arnold David V Systems and methods for configuring intersection detection zones
JP2007121116A (en) 2005-10-28 2007-05-17 Sharp Corp Optical distance measuring device
US7221288B2 (en) 2004-10-25 2007-05-22 The Chamberlain Group, Inc. Method and apparatus for using optical signal time-of-flight information to facilitate obstacle detection
CA2633377A1 (en) 2005-12-19 2007-06-28 Institut National D'optique Object-detecting lighting system and method
US7253747B2 (en) 2003-09-11 2007-08-07 Oki Electric Industry Co., Ltd. Parking lot management system using wireless LAN system
US20070181786A1 (en) 2004-09-28 2007-08-09 Siemens Aktiengesellschaft Device for monitoring spatial areas
US20070181810A1 (en) * 2006-02-06 2007-08-09 Tan Michael R T Vertical cavity surface emitting laser (VCSEL) array laser scanner
WO2007096814A1 (en) 2006-02-20 2007-08-30 Koninklijke Philips Electronics N.V. Portable illumination device
US20070205918A1 (en) 2006-03-06 2007-09-06 Quality Informations System, S.A. System for estimating the location of vehicles in parking lots
US20070222639A1 (en) 2006-03-24 2007-09-27 Wavetronix Llc Monitoring signalized traffic flow
US20070255525A1 (en) 2003-07-10 2007-11-01 Seok-Hwan Lee Laser Rangefinder and Method Thereof
DE102006025020A1 (en) 2006-05-26 2007-11-29 Pmd Technologies Gmbh Time of flight lighting for illumination to capture three dimensional scenery, has illuminant and is combined with signal lighting and surface lighting
US7317384B2 (en) 2003-05-07 2008-01-08 Peugeot Citroen Automobiles Sa Optical exploration device and vehicle comprising said device
US20080006762A1 (en) 2005-09-30 2008-01-10 Fadell Anthony M Integrated proximity sensor and light sensor
US7319777B2 (en) 2001-04-04 2008-01-15 Instro Precision Limited Image analysis apparatus
US7321317B2 (en) 2003-11-07 2008-01-22 Nattel Group, Inc. Method for intelligent parking/pollution and surveillance control system
US7352972B2 (en) 1997-01-02 2008-04-01 Convergence Wireless, Inc. Method and apparatus for the zonal transmission of data using building lighting fixtures
US7350945B2 (en) 2004-01-09 2008-04-01 Valeo Vision System and method of detecting driving conditions for a motor vehicle
WO2008037049A1 (en) 2006-09-25 2008-04-03 Tony Mayer Micro-diffractive surveillance illuminator
US7359782B2 (en) 1994-05-23 2008-04-15 Automotive Technologies International, Inc. Vehicular impact reactive system and method
FR2910408A1 (en) 2006-12-21 2008-06-27 Valeo Vision Sa Infrared illuminator controlling method for e.g. car, involves detecting presence of object or person in detecting zone in carrying zone of illuminator using presence sensor, where detection zone has ophthalmic risk zone
US20080166023A1 (en) 2007-01-05 2008-07-10 Jigang Wang Video speed detection system
US20080172171A1 (en) 2007-01-17 2008-07-17 Gregory Mikituk Kowalski Methods and systems for controlling traffic flow
GB2445767A (en) 2005-11-24 2008-07-23 Linda Long Illuminated car park space indicator.
US7405676B2 (en) 2004-09-10 2008-07-29 Gatsometer B.V. Method and system for detecting with laser the passage by a vehicle of a point for monitoring on a road
US20080186470A1 (en) 2006-09-15 2008-08-07 Triple-In Holding Ag Taking distance images
US7417718B2 (en) 2005-10-28 2008-08-26 Sharp Kabushiki Kaisha Optical distance measuring apparatus
DE202008007078U1 (en) 2008-05-26 2008-09-04 Signalbau Huber Gmbh Video detection with PMD sensors
WO2008121648A1 (en) 2007-03-29 2008-10-09 Roberts Howard H Traffic control system
US20080245952A1 (en) 2007-04-03 2008-10-09 Troxell John R Synchronous imaging using segmented illumination
US20080278366A1 (en) 2007-05-07 2008-11-13 Andreas Behrens Method and Device for Determining the Vehicle Class of Vehicles
EP1997090A2 (en) 2006-03-22 2008-12-03 Kria S.R.L. A system for detecting vehicles
US20080309914A1 (en) 2007-06-18 2008-12-18 Daniel Cantin Method for detecting objects with visible light
WO2008154737A1 (en) 2007-06-18 2008-12-24 Leddartech Inc. Lighting system with traffic management capabilities
WO2008154736A1 (en) 2007-06-18 2008-12-24 Leddartech Inc. Lighting system with driver assistance capabilities
WO2009013739A1 (en) 2007-07-24 2009-01-29 Elbit Systems Ltd. System and method for level of visibility determination and vehicle counting
US7486204B2 (en) 2005-02-23 2009-02-03 Quintos Mel Francis P Warning alert system and method for pedestrians
DE102007038973A1 (en) 2007-08-17 2009-02-19 GM Global Technology Operations, Inc., Detroit Motor vehicle, has sensor e.g. parking space sensor, arranged on exterior mirror at passenger's side, and monitoring dead angle of exterior mirror, where monitoring is executable upto definite speed of vehicle
US20090102699A1 (en) 2007-10-11 2009-04-23 Andreas Behrens Method for Detecting and Documenting Traffic Violations at a Traffic Light
US7554652B1 (en) 2008-02-29 2009-06-30 Institut National D'optique Light-integrating rangefinding device and method
CA2710212A1 (en) 2007-12-21 2009-07-02 Leddartech Inc. Detection and ranging methods and systems
WO2009087536A2 (en) 2007-12-31 2009-07-16 Imagsa Technologies S.A. Method and system for detecting moving objects
WO2009104955A2 (en) 2008-02-20 2009-08-27 Markus Henricus Beuvink Method, system, and optical communication assembly for obtaining traffic information
DE102009013841A1 (en) 2008-03-20 2009-09-24 Fraas, Alfred Measuring system for traffic flow analysis
WO2009117197A2 (en) 2008-03-19 2009-09-24 Microsoft Corporation Visualizing camera feeds on a map
US20090243822A1 (en) 2008-03-31 2009-10-01 Hond Motor Co., Ltd. Vehicle blind spot detection and indicator system
US20090251680A1 (en) 2008-04-02 2009-10-08 Ali Farsaie Three dimensional spatial imaging system and method
US20090267784A1 (en) 2008-04-24 2009-10-29 Snap-On Equipment Srl A Unico Socio Parameter detection system
US7616293B2 (en) 2004-04-29 2009-11-10 Sigma Space Corporation System and method for traffic monitoring, speed determination, and traffic light violation detection and recording
US20090299631A1 (en) * 2008-05-29 2009-12-03 Delphi Technologies, Inc. Vehicle Pre-Impact Sensing System Having Object Feature Detection
US7635854B1 (en) 2008-07-09 2009-12-22 Institut National D'optique Method and apparatus for optical level sensing of agitated fluid surfaces
EP2136550A2 (en) 2008-06-18 2009-12-23 Ricoh Company, Ltd. Image pickup
US7640122B2 (en) 2007-11-07 2009-12-29 Institut National D'optique Digital signal processing in optical systems used for ranging applications
US20090323741A1 (en) 2008-06-27 2009-12-31 Institut National D'optique Digital laser pulse shaping module and system
US7652245B2 (en) 2005-10-25 2010-01-26 Qinetiq Limited Traffic sensing and monitoring apparatus
US20100066527A1 (en) 2008-09-17 2010-03-18 Jyh-Chiang Liou Integrated driving assistance apparatus
WO2010033024A1 (en) 2008-09-19 2010-03-25 N.V. Nederlandsche Apparatenfabriek Nedap Parking arrangement with an automatic vehicle detection system, and method for putting into operation and managing a parking arrangement
US20100117812A1 (en) 2008-11-10 2010-05-13 Lorenz Laubinger System and method for displaying a vehicle surrounding with adjustable point of view
DE102008043880A1 (en) 2008-11-19 2010-05-20 Robert Bosch Gmbh Lighting unit for a vehicle, vehicle and method therefor
US7725348B1 (en) * 2001-10-17 2010-05-25 United Toll Systems, Inc. Multilane vehicle information capture system
US7734500B1 (en) * 2001-10-17 2010-06-08 United Toll Systems, Inc. Multiple RF read zone system
US20100141765A1 (en) 2008-12-09 2010-06-10 Davide Capello Optical device for motor vehicles, for detecting the condition of the road surface
WO2010069002A1 (en) 2008-12-19 2010-06-24 Park Assist Pty Ltd Method, apparatus and system for vehicle detection
US7764193B2 (en) 2006-11-24 2010-07-27 Hon Hai Precision Industry Co., Ltd. Traffic regulation system
US20100214554A1 (en) 2008-12-23 2010-08-26 Thales Passive imaging system equipped with a range finder
US7796081B2 (en) 1997-10-22 2010-09-14 Intelligent Technologies International, Inc. Combined imaging and distance monitoring for vehicular applications
US7808401B1 (en) 2008-01-11 2010-10-05 Global Traffic Technologies, Llc Light emitters for optical traffic control systems
WO2010122284A1 (en) 2009-04-21 2010-10-28 Clearview Traffic Group Limited Traffic counting device
US20100309024A1 (en) 2007-12-21 2010-12-09 Yvan Mimeault Parking management system and method using lighting system
US7852462B2 (en) 2000-05-08 2010-12-14 Automotive Technologies International, Inc. Vehicular component control methods based on blind spot monitoring
WO2010144349A1 (en) 2009-06-08 2010-12-16 Wavetronix Llc. Detecting targets in roadway intersections
US7859432B2 (en) 2007-05-23 2010-12-28 Che Il Electric Wireing Devices Co., Ltd. Collision avoidance system based on detection of obstacles in blind spots of vehicle
US20110006188A1 (en) 2009-07-07 2011-01-13 Intersil Americas Inc. Proximity sensors with improved ambient light rejection
US7872572B2 (en) 2008-09-17 2011-01-18 International Business Machines Corporation Method and system for vehicle mounted infrared wavelength information displays for traffic camera viewers
US20110026007A1 (en) 2009-07-28 2011-02-03 Gammenthaler Robert S Lidar Measurement Device for Vehicular Traffic Surveillance and Method for Use of Same
US20110025843A1 (en) 2009-07-31 2011-02-03 Mesa Imaging Ag Time of Flight Camera with Rectangular Field of Illumination
US20110026008A1 (en) * 2009-07-28 2011-02-03 Gammenthaler Robert S Lidar Measurement Device with Target Tracking and Method for Use of Same
WO2011015817A2 (en) 2009-08-03 2011-02-10 Hatton Traffic Management Limited Traffic control system
US7889098B1 (en) 2005-12-19 2011-02-15 Wavetronix Llc Detecting targets in roadway intersections
WO2011025563A1 (en) 2009-08-26 2011-03-03 Raytheon Company Network of traffic behavior-monitoring unattended ground sensors (netbugs)
EP2306426A1 (en) 2009-10-01 2011-04-06 Kapsch TrafficCom AG Device for detecting vehicles on a traffic surface
US7933690B2 (en) 2005-02-23 2011-04-26 Honda Motor Co., Ltd. Vehicle recognition allowing device
WO2011055259A1 (en) 2009-11-03 2011-05-12 Koninklijke Philips Electronics N.V. Object-sensing lighting network and control system therefor
US20110115645A1 (en) 2008-01-11 2011-05-19 Timothy Hall LED Light Bar for Optical Traffic Control Systems
US20110115409A1 (en) 2008-06-16 2011-05-19 Mark Schwartz Led emitter for optical traffic control systems
US7957900B2 (en) * 2008-02-08 2011-06-07 Gaurav Chowdhary Tracking vehicle locations in a parking lot for definitive display on a GUI
US20110134249A1 (en) 2009-12-04 2011-06-09 Lockheed Martin Corporation Optical Detection and Ranging Sensor System For Sense and Avoid, and Related Methods
WO2011077400A2 (en) 2009-12-22 2011-06-30 Leddartech Inc. Active 3d monitoring system for traffic detection
US20110205521A1 (en) * 2005-12-19 2011-08-25 Yvan Mimeault Multi-channel led object detection system and method
US20110235028A1 (en) 2008-12-18 2011-09-29 Nicola Rohrseitz Passive translational velocity measurement from optical information
DE102010012811A1 (en) 2010-03-23 2011-09-29 Jenoptik Robot Gmbh Method for measurement of speed and assigning measured speed to car, involves fading marking in holder on car when car passes monitoring region, where marking represents measurement data of speed measured from car
EP2393295A1 (en) 2010-06-07 2011-12-07 Harman Becker Automotive Systems GmbH Method and device for identifying driving situations
US20120038902A1 (en) * 2010-08-13 2012-02-16 Ryan Dotson Enhancement of range measurement resolution using imagery
US20120229304A1 (en) * 2011-03-09 2012-09-13 Xerox Corporation Automated vehicle speed measurement and enforcement method and system
US20120287417A1 (en) 2011-05-11 2012-11-15 Yvan Mimeault Multiple-field-of-view scannerless optical rangefinder in high ambient background light
US8331621B1 (en) * 2001-10-17 2012-12-11 United Toll Systems, Inc. Vehicle image capture system
WO2012172526A1 (en) 2011-06-17 2012-12-20 Leddartech Inc. System and method for traffic side detection and characterization
WO2013128427A1 (en) 2012-03-02 2013-09-06 Leddartech Inc. System and method for multipurpose traffic detection and characterization
US8593519B2 (en) * 2007-02-06 2013-11-26 Denso Corporation Field watch apparatus
US8761447B2 (en) * 2010-11-09 2014-06-24 Biological Illumination, Llc Sustainable outdoor lighting system for use in environmentally photo-sensitive area
US8823951B2 (en) * 2010-07-23 2014-09-02 Leddartech Inc. 3D optical detection system and method for a mobile storage system
US8924140B2 (en) * 2009-04-14 2014-12-30 Hitachi, Ltd. External environment recognition device for vehicle and vehicle system using same
US8964031B2 (en) * 2009-08-17 2015-02-24 3M Innovative Properties Company Method and system for measuring the speed of a vehicle

Patent Citations (350)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3680085A (en) 1969-01-21 1972-07-25 Giovanni Del Signore Anti-collision apparatus for vehicles
US3967111A (en) 1974-12-20 1976-06-29 Scientific Technology Incorporated Pulsed light source discriminator system
US4634272A (en) 1982-06-02 1987-01-06 Nissan Motor Company, Limited Optical radar system with an array of photoelectric sensors
US4533242A (en) 1982-09-28 1985-08-06 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Ranging system which compares an object-reflected component of a light beam to a reference component of the light beam
US4733961A (en) 1983-03-07 1988-03-29 Texas Instruments Incorporated Amplifier for integrated laser/FLIR rangefinder
US4717862A (en) 1984-11-19 1988-01-05 The United States Government As Represented By The Secretary Of The Navy Pulsed illumination projector
WO1987005138A1 (en) 1986-02-19 1987-08-27 George Beggs Object detection method and apparatus employing electro-optics
EP0259445A1 (en) 1986-02-19 1988-03-16 Auto Sense Ltd Object detection method and apparatus employing electro-optics.
US4808997A (en) 1987-05-21 1989-02-28 Barkley George J Photoelectric vehicle position indicating device for use in parking and otherwise positioning vehicles
US4891624A (en) 1987-06-12 1990-01-02 Stanley Electric Co., Ltd. Rearward vehicle obstruction detector using modulated light from the brake light elements
EP0318260A2 (en) 1987-11-27 1989-05-31 Combustion Developments Limited Monitoring means
US5317311A (en) 1988-11-14 1994-05-31 Martell David K Traffic congestion monitoring system
US4928232A (en) 1988-12-16 1990-05-22 Laser Precision Corporation Signal averaging for optical time domain relectometers
US5134393A (en) 1990-04-02 1992-07-28 Henson H Keith Traffic control system
WO1992003808A1 (en) 1990-08-17 1992-03-05 The Secretary Of State For Defence In Her Britannic Majesty's Government Of The United Kingdom Of Great Britain And Northern Ireland Surveillance apparatus particularly for use in viewing vehicle number-plates
EP0476562A2 (en) 1990-09-19 1992-03-25 Hitachi, Ltd. Method and apparatus for controlling moving body and facilities
JPH04145391A (en) 1990-10-05 1992-05-19 Mitsubishi Electric Corp Distance measuring device
JPH04145390A (en) 1990-10-05 1992-05-19 Mitsubishi Electric Corp Distance measuring device
US5179286A (en) 1990-10-05 1993-01-12 Mitsubishi Denki K.K. Distance measuring apparatus receiving echo light pulses
JPH04172285A (en) 1990-11-02 1992-06-19 Mitsubishi Electric Corp Distance measuring apparatus
EP0494815A1 (en) 1991-01-11 1992-07-15 Regie Nationale Des Usines Renault S.A. Motor vehicles traffic measuring system
US5357331A (en) 1991-07-02 1994-10-18 Flockencier Stuart W System for processing reflected energy signals
US5102218A (en) 1991-08-15 1992-04-07 The United States Of America As Represented By The Secretary Of The Air Force Target-aerosol discrimination by means of digital signal processing
US5270780A (en) 1991-09-13 1993-12-14 Science Applications International Corporation Dual detector lidar system and method
GB2264411A (en) 1992-02-13 1993-08-25 Roke Manor Research Active infrared vehicle detector system
FR2690519A1 (en) 1992-04-23 1993-10-29 Est Centre Etu Tech Equipement Road traffic speed and distance monitoring system - uses pair of optical transceivers and ultra-sonic telemetry
US5896190A (en) 1992-11-23 1999-04-20 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system sensor and method
US6304321B1 (en) * 1992-11-23 2001-10-16 Schwartz Electro-Optics, Inc. Vehicle classification and axle counting sensor system and method
US5793491A (en) * 1992-12-30 1998-08-11 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system multi-lane sensor and method
EP0612049A1 (en) 1993-02-15 1994-08-24 STN ATLAS Elektronik GmbH Method for classifying vehicles passing a predetermined point on the road
US5389921A (en) 1993-05-17 1995-02-14 Whitton; John M. Parking lot apparatus and method
US5381155A (en) 1993-12-08 1995-01-10 Gerber; Eliot S. Vehicle speeding detection and identification
US5760686A (en) 1994-02-14 1998-06-02 Toman; John R. Assembly and method for detecting errant vehicles and warning work zone personnel thereof
US5714754A (en) 1994-03-04 1998-02-03 Nicholas; John Jacob Remote zone operation of lighting systems for above-ground enclosed or semi-enclosed parking structures
JPH07280940A (en) 1994-04-12 1995-10-27 Mitsubishi Electric Corp Radar for vehicle
US5836583A (en) 1994-04-26 1998-11-17 Technical Casino Services Ltd. Detection system for detecting a position of a ball on a roulette wheel
US7209221B2 (en) 1994-05-23 2007-04-24 Automotive Technologies International, Inc. Method for obtaining and displaying information about objects in a vehicular blind spot
US7359782B2 (en) 1994-05-23 2008-04-15 Automotive Technologies International, Inc. Vehicular impact reactive system and method
EP0779990A1 (en) 1994-09-06 1997-06-25 The Regents Of The University Of California Time-of-flight radio location system
US5629704A (en) 1994-09-12 1997-05-13 Nissan Motor Co., Ltd. Target position detecting apparatus and method utilizing radar
US5621518A (en) 1994-11-26 1997-04-15 Hewlett-Packard Company Optical time domain reflectometer (OTDR) with improved dynamic range and linearity
US5633629A (en) 1995-02-08 1997-05-27 Hochstein; Peter A. Traffic information system using light emitting diodes
DE19604338A1 (en) 1995-02-18 1996-08-29 Univ Dresden Tech Vehicle counting and classification sensor
US6259862B1 (en) 1995-04-11 2001-07-10 Eastman Kodak Company Red-eye reduction using multiple function light source
WO1996034252A1 (en) 1995-04-28 1996-10-31 Schwartz Electro-Optics, Inc. Intelligent vehicle highway system sensor and method
US5805468A (en) 1995-05-09 1998-09-08 Erwin Sick Gmbh Optik-Elektronik Method and apparatus for determining the light transit time over a measurement path arranged between a measuring apparatus and a reflecting object
US5764163A (en) 1995-09-21 1998-06-09 Electronics & Space Corp. Non-imaging electro-optic vehicle sensor apparatus utilizing variance in reflectance
US5633801A (en) 1995-10-11 1997-05-27 Fluke Corporation Pulse-based impedance measurement instrument
JPH09178786A (en) 1995-10-11 1997-07-11 Fluke Corp Pulse-base impedance-measuring instrument and pulse-base method for measuring complex impedance
FR2743151A1 (en) 1996-01-02 1997-07-04 Renault Parking Space Size Measurement System for Cars
FR2743150A1 (en) 1996-01-02 1997-07-04 Renault Parking Space Size Measurement System for Cars
EP0784302A1 (en) 1996-01-10 1997-07-16 Toyota Jidosha Kabushiki Kaisha System and method for detecting vehicle types by utilizing information of vehicle height, and debiting system utilizing this system and method
EP0789342A1 (en) 1996-02-08 1997-08-13 Toyota Jidosha Kabushiki Kaisha Moving object detection method and apparatus
GB2311265A (en) 1996-03-22 1997-09-24 Donnelly Corp Vehicle blind spot detection and display system
US5889477A (en) 1996-03-25 1999-03-30 Mannesmann Aktiengesellschaft Process and system for ascertaining traffic conditions using stationary data collection devices
EP0798684A1 (en) 1996-03-25 1997-10-01 MANNESMANN Aktiengesellschaft Method and system to obtain the traffic situation through fixed data-acquisition device
EP0935764A1 (en) 1996-04-01 1999-08-18 Gatsometer B.V. Method and apparatus for determining the speed and location of a vehicle
US5838116A (en) 1996-04-15 1998-11-17 Jrs Technology, Inc. Fluorescent light ballast with information transmission circuitry
US5760887A (en) 1996-04-30 1998-06-02 Hughes Electronics Multi-pulse, multi-return, modal range processing for clutter rejection
US5777564A (en) 1996-06-06 1998-07-07 Jones; Edward L. Traffic signal system and method
EP0904552A1 (en) 1996-06-11 1999-03-31 Renault Device and method for measuring parking gaps for a motor vehicle
DE69710579T2 (en) 1996-06-11 2002-08-22 Renault METHOD AND DEVICE FOR MEASURING PARKING SPACES FOR VEHICLES
FR2749670A1 (en) 1996-06-11 1997-12-12 Renault DEVICE AND METHOD FOR MEASURING PARKING SPOTS OF A MOTOR VEHICLE
EP0912970A1 (en) 1996-07-26 1999-05-06 Paolo Sodi Machine and method for detecting traffic offenses with dynamic aiming systems
US20030154017A1 (en) 1996-09-25 2003-08-14 Ellis Christ G. Apparatus and method for vehicle counting, tracking and tagging
US20040083035A1 (en) 1996-09-25 2004-04-29 Ellis Christ G. Apparatus and method for automatic vision enhancement in a traffic complex
US5812249A (en) 1996-09-26 1998-09-22 Envirotest Systems Corporation Speed and acceleration monitoring device using visible laser beams
EP0834424A1 (en) 1996-10-07 1998-04-08 MEKRA Lang GmbH & Co. KG Monitoring device of blind and visible zones around vehicles
DE29617413U1 (en) 1996-10-07 1996-11-21 Mekra Lang Gmbh & Co Kg Monitoring device for difficult or invisible zones around motor vehicles
US5963127A (en) 1996-10-07 1999-10-05 Mekra Lang Gmbh & Co. Kg Control equipment for difficult to see or blind spot areas around vehicles, and related method
EP0838695A1 (en) 1996-10-22 1998-04-29 LAP GmbH Laser Applikationen Speed measuring method according to the laser-doppler principle
US7352972B2 (en) 1997-01-02 2008-04-01 Convergence Wireless, Inc. Method and apparatus for the zonal transmission of data using building lighting fixtures
US6100539A (en) 1997-01-20 2000-08-08 Sick Ag Light sensor with evaluation of the light transit time
US5995900A (en) 1997-01-24 1999-11-30 Grumman Corporation Infrared traffic sensor with feature curve generation
US6417783B1 (en) 1997-02-05 2002-07-09 Siemens Aktiengesellschaft Motor vehicle detector
EP0866434A1 (en) 1997-02-19 1998-09-23 MANNESMANN Aktiengesellschaft Device to collect data about moving objects
US6411221B2 (en) 1997-02-27 2002-06-25 Hoerber Ernst Device and method to detect an object in a given area, especially vehicles, for the purpose of traffic control
US5942753A (en) 1997-03-12 1999-08-24 Remote Sensing Technologies Infrared remote sensing device and system for checking vehicle brake condition
WO1999004378A1 (en) 1997-07-19 1999-01-28 Footfall Limited Video imaging systems
US6377167B1 (en) 1997-07-22 2002-04-23 Auto-Sense Llc Multi frequency photoelectric detection system
US6548967B1 (en) 1997-08-26 2003-04-15 Color Kinetics, Inc. Universal lighting network methods and systems
US5828320A (en) 1997-09-26 1998-10-27 Trigg Industries, Inc. Vehicle overheight detector device and method
US7796081B2 (en) 1997-10-22 2010-09-14 Intelligent Technologies International, Inc. Combined imaging and distance monitoring for vehicular applications
US6363326B1 (en) 1997-11-05 2002-03-26 Robert Lawrence Scully Method and apparatus for detecting an object on a side of or backwards of a vehicle
EP1034522A1 (en) 1997-11-24 2000-09-13 Michel Cuvelier Device for detection by photoelectric cells
US6259515B1 (en) 1998-02-07 2001-07-10 Itt Manufacturing Enterprises, Inc. Evaluation concept for distance measuring processes
US6094159A (en) 1998-02-07 2000-07-25 Itt Manufacturing Enterprises, Inc. Process for measuring distance with adaptive amplification
US6104314A (en) 1998-02-10 2000-08-15 Jiang; Jung-Jye Automatic parking apparatus
US20020141618A1 (en) * 1998-02-24 2002-10-03 Robert Ciolli Automated traffic violation monitoring and reporting system
US6404506B1 (en) 1998-03-09 2002-06-11 The Regents Of The University Of California Non-intrusive laser-based system for detecting objects moving across a planar surface
EP0988624A2 (en) 1998-04-09 2000-03-29 DaimlerChrysler AG System for recognizing road conditions
US6794831B2 (en) 1998-04-15 2004-09-21 Talking Lights Llc Non-flickering illumination based communication
US5953110A (en) 1998-04-23 1999-09-14 H.N. Burns Engineering Corporation Multichannel laser radar
US6836317B1 (en) 1998-05-19 2004-12-28 Andreas Perger Method for optically measuring distance
DE19823135A1 (en) 1998-05-23 1999-11-25 Bosch Gmbh Robert Traffic data acquisition for respective control of light signal system
US6044336A (en) 1998-07-13 2000-03-28 Multispec Corporation Method and apparatus for situationally adaptive processing in echo-location systems operating in non-Gaussian environments
US6281632B1 (en) 1998-09-18 2001-08-28 Gentex Corporation Continuously variable headlamp control
US6142702A (en) 1998-11-25 2000-11-07 Simmons; Jason Parking space security and status indicator system
US6115113A (en) 1998-12-02 2000-09-05 Lockheed Martin Corporation Method for increasing single-pulse range resolution
US6266609B1 (en) 1998-12-02 2001-07-24 DDG GESELLSCHAFT FüR VERKEHRSDATEN MBH Parking space detection
US6166645A (en) 1999-01-13 2000-12-26 Blaney; Kevin Road surface friction detector and method for vehicles
US6107942A (en) 1999-02-03 2000-08-22 Premier Management Partners, Inc. Parking guidance and management system
US6771185B1 (en) 1999-02-03 2004-08-03 Chul Jin Yoo Parking guidance and management system
US6340935B1 (en) 1999-02-05 2002-01-22 Brett O. Hall Computerized parking facility management system
US6516286B1 (en) 1999-04-06 2003-02-04 Leica Geosystems Ag Method for measuring the distance to at least one target
EP1049064A2 (en) 1999-04-27 2000-11-02 ROBOT FOTO UND ELECTRONIC GmbH Traffic monitoring device with polarisation filters
EP1048961A2 (en) 1999-04-30 2000-11-02 Siemens Aktiengesellschaft Apparatus and method for simultaneous measurement of the speed and surface characteristics of moving objects
US6285297B1 (en) 1999-05-03 2001-09-04 Jay H. Ball Determining the availability of parking spaces
US6388565B1 (en) 1999-05-08 2002-05-14 Daimlerchrysler Ag Guidance system for assisting lane change of a motor vehicle
EP1052143A2 (en) 1999-05-08 2000-11-15 DaimlerChrysler AG Driving assistance for vehicle lane changing
DE19921449C1 (en) 1999-05-08 2001-01-25 Daimler Chrysler Ag Guide assistance when changing the lane of a motor vehicle
US6580385B1 (en) 1999-05-26 2003-06-17 Robert Bosch Gmbh Object detection system
GB2354898A (en) 1999-07-07 2001-04-04 Pearpoint Ltd Vehicle licence plate imaging using two-part optical filter
US6502011B2 (en) 1999-07-30 2002-12-31 Gerhard Haag Method and apparatus for presenting and managing information in an automated parking structure
US6946974B1 (en) 1999-09-28 2005-09-20 Racunas Jr Robert Vincent Web-based systems and methods for internet communication of substantially real-time parking data
US6850156B2 (en) 1999-11-15 2005-02-01 Donnelly Corporation Anti-collision safety system for vehicle
WO2001039153A1 (en) 1999-11-24 2001-05-31 Adt Services Ag An illumination source
US6927700B1 (en) 2000-01-04 2005-08-09 Joseph P. Quinn Method and apparatus for detection and remote notification of vehicle parking space availability data
US6753950B2 (en) 2000-01-26 2004-06-22 Instro Precision Limited Optical distance measurement
US6147624A (en) 2000-01-31 2000-11-14 Intel Corporation Method and apparatus for parking management system for locating available parking space
US20020033884A1 (en) 2000-05-03 2002-03-21 Schurr George W. Machine vision-based sorter verification
US20020005778A1 (en) 2000-05-08 2002-01-17 Breed David S. Vehicular blind spot identification and monitoring system
WO2001085491A1 (en) 2000-05-08 2001-11-15 Automotive Technologies International, Inc. Vehicular blind spot identification and monitoring system
US7049945B2 (en) 2000-05-08 2006-05-23 Automotive Technologies International, Inc. Vehicular blind spot identification and monitoring system
US7852462B2 (en) 2000-05-08 2010-12-14 Automotive Technologies International, Inc. Vehicular component control methods based on blind spot monitoring
GB2369737A (en) 2000-05-08 2002-06-05 Automotive Tech Int Vehicular blind spot identification and monitoring system
US6765495B1 (en) 2000-06-07 2004-07-20 Hrl Laboratories, Llc Inter vehicle communication system
US6502053B1 (en) 2000-06-12 2002-12-31 Larry Hardin Combination passive and active speed detection system
US6642854B2 (en) 2000-06-14 2003-11-04 Mcmaster Steven James Electronic car park management system
EP1224632A1 (en) 2000-07-13 2002-07-24 Iris-Gmbh Infrared &amp; Intelligent Sensors Detection device
WO2002015334A1 (en) 2000-08-16 2002-02-21 Raytheon Company Switched beam antenna architecture
US7123166B1 (en) 2000-11-17 2006-10-17 Haynes Michael N Method for managing a parking lot
US6665621B2 (en) 2000-11-28 2003-12-16 Scientific Technologies Incorporated System and method for waveform processing
EP1220181A1 (en) 2000-12-30 2002-07-03 Goddert Peters Tunnel monitoring system in a tunnel
US6753766B2 (en) 2001-01-15 2004-06-22 1138037 Ontario Ltd. (“Alirt”) Detecting device and method of using same
US20020117340A1 (en) 2001-01-31 2002-08-29 Roger Stettner Laser radar based collision avoidance system for stationary or moving vehicles, automobiles, boats and aircraft
US6885311B2 (en) 2001-02-07 2005-04-26 Vehiclesense, Inc. Parking management systems
US6559776B2 (en) 2001-02-15 2003-05-06 Yoram Katz Parking status control system and method
US7319777B2 (en) 2001-04-04 2008-01-15 Instro Precision Limited Image analysis apparatus
US6650250B2 (en) 2001-05-21 2003-11-18 Seiko Epson Corporation Parking lot guidance system and parking lot guidance program
WO2003000520A1 (en) 2001-06-21 2003-01-03 Tis, Inc. Parking guidance and vehicle control system
US6426708B1 (en) 2001-06-30 2002-07-30 Koninklijke Philips Electronics N.V. Smart parking advisor
WO2003007269A1 (en) 2001-07-12 2003-01-23 Tenix Solutions Pty Ltd Method and apparatus for measuring speed
EP1296302A1 (en) 2001-09-20 2003-03-26 Alma Mater Studiorum -Universita' di Bologna Vehicle traffic monitoring system, central control unit, and method
EP1435036A2 (en) 2001-09-27 2004-07-07 Wavetronix LLC System and method for identification of traffic lane positions
US6556916B2 (en) 2001-09-27 2003-04-29 Wavetronix Llc System and method for identification of traffic lane positions
US7116246B2 (en) 2001-10-03 2006-10-03 Maryann Winter Apparatus and method for sensing the occupancy status of parking spaces in a parking lot
US7725348B1 (en) * 2001-10-17 2010-05-25 United Toll Systems, Inc. Multilane vehicle information capture system
US8331621B1 (en) * 2001-10-17 2012-12-11 United Toll Systems, Inc. Vehicle image capture system
US7734500B1 (en) * 2001-10-17 2010-06-08 United Toll Systems, Inc. Multiple RF read zone system
US20050078297A1 (en) 2001-12-21 2005-04-14 Gunter Doemens Device for monitoring spatial areas
EP1334869A2 (en) 2002-02-07 2003-08-13 Toyota Jidosha Kabushiki Kaisha Vehicle operation supporting device and vehicle operation supporting system
US20030189500A1 (en) 2002-04-04 2003-10-09 Lg Industrial Systems Co., Ltd. System for determining kind of vehicle and method therefor
US6885312B1 (en) 2002-05-28 2005-04-26 Bellsouth Intellectual Property Corporation Method and system for mapping vehicle parking
US6821003B2 (en) 2002-07-16 2004-11-23 Visteon Global Technologies, Inc. Vehicle lamp and vehicle illumination and data transmission system incorporating same
US7378947B2 (en) 2002-07-17 2008-05-27 Fico Mirrors, S.A. Device and method for the active monitoring of the safety perimeter of a motor vehicle
WO2004010402A1 (en) 2002-07-17 2004-01-29 Fico Mirrors, Sa Device and method for the active monitoring of the safety perimeter of a motor vehicle
EP1542194A1 (en) 2002-07-17 2005-06-15 Fico Mirrors, S.A. Device and method for the active monitoring of the safety perimeter of a motor vehicle
US20050269481A1 (en) 2002-08-05 2005-12-08 Elbit Systems Ltd. Vehicle mounted night vision imaging system and method
US20040035620A1 (en) 2002-08-26 2004-02-26 Mckeefery James Single wire automatically navigated vehicle systems and methods for toy applications
US20040051859A1 (en) 2002-09-12 2004-03-18 Flockencier Stuart W. Programmable pulse capture device with automatic gain control
JP2004102889A (en) 2002-09-12 2004-04-02 Honda Motor Co Ltd Vehicle detection device
WO2004027451A2 (en) 2002-09-18 2004-04-01 Bendix Commercial Vehicle Systems, Llc Vehicular situational awareness system
US6842231B2 (en) 2002-09-30 2005-01-11 Raytheon Company Method for improved range accuracy in laser range finders
DE10247290A1 (en) 2002-10-10 2004-04-22 Volkswagen Ag Warning system installed on road vehicle detects presence of other vehicle in blind zone of first vehicle and calculates relative speed of two vehicles
WO2004036244A1 (en) 2002-10-10 2004-04-29 Volkswagen Aktiengesellschaft Method and device for monitoring dead angles of a motor vehicle
US7504932B2 (en) 2002-10-10 2009-03-17 Volkswagen Ag Method and device for monitoring blind spots of a motor vehicle
US6825778B2 (en) 2002-10-21 2004-11-30 International Road Dynamics Inc. Variable speed limit system
US20040254728A1 (en) * 2002-10-25 2004-12-16 Poropat George Vladimir Collision warning system and method
WO2004039631A1 (en) 2002-10-31 2004-05-13 Gerd Reime Device for controlling lighting, especially inside the passenger compartments of vehicles and control method therefor
US7221271B2 (en) 2002-10-31 2007-05-22 Gerd Reime Device for controlling lighting for the interiors of automotive vehicles and method for controlling said device
US6831576B2 (en) 2002-11-13 2004-12-14 Robert Bosch Gmbh A/D converter with improved resolution by sampling a superposed signal
US20060203505A1 (en) 2002-11-25 2006-09-14 Manfred Griesinger Wideband illumination device
JP2006507180A (en) 2002-11-25 2006-03-02 ダイムラークライスラー・アクチェンゲゼルシャフト Broadband lighting device
US20040135992A1 (en) 2002-11-26 2004-07-15 Munro James F. Apparatus for high accuracy distance and velocity measurement and methods thereof
JP2006521536A (en) 2002-11-26 2006-09-21 ジェームス エフ. マンロ High-precision distance measuring apparatus and method
WO2005008271A2 (en) 2002-11-26 2005-01-27 Munro James F An apparatus for high accuracy distance and velocity measurement and methods thereof
US20040118624A1 (en) 2002-12-20 2004-06-24 Motorola, Inc. CMOS camera with integral laser ranging and velocity measurement
US7426450B2 (en) 2003-01-10 2008-09-16 Wavetronix, Llc Systems and methods for monitoring speed
EP1611458A2 (en) 2003-01-10 2006-01-04 Wavetronix LLC Systems and methods for monitoring speed
US7148813B2 (en) 2003-03-20 2006-12-12 Gentex Corporation Light emitting traffic sign having vehicle sensing capabilities
DE102004016025A1 (en) 2003-03-28 2004-10-21 Visteon Global Technologies, Inc., Dearborn Method for determining an object location from data from a side-facing sensor
US6674394B1 (en) 2003-03-28 2004-01-06 Visteon Global Technologies, Inc. Method for determining object location from side-looking sensor data
GB2399968A (en) 2003-03-28 2004-09-29 Visteon Global Tech Inc Method for classifying the position of an object in a vehicle side object detection arrangement
US7081832B2 (en) 2003-04-25 2006-07-25 General Electric Capital Corporation Method and apparatus for obtaining data regarding a parking location
US7317384B2 (en) 2003-05-07 2008-01-08 Peugeot Citroen Automobiles Sa Optical exploration device and vehicle comprising said device
WO2004100103A1 (en) 2003-05-07 2004-11-18 Koninklijke Philips Electronics N.V. Event detection system
US6917307B2 (en) 2003-05-08 2005-07-12 Shih-Hsiung Li Management method and system for a parking lot
US20060145824A1 (en) 2003-05-08 2006-07-06 Henryk Frenzel Method and device for detecting an object or a person
US7119674B2 (en) 2003-05-22 2006-10-10 Pips Technology, Inc. Automated site security, monitoring and access control system
US7026954B2 (en) 2003-06-10 2006-04-11 Bellsouth Intellectual Property Corporation Automated parking director systems and related methods
US7135991B2 (en) 2003-06-10 2006-11-14 Bellsouth Intellectual Property Automated parking director systems and related methods
US20070255525A1 (en) 2003-07-10 2007-11-01 Seok-Hwan Lee Laser Rangefinder and Method Thereof
DE102004035856A1 (en) 2003-08-14 2005-03-10 Roland Bittner Electrical auxiliary device for use in a traffic system, e.g. a traffic data collection system or traffic warning system, whereby the device is mounted at least partially in a mounting tube or pipe of existing infrastructure
US20050046597A1 (en) 2003-08-18 2005-03-03 Hutchison Michael C. Traffic light signal system using radar-based target detection and tracking
US20070061192A1 (en) 2003-09-03 2007-03-15 Stratech Systems Limited Apparatus And Method For Locating, Identifying And Tracking Vehicles In A Parking Area
US7253747B2 (en) 2003-09-11 2007-08-07 Oki Electric Industry Co., Ltd. Parking lot management system using wireless LAN system
US20050270175A1 (en) 2003-09-18 2005-12-08 Spot Devices, Inc. Methods, systems and devices related to road mounted indicators for providing visual indications to approaching traffic
US7688222B2 (en) 2003-09-18 2010-03-30 Spot Devices, Inc. Methods, systems and devices related to road mounted indicators for providing visual indications to approaching traffic
EP1521226A1 (en) 2003-10-02 2005-04-06 C.R.F. Società Consortile per Azioni Device for detecting environmental conditions and monitoring and controlling traffic
US20070091294A1 (en) 2003-10-06 2007-04-26 Triple-In Holding Ag Distance measurement
US20050117364A1 (en) 2003-10-27 2005-06-02 Mark Rennick Method and apparatus for projecting a turn signal indication
US7321317B2 (en) 2003-11-07 2008-01-22 Nattel Group, Inc. Method for intelligent parking/pollution and surveillance control system
JP2005170184A (en) 2003-12-10 2005-06-30 Nissan Motor Co Ltd Light emitting diode lamp device with radar function
US7350945B2 (en) 2004-01-09 2008-04-01 Valeo Vision System and method of detecting driving conditions for a motor vehicle
WO2005072358A2 (en) 2004-01-28 2005-08-11 Canesta, Inc. Single chip red, green, blue, distance (rgb-z) sensor
US20050187701A1 (en) 2004-02-23 2005-08-25 Baney Douglas M. Traffic communication system
US7119715B2 (en) 2004-03-31 2006-10-10 Honda Motor Co., Ltd. Parking lot attendant robot system
US7106214B2 (en) 2004-04-06 2006-09-12 Mongkol Jesadanont Apparatus and method of finding an unoccupied parking space in a parking lot
US20050231384A1 (en) 2004-04-15 2005-10-20 Denso Corporation Vehicle information system for a loop intersection
US20050232469A1 (en) 2004-04-15 2005-10-20 Kenneth Schofield Imaging system for vehicle
US7236102B2 (en) 2004-04-15 2007-06-26 Denso Corporation Vehicle information system for a loop intersection
US7616293B2 (en) 2004-04-29 2009-11-10 Sigma Space Corporation System and method for traffic monitoring, speed determination, and traffic light violation detection and recording
US20050285738A1 (en) 2004-06-28 2005-12-29 Antonios Seas Compact single lens laser system for object/vehicle presence and speed determination
JP2006021720A (en) 2004-07-09 2006-01-26 Nissan Motor Co Ltd Lamp device with distance measuring function
US20060033641A1 (en) 2004-08-16 2006-02-16 Alcatel Methods and system for detecting available parking places
US20060066472A1 (en) 2004-09-10 2006-03-30 Gatsometer B.V. Method and system for detecting with radar the passage by a vehicle of a point for monitoring on a road
WO2006031220A2 (en) 2004-09-10 2006-03-23 Darryll Anderson Blind spot detector system
US7405676B2 (en) 2004-09-10 2008-07-29 Gatsometer B.V. Method and system for detecting with laser the passage by a vehicle of a point for monitoring on a road
US20070181786A1 (en) 2004-09-28 2007-08-09 Siemens Aktiengesellschaft Device for monitoring spatial areas
WO2006044758A2 (en) 2004-10-15 2006-04-27 Trico Products Corporation Of Tennessee Object detection system with a vcsel diode array
US7221288B2 (en) 2004-10-25 2007-05-22 The Chamberlain Group, Inc. Method and apparatus for using optical signal time-of-flight information to facilitate obstacle detection
US20060180670A1 (en) 2004-12-01 2006-08-17 Psc Scanning, Inc. Triggering illumination for a data reader
JP2006172210A (en) 2004-12-16 2006-06-29 Matsushita Electric Works Ltd Distance image sensor for vehicle, and obstacle monitoring device using the same
US20060147089A1 (en) 2005-01-04 2006-07-06 Deere & Company, A Delaware Corporation Method and system for guiding a vehicle with vision-based adjustment
US20060149472A1 (en) 2005-01-04 2006-07-06 Deere & Company, A Delaware Corporation. Vision-aided system and method for guiding a vehicle
US20090027185A1 (en) 2005-02-04 2009-01-29 Francesc Daura Luna Method and System for Improving the Monitoring of the External Environment of a Motor Vehicle
WO2006082502A1 (en) 2005-02-04 2006-08-10 Fico Mirrors, Sa Method and system for improving the monitoring of the external environment of a motor vehicle
EP1859990A1 (en) 2005-02-04 2007-11-28 Fico Mirrors, SA Method and system for improving the monitoring of the external environment of a motor vehicle
US7486204B2 (en) 2005-02-23 2009-02-03 Quintos Mel Francis P Warning alert system and method for pedestrians
US7933690B2 (en) 2005-02-23 2011-04-26 Honda Motor Co., Ltd. Vehicle recognition allowing device
WO2006092659A2 (en) 2005-03-04 2006-09-08 C.R.F. Società Consortile Per Azioni System and method for monitoring road traffic
US20060221228A1 (en) 2005-03-17 2006-10-05 Honda Motor Co., Ltd. Vehicle-purpose object sensing apparatus
JP2006258598A (en) 2005-03-17 2006-09-28 Honda Motor Co Ltd Object detection apparatus for vehicle
US7250605B2 (en) 2005-03-21 2007-07-31 Visonic Ltd. Passive infra-red detectors
US20070018106A1 (en) 2005-03-21 2007-01-25 Visonic Ltd. Passive infra-red detectors
GB2431498A (en) 2005-04-02 2007-04-25 Agd Systems Ltd Traffic detector that is programmed using a short range wireless configuration device.
US7760111B2 (en) 2005-07-06 2010-07-20 Donnelly Corporation Vehicle exterior mirror assembly with blind spot indicator
WO2007005942A2 (en) 2005-07-06 2007-01-11 Donnelly Corporation Vehicle exterior mirror assembly with blind spot indicator
US7492281B2 (en) 2005-07-06 2009-02-17 Donnelly Corporation Vehicle exterior mirror assembly with blind spot indicator
DE202005010816U1 (en) 2005-07-09 2005-11-03 Owzar, Houtan, Dipl.-Ing.(FH) Alarm system for dead angle area of motor vehicle has sensors mounted on side mirror or roof edge of both sides of vehicle
US20080006762A1 (en) 2005-09-30 2008-01-10 Fadell Anthony M Integrated proximity sensor and light sensor
US7652245B2 (en) 2005-10-25 2010-01-26 Qinetiq Limited Traffic sensing and monitoring apparatus
US7417718B2 (en) 2005-10-28 2008-08-26 Sharp Kabushiki Kaisha Optical distance measuring apparatus
JP2007121116A (en) 2005-10-28 2007-05-17 Sharp Corp Optical distance measuring device
US7573400B2 (en) 2005-10-31 2009-08-11 Wavetronix, Llc Systems and methods for configuring intersection detection zones
US20070096943A1 (en) 2005-10-31 2007-05-03 Arnold David V Systems and methods for configuring intersection detection zones
GB2445767A (en) 2005-11-24 2008-07-23 Linda Long Illuminated car park space indicator.
CN2857132Y (en) 2005-12-12 2007-01-10 上海高德威智能交通系统有限公司 Central mode type vehicle information acquisition system
US7889097B1 (en) 2005-12-19 2011-02-15 Wavetronix Llc Detecting targets in roadway intersections
US7855376B2 (en) 2005-12-19 2010-12-21 Institut National D'optique Lighting system and method for illuminating and detecting object
US20070228262A1 (en) 2005-12-19 2007-10-04 Daniel Cantin Object-detecting lighting system and method
US7889098B1 (en) 2005-12-19 2011-02-15 Wavetronix Llc Detecting targets in roadway intersections
WO2007071032A1 (en) 2005-12-19 2007-06-28 Institut National D'optique Object-detecting lighting system and method
US20110205521A1 (en) * 2005-12-19 2011-08-25 Yvan Mimeault Multi-channel led object detection system and method
US8242476B2 (en) 2005-12-19 2012-08-14 Leddartech Inc. LED object detection system and method combining complete reflection traces from individual narrow field-of-view channels
CA2633377A1 (en) 2005-12-19 2007-06-28 Institut National D'optique Object-detecting lighting system and method
US20070181810A1 (en) * 2006-02-06 2007-08-09 Tan Michael R T Vertical cavity surface emitting laser (VCSEL) array laser scanner
WO2007096814A1 (en) 2006-02-20 2007-08-30 Koninklijke Philips Electronics N.V. Portable illumination device
US20070205918A1 (en) 2006-03-06 2007-09-06 Quality Informations System, S.A. System for estimating the location of vehicles in parking lots
EP1997090A2 (en) 2006-03-22 2008-12-03 Kria S.R.L. A system for detecting vehicles
US20070222639A1 (en) 2006-03-24 2007-09-27 Wavetronix Llc Monitoring signalized traffic flow
DE102006025020A1 (en) 2006-05-26 2007-11-29 Pmd Technologies Gmbh Time of flight lighting for illumination to capture three dimensional scenery, has illuminant and is combined with signal lighting and surface lighting
US20080186470A1 (en) 2006-09-15 2008-08-07 Triple-In Holding Ag Taking distance images
WO2008037049A1 (en) 2006-09-25 2008-04-03 Tony Mayer Micro-diffractive surveillance illuminator
US7764193B2 (en) 2006-11-24 2010-07-27 Hon Hai Precision Industry Co., Ltd. Traffic regulation system
FR2910408A1 (en) 2006-12-21 2008-06-27 Valeo Vision Sa Infrared illuminator controlling method for e.g. car, involves detecting presence of object or person in detecting zone in carrying zone of illuminator using presence sensor, where detection zone has ophthalmic risk zone
US20080166023A1 (en) 2007-01-05 2008-07-10 Jigang Wang Video speed detection system
US20080172171A1 (en) 2007-01-17 2008-07-17 Gregory Mikituk Kowalski Methods and systems for controlling traffic flow
US8593519B2 (en) * 2007-02-06 2013-11-26 Denso Corporation Field watch apparatus
US7898433B2 (en) 2007-03-29 2011-03-01 Roberts Howard H Traffic control system
WO2008121648A1 (en) 2007-03-29 2008-10-09 Roberts Howard H Traffic control system
US20080245952A1 (en) 2007-04-03 2008-10-09 Troxell John R Synchronous imaging using segmented illumination
US20080278366A1 (en) 2007-05-07 2008-11-13 Andreas Behrens Method and Device for Determining the Vehicle Class of Vehicles
US7859432B2 (en) 2007-05-23 2010-12-28 Che Il Electric Wireing Devices Co., Ltd. Collision avoidance system based on detection of obstacles in blind spots of vehicle
US20080309914A1 (en) 2007-06-18 2008-12-18 Daniel Cantin Method for detecting objects with visible light
US20100194595A1 (en) 2007-06-18 2010-08-05 Yvan Mimeault Lighting system with traffic management capabilities
US8600656B2 (en) 2007-06-18 2013-12-03 Leddartech Inc. Lighting system with driver assistance capabilities
US20100191418A1 (en) 2007-06-18 2010-07-29 Yvan Mimeault Lighting system with driver assistance capabilities
US8436748B2 (en) 2007-06-18 2013-05-07 Leddartech Inc. Lighting system with traffic management capabilities
WO2008154737A1 (en) 2007-06-18 2008-12-24 Leddartech Inc. Lighting system with traffic management capabilities
WO2008154736A1 (en) 2007-06-18 2008-12-24 Leddartech Inc. Lighting system with driver assistance capabilities
WO2009013739A1 (en) 2007-07-24 2009-01-29 Elbit Systems Ltd. System and method for level of visibility determination and vehicle counting
DE102007038973A1 (en) 2007-08-17 2009-02-19 GM Global Technology Operations, Inc., Detroit Motor vehicle, has sensor e.g. parking space sensor, arranged on exterior mirror at passenger's side, and monitoring dead angle of exterior mirror, where monitoring is executable upto definite speed of vehicle
US7633433B2 (en) 2007-10-11 2009-12-15 Robot Visual Systems Gmbh Method for detecting and documenting traffic violations at a traffic light
US20090102699A1 (en) 2007-10-11 2009-04-23 Andreas Behrens Method for Detecting and Documenting Traffic Violations at a Traffic Light
US7640122B2 (en) 2007-11-07 2009-12-29 Institut National D'optique Digital signal processing in optical systems used for ranging applications
US7917320B2 (en) 2007-11-07 2011-03-29 Leddartech Inc. Digital signal processing in optical systems used for ranging applications
US7895007B2 (en) 2007-11-07 2011-02-22 Institut National D'optique Digital signal processing in optical systems used for ranging applications
US20100309024A1 (en) 2007-12-21 2010-12-09 Yvan Mimeault Parking management system and method using lighting system
CA2710212A1 (en) 2007-12-21 2009-07-02 Leddartech Inc. Detection and ranging methods and systems
US20100277713A1 (en) 2007-12-21 2010-11-04 Yvan Mimeault Detection and ranging methods and systems
WO2009079789A1 (en) 2007-12-21 2009-07-02 Leddartech Inc. Detection and ranging methods and systems
WO2009087536A2 (en) 2007-12-31 2009-07-16 Imagsa Technologies S.A. Method and system for detecting moving objects
US20110115645A1 (en) 2008-01-11 2011-05-19 Timothy Hall LED Light Bar for Optical Traffic Control Systems
US7808401B1 (en) 2008-01-11 2010-10-05 Global Traffic Technologies, Llc Light emitters for optical traffic control systems
US7952491B2 (en) 2008-01-11 2011-05-31 Global Traffic Technologies, Llc Optical traffic control system with burst mode light emitter
US7957900B2 (en) * 2008-02-08 2011-06-07 Gaurav Chowdhary Tracking vehicle locations in a parking lot for definitive display on a GUI
WO2009104955A2 (en) 2008-02-20 2009-08-27 Markus Henricus Beuvink Method, system, and optical communication assembly for obtaining traffic information
US7554652B1 (en) 2008-02-29 2009-06-30 Institut National D'optique Light-integrating rangefinding device and method
WO2009117197A2 (en) 2008-03-19 2009-09-24 Microsoft Corporation Visualizing camera feeds on a map
DE102009013841A1 (en) 2008-03-20 2009-09-24 Fraas, Alfred Measuring system for traffic flow analysis
US20090243822A1 (en) 2008-03-31 2009-10-01 Hond Motor Co., Ltd. Vehicle blind spot detection and indicator system
EP2106968A2 (en) 2008-03-31 2009-10-07 Honda Motor Co., Ltd. Vehicle blind spot detection and indicator system
US20090251680A1 (en) 2008-04-02 2009-10-08 Ali Farsaie Three dimensional spatial imaging system and method
US20090267784A1 (en) 2008-04-24 2009-10-29 Snap-On Equipment Srl A Unico Socio Parameter detection system
DE202008007078U1 (en) 2008-05-26 2008-09-04 Signalbau Huber Gmbh Video detection with PMD sensors
US20090299631A1 (en) * 2008-05-29 2009-12-03 Delphi Technologies, Inc. Vehicle Pre-Impact Sensing System Having Object Feature Detection
US20110115409A1 (en) 2008-06-16 2011-05-19 Mark Schwartz Led emitter for optical traffic control systems
EP2136550A2 (en) 2008-06-18 2009-12-23 Ricoh Company, Ltd. Image pickup
US20090323741A1 (en) 2008-06-27 2009-12-31 Institut National D'optique Digital laser pulse shaping module and system
US7635854B1 (en) 2008-07-09 2009-12-22 Institut National D'optique Method and apparatus for optical level sensing of agitated fluid surfaces
US7872572B2 (en) 2008-09-17 2011-01-18 International Business Machines Corporation Method and system for vehicle mounted infrared wavelength information displays for traffic camera viewers
US20100066527A1 (en) 2008-09-17 2010-03-18 Jyh-Chiang Liou Integrated driving assistance apparatus
WO2010033024A1 (en) 2008-09-19 2010-03-25 N.V. Nederlandsche Apparatenfabriek Nedap Parking arrangement with an automatic vehicle detection system, and method for putting into operation and managing a parking arrangement
US20100117812A1 (en) 2008-11-10 2010-05-13 Lorenz Laubinger System and method for displaying a vehicle surrounding with adjustable point of view
DE102008043880A1 (en) 2008-11-19 2010-05-20 Robert Bosch Gmbh Lighting unit for a vehicle, vehicle and method therefor
WO2010057697A1 (en) 2008-11-19 2010-05-27 Robert Bosch Gmbh Lighting unit for a vehicle, vehicle and method therefor
US20100141765A1 (en) 2008-12-09 2010-06-10 Davide Capello Optical device for motor vehicles, for detecting the condition of the road surface
US20110235028A1 (en) 2008-12-18 2011-09-29 Nicola Rohrseitz Passive translational velocity measurement from optical information
WO2010069002A1 (en) 2008-12-19 2010-06-24 Park Assist Pty Ltd Method, apparatus and system for vehicle detection
US20100214554A1 (en) 2008-12-23 2010-08-26 Thales Passive imaging system equipped with a range finder
US8924140B2 (en) * 2009-04-14 2014-12-30 Hitachi, Ltd. External environment recognition device for vehicle and vehicle system using same
WO2010122284A1 (en) 2009-04-21 2010-10-28 Clearview Traffic Group Limited Traffic counting device
WO2010144349A1 (en) 2009-06-08 2010-12-16 Wavetronix Llc. Detecting targets in roadway intersections
US20110006188A1 (en) 2009-07-07 2011-01-13 Intersil Americas Inc. Proximity sensors with improved ambient light rejection
US20110026007A1 (en) 2009-07-28 2011-02-03 Gammenthaler Robert S Lidar Measurement Device for Vehicular Traffic Surveillance and Method for Use of Same
US20110026008A1 (en) * 2009-07-28 2011-02-03 Gammenthaler Robert S Lidar Measurement Device with Target Tracking and Method for Use of Same
US20110025843A1 (en) 2009-07-31 2011-02-03 Mesa Imaging Ag Time of Flight Camera with Rectangular Field of Illumination
WO2011015817A2 (en) 2009-08-03 2011-02-10 Hatton Traffic Management Limited Traffic control system
US8964031B2 (en) * 2009-08-17 2015-02-24 3M Innovative Properties Company Method and system for measuring the speed of a vehicle
WO2011025563A1 (en) 2009-08-26 2011-03-03 Raytheon Company Network of traffic behavior-monitoring unattended ground sensors (netbugs)
EP2306426A1 (en) 2009-10-01 2011-04-06 Kapsch TrafficCom AG Device for detecting vehicles on a traffic surface
WO2011055259A1 (en) 2009-11-03 2011-05-12 Koninklijke Philips Electronics N.V. Object-sensing lighting network and control system therefor
US20110134249A1 (en) 2009-12-04 2011-06-09 Lockheed Martin Corporation Optical Detection and Ranging Sensor System For Sense and Avoid, and Related Methods
CA2782180A1 (en) 2009-12-22 2011-06-30 Leddartech Inc. Active 3d monitoring system for traffic detection
WO2011077400A2 (en) 2009-12-22 2011-06-30 Leddartech Inc. Active 3d monitoring system for traffic detection
US20120307065A1 (en) 2009-12-22 2012-12-06 Yvan Mimeault Active 3d monitoring system for traffic detection
DE102010012811A1 (en) 2010-03-23 2011-09-29 Jenoptik Robot Gmbh Method for measurement of speed and assigning measured speed to car, involves fading marking in holder on car when car passes monitoring region, where marking represents measurement data of speed measured from car
EP2393295A1 (en) 2010-06-07 2011-12-07 Harman Becker Automotive Systems GmbH Method and device for identifying driving situations
US8823951B2 (en) * 2010-07-23 2014-09-02 Leddartech Inc. 3D optical detection system and method for a mobile storage system
US20120038902A1 (en) * 2010-08-13 2012-02-16 Ryan Dotson Enhancement of range measurement resolution using imagery
US8761447B2 (en) * 2010-11-09 2014-06-24 Biological Illumination, Llc Sustainable outdoor lighting system for use in environmentally photo-sensitive area
US20120229304A1 (en) * 2011-03-09 2012-09-13 Xerox Corporation Automated vehicle speed measurement and enforcement method and system
WO2012153309A2 (en) 2011-05-11 2012-11-15 Leddartech Inc. Multiple-field-of-view scannerless optical rangefinder in high ambient background light
US20120287417A1 (en) 2011-05-11 2012-11-15 Yvan Mimeault Multiple-field-of-view scannerless optical rangefinder in high ambient background light
WO2012172526A1 (en) 2011-06-17 2012-12-20 Leddartech Inc. System and method for traffic side detection and characterization
US20140232566A1 (en) 2011-06-17 2014-08-21 Leddartech Inc. System and method for traffic side detection and characterization
WO2013128427A1 (en) 2012-03-02 2013-09-06 Leddartech Inc. System and method for multipurpose traffic detection and characterization
US9235988B2 (en) 2012-03-02 2016-01-12 Leddartech Inc. System and method for multipurpose traffic detection and characterization

Non-Patent Citations (14)

* Cited by examiner, † Cited by third party
Title
Akindinov et al., "Detection of Light Pulses Using an Avalanche-Photodiode Array with a Metal-Resistor-Semiconductor Structure", Instruments and Experimental Techniques, Nov. 2004, vol. 48, No. 3 205, pp. 355-363, Russia.
Braun et al., "Nanosecond transient electroluminescence from polymer lightemitting diodes", Applied Physics Letters Dec. 1992, vol. 61, No. 26, pp. 3092-3094, California.
Dimitri Loukakos, Active Laser Infrared Detectors, Intelligent Transportation Systems, Traffic Surveillance, California Center for Innovative Transportation at the University of California, Dec. 20, 2001, available at http://www.calccit.org/itsdecision/serv_and_tech/Traffic_Surveillance/road-based/roadside/other_roadside_rep.html on Sep. 16, 2009.
GENEQ Inc., Passive Infrared Detector for Traffic Data Acquisition, Model IR 250, Department of Meteorology, available at http://www.geneq.com/catalog/en/ir250.html on Sep. 16, 2009.
Hussain, Tarik Mustafa, City University of New-York, Infrared Vehicle Sensor for Traffic Control, Thesis (PHD) City University of New York, Dissertation Abstracts International, vol. 55-07, Section A, p. 2176, 1994, available at http://adsabs.harvard.edu//abs/1994PhDT 85H on Sep. 16, 2009.
International Preliminary Report on Patentability in International Application No. PCT/IB2013/051667, dated Sep. 2, 2014, 6 pages.
International Search Report and Written Opinion in International Application No. PCT/IB2013/051667, dated Jul. 9, 2013, 8 pages.
Lawrence A. Klein, Vehicle Detector Technologies for Traffic Management Applications, Part 1, Colorado Department of Transportation, Intelligent Transportation Systems (ITS), 1997, available at http://www.cotrip.org/its/ITS%20Guidelines%20Web%20New%20Format%202-05/Web%20Solutions%20Packages/ITS%20Solution%20Packages%20-%20Web%20Copy/Vehicle%20Detectors/Klein%20Part%201%20Vehicle%20Detector%20Technologies.doc on Sep. 16, 2009.
Shimoni et al., "Detection of vehicles in shadow areas", Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), 2011 3rd, Jun. 6-9, 2011, pp. 1-4, IEEE, Lisbon.
Tayfun Kon, Thesis, "Collision Warning and Avoidance System for Crest Vertical Curves", Virginia Tech, May 4, 1998, Appendix 82, pp. 51-92, published on Digital Library and Archives, University Libraries of Virginia Tech, VA.
The Vehicule Detector Clearinghouse, "A Summary of Vehicle Detection and Surveillance Technologies used in Intelligent Transportation Systems", Fall 2000, Southwest Technology Development Institute (SWTDI) at New Mexico State University (NMSU), sponsored in cooperation with the U.S. Department of Transportation FHWA, available at http://www.fhwa.dot.gov/ohim/tvtw/vdstits.
U.S. Department of Transportation Federal Highway Administration, "Detailed Monitoring Protocol 4.0 Monitoring Methods", Department of Air Quality, Air Toxic MSAT, available at http://www.fhwa.dot.gov/environment/air_quality/air_toxics/research_and_analysis/near_road_study/protocol/protocol04.cfm, updated on Jul. 6, 2011.
United States Department of Transportation, Federal Highway Administration, Sensor Technology—Chapter 2, Traffic Detector Handbook : Third Edition—vol. 1, FHWA-HRT-06-108, available at http://www.tfhrc.gov/its/pubs/06108/02a.htm on Sep. 16, 2009.
United States Department of Transportation, Research and Innovative Technology Administration, 5.3. Infrared Detectors, available at http://ntl.bts.gov/DOCS/96100/ch05/body_ch05_03.html on Sep. 16, 2009.

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11725956B2 (en) 2015-04-01 2023-08-15 Vayavision Sensing Ltd. Apparatus for acquiring 3-dimensional maps of a scene
US11668830B1 (en) 2018-06-01 2023-06-06 Vayavision Sensing Ltd. System and method for performing active distance measurements
US12093834B2 (en) 2019-09-22 2024-09-17 Vaya Vision Sensing Ltd. Methods and systems for training and validating a perception system

Also Published As

Publication number Publication date
CA2998175A1 (en) 2013-09-06
CA3112113A1 (en) 2013-09-06
EP2820632A1 (en) 2015-01-07
US9235988B2 (en) 2016-01-12
EP2820632A4 (en) 2015-08-12
CA2998166C (en) 2019-04-09
CA2998166A1 (en) 2013-09-06
EP2820632B1 (en) 2017-05-10
CA2865733A1 (en) 2013-09-06
CA2865733C (en) 2023-09-26
EP2820632B8 (en) 2017-07-26
US20140159925A1 (en) 2014-06-12
CA2998175C (en) 2020-11-10
WO2013128427A1 (en) 2013-09-06

Similar Documents

Publication Publication Date Title
USRE48914E1 (en) System and method for multipurpose traffic detection and characterization
EP2721593B1 (en) System and method for traffic side detection and characterization
US9946734B2 (en) Portable vehicle monitoring system
US8184863B2 (en) Video speed detection system
US8294595B1 (en) Speed detector for moving vehicles
US10474154B1 (en) Self-driving vehicle systems and methods
KR101967610B1 (en) Multi lane monitoring system that can recognize vehicle velocity and license plate number of multi lane
US11914041B2 (en) Detection device and detection system
US20060111841A1 (en) Method and apparatus for obstacle avoidance with camera vision
CN109696667B (en) Entrance guard barrier detection method based on 3DToF camera
KR102200204B1 (en) 3-D Image Analyzing System Using CCTV Image
CN116601681A (en) Estimating automatic exposure values of a camera by prioritizing objects of interest based on relevant inputs of a 3D map
JP2019207654A (en) Detection device and detection system
EP3806062A1 (en) Detection device and detection system
JP2019207655A (en) Detection device and detection system
KR101262044B1 (en) Vehicle detection apparatus using thermal image and method thereof
US12146961B2 (en) Vehicle behavior detection device and detection system
RU2760058C1 (en) Method for automatic traffic control and the system implementing it
US20240142609A1 (en) Radar object classification method and system
Stjepanović et al. Subsystem With Ultrasonic and Passive Infrared Sensors for Pedestrian Detection
KR20240099675A (en) Road traffic situation monitoring system and method
CN116468755A (en) Vehicle speed detection method
RU2573629C2 (en) Apparatus for controlling vehicular traffic flow in order to account for and control movement
Kamesh et al. CHARACTERIZATION OF NUMBER PLATES THROUGH DIGITAL IMAGES

Legal Events

Date Code Title Description
AS Assignment

Owner name: LEDDARTECH INC., CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIMEAULT, YVAN;GIDEL, SAMUEL;REEL/FRAME:031531/0035

Effective date: 20130507

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

AS Assignment

Owner name: LEDDARTECH INC., CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIMEAULT, YVAN;GIDEL, SAMUEL;REEL/FRAME:045856/0192

Effective date: 20130507

RF Reissue application filed

Effective date: 20180111

AS Assignment

Owner name: FEDERATION DES CAISSES DESJARDINS DU QUEBEC, QUEBE

Free format text: SECURITY CONFIRMATION AGREEMENT;ASSIGNOR:LEDDARTECH INC.;REEL/FRAME:048044/0875

Effective date: 20181001

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4

AS Assignment

Owner name: INVESTISSEMENT QUEBEC, CANADA

Free format text: SECURITY INTEREST;ASSIGNOR:LEDDARTECH INC.;REEL/FRAME:051713/0622

Effective date: 20200130

AS Assignment

Owner name: FEDERATION DES CAISSES DESJARDINS DU QUEBEC, QUEBEC

Free format text: SECURITY CONFIRMATION AGREEMENT;ASSIGNOR:LEDDARTECH INC.;REEL/FRAME:053980/0942

Effective date: 20200123

AS Assignment

Owner name: INVESTISSEMENT QUEBEC, CANADA

Free format text: SECURITY INTEREST;ASSIGNOR:LEDDARTECH INC.;REEL/FRAME:055244/0208

Effective date: 20210205

RF Reissue application filed

Effective date: 20210825

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8