[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112578367B - System and method for measuring relative time of camera and laser radar in automatic driving system - Google Patents

System and method for measuring relative time of camera and laser radar in automatic driving system Download PDF

Info

Publication number
CN112578367B
CN112578367B CN202011128834.2A CN202011128834A CN112578367B CN 112578367 B CN112578367 B CN 112578367B CN 202011128834 A CN202011128834 A CN 202011128834A CN 112578367 B CN112578367 B CN 112578367B
Authority
CN
China
Prior art keywords
camera
laser radar
lidar
time stamp
observation target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011128834.2A
Other languages
Chinese (zh)
Other versions
CN112578367A (en
Inventor
刘志成
张雯君
姚明江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SAIC Volkswagen Automotive Co Ltd
Original Assignee
SAIC Volkswagen Automotive Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SAIC Volkswagen Automotive Co Ltd filed Critical SAIC Volkswagen Automotive Co Ltd
Priority to CN202011128834.2A priority Critical patent/CN112578367B/en
Publication of CN112578367A publication Critical patent/CN112578367A/en
Application granted granted Critical
Publication of CN112578367B publication Critical patent/CN112578367B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497Means for monitoring or calibrating
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

The invention discloses a system for measuring the relative time of a camera and a laser radar in an automatic driving system, which comprises: the laser radar and the camera are horizontally arranged in front of the automatic driving vehicle; a vertically arranged scale having height scales thereon; a viewing target arranged to fall from the zero scale of the scale; the control device is in data connection with the laser radar and the camera; during the falling process of the observation target, the control device receives the original point cloud data collected by the laser radar and the first system time stamp of each frame of original point cloud data, and the original image data collected by the camera and the second system time stamp of each frame of original image data, and sets the first system time stamp T at the reference height based on the arrival of the observation target lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar. Correspondingly, the invention also discloses a method for measuring the relative time of the camera and the laser radar in the automatic driving system.

Description

System and method for measuring relative time of camera and laser radar in automatic driving system
Technical Field
The present invention relates to a measuring system and method, and more particularly, to a system and method for measuring time.
Background
In recent years, with the rapid development of the automobile industry and the improvement of the technological level, the automobile requirements of the market and users are gradually increased. In order to further improve the driving comfort for the users, many automobile manufacturers have conducted related research into autonomous vehicles, and some of the autonomous vehicles have begun to appear in the automobile market.
In the prior art, multiple types of sensors are integrated in an autonomous vehicle, wherein each type of sensor has its own time system, and different time systems may have different timestamps for environmental perception at the same time. Therefore, in the automatic driving vehicle, the relative time of different sensors is calibrated to facilitate the further processing of subsequent data by the sensor fusion algorithm.
Based on this, it is desirable to have a system and method for measuring the relative time between a camera and a lidar in an autonomous driving system that can quickly and accurately obtain the relative time between the lidar and the camera by comparing the system times of the lidar and the camera at the same time on an autonomous driving vehicle. The system and the method have very important practical significance, and in the automatic driving vehicle, the relative time of different sensors is calibrated, so that the further processing of the subsequent data by a sensor fusion algorithm is facilitated.
Disclosure of Invention
One of the objectives of the present invention is to provide a system for measuring the relative time between a camera and a lidar in an autonomous driving system, which can quickly and accurately obtain the relative time between the lidar and the camera by comparing the system time of the lidar and the camera at the same time on an autonomous driving vehicle. The system has very important practical significance, and in the automatic driving vehicle, the relative time of different sensors is calibrated, so that the further processing of the subsequent data by a sensor fusion algorithm is facilitated.
In order to achieve the above object, the present invention provides a system for measuring relative time between a camera and a lidar in an autopilot system, comprising:
a laser radar horizontally mounted in front of the autonomous vehicle;
a camera horizontally mounted in front of the autonomous vehicle;
the vertical scale is provided with height scales;
an observation target which is set to fall from the zero scale of the scale;
the control device is in data connection with the laser radar and the camera;
wherein, in the falling process of the observation target, the control device receives the original point cloud data and each frame collected by the laser radarA first system time stamp of the original point cloud data, a second system time stamp of the original image data collected by the camera and each frame of original image data, and a first system time stamp T of the observation target reaching the set reference height lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar.
Further, in the system for measuring the relative time between the camera and the lidar in the autopilot system of the present invention, the system further comprises a reference element disposed at the set reference height.
Further, in the system for measuring relative time of a camera and a lidar in an autopilot system of the present invention, the reference element comprises a metal rod.
Further, in the system for measuring relative time between a camera and a lidar in an autopilot system according to the present invention, the observation target includes a metal ball.
In the technical scheme, the observation target can comprise a metal ball, and the metal ball has stronger laser reflection capability and can be effectively detected by a laser radar.
Accordingly, another object of the present invention is to provide a method for measuring relative time between a camera and a lidar in an autonomous driving system, which can quickly and accurately obtain the relative time between the lidar and the camera by comparing the system time of the lidar and the camera at the same time on an autonomous driving vehicle. The method has very important practical significance, and in the automatic driving vehicle, the calibration of the relative time of different sensors is beneficial to the further processing of the subsequent data by the sensor fusion algorithm.
In order to achieve the above object, the present invention provides a method for measuring relative time between a camera and a lidar in an autopilot system, comprising the steps of:
a vertical scale is arranged in front of the automatic driving vehicle, and height scales are arranged on the vertical scale;
enabling the observation target to fall from the zero scale of the scale;
in the falling process of the observation target, a first system time stamp of original point cloud data collected by a laser radar and each frame of original point cloud data is received, a second system time stamp of original image data collected by a camera and each frame of original image data is received, and the first system time stamp T is based on the first system time stamp T of the observation target reaching a set reference height lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar.
Further, in the method for measuring relative time between a camera and a lidar in an automatic driving system of the present invention, the method further comprises: a reference element is provided at the set reference height.
Still further, in the method for measuring relative time of a camera and a lidar in an autonomous driving system of the present invention, the reference element comprises a metal rod.
Further, in the method for measuring relative time of a camera and a lidar in an autopilot system according to the present invention, the observation target includes a metal ball.
Further, in the method for measuring the relative time between the camera and the lidar in the autopilot system of the present invention, the set reference height is 1m.
The system for measuring the relative time between the camera and the laser radar in the automatic driving system can quickly and accurately obtain the relative time between the laser radar and the camera by comparing the system time of the laser radar and the camera on the automatic driving vehicle at the same moment.
The system has very important practical significance, and in the automatic driving vehicle, the calibration of the relative time of different sensors is beneficial to the further processing of the subsequent data by the sensor fusion algorithm.
Accordingly, the method for measuring the relative time between the camera and the laser radar in the automatic driving system, which is implemented based on the system, has the advantages and the beneficial effects.
Drawings
Fig. 1 schematically shows a schematic diagram of an apparatus for measuring relative time of a camera and a lidar in an autopilot system according to an embodiment of the present invention.
FIG. 2 is a flow chart of a method for measuring relative time between a camera and a lidar in an autopilot system of the present invention in one embodiment.
Detailed Description
The system and method for measuring relative time between a camera and a lidar in an autopilot system according to the present invention will be further explained and illustrated with reference to the drawings and the detailed embodiments of the present invention, which, however, should not be construed as unduly limiting the technical solution of the present invention.
FIG. 1 schematically illustrates an apparatus for measuring relative time between a camera and a lidar in an autopilot system according to one embodiment of the present invention.
As shown in fig. 1, in this embodiment, the system for measuring relative time between a camera and a lidar in an autopilot system according to the present invention may include: laser radar 1, camera 2, scale 3, observation target 4, control device (not shown in the figure). The laser radar 1 and the camera 2 are horizontally arranged in front of the automatic driving vehicle 5 and are in data connection with the control device; the scale 3 is vertically arranged and provided with height scales; the viewing target 4 may be arranged to fall from zero scale on the scale 3.
When the observation target 4 falls from the zero scale of the vertically arranged scale 3, the laser radar 1 can collect the original point cloud data and the first system timestamp of each frame of original point cloud data in the falling process of the observation target 4; the camera 2 may capture raw image data and a second system time stamp for each frame of raw image data.
In the present invention, a reference height may be preset in advance, so as to collect a first system time stamp T of the observation target 4 at the set reference height lidar And a second system time stamp T camera Second to the camera 2System time stamp T camera First system time stamp T acquired by subtracting laser radar 1 lidar Finally, the time delay delta T of the camera 2 relative to the laser radar 1 can be effectively obtained.
In addition, in the present invention, the system of the present invention may further include a reference element 6, in this embodiment, the reference element 6 may be a metal rod, and the observation target 4 falling from the zero scale of the scale 3 may be a metal ball.
FIG. 2 is a flow chart of a method for measuring relative time of a camera and a lidar in an autopilot system according to an embodiment of the invention.
As shown in fig. 2, in this embodiment, the method for measuring the relative time between the camera and the lidar in the autopilot system according to the present invention may include the steps of:
step (1): a vertical scale is arranged in front of the automatic driving vehicle, and height scales are arranged on the vertical scale;
step (2): enabling the observation target to fall from the zero scale of the scale;
and (3): in the falling process of the observation target, a first system time stamp of original point cloud data collected by a laser radar and each frame of original point cloud data is received, a second system time stamp of original image data collected by a camera and each frame of original image data is received, and the first system time stamp T is based on the first system time stamp T of the observation target reaching a set reference height lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar.
It should be noted that the method of the present invention is implemented based on the above system for measuring relative time between the camera and the lidar in the autopilot system. In the present embodiment, the length of the scale 3 in the system may be 1.5m, the observation target 4 to be dropped is a metal ball, the reference height preset in advance may be 1m, and the reference element 6 is disposed at the reference height preset in advance.
A 1.5m long scale 3 is placed standing on the ground and the scale 3 can be detected by both the lidar and the camera in the system. At 1m of the scale 3, a metal rod with the length of 0.2m is fixed on the vertical scale 3 and used as a reference object for detecting that the observation target 4 falls to 1m by the laser radar 1 and the camera 2. A metal ball is taken as an observation target 4 and placed at the zero scale position at the top end of the scale 3 to begin to fall, and the metal ball has strong laser reflection capacity and can be detected by the laser radar 1.
When the metal ball falls from the zero scale of the vertically arranged scale 3, the laser radar 1 can collect the original point cloud data and the first system timestamp of each frame of original point cloud data in the falling process of the metal ball; the camera 2 may capture raw image data and a second system time stamp for each frame of raw image data.
The position of the metal ball is judged through the metal rod at the position of 1m of the scale, and the first system time stamp T when the metal ball falls to the position 1m away from the ground is respectively observed lidar And a second system time stamp T camera . And finally, a second system time stamp T acquired by the camera 2 camera First system time stamp T acquired by laser radar 1 is subtracted lidar The delay Δ T of the camera 2 with respect to the laser radar 1 can be obtained.
In conclusion, the method for measuring the relative time between the camera and the laser radar in the automatic driving system has the advantages of simple process, quick measurement and quite accurate measurement result. By adopting the method, the relative time between the laser radar and the camera in the automatic driving vehicle can be quickly and accurately obtained, and the sensor fusion algorithm is favorable for further processing subsequent data.
Accordingly, the system for measuring the relative time between the camera and the laser radar in the automatic driving system also has the advantages and beneficial effects.
It should be noted that the prior art in the protection scope of the present invention is not limited to the examples given in the present application, and all the prior art which is not inconsistent with the technical scheme of the present invention, including but not limited to the prior patent documents, the prior publications and the like, can be included in the protection scope of the present invention.
In addition, the combination of the features in the present application is not limited to the combination described in the claims of the present application or the combination described in the embodiments, and all the features described in the present application may be freely combined or combined in any manner unless contradictory to each other.
It should also be noted that the above-mentioned embodiments are only specific embodiments of the present invention. It is apparent that the present invention is not limited to the above embodiments and similar changes or modifications can be easily made by those skilled in the art from the disclosure of the present invention and shall fall within the scope of the present invention.

Claims (9)

1. A system for measuring camera to lidar relative time in an autonomous driving system, comprising:
a laser radar horizontally mounted in front of the autonomous vehicle;
a camera horizontally mounted in front of the autonomous vehicle;
a vertically arranged scale having height scales thereon;
an observation target which is set to fall from the zero scale of the scale;
the control device is in data connection with the laser radar and the camera;
during the falling process of the observation target, the control device receives the original point cloud data collected by the laser radar and the first system time stamp of each frame of original point cloud data, and the original image data collected by the camera and the second system time stamp of each frame of original image data, and the control device is based on the first system time stamp T of the observation target reaching the set reference height lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar.
2. The system for measuring camera to lidar relative time in an autonomous driving system of claim 1, further comprising a reference element disposed at the set reference height.
3. A system for measuring camera to lidar relative time in an autonomous driving system as recited in claim 2, wherein the reference element comprises a metal rod.
4. A system for measuring camera to lidar relative time in an autonomous driving system as recited in claim 1, wherein the observation target comprises a metal ball.
5. A method for measuring relative time of a camera and a lidar in an autonomous driving system, comprising the steps of:
a vertical scale is arranged in front of the automatic driving vehicle, and is provided with height scales;
enabling the observation target to fall from the zero scale of the scale;
in the falling process of the observation target, a first system time stamp of original point cloud data collected by a laser radar and each frame of original point cloud data is received, a second system time stamp of original image data collected by a camera and each frame of original image data is received, and the first system time stamp T is based on the first system time stamp T of the observation target reaching a set reference height lidar And a second system time stamp T camera And obtaining the time delay delta T of the camera relative to the laser radar.
6. The method for measuring camera to lidar relative time in an autonomous driving system of claim 5, further comprising: a reference element is provided at the set reference height.
7. The method for measuring camera to lidar relative time in an autonomous driving system of claim 6 wherein the reference element comprises a metal rod.
8. The method for measuring camera to lidar relative time in an autonomous driving system of claim 5 wherein the observation target comprises a metal ball.
9. The method for measuring camera to lidar relative time in an autonomous driving system of claim 5 wherein the set reference height is 1m.
CN202011128834.2A 2020-10-21 2020-10-21 System and method for measuring relative time of camera and laser radar in automatic driving system Active CN112578367B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011128834.2A CN112578367B (en) 2020-10-21 2020-10-21 System and method for measuring relative time of camera and laser radar in automatic driving system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011128834.2A CN112578367B (en) 2020-10-21 2020-10-21 System and method for measuring relative time of camera and laser radar in automatic driving system

Publications (2)

Publication Number Publication Date
CN112578367A CN112578367A (en) 2021-03-30
CN112578367B true CN112578367B (en) 2023-01-06

Family

ID=75119935

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011128834.2A Active CN112578367B (en) 2020-10-21 2020-10-21 System and method for measuring relative time of camera and laser radar in automatic driving system

Country Status (1)

Country Link
CN (1) CN112578367B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111474532A (en) * 2020-04-10 2020-07-31 北京建筑大学 Time synchronization method and device for vehicle-mounted mobile laser radar measurement system
CN111756463A (en) * 2019-03-29 2020-10-09 北京航迹科技有限公司 Time synchronization system and method for vehicle

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3438872A1 (en) * 2017-08-04 2019-02-06 Bayerische Motoren Werke Aktiengesellschaft Method, apparatus and computer program for a vehicle
US11061406B2 (en) * 2018-10-22 2021-07-13 Waymo Llc Object action classification for autonomous vehicles
CN111127563A (en) * 2019-12-18 2020-05-08 北京万集科技股份有限公司 Combined calibration method and device, electronic equipment and storage medium
CN111179358B (en) * 2019-12-30 2024-01-05 浙江商汤科技开发有限公司 Calibration method, device, equipment and storage medium
CN113219479A (en) * 2021-05-13 2021-08-06 环宇智行科技(苏州)有限公司 Camera and laser radar synchronization method and system of intelligent driving control system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111756463A (en) * 2019-03-29 2020-10-09 北京航迹科技有限公司 Time synchronization system and method for vehicle
CN111474532A (en) * 2020-04-10 2020-07-31 北京建筑大学 Time synchronization method and device for vehicle-mounted mobile laser radar measurement system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Clock-based time synchronization for an event-based camera dataset acquisition platform;Vitalijs Osadcuks 等;《2020 IEEE International Conference on Robotics and Automation 》;20200915;全文 *
面向停车场场景的多传感器融合匹配算法与融合数据的并行处理;宝鹤鹏等;《现代计算机》;20200225(第06期);全文 *

Also Published As

Publication number Publication date
CN112578367A (en) 2021-03-30

Similar Documents

Publication Publication Date Title
KR101411668B1 (en) A calibration apparatus, a distance measurement system, a calibration method, and a computer readable medium recording a calibration program
EP1909064A1 (en) Object detection device
US7580548B2 (en) Abnormality detecting apparatus for imaging apparatus
CN109410264B (en) Front vehicle distance measuring method based on laser point cloud and image fusion
EP3499184B1 (en) Measurement method and apparatus
CN113240756B (en) Pose change detection method and device for vehicle-mounted BSD camera and storage medium
KR101735557B1 (en) System and Method for Collecting Traffic Information Using Real time Object Detection
CN110174059A (en) A kind of pantograph based on monocular image is led high and pulls out value measurement method
KR102268094B1 (en) System and method for dynamic stereoscopic calibration
CN108871185B (en) Method, device and equipment for detecting parts and computer readable storage medium
CN109963147B (en) Camera installation angle detection method and device and vehicle
CN112578367B (en) System and method for measuring relative time of camera and laser radar in automatic driving system
CN110418937A (en) Controller of vehicle
US10697821B2 (en) Weight calibration for a vehicle weight load determination meter
EP3591353B1 (en) Calibration device and calibration method
CN113628117A (en) Depth image rotation transformation method and device
GB2604175A (en) A method for determining a mounting position error of an environment sensor device of an assistance system of a motor vehicle as well as an assistance syste
JP7253322B2 (en) Integument discoloration diagnostic method
CN113847905B (en) Three-dimensional binocular recognition slope detection method
CN112492137B (en) Device, method and storage medium for detecting train bottom
CN116543002B (en) Automatic detection method, device and system for products
CN116052121B (en) Multi-sensing target detection fusion method and device based on distance estimation
KR102144249B1 (en) Method And Apparatus for Providing Vehicle Speed Calibration by Using Measured Material
US11010909B1 (en) Road surface information-based imaging environment evaluation method, device and system, and storage medium
CN116296070A (en) Gravity center measuring system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant