8000 GitHub - SeasoulChris/UniAD: [CVPR 2023 Award Candidate] Planning-oriented Autonomous Driving
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

SeasoulChris/UniAD

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Planning-oriented Autonomous Driving

UniAD.mp4



teaser

Table of Contents:

  1. Highlights
  2. News
  3. Getting Started
  4. Results and Models
  5. TODO List
  6. License
  7. Citation

Highlights

  • 🚘 Planning-oriented philosophy: UniAD is a Unified Autonomous Driving algorithm framework following a planning-oriented philosophy. Instead of standalone modular design and multi-task learning, we cast a series of tasks, including perception, prediction and planning tasks hierarchically.
  • 🏆 SOTA performance: All tasks within UniAD achieve SOTA performance, especially prediction and planning (motion: 0.71m minADE, occ: 63.4% IoU, planning: 0.31% avg.Col)

News

  • Paper Title Change: To avoid confusion with the "goal-point" navigation in Robotics, we change the title from "Goal-oriented" to "Planning-oriented" suggested by Reviewers. Thank you!

  • [2023/04] Estimated. Model checkpoints release v2.0

  • [2023/03/29] Code & model initial release v1.0

  • [2023/03/21] 🚀🚀 UniAD is accepted by CVPR 2023, as an Award Candidate (12 out of 2360 accepted papers)!

  • [2022/12/21] UniAD paper is available on arXiv.

Getting Started

Results and Pre-trained Models

UniAD is trained in two stages. Pretrained checkpoints of both stages will be released and the results of each model are listed in the following tables.

Stage-one: Perception training

We first train the perception modules (i.e., track and map) to obtain a stable initlization for the next stage.

Method Encoder Tracking
AMOTA
Mapping
IoU-lane
config Download
UniAD-S R50 - - TBA TBA
UniAD-B R101 0.390 0.297 base-stage1 base-stage1
UniAD-L V2-99 - - TBA TBA

Stage-two: End-to-end training

We optimize all task modules together, including track, map, motion, occupancy and planning.

Method Encoder Tracking
AMOTA
Mapping
IoU-lane
Motion
minADE
Occupancy
IoU-n.
Planning
avg.Col.
config Download
UniAD-S R50 0.241 0.315 0.788 59.4 0.32 TBA TBA
UniAD-B R101 0.359 0.313 0.708 63.4 0.31 TBA TBA
UniAD-L V2-99 0.409 0.323 0.723 64.1 0.29 TBA TBA

Checkpoint Usage

  • Download the checkpoints you need into UniAD/ckpts/ directory.
  • You can evaluate these checkpoints to reproduce the results, following the evaluation section in TRAIN_EVAL.md.
  • You can also initialize your own model with the provided weights. Change the load_from field to path/of/ckpt in the config and follow the train section in TRAIN_EVAL.md to start training.

Model Structure

The overall pipeline of UniAD is controlled by uniad_e2e.py which coordinates all the task modules in UniAD/projects/mmdet3d_plugin/uniad/dense_heads. If you are interested in the implementation of a specific task module, please refer to its corresponding file, e.g., motion_head.

TODO List

  • Base-model configs & checkpoints [Est. 2023/04]
  • Separating BEV encoder and tracking module [Est. 2023/04]
  • Support larger batch size [Est. 2023/04]
  • (Long-term) Improve flexibility for future extensions
  • All configs & checkpoints
  • Code initialization

License

All assets and code are under the Apache 2.0 license unless specified otherwise.

Citation

Please consider citing our paper if the project helps your research with the following BibTex:

@inproceedings{hu2023_uniad,
 title={Planning-oriented Autonomous Driving}, 
 author={Yihan Hu and Jiazhi Yang and Li Chen and Keyu Li and Chonghao Sima and Xizhou Zhu and Siqi Chai and Senyao Du and Tianwei Lin and Wenhai Wang and Lewei Lu and Xiaosong Jia and Qiang Liu and Jifeng Dai and Yu Qiao and Hongyang Li},
 booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
 year={2023},
}

Related resources

Awesome

About

[CVPR 2023 Award Candidate] Planning-oriented Autonomous Driving

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.7%
  • Shell 0.3%
0