TY - JOUR
T1 - Sora for hierarchical parallel motion planner
T2 - a safe end-to-end method against OOD events
AU - Teng, Siyu
AU - Yan, Ran
AU - Zhang, Xiaotong
AU - Li, Yuchen
AU - Wang, Xingxia
AU - Wang, Yutong
AU - Tian, Yonglin
AU - Yu, Hui
AU - Li, Lingxi
AU - Chen, Long
AU - Wang, Fei Yue
PY - 2024/6/12
Y1 - 2024/6/12
N2 - End-to-end motion planners have shown great potential for enabling fully autonomous driving. However, when facing out-of-distribution (OOD) events, these planners might not guarantee the optimal prediction of control commands. To better enhance safety, an end-to-end method that benefits robust and general policy learning from potential OOD events is urgently desirable. In this perspective, Sore4PMP, a hierarchical parallel motion planner, is presented as a suitable solution. Based on raw perception data and descriptive prompts, Sore4PMP can first leverage the advanced generative capabilities of Sora to generate virtual OOD events, and then integrate these events into the decision-making process, thereby enhancing the robustness and generalization of autonomous vehicles (AVs) in emergency scenarios. With a comprehensive outlook, this perspective aims to provide a potential direction for the development of foundation models coupled with autonomous driving and finally promote the safety, efficiency, reliability, and sustainability of AVs.
AB - End-to-end motion planners have shown great potential for enabling fully autonomous driving. However, when facing out-of-distribution (OOD) events, these planners might not guarantee the optimal prediction of control commands. To better enhance safety, an end-to-end method that benefits robust and general policy learning from potential OOD events is urgently desirable. In this perspective, Sore4PMP, a hierarchical parallel motion planner, is presented as a suitable solution. Based on raw perception data and descriptive prompts, Sore4PMP can first leverage the advanced generative capabilities of Sora to generate virtual OOD events, and then integrate these events into the decision-making process, thereby enhancing the robustness and generalization of autonomous vehicles (AVs) in emergency scenarios. With a comprehensive outlook, this perspective aims to provide a potential direction for the development of foundation models coupled with autonomous driving and finally promote the safety, efficiency, reliability, and sustainability of AVs.
KW - Cognition
KW - Feature extraction
KW - Planning
KW - Robustness
KW - Task analysis
KW - Vectors
KW - Visualization
UR - http://www.scopus.com/inward/record.url?scp=85192195532&partnerID=8YFLogxK
U2 - 10.1109/TIV.2024.3392647
DO - 10.1109/TIV.2024.3392647
M3 - Article
AN - SCOPUS:85192195532
SN - 2379-8858
VL - 9
SP - 4573
EP - 4576
JO - IEEE Transactions on Intelligent Vehicles
JF - IEEE Transactions on Intelligent Vehicles
IS - 4
ER -