Abstract
Average performance on routine driving benchmarks does not establish planner reliability under rare, safety-critical hazards. We proposed ExceptionDrive, a counterfactual planning benchmark that uses VLM-assisted screening, localized multi-view editing, and quality auditing to insert hazards into real nuScenes scenes while preserving their context. Its 21 tasks span six safety families and define hazard or conflict regions, local safety constraints, and acceptable responses. Because hazard insertion can invalidate the recorded human trajectory, our reference-free protocol evaluates edited predictions using Unsafe Rate (UR), Hazard Clearance Compliance (HCC), Hazard Proximity Response (HPR), and Counterfactual Trajectory Shift (CTS), which measure core-region intrusion, clearance compliance, clearance relative to a prescribed margin, and counterfactual trajectory change. Seven representative planners frequently intrude into hazard regions or provide insufficient clearance. We also develop a Reminder Agent that, without sample-specific task labels, converts visual evidence and the shared taxonomy into structured records of hazard presence, type, and a recommended high-level strategy. The agent neither predicts trajectories nor controls the vehicle; its records guide a VLM-based decision agent. In zero-shot experiments, the reminders improve strategy accuracy and reduce under-warning.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Luo, Z., Sun, Z., Lu, Y., Zhou, L., Wu, L., Li, X., Qin, Z., & Li, X. (2026). ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving. https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving
MLA 9
Luo, Ziyi, et al. "ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving." https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving.
Chicago (author–date)
Luo, Ziyi, Zhe Sun, Yehao Lu, Lei Zhou, Lisheng Wu, Xuewei Li, Zequn Qin, and Xi Li. 2026. "ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving." https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving.
Harvard
Luo, Z., Sun, Z., Lu, Y., Zhou, L., Wu, L., Li, X., Qin, Z. and Li, X. (2026) 'ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving', Available at: https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving.
Vancouver
Luo Z, Sun Z, Lu Y, Zhou L, Wu L, Li X, et al. ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving. https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving
IEEE
Z. Luo, Z. Sun, Y. Lu, L. Zhou, L. Wu, X. Li, Z. Qin, and X. Li, "ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving," https://omanscience.com/en/articles/exceptiondrive-a-planning-oriented-counterfactual-corner-case-benchmark-for-autonomous-driving.