2025-11-17 ODD working group weekly meeting (266) #6582
diegoyabuki
started this conversation in
Working group meetings
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Attendees
Agenda/Minutes
Weekly Simulation Results
October 19, 2025
Urban-Dense catalog on branch "scenario-dev": 70/81 scenarios passed.
public road bus catalog on branch "main": 320/329 scenarios passed.
October 26, 2025
Urban-Dense catalog on branch "scenario-dev": 69/81 scenarios passed.
public road bus catalog on branch "main": 313/329 scenarios passed.
November 02, 2025
Urban-Dense catalog on branch "scenario-dev": 70/81 scenarios passed.
public road bus catalog on branch "main": 314/329 scenarios passed.
November 09, 2025
Urban-Dense catalog on branch "scenario-dev": 68/81 scenarios passed.
public road bus catalog on branch "main": 307/329 scenarios passed.
November 16, 2025
Urban-Dense catalog on branch "scenario-dev": 66/81 scenarios passed.
public road bus catalog on branch "main": 310/329 scenarios passed.
Updated Summary of Failures
Fixed failures
Expected failures
Ongoing failures
Excess deceleration: Failed with excess deceleration (Non-deterministic case).
Insufficient avoidance margin: Ego got too close to NPC/Pedestrian laterally.
Bicycle collides with ego: Bicycle NPC collides with ego.
Cannot perform avoidance: Ego could not avoid a stationary NPC.
Collision during avoidance: Ego collides with static obstacle during avoidance (insufficient lateral clearance).
Ego stuck outside drivable area: Drivable area looks appropriately enhanced, but EGO stops for "Outside (of) Drivable Area".
Ego did not back up: Ego did not back up as intended.
Vehicle collision: Ego collided with a vehicle NPC.
Could not initialize localization: Requested the service "/api/localization/initialize" 30 times, but was not successful.
Could not engage: The simulator attempted to request Autoware to engage, but was aborted because Autoware's current state is INITIALIZING | WAITING_FOR_ROUTE | PLANNING.
Ego collides with vehicle moving on target lane after right turn: Ego collides with vehicle running on lane after right turn.
SIGSEGV in freespace planner: Freespace planner error after avoidance completion.
Simulation timed out: "map" passed to lookupTransform argument target_frame does not exist.
SIGABRT in start planner: Error in start planner (could be similar to SIGSEGV in freespace planner.
Simulator health check failed: Test execution succeeds, but the simulator health check fails.
Ego cannot find path to depart from parking lot: Ego gets stuck in the parking lot.
Autoware does not reach state WAITING_FOR_ENGAGE: Simulator waited for the Autoware state to transition to WAITING_FOR_ENGAGE, but time is up. The current Autoware state is PLANNING.
Could not call clear_route API: Requested the service "/api/routing/clear_route" 30 times, but was not successful.
change_to_stop API not ready: Service "/api/operation_mode/change_to_stop" is not ready after 180 seconds.
Could not call change_to_stop API: Requested the service "api/operation_mode/change_to_stop" 30 times, but was not successful.
New failures
Obstacle cruise virtual wall temporarily shifted back: The virtual wall shifted back, causing ego to slow down.
MPT failure: Bad alloc in Model Predictive Trajectory stack.
MRM virtual wall: MRM comfortable stop wall keeps appearing during driving.
Autoware does not reach state WAITING_FOR_ROUTE: Simulator waited for the Autoware state to transition to WAITING_FOR_ROUTE, but time is up. The current Autoware state is INITIALIZING.
Trajectory topic timed out: /planning/trajectory topic is timeout. Set ERROR in diagnostics.
MRM comfortable stop triggered: /adapi/mrm_request/delegate diagnostic is in ERROR state.
Ego slowed down too much: Ego slowed down too much when following preceding vehicle.
velocity_limit API not ready: Service "/api/autoware/set/velocity_limit" is not ready after 180 seconds.
Trajectory topic rate MRM: Diagnostic "/autoware/planning/topic_rate_check/trajectory" error triggered MRM.
Inaccurate arrival position: Ego arrival position is too far from the destination point.
Invalid message request: Simulator failed with message "attempting to request a message part outside the valid range".
Scenario Results Since Last TSC
- 3x Bicycle collides with ego
- 3x Excess deceleration
- 3x Cannot perform avoidance
- 1x Ego stuck outside drivable area
- 1x Simulation timed out
- 2x Ego cannot find path to depart from parking lot
- 5x Bicycle collides with ego
- 1x Excess deceleration
- 3x Cannot perform avoidance
- 1x Ego slowed down too much
- 1x Ego stuck outside drivable area
- 1x Autoware does not reach state WAITING_FOR_ENGAGE
- 1x Could not call clear_route API
- 2x Ego cannot find path to depart from parking lot
- 4x SIGABRT in start planner
- 1x change_to_stop API not ready
- 2x Could not call change_to_stop API
- 3x Bicycle collides with ego
- 3x Excess deceleration
- 3x Cannot perform avoidance
- 1x Ego stuck outside drivable area
- 1x Could not call clear_route API
- 1x Simulator health check failed
- 1x velocity_limit API is not ready
- 2x Ego cannot find path to depart from parking lot
- 1x SIGABRT in start planner
- 1x change_to_stop API not ready
- 1x Could not call change_to_stop API
- 1x Trajectory topic rate MRM
- 1x Autoware does not reach state WAITING_FOR_ENGAGE
- 4x Bicycle collides with ego
- 3x Excess deceleration
- 3x Cannot perform avoidance
- 1x Collision during avoidance
- 1x Ego stuck outside drivable area
- 2x Simulator health check failed
- 4x Could not call change_to_stop API
- 2x Autoware does not reach state WAITING_FOR_ENGAGE
- 2x Ego cannot find path to depart from parking lot
- 3x SIGABRT in start planner
- 3x Could not call change_to_stop API
- 1x SIGSEGV in freespace planner
- 5x Bicycle collides with ego
- 3x Excess deceleration
- 3x Cannot perform avoidance
- 1x Inaccurate arrival position
- 1x Invalid message request
- 1x Ego stuck outside drivable area
- 2x Could not call change_to_stop API
- 2x Ego cannot find path to depart from parking lot
- 3x SIGABRT in start planner
- 7x Could not call change_to_stop API
This Week's Discussions
General Topics
Task Progress
Safety Pool scenario execution:
SSv2 scenario execution:
Natural language scenario description creation:
Roadmap Phase 3 ongoing tasks:
Trial run of ODD definition:
Definition of base safety scenarios:
Test scenario creation for PoV Vision Pilot demo to JOEM customer:
Not Phase-scoped:
Previous MoM
https://github.com/orgs/autowarefoundation/discussions/6572
Action Items
Documents
Tools
[Autoware Evaluator (CI/CD pipeline)]
[Scenario Simulator V2 (Scenario testing framework)]
The GUI Scenario editor
[TIER IV account]
Administrative
Please check the ODD WG wiki page.
This and other AWF periodic meetings can be checked on the Autoware Foundation events calendar. You can also add your contact to the ODD WG meeting invitation group to receive invitations for future meetings.
ODD WG meetings are held weekly in the following single time slot.
Beta Was this translation helpful? Give feedback.
All reactions