Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ROS agent for leaderboard 2.0 has no statistics #153

Open
cdefg opened this issue Jun 25, 2023 · 0 comments
Open

ROS agent for leaderboard 2.0 has no statistics #153

cdefg opened this issue Jun 25, 2023 · 0 comments

Comments

@cdefg
Copy link

cdefg commented Jun 25, 2023

I tried to create an agent in leaderboard 2.0 framework, and start with the shell script to start fromleaderboard_evaluate.py. Everything goes almost right until I stop the statistics manually. I observed that the carla simulator has already got blank because the actors in it have been destroyed, so the object in python got "Nonetype" AttributeError: 'NoneType' object has no attribute 'get_snapshot', and got stucked.

devices: Intel136k + 4070Ti
system: Ubuntu 20.04
api : ROS1Agent

> Stopping the route

========= Results of RouteScenario_0 (repetition 0) ------ FAILURE =========

╒═════════════════════════════════╤═════════════════════╕
│ Start Time                      │ 2023-06-25 13:56:50 │
├─────────────────────────────────┼─────────────────────┤
│ End Time                        │ 2023-06-25 13:58:10 │
├─────────────────────────────────┼─────────────────────┤
│ Duration (System Time)          │ 80.07s              │
├─────────────────────────────────┼─────────────────────┤
│ Duration (Game Time)            │ 97.05s              │
├─────────────────────────────────┼─────────────────────┤
│ Ratio (System Time / Game Time) │ 1.212               │
╘═════════════════════════════════╧═════════════════════╛

╒═══════════════════════╤═════════╤═════════╕
│ Criterion             │ Result  │ Value   │
├───────────────────────┼─────────┼─────────┤
│ RouteCompletionTest   │ FAILURE │ 0.04 %  │
├───────────────────────┼─────────┼─────────┤
│ OutsideRouteLanesTest │ SUCCESS │ 0 %     │
├───────────────────────┼─────────┼─────────┤
│ CollisionTest         │ SUCCESS │ 0 times │
├───────────────────────┼─────────┼─────────┤
│ RunningRedLightTest   │ SUCCESS │ 0 times │
├───────────────────────┼─────────┼─────────┤
│ RunningStopTest       │ SUCCESS │ 0 times │
├───────────────────────┼─────────┼─────────┤
│ MinSpeedTest          │ SUCCESS │ 100 %   │
├───────────────────────┼─────────┼─────────┤
│ InRouteTest           │ SUCCESS │         │
├───────────────────────┼─────────┼─────────┤
│ AgentBlockedTest      │ SUCCESS │         │
├───────────────────────┼─────────┼─────────┤
│ ScenarioTimeoutTest   │ SUCCESS │ 0 times │
├───────────────────────┼─────────┼─────────┤
│ Timeout               │ SUCCESS │         │
╘═══════════════════════╧═════════╧═════════╛

> Registering the route statistics
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
Exception on start_listening while trying to handle message received.It could indicate a bug in user code on message handlers. Message skipped.
Traceback (most recent call last):
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm_autobahn.py", line 40, in onMessage
    self.on_message(payload)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 38, in on_message
    handler(message)
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/comm/comm.py", line 85, in _handle_publish
    self.factory.emit(message["topic"], message["msg"])
  File "/home/wly/miniconda3/envs/myfuser/lib/python3.8/site-packages/roslibpy/event_emitter.py", line 164, in emit
    result = f(*args, **kwargs)
  File "/mnt/LinuxData/myfuser/leaderboard/leaderboard/autoagents/ros_base_agent.py", line 208, in _vehicle_control_cmd_callback
    carla_timestamp = CarlaDataProvider.get_world().get_snapshot().timestamp.elapsed_seconds
AttributeError: 'NoneType' object has no attribute 'get_snapshot'
> Registering the global statistics
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant