Skip to content

Conversation

@eynsai
Copy link

@eynsai eynsai commented Jul 25, 2023

What is this PR

This PR contains no changes outside of the addition of astrobee/localization/cnn_object_localization and astrobee/localization/lightweight_cnn_object_detection. It serves to incorporate the work done by Aryan Naveen on MRCNN-based detection and localization of handrails on the ISS., as well as some cleanup, integration, and experimental work that builds on it.

Things this PR depends on

The code in this PR expects the following changes within the Astrobee repo for cnn_object_localization to run in simulation. For a minimal "quick-fix" example of these changes, see this comparison.

  • Addition of a publisher for color dock-cam images
  • Updating of the dock-cam camera parameters used in gazebo simulation

Additionally, the following data is not included in this PR, but is associated with handrail segmentation. These materials are currently located on bartlett:/usr/local/home/mnsun/CNN_LOCALIZATION_RESOURCES.

  • Synthetically generated dataset
  • Manually labelled dataset for fine-tuning
  • Small image dataset of demo results
  • Pretrained checkpoints/models
  • Reference pointclouds for ICP
  • Compiled libtorch and libtorchvision binaries for armv7l

eynsai and others added 30 commits July 14, 2023 13:22
…-downgrade

Morgan develop torchscript downgrade
… can be compiled with catkin for native (not arm)
…rks when arm binaries are avaiable, for what it's worth.
…oss-compilation; other documentation reformatting
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant