Skip to content

[Feature] Segmentation Support for Deformable Materials #1363

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Jul 15, 2025

Conversation

ACMLCZH
Copy link
Contributor

@ACMLCZH ACMLCZH commented Jul 6, 2025

  1. Segmentation maps now include deformable materials such as FEM, MPM, PBD, and SPH.
  • When colorize_seg=False, the segmentation output is a 2D array of integer indices.
  • Use camera.get_segmentation_idx_dict() to retrieve the mapping from indices to scene elements:
    • $0$ → background (entity_id = -1)
    • $>0$ → scene elements, represented as (depending on the material type and segmentation level.):
      • entity_id
      • (entity_id, link_id)
      • (entity_id, link_id, geom_id)
  1. Double-Sided Surface Support for Segmentation Rendering.
  2. Unit Tests for Segmentation Rendering.

Resolves /issues/1072
Resolves /issues/1194

@duburcqa duburcqa enabled auto-merge (squash) July 13, 2025 13:32
duburcqa
duburcqa previously approved these changes Jul 13, 2025
@duburcqa
Copy link
Collaborator

I fixed your PR. I will push directly on it!

@duburcqa duburcqa enabled auto-merge (squash) July 14, 2025 08:46
duburcqa
duburcqa previously approved these changes Jul 14, 2025
@duburcqa
Copy link
Collaborator

Failing on Windows. I will investigate.

@duburcqa duburcqa force-pushed the seg_fix branch 4 times, most recently from 17aaf61 to 9ec4c43 Compare July 14, 2025 19:38
duburcqa
duburcqa previously approved these changes Jul 14, 2025
@duburcqa duburcqa force-pushed the seg_fix branch 2 times, most recently from d96ab49 to 43319ba Compare July 14, 2025 21:30
auto-merge was automatically disabled July 15, 2025 04:01

Head branch was pushed to by a user without write access

@duburcqa duburcqa enabled auto-merge (squash) July 15, 2025 06:24
@duburcqa duburcqa merged commit e5d7d92 into Genesis-Embodied-AI:main Jul 15, 2025
13 checks passed
ACMLCZH added a commit to ACMLCZH/Genesis that referenced this pull request Jul 15, 2025
@ACMLCZH
Copy link
Contributor Author

ACMLCZH commented Jul 16, 2025

You can close #1194

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug]: No segmentation maps for MPM objects. [Bug]: FEM and Rigid Entity Collision Bug
5 participants