Skip to content

Add semantic attribute to the 3D Gaussians ? #210

@nhghieu22-pixel

Description

@nhghieu22-pixel

Hi @aras-p and everybody,
I am currently work on a project that will apply semantic segmentation onto 3D Gaussians while training; and as the result, each Gaussian will have its own semantic_id to indicate which class it's in, this can be used to modify the scene semantically or render depth map.

I completed the training, I will append another attribute named semantic_id to the back of each point in the point cloud PLY file; but I met bugs when naively integrating my updated PLY file into this repo just by simply changing 2 utils files used to read the PLY file to accept 1 more element:

{repo}/package/Editor/Utils/GaussianFileReader.cs
{repo}/package/Editor/Utils/PLYFileReader.cs

Looks like I need to fix some more deep down related to Shaders, but I have no idea at this time. I am in urgent need to have solution to this, so if you know or have tried please reply me.

Thanks.

Best regards,
GH

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions