Skip to content

Any plan to evaluation code? #60

Open
@mingzhuzhang1

Description

@mingzhuzhang1

Thank you very much for your outstanding work! However, I encountered an issue while attempting to evaluate the entire Nuscenes validation set, which includes 5,369 samples, using both FID and FVD metrics. While the FID results are close, I faced difficulties when evaluating the FVD for the generated 25-frame 1024x576 videos using the method described in LVDM. In my reproduction, I obtained FID = 7.2 and FVD = 249.74 (for 25 frames). I also tried evaluating 16 frames, which resulted in FVD = 160.13.

Since others have expressed similar concerns before, I was wondering if you would be willing to share the evaluation code. This would greatly help me refine my evaluation results, which are crucial for my subsequent work. Once again, thank you for your excellent work!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions