Skip to content

Allow to use classification token in CvT? #336

Open
@Yash-10

Description

@Yash-10

Thanks for the amazing collection of ViT implementations!

As far as I see from the CvT paper, it also allows for a class token (like in ViT but which was removed in SimpleViT by the authors of the SimpleViT paper). Whereas it seems that the CvT code in this repository does not implement it. Is this by design choice, or do you think it might be worth adding an option for a classification token? If it's the former, maybe that can be clarified in the README? I'm not sure if there have been benchmark tests in the literature with and without a classification token.

For reference, I was looking at the CvT code that came with the paper (this line) and there seems to be an option called with_cls_token.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @Yash-10

        Issue actions

          Allow to use classification token in CvT? · Issue #336 · lucidrains/vit-pytorch