size mismatch for blocks.0.attn.relative_position_bias_table: copying a param with shape torch.Size([732, 12]) from checkpoint, the shape in current model is torch.Size([3972, 12]).

[iefengyan]

Hi! For the Beit pre-trained model with the input size of 224x224, I meet this problem when use_rel_pos_bias=True when using the input 512x512. Can you help me solve this problem?