I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b. It happened in int_llama_layer.py: self.rotary_emb = copy.deepcopy(org_module.rotary_emb)

[WX-yh]

I encounter a error: "AttributeError: 'LlamaAttention' object has no attribute 'rotary_emb'",when i run code with llama-1-7b.
It happened in int_llama_layer.py:
self.rotary_emb = copy.deepcopy(org_module.rotary_emb)
what should i do?

[mostafaelhoushi]

Downgrading transformers to 4.31.0 solved the problem for me:

pip install transformers==4.31.0

[WX-yh]

Downgrading transformers to 4.31.0 solved the problem for me:

pip install transformers==4.31.0

thank you!