bad performance of generated text

[ALR-alr]

My generated text is
<unk> [IMG0] [IMG7] [IMG7] 's [IMG0] , [IMG0] theirt [IMG0] is one his own [IMG0] have been in this there are an thea a c [IMG0] has.## to be very and Mia their name The term of they were that Their was her [IMG0] His Name? leur míst een for être at sein thair lui était zijn A person [IMG0] seu hém est eran ihr théiré being été on its Thérème hereer from mé_Thee Rei [IMG0] -Mers them your hé _ votre légère 98 [IMG0] One [IMG0] deren their names him_\_, Mr étant élée There was Her Theyérism< [IMG0] who… [IMG0] quien er __ là Meur Ce RépTour Tahm [IMG0] whose father à mě named dort el ép ithürüth;—in [IMG0] their than ihm would me(her). Beerenheitт</ / Umm [IMG0] hers (their è ihre éereл= —› " />#"을ـ [IMG0] их MéR [IMG0] dessenх а cat [IMG0] Who в Heure bý meme_.--his self,--there’dheim [IMG0] himself ed as an expert with regard–ther their affair to be made famous [IMG0] another terme на céling [IMG0] those themselves involved in témoш.
I have read previous issues and manually set IS_STAGE2 to True in constants.py, but don't work. I notice that the bad generated text is the same with only use stage1 ckpt. Why can't I load the stage2 ckpt?

[KzZheng]

My guess is that you use the highest peft lib version and change the code little? I just tried with peft==0.10.0 in a new machine. The current code can work well.