You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Allow for N (user defined) number of retries of the same question.
🔈 Motivation
In some cases, asking the exact same question 5+ times causes the jailbreak to actually work. Sometimes injection only happens after N retries, like llama3 - I had to insert/ask the same question 5 times and finally it jailbroke and told me how to make a bomb or something like that. If I was testing with Giskard, it may just test once and call it a pass.
🛰 Alternatives
None
📎 Additional context
None
The text was updated successfully, but these errors were encountered:
🚀 Feature Request
Allow for N (user defined) number of retries of the same question.
🔈 Motivation
In some cases, asking the exact same question 5+ times causes the jailbreak to actually work. Sometimes injection only happens after N retries, like llama3 - I had to insert/ask the same question 5 times and finally it jailbroke and told me how to make a bomb or something like that. If I was testing with Giskard, it may just test once and call it a pass.
🛰 Alternatives
None
📎 Additional context
None
The text was updated successfully, but these errors were encountered: