Some failed prompt but caused a jailbreak

[zichuan-liu]

In the samples, there are some generated prompts that turn into [new prompt], resulting in a jailbreak message when calculating the result. The probability of it appearing is about 1 in 20.
e.g,

[zhu111-eng]

![Uploading 1RF1]1X9}VE]Q}R2SYOD2.png…]()

In the samples, there are some generated prompts that turn into [new prompt], resulting in a jailbreak message when calculating the result. The probability of it appearing is about 1 in 20. e.g,

Hello, I encountered this problem during the reproduction process, consulted some information, and also tried to modify the code, but the limited ability is still not solved, so I would like to ask you how to solve it~

[zichuan-liu]

![Uploading 1RF1]1X9}VE]Q}R2SYOD2.png…]()

In the samples, there are some generated prompts that turn into [new prompt], resulting in a jailbreak message when calculating the result. The probability of it appearing is about 1 in 20. e.g,

Hello, I encountered this problem during the reproduction process, consulted some information, and also tried to modify the code, but the limited ability is still not solved, so I would like to ask you how to solve it~

that's same ur conv has no "set_sys_msg", check out ur fastchat version it may have correct template "from fastchat.model import get_conversation_template"

[zhu111-eng]

![Uploading 1RF1]1X9}VE]Q}R2SYOD2.png…]()

In the samples, there are some generated prompts that turn into [new prompt], resulting in a jailbreak message when calculating the result. The probability of it appearing is about 1 in 20. e.g,

Hello, I encountered this problem during the reproduction process, consulted some information, and also tried to modify the code, but the limited ability is still not solved, so I would like to ask you how to solve it~

that's same ur conv has no "set_sys_msg", check out ur fastchat version it may have correct template "from fastchat.model import get_conversation_template"

Thank you for your reply.