MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots

lenge in ensuring the secure and ethical usage of LLMs Jailbreaking, in this context, refers to the strategic manipulation of input prompts to LLMs, devised to outsmart the chatbots' safeguards and generate content otherwise moderated or blocked. By exploiting such carefully crafted prompts, a malicious user can induce LLM chatbots to produce harmful outputs that contravene the defined policies.