A study by IBM reveals that generative AI systems like ChatGPT can be manipulated using hypnotic suggestions, generating malicious code and providing poor security advice. English has evolved into a “programming language” for viruses, allowing attackers to bypass established programming languages and produce harmful information. Google’s Bard was less prone to manipulation than OpenAI’s GPT-3.5 and GPT-4 models, raising security concerns.
The susceptibility of generative AI systems, such as ChatGPT, to being tricked into taking part in hacks and frauds without having considerable coding skills has recently come to light in a paper. Major IT corporation IBM said that researchers have found simple ways to take advantage of ChatGPT and other large language models (LLMs), generating malicious code and giving poor security recommendations.
Chenta Lee, IBM’s Chief Architect of Threat Intelligence, outlined the purpose of their analysis, which was to identify any possible security risks created by these developments. Five LLMs were effectively “hypnotized” by them, albeit some were more persuasively than others. This allowed them to determine if it would be possible to use hypnosis for evil.
In essence, English has evolved into a “programming language” for viruses, according to the research. Attackers can circumvent established programming languages like Go, JavaScript, or Python thanks to LLMs. Instead, they use English instructions to modify LLMs and produce a variety of harmful information.
Security specialists were able to hypnotize LLMs into disclosing users’ private bank information, creating harmful code, and providing flimsy security advice. To show the potential for deception, the researchers even persuaded the AI chatbots that they were participating in a game and needed to give false replies.
The fact that an LLM confirmed the legality of an IRS email requesting money transfers in exchange for a tax refund even though the right response was given is a revealing illustration.
Interestingly, the paper claimed that Google’s Bard was less prone to manipulation than the GPT-3.5 and GPT-4 models from OpenAI. Particularly GPT-4 demonstrated a command of the rules that made it easier to give bad advise in response to cyber problems, including promoting ransom payments.
Google’s Bard, on the other hand, showed greater resilience to manipulation. When users gave particular reminders, GPT-3.5 and GPT-4 were both susceptible to producing harmful code.
In conclusion, a new study has revealed how easily hypnotic suggestions may be used to manipulate AI chatbots like ChatGPT, causing them to participate in frauds and hacks. The study underscored the fact that English is currently used to “program” malware using important language models, raising serious security concerns.
Conclusion:-
A study by IBM reveals that generative AI systems like ChatGPT can be tricked into engaging in hacks and frauds without coding skills. Researchers found ways to exploit ChatGPT and other large language models (LLMs), generating malicious code and providing poor security recommendations. English has evolved into a “programming language” for viruses, allowing attackers to bypass established languages like Go, JavaScript, or Python. The researchers were able to hypnotize LLMs into disclosing users’ private bank information, creating harmful code, and providing flimsy security advice. Google’s Bard was less prone to manipulation than OpenAI’s GPT-3.5 and GPT-4 models, but Google’s Bard showed greater resilience to manipulation. The study highlights the potential for hypnotic suggestions to manipulate AI chatbots, raising serious security concerns.
