OpenAI Reveals China Covertly Used ChatGPT To Spread Propaganda, Manipulate Social Media Engagement, And Target Journalists And Politicians In A Coordinated AI-Powered Influence Campaign

OpenAI revolutionized AI and how the technology is used by introducing ChatGPT. The company has come far, with its services being integrated and used in varied domains, from the healthcare sector to the education sector, the chatbot has been put to good use. But it seems that many are misusing the AI tool, or so the company claims. OpenAI is said to have identified and shut down several secret campaigns with harmful purposes that are said to be linked to China and aimed at influencing public opinion.

OpenAI is said to have discovered that ChatGPT is being misused for carrying out some propaganda posts on social media by China

With the growing influence of AI and the wider application of technology, there is also an increased concern among the tech community regarding the responsible use of AI tools, which puts an added responsibility on the company’s shoulders to ensure they support ethical AI development and progress. Even if there are vigorous efforts put into this, there is often abuse of the technology, and it is used for wrongful purposes. OpenAI recently shared it has traced out and shut down several social media campaigns that misused ChatGPT and were linked to propaganda, believed to be originating from China.

It is said that there were ten operations that were shut down, four of which were linked to China. The operations consisted of ChatGPT being used for creating politically charged posts and even engaging in several platforms online with a fake identity to influence public opinions and direct them in a certain direction. A campaign called Uncle Spam was used to write controversial campaigns against sensitive topics in the U.S. The company suggests this is not the first time that its technology has been wrongfully used, as other countries such as Russia, Iran, and even North Korea are also claimed to be involved in such practices.

As per an NPR report, the ChatGPT misuse is one step ahead as not only were the propaganda posts being created, but they were also boosted and made to appear more genuinely and widely available, causing concern about the wrongful influence it might have had on the community. The tool was further used to create performance reviews of how the chatbot was used for the activities. The report states:

Chinese propagandists are using ChatGPT to write posts and comments on social media sites — and also to create performance reviews detailing that work for their bosses.

Ben Nimmo, who is the main investigator on OpenAI’s intelligence and investigation team also commented on the threat the company is facing.

What we’re seeing from China is a growing range of covert operations using a growing range of tactics.

The operation involved another layer of activities that involved using OpenAI’s ChatGPT for creating emails that were directed at analysts, journalists, and politicians in an attempt to build relationships by using false pretenses and being able to extract information as a result. The AI tools being used for strategic manipulation and violating ethical boundaries is concerning and companies should stay more vigilant and take immediate action against it.