OpenAI has suspended accounts of users in China and North Korea who allegedly used its technology for malicious purposes, including surveillance and influence campaigns. The company stated that authoritarian regimes could exploit AI to harm the United States and their own citizens. A specialized AI algorithm was reportedly used to detect suspicious activity.
The exact number of suspended accounts and the duration of OpenAI’s monitoring efforts remain undisclosed. However, one identified case involved a ChatGPT user generating Spanish-language news articles that portrayed the United States negatively. These articles were subsequently published by Latin American news outlets on behalf of a Chinese company.
AI Used for Fraud and Disinformation
In another case, attackers allegedly linked to North Korea used AI to generate fake resumes and online profiles to secure jobs at Western companies. Additionally, a network of accounts from Cambodia, associated with financial fraud, was identified. These accounts were used to translate and distribute content across social platforms, including X and Facebook.
The U.S. government has expressed concern over China’s alleged use of AI to manipulate public opinion domestically and spread disinformation to undermine U.S. and allied security, adds NIXSOLUTIONS. OpenAI’s ChatGPT remains the most widely used AI chatbot, boasting 400 million weekly active users. The company is currently in discussions to secure investments of up to $40 billion, potentially reaching a valuation of $300 billion—a record for a private company.
We’ll keep you updated on further developments.