State Hackers Caught Weaponizing AI, Microsoft Steps In (But is it Enough?)

State-backed hackers from Russia, China, Iran, and North Korea have been using large language models like OpenAI's ChatGPT for spying purposes, prompting Microsoft to ban such groups from accessing its AI tools.


  • Microsoft identified state-backed hackers from Russia, China, Iran, and North Korea using its AI tools for potential espionage.
  • Hackers used large language models like ChatGPT to create content for phishing attacks, research military technologies, and write persuasive emails.
  • Microsoft banned state-backed hacking groups from using its AI products, citing concerns about potential misuse despite no legal violations.
  • OpenAI and Microsoft downplayed the hackers' success, describing their usage as "early-stage" and "incremental."
  • Examples include Russian hackers researching Ukraine military operations, North Korean hackers creating phishing content, Iranian hackers crafting emails to target feminists, and Chinese hackers gathering intelligence.
  • The incident highlights growing concerns about the potential misuse of AI for malicious purposes and the need for safeguards.


Related post

AI Ethics

Microsoft Allegedly Stifles Worker Warning on AI Risks

Microsoft AI engineer Shane Jones discovered vulnerabilities in OpenAI's DALL-E 3 image generator in early December 2023 that allowed users to bypass safety filters to create violent and explicit images. He alleges Microsoft impeded his attempts to bring public attention to the issues and did not adequately respond to his…