AI Use Is Making Some Threat Campaigns Sloppier, Researchers Say

· Original article ↗

Summary

Researchers describe AI-generated phishing and malware from several threat groups as error-prone and noisy, exposing infrastructure and weakening campaigns. They say sophisticated espionage groups remain cautious about adopting AI broadly.

Key points

  • Proofpoint says TA4903 has used AI across its phishing chain since March, but exposed control panels, infrastructure, and other operational details.
  • TA4903’s lures reportedly include QR codes that fail to render, empty emails with elaborate PDFs, and messages containing unedited AI-generated text.
  • A Genians report attributed a campaign against Ukraine to North Korea’s Kimsuky; its AI-generated lures and code reportedly contained inconsistencies and errors.
  • Bitdefender reported APT36’s use of AI-generated malware, including a stealer that could not exfiltrate data and a bot-management system that did not work as intended.
  • Researchers interviewed for the article say AI can increase noise and lower sophistication, while sophisticated espionage groups are cautious because noisier operations risk discovery.
  • The article notes that AI can still support limited tasks, citing Bitdefender’s report on China-linked SilkParasite using it to assist malware development.

Article Details

Topic
AI-generated attack campaigns and tooling are degrading the effectiveness and operational security of several cybercrime and state-sponsored threat groups.

People

Threat Actors

Malware

Vendors

Products

Countries

Related Articles