cyber.hendryadrian.com
Interesting Stuff · darkowl.com

Webinar Explores AI Use in Investigations and Threat Actor Operations

· Original article ↗

Summary

A webinar discusses how investigators use AI and how threat actors apply it to phishing, fraud, deepfakes, and propaganda. Speakers stress human oversight, layered verification, and preparation for impersonation.

Key points

  • Investigators use AI for tasks including translation, entity resolution, pattern recognition, and summarizing large volumes of content.
  • The speakers describe threat actors using AI to improve phishing and business email compromise, impersonate executives, and conduct romance scams and financial fraud.
  • Criminals advertise tools such as WormGPT, FraudGPT, AI face generators, and synthetic voice services for malicious uses.
  • AI-generated imagery and media are also used in sextortion, child sexual abuse material, human-trafficking recruitment, and extremist propaganda.
  • The speakers recommend keeping a human accountable for investigative decisions and validating AI outputs with multiple methods.
  • They advise analysts to communicate confidence and uncertainty transparently and document how AI contributed to their findings.
  • Organizations should prepare for synthetic-media impersonation and establish response playbooks.

Article Details

Topic
AI use in OSINT investigations and its abuse by threat actors for phishing, fraud, impersonation, and propaganda

MITRE ATT&CK

T1566 · PhishingThreat actors use AI to create more convincing phishing emails and SMS messages.T1656 · ImpersonationAI-generated voices, images, and videos are used to impersonate executives, celebrities, and other people.

People

Erin BrownDirector of Intelligence and Collections at DarkOwl and webinar speaker discussing threat actors' use of AI.Jane van TienenChief Intelligence Officer at OSINT Combine and webinar speaker discussing AI in OSINT investigations.

Threat Actors

HamasThe article describes Hamas using a fabricated video and AI-generated imagery in disinformation.ISISAn ISIS chat group is shown using AI-generated imagery in propaganda.

Products

ChatGPTThese are based usually on the, you know, open source or other LLMs that we’re using out there, things like ChatGPT that have been made freely available.GrokSo, the bottom one’s very hard to see, but they’re talking about Grok.

Tools

FraudGPTAnother one is FraudGPT. And this kind of does what it says on the tin.WormGPTWormGPT is one of the models that came out fairly early.

Related Articles