How One AI Agent Exposed Five Critical Enterprise Security Gaps

Summary
A sponsored, fictional AI-agent scenario illustrates security gaps in access, review, prompt-injection defenses, behavioral detection, and audit trails, alongside practical controls for addressing them.
Key points
- The article’s agent scenario is fictional; it illustrates how an agent built without security review could access email, an ERP system, and Slack.
- A Token-commissioned Cloud Security Alliance survey of 418 IT and security professionals found 82% had discovered agents they did not know about in the past year; 68% reported strong visibility into their agents.
- The article recommends understanding each agent’s access paths, limiting permissions, and reviewing OAuth grants that may remain active after an employee changes roles.
- It applies Meta’s Agents Rule of Two: an agent should not combine untrusted input, access to sensitive data, and the ability to act or communicate externally in one session.
- For detection, it recommends baselining actual agent behavior and watching for first-time tool use or unusual action sequences, rather than relying only on permission violations.
- For incident response and audits, it recommends revoking credentials while preserving agent memory and transcripts, and recording the human, entitlement, approval, and authority behind each action.
Article Details
- Defense Focus
- Detect and contain unsafe or compromised AI-agent behavior while preserving evidence and recording who authorized each action.
- Detection Methods
- Baseline each agent’s actual tool use and data destinations over a trusted observation window, rather than relying only on its permissions.
- Alert on first use of a tool or a new operation, such as an agent that previously only read ERP data performing its first write.
- Detect unusual action sequences, such as reading an email and then changing a payment record.
- Data Sources
- Agent tool-call and data-destination history
- ERP audit logs and payment-record changes
- SaaS audit logs
- Identity-provider logs
- Database logs
- Agent memory and transcripts
- Records of human approval and delegation chains
- Rule Types
- Behavioral-baseline anomaly detection
- First-use-of-tool detection
- Unusual action-sequence detection
- Platforms
- AI agent environments
- ERP systems
- Email systems
- Identity providers
- Slack
- Defensive Actions
- Require security review before enabling agents that ingest outside input, access private data, and act without human review.
- Limit agents to no more than two of those three capabilities in a single session until prompt injection can be reliably detected and refused.
- Use registered, short-lived identities tied to individual agents where possible; constrain credentials and permissions.
- Treat agent inputs as potentially able to issue instructions, and require human review for consequential or difficult-to-reverse actions.
- On suspected compromise, suspend the agent without destroying it, revoke its credentials, and preserve its memory and transcripts.
- Record the human behind each request, the delegation chain, the entitlement, and the approval at the time of each action.
- Periodically review deployed agents, their current owners, and historical actions.
MITRE ATT&CK
People
Amber BennouiPresents the Agents Rule of Two and recommends reviewing agents that ingest external input, access private data, and act without human review.Chad KalmesRecommends baselining agent behavior and detecting first-time tool use and novel action sequences; advises suspending agents and preserving evidence during response.John DonovanDescribes agent access paths and explains how delegated OAuth grants, static credentials, and mixed access paths affect visibility and revocation.Joshua CopelandExplains how instructions can reach agents through user input or content they read, and discusses the risks of stolen agent credentials.Rajesh Seshadri AppikulamDescribes audit evidence for agent actions, including identity, entitlement, approval, and authority, and emphasizes recording delegation chains.
