Black Hat Panel Examines AI Security Flaws, Agent Trust and Vulnerability Research

· 2:05:11 · Watch on YouTube ↗

Summary

Security Now's Black Hat panel discusses signed commands for AI agents, privacy risks from cloud models, barriers to defensive research and the difficulty of turning AI vulnerability discoveries into reliable fixes.

Key points

  • A panelist describes requiring commands through a signed Buzz channel after an agent refused to trust instructions relayed by another agent, illustrating the need to authenticate authority in multi-agent workflows.
  • The panel discusses local models as a way to retain control over sensitive financial, health and credential data that cloud-based AI workflows may transmit outside the user's environment.
  • Panelists distinguish vulnerability discovery, exploit development and reliable patching, emphasizing that fixes require surrounding code context and validation.
  • Listener Jack Christiansen reports that AI models restricted his investigation of a reported security issue, highlighting how dual-use safeguards can obstruct legitimate defensive work.
  • The panel relays an unverified listener account alleging a Coldcard firmware entropy flaw and Bitcoin theft; the claimed use of Kimi K3 to discover the flaw is explicitly speculative.
  • The discussion introduces GRAM, or gradient routed auxiliary modules, as a proposed training approach for selectively restricting dual-use capabilities while preserving access for trusted users.

Article Details

Topics
  • [11:54] Authenticating commands and establishing trust between AI agents
  • [17:58] AI-assisted log analysis for breach investigation
  • [20:17] Cloud AI data exposure and local-model privacy
  • [34:10] AI cryptanalysis and cryptographic security margins
  • [37:45] Agent containment and unintended paths to completing objectives
  • [50:10] Reported wallet entropy flaws and AI-assisted vulnerability discovery
  • [57:01] Challenges in exploit development, patching and code-context validation
  • [01:04:30] Defensive research restrictions, dual-use safeguards and GRAM

People

Products

Related Articles