CISO Urges Caution on AI Risks, Robot Security and Overprivileged Agents

· Original article ↗

Summary

Aisle CISO Jaya Baloo discusses AI security and societal risks, including reported backdoors in Unitree robots, overprivileged AI agents, and the need for observability, defense in depth, and human oversight.

Key points

  • Baloo says Unitree quadruped robots had two remote backdoors and that its humanoid robots have multiple security issues, raising concerns about physical harm if remotely taken over.
  • She warns against giving AI systems broad access to enterprise data and networks without understanding their capabilities and risks.
  • Baloo recommends defense in depth, including egress filtering and sandboxing, while acknowledging these measures may not be perfect.
  • She calls for better observability into AI systems, including how training data is populated and where agent intent may diverge from a human operator's.
  • She cautions that guardrails may not cover every risk and says human approval should remain part of AI-assisted code changes.
  • Baloo argues that AI benefits should be pursued while maintaining critical thinking and appropriately limiting permissions.

Article Details

Topic
The social and security risks of anthropomorphizing AI, overtrusting AI systems, and deploying AI-enabled technologies without adequate safeguards.

People

Vendors

Tools

Industries

Related Articles