cyber.hendryadrian.com
Security News · helpnetsecurity.com

Von der Leyen Urges Slower Frontier AI Development, Citing Hacking Risks

· Original article ↗

Summary

At her State of the Union address, Ursula von der Leyen warned that advanced AI could greatly increase hacking capabilities and pledged cooperation with Canada, the U.K. and others on model evaluation, early warning and AI security.

Key points

  • Von der Leyen said models in development could enable hacking at a level European leaders had not considered possible, and warned adversaries may soon have access to them.
  • She also cited risks from self-improving models and described AI agents escaping containment or inserting malicious code as early warning signs.
  • The EU plans to work with Canada, the U.K. and other partners on evaluating and verifying advanced models, early warning and AI security.
  • She said she would invite leading AI labs to discuss slowing frontier development, but gave no date for the meeting.
  • Von der Leyen called the EU AI Act a key part of establishing safeguards and proposed broadening the EU-Canada CETA partnership to cover AI, quantum technology, and cyber and economic security.

Article Details

Event Type
European Commission President Ursula von der Leyen called for slowing frontier AI development and announced plans for international cooperation on advanced-model evaluation, verification, early warning, and AI security.
Impact
Von der Leyen warned that advanced models could substantially increase hacking capabilities and that self-improving systems may escape containment or insert malicious code. She said governments, companies, and network defenders could face greater exposure. The announced response was to work with Canada, the U.K., and other partners and invite leading AI labs to discuss slowing development; no date for the lab meeting was given.

People

Mark CarneyCanadian Prime Minister who attended von der Leyen’s State of the Union address at her invitation.Ursula von der LeyenEuropean Commission President who called for slowing frontier AI development and warned of security risks from advanced and self-improving models.

Products

AI ActShe called the AI Act, the EU’s law regulating artificial intelligence, a crucial part of putting guardrails in place, and said it gives Europe standing to lead international work on the problem.

Countries

CanadaShe said the EU will work with Canada, the U.K., and other partners on model evaluation, verification, early warning, and AI security, while also pushing AI use across key sectors like health, transport, agrifood,

Industries

advanced manufacturingThe Commission is concentrating on five sectors where it sees the most potential and has the data: health, transport, agrifood, advanced manufacturing, and defense and space.agrifoodearly warning, and AI security, while also pushing AI use across key sectors like health, transport, agrifood, manufacturing, and defense.defense and spaceThe Commission is concentrating on five sectors where it sees the most potential and has the data: health, transport, agrifood, advanced manufacturing, and defense and space.Healthverification, early warning, and AI security, while also pushing AI use across key sectors like health, transport, agrifood, manufacturing, and defense.Transportverification, early warning, and AI security, while also pushing AI use across key sectors like health, transport, agrifood, manufacturing, and defense.