Why Doomsday Is a Distraction, and the Real AI Risk We Should Be Worried About

PUBLISHER ARTICLE PREVIEW

From the original article

If you consume any news media, it is hard to ignore the rising alarmism surrounding the AI industry and doomsday warnings. The narrative, which warns of the ‘existential risk’ AI systems pose to humanity, has made it all too easy for cybersecurity firms to jump on the bandwagon and let fear do the selling. However, focusing on ‘doomsday’ is misguided, because it overlooks the more immediate risks agentic AI poses to organisations today.

Of course, there are clear risks posed by AI agents acting independently of an organisation’s controls. Only recently, reports from Australia and the US found that OpenAI AI agents had strayed beyond their tasks on government systems in both countries.

Yet, the threat of AI doomsday scenarios is overblown. Rather than fixating on hypotheticals, organisations must face this new reality and ensure deterministic safeguards are in place for operational resilience.

Those who subscribe to the doomsday narrative believe that as AI develops in sophistication and reach, it could become a concentrated ‘kill switch’, a single point vulnerable to someone seizing complete control and triggering catastrophe.

However, the internet is far more distributed and varied than the kill switch theory assumes. It operates as a ‘network of networks’, comprising billions of components layered into different architectures and defended by countless operating teams working to different standards and tools, leaving no single switch for anyone, human or machine, to flip – no single vulnerability or chain of vulnerabilities that can be exploited to this terminal effect.