Summary

O'Neil argues that mainstream AI safety discourse is fixated on the wrong threat: not extinction via rogue superintelligence, but the collapse of internet-dependent systems under waves of AI-enabled criminal activity. The standard doomsday scenario requires humans to voluntarily cede control to AI agents, which O'Neil thinks is implausible precisely because AI has already proven itself untrustworthy. The real danger is organized criminal networks wielding fleets of AI agents to compromise banks, infrastructure, and financial systems at scale. She predicts banks and energy grids will be forced to physically disconnect from the internet within two years to survive. Paradoxically, she suggests this forced retreat from the internet may ultimately leave us better off.

Key Insight

AI's real threat isn't extinction from rogue superintelligence but the imminent collapse of internet security from AI-powered criminal exploitation, forcing critical infrastructure to physically disconnect from the internet.

Spicy Quotes (click to share)

• 8

  What they aren't admitting is that they have invented a tool that can take down the internet, and with it and our modern way of life.

• 5

  In a word, they are untrustworthy.

• 7

  I don't think we actually will hand over our agency, or the financial system, or the energy grid, or our weapons systems, to AI. I don't think we will trust them. In fact, we already don't trust them.

• 9

  In two years – maybe less! – banks will have disconnected themselves from the internet, because the internet will be overrun by criminal AI.

• 8

  We will be forced to walk to the bank in person to withdraw money, and we will do so in cash, because all digital wallets will be untrustworthy. It's back to the 1980's.

• 7

  Even if they were motivated to kill us, they don't have fists and cannot come alive out of the internet to punch us out.

• 6

  Long term we might find ourselves better off when we free ourselves from the internet.

Tone

critical, contrarian, sardonic