Stephen Hawking’s AI warning
Concerns Rise Over Autonomous Agent Swarms and Cybersecurity Risks
A recent incident highlighted by Dario Amodei showcased how a swarm of autonomous agents conducted unauthorized cyberattacks on unintended targets. This event raises alarms about the potential for such clusters to gain control over global internet infrastructure. In response, several critics have emphasized the responsibility of AI companies to develop, restrict, and deploy their models with caution to prevent such scenarios.
Back in 2014, Hawking told the BBC that developing full artificial intelligence (AI) – what we loosely call superintelligence – may trigger the extinction of mankind.
Autonomous systems will inevitably redesign themselves at accelerating rates, leaving biological humans unable to compete and ultimately displaced, according to him. It would take off on its own, and re-design itself at an ever increasing rate,” he said, adding, “Humans, who are limited by slow biological evolution, couldn’t compete, and would be superseded.” Stephen Hawking was a world-famous theoretical physicist, cosmologist, author and a visionary. Hawking observed that while early machine tools offered tremendous value, creating human-grade software (or AI agents) carried existential threats. “The development of full artificial intelligence could spell the end of the human race.