亚洲AV

Schar School Scholar Warns of Existential Threats to Humanity by Terrorists

Body

As artificial intelligence and drones become increasingly ubiquitous, 鈥攁 policy fellow at 亚洲AV's 鈥攕tands at the cutting edge of researching how terrorists might use these emerging technologies to wipe out humanity.

A man with a long white goatee beard and moustache and wearing an earring and glasses gazes to his right.
Zak Kallenborn: His job is to be 鈥榠nterested in the highest risk scenarios that could have the biggest effect on society.鈥

In the last few days, he鈥檚 received coverage in Forbes and Newsweek for an essay he co-wrote that dissects the threat of existential terrorism to our national security鈥攁nd the world.

Kallenborn is also featured in a new documentary series debuting on Netflix in July, Unknown: Killer Robots, which examines how AI represents, or not, a threat to mankind.

The rapidly circulating peer-reviewed study that has gripped the media describes existential terrorism as the desire to inflict damage of a magnitude so catastrophic that it threatens humanity鈥檚 survival. Even if the likelihood of such an event is minor, Kallenborn said it is vital to ask, 鈥淲hat if terrorists wanted to destroy all of humanity鈥攚hat would that look like?鈥 Most terrorists, he noted, are likely not interested in humanity鈥檚 annihilation 鈥渂ecause [they] have constituencies and things they want to achieve.鈥 Still, the possibility lingers.

As an officially proclaimed Army Mad Scientist鈥攐ne of a network of experts exploring advanced warfare capabilities鈥攁nd an authority on drone swarms and killer robots, it鈥檚 his job to be 鈥渋nterested in the highest risk scenarios that could have the biggest effect on society,鈥 he said. Yet, Kallenborn maintains a flair for the comedic. He describes himself in his Twitter bio as an 鈥渁nalyst in horrible ways people kill each other.鈥

Before graduating high school, Kallenborn was a published mathematician, but he was still looking for 鈥渟omething that would be directly useful for people鈥檚 day-to-day lives,鈥 he said. Studying the 鈥渉orrible鈥 ways we kill one another was something he stumbled on in college. 鈥淢y notion of national security was like Jack Bauer-style guys,鈥 he said referencing the action television show 24. 鈥淚 didn鈥檛 really see it as an academic thing.鈥

But after hearing a talk on cybersecurity in his freshman year at the University of Puget Sound in Washington, he was hooked. Promptly adding a major in international relations, Kallenborn interned in chemical and biological warfare at the James Martin Center for Nonproliferation Studies in Monterey, California, where he developed a fascination with cataclysmic terrorism. (Later, by coincidence, he discovered drone swarm technology was not science fiction and quickly set out to become an expert on the topic.)

While drones are not a new technology, Kallenborn noted that their capacity for integration with artificial intelligence could form drone swarms capable of communicating and collaborating autonomously. Moreover, their affordability and versatility make them a formidable weapon of war.

In the war in Ukraine, for example, drones offer an inexpensive alternative for air combat weapons. Russia, he said, has 鈥渂een using cheap drones to essentially saturate Ukrainian defenses.鈥 Likewise, Kallenborn says Ukrainian forces have used drones to guide artillery strikes.

鈥淭he problem is that current artificial intelligence is very brittle,鈥 he said. 鈥淩esearchers have shown that a single pixel change can cause a mission vision system to confuse a stealth bomber with a dog.鈥 In the event of an error, 鈥測ou get not only death to civilians 鈥 but we also have escalation dynamics that come along with that.鈥

So, will drones and AI eventually destroy us all? After a chuckle, Kallenborn calmly replied, 鈥淣o. But I think it鈥檚 a plausible enough scenario that it鈥檚 worth taking seriously.鈥