Skip to main content

Home/ History Readings/ Group items tagged cyberwar

Rss Feed Group items tagged

Javier E

We're at cyberwar. And the enemy is us. - The Washington Post - 0 views

  • The United States and its allies are under attack. The cyberwar we’ve feared for a generation is well underway, and we are losing. This is the forest, and the stuff about Russian election meddling, contacts with the Trump campaign, phony Twitter accounts, fake news on Facebook — those things are trees.
  • we failed to prepare for an attack of great subtlety and strategic nuance. Enemies of the West have hacked our cultural advantages, turning the very things that have made us strong — technological leadership, free speech, the market economy and multi-party government — against us. The attack is ongoing.
  • With each passing week, we learn more. Russia and its sympathizers have cranked up the volume on existing political and cultural divisions in the West, like some psychic version of the Stuxnet hack that caused Iran’s nuclear centrifuges to spin so fast they tore themselves to pieces.
  • ...10 more annotations...
  • They’ve exploited the cutting-edge algorithms of Facebook and Google to feed misinformation to Americans most likely to believe and spread it.
  • They have targeted online ads designed to intensify our hottest culture wars: abortion, guns, sexuality, race.
  • The genius of this cyberwar is that unwitting Westerners do most of the work. Our eagerness to believe the worst about our political opponents makes us easy marks for fake or distorted “news” from anti-American troll farms
  • Our media — talk radio, cable news, every variety of digital communication — seek to cull us into like-minded echo chambers.
  • The West has monetized polarization; our enemies have, in turn, weaponized it.
  • What was first perceived as a targeted attack — Russia attempting to hack the U.S. election — is proving to be a broader and bolder war.
  • Seeking to weaken and discredit the Western alliance that has constrained Russia’s global ambitions for 70 years, Putin pushed the Brexit vote that rattled the European Union.
  • His cyber-sappers have also aided nationalist movements in France, Germany, the Netherlands, Poland and Hungary
  • Russia did not need to collude with Trump. He was already an ideal host for the virus they are spreading. Putin’s goal, in May’s words, is to “sow discord in the West,” and Trump eats, sleeps and breathes discord. He understands that our siloed, targeted, algorithmic media feeds on conflict and outrage, and he is happy to dish it up.
  • We can’t defend ourselves until we see clearly what is happening, and understand that fact-checking, truth-telling and goodwill are more than virtues now. They are patriotic duties. Pogo’s words were never so true: We’ve met the enemy, and he is us.
anonymous

Trump Inherits a Secret Cyberwar Against North Korean Missiles - The New York Times - 0 views

  • Trump Inherits a Secret Cyberwar Against North Korean Missiles
  • Three years ago, President Barack Obama ordered Pentagon officials to step up their cyber and electronic strikes against North Korea’s missile program in hopes of sabotaging test launches in their opening seconds.
  • Soon a large number of the North’s military rockets began to explode, veer off course, disintegrate in midair and plunge into the sea. Advocates of such efforts say they believe that targeted attacks have given American antimissile defenses a new edge and delayed by several years the day when North Korea will be able to threaten American cities with nuclear weapons launched atop intercontinental ballistic missiles.
  • ...3 more annotations...
  • But other experts have grown increasingly skeptical of the new approach, arguing that manufacturing errors, disgruntled insiders and sheer incompetence can also send missiles awry.
  • Advocates of the sophisticated effort to remotely manipulate data inside North Korea’s missile systems argue the United States has no real alternative because the effort to stop the North from learning the secrets of making nuclear weapons has already failed. The only hope now is stopping the country from developing an intercontinental missile, and demonstrating that destructive threat to the world.
  • The White House is also looking at pre-emptive military strike options, a senior Trump administration official said, though the challenge is huge given the country’s mountainous terrain and deep tunnels and bunkers. Putting American tactical nuclear weapons back in South Korea — they were withdrawn a quarter-century ago — is also under consideration, even if that step could accelerate an arms race with the North. 548 Comments Mr. Trump’s “It won’t happen!” post on Twitter about the North’s ICBM threat suggests a larger confrontation could be looming.“Regardless of Trump’s actual intentions,” James M. Acton, a nuclear analyst at the Carnegie Endowment for International Peace, recently noted, “the tweet could come to be seen as a ‘red line’ and hence set up a potential test of his credibility.”
Javier E

U.S. Reacting at Analog Pace to a Rising Digital Risk, Hacking Report Shows - The New Y... - 0 views

  • the United States government is still responding at an analog pace to a low-grade, though escalating, digital conflict.
  • to anyone who reads between the lines and knows a bit of the back story not included in the report, the long lag times between detection and reaction are stunning.
  • The delays reveal fundamental problems with American cyberdefenses and deterrence that President-elect Donald J. Trump will begin to confront in two weeks
  • ...10 more annotations...
  • a failure of imagination about the motives and plans of a longtime adversary meant that government officials were not fully alert to the possibility that Mr. Putin might try tactics here that have worked so well for him in Ukraine, the Baltics and other parts of Europe.
  • while American intelligence officials — who were focused primarily on the Islamic State and other urgent threats like China’s action in the South China Sea and North Korea’s nuclear and missile threat — saw what was happening, they came late to its broader implications
  • It was telling that within an hour of the release of the report on Friday, the secretary of homeland security, Jeh Johnson, declared for the first time that America’s election system — the underpinning of its democracy — would be added to the list of “critical infrastructure.” This after years of cyberattacks on campaigns and government agencies.
  • “in July 2015, Russian intelligence gained access to Democratic National Committee networks” and stayed there for 11 months, roaming freely and copying the contents of emails that it ultimately released in the midst of the election. Classified briefings circulating in Washington indicate that British intelligence had alerted the United States to the intrusion by fall 2015.
  • Almost immediately, a low-level special agent with the F.B.I. alerted the Democratic National Committee’s information technology contractor, which doubted the call and did nothing for months. The F.B.I. failed to escalate the issue, even though it was clear from the start that the attackers were almost certainly the same Russians who had mounted similar campaigns against the State Department, the White House and the Joint Chiefs of Staff.
  • It was not until Oct. 7, 2016, 15 months after the initial hacking attack, that the intelligence agencies first publicly blamed Russia. Even then, Mr. Obama made it clear that he did not want to escalate the situation before the election, for fear of getting into a tit-for-tat cyberwar in which Russia might try to alter the actual vote tallying. (It did not.)
  • “The biggest frustration to me is speed, speed, speed,” he told the Senate Armed Services Committee on Thursday, in response to a question from Senator Jack Reed of Rhode Island, the top Democrat on the panel, about the obstacles to seeing a threat from abroad and acting on it here in the United States.
  • It is clear that Mr. Putin saw a huge vulnerability in the American system that was ripe to be exploited.
  • The country’s highly partisan politics, with cable channels and websites devoted to pressing an agenda for the fully convinced and the half-convinced, made it more vulnerable to any disclosures that could capture a news cycle
  • Add to that the uniquely Russian combination of covert espionage and the disclosure of the emails it harvested, as well as the release of “kompromat” — compromising information about politicians and policy makers — and “fake news,” a tactic not above American officials at times.
blairca

Donald Trump's Iran Problem | The New Yorker - 0 views

  • The next four U.S. Presidents avoided a military showdown with the Islamic Republic, even as its strategic advance across the region deepened. The risks and the potential complications were deemed too great. President Trump has said that he, too, has no desire for war, yet he started the new year with a drone strike that killed General Qassem Suleimani, the mastermind of Iran’s expeditionary Quds Force, while he was on a trip to Baghdad.
  • Trump’s decision has already had sweeping consequences—for the regional military balance, the campaign against ISIS and Al Qaeda, Iran’s nuclear program, and the unnerving political dysfunction in the Middle East.
  • Seventeen years after the U.S. invasion, the presence of American troops is suddenly precarious; so is the fractured government of Iraq, after months of protests demanding its ouster.
  • ...3 more annotations...
  • The Trump Administration’s top two goals in Iran have also been undermined.
  • The nuclear deal, which Trump abandoned in May, 2018, on the ground that he wanted something broader, is now unravelling. Iran’s breakout time has begun to tick down again.
  • It has evolved into the world’s leading practitioner of “gray zone” activities—covert and unacknowledged military operations, proxy attacks and cyberwar—Michael Eisenstadt, of the Washington Institute for Near East Policy, said last week. “The United States has struggled to respond effectively to this asymmetric way of war.”
Javier E

What the War on Terror Cost America | Foreign Affairs - 0 views

  • At a joint session of Congress on September 20, 2001, U.S. President George W. Bush announced a new type of war, a “war on terror.” He laid out its terms: “We will direct every resource at our command—every means of diplomacy, every tool of intelligence, every instrument of law enforcement, every financial influence, and every necessary weapon of war—to the disruption and to the defeat of the global terror network.” Then he described what that defeat might look like: “We will starve terrorists of funding, turn them one against another, drive them from place to place until there is no refuge or no rest.”
  • If Bush’s words outlined the essential objectives of the global war on terror, 20 years later, the United States has largely achieved them. Osama bin Laden is dead. The surviving core members of al Qaeda are dispersed and weak. Bin Laden’s successor, Ayman al-Zawahiri, communicates only through rare propaganda releases, and al Qaeda’s most powerful offshoot, the Islamic State (or ISIS), has seen its territorial holdings dwindle to insignificance in Iraq and Syria.
  • Most important, however, is the United States’ success in securing its homeland.
  • ...39 more annotations...
  • Since 9/11, the United States has suffered, on average, six deaths per year due to jihadi terrorism. (To put this in perspective, in 2019, an average of 39 Americans died every day from overdoses involving prescription opioids.) If the goal of the global war on terror was to prevent significant acts of terrorism, particularly in the United States, then the war has succeeded.
  • But at what cost?
  • Every war the United States has fought, beginning with the American Revolution, has required an economic model to sustain it with sufficient bodies and cash.
  • Like its predecessors, the war on terror came with its own model: the war was fought by an all-volunteer military and paid for largely through deficit spending.
  • It should be no surprise that this model, which by design anesthetized a majority of Americans to the costs of conflict, delivered them their longest war; in his September 20, 2001, speech, when describing how Americans might support the war effort, Bush said, “I ask you to live your lives and hug your children.”
  • This model has also had a profound effect on American democracy, one that is only being fully understood 20 years later.
  • Funding the war through deficit spending allowed it to fester through successive administrations with hardly a single politician ever mentioning the idea of a war tax. Meanwhile, other forms of spending—from financial bailouts to health care and, most recently, a pandemic recovery stimulus package—generate breathless debate.
  • , technological and social changes have numbed them to its human cost. The use of drone aircraft and other platforms has facilitated the growing automation of combat, which allows the U.S. military to kill remotely. This development has further distanced Americans from the grim costs of war
  • the absence of a draft has allowed the U.S. government to outsource its wars to a military caste, an increasingly self-segregated portion of society, opening up a yawning civil-military divide as profound as any that American society has ever known.
  • For now, the military remains one of the most trusted institutions in the United States and one of the few that the public sees as having no overt political bias. How long will this trust last under existing political conditions? As partisanship taints every facet of American life, it would seem to be only a matter of time before that infection spreads to the U.S. military.
  • From Caesar’s Rome to Napoleon’s France, history shows that when a republic couples a large standing military with dysfunctional domestic politics, democracy doesn’t last long. The United States today meets both conditions.
  • Historically, this has invited the type of political crisis that leads to military involvement (or even intervention) in domestic politics.
  • How imminent is the threat from these states? When it comes to legacy military platforms—aircraft carriers, tanks, fighter planes—the United States continues to enjoy a healthy technological dominance over its near-peer competitors. But its preferred platforms might not be the right ones. Long-range land-based cruise missiles could render large aircraft carriers obsolete. Advances in cyberoffense could make tech-reliant fighter aircraft too vulnerable to fly
  • It is not difficult to imagine a more limited counterterrorism campaign in Afghanistan that might have brought bin Laden to justice or a strategy to contain Saddam Hussein’s Iraq that would not have involved a full-scale U.S. invasion. The long, costly counterinsurgency campaigns that followed in each country were wars of choice.
  • Both proved to be major missteps when it came to achieving the twin goals of bringing the perpetrators of 9/11 to justice and securing the homeland. In fact, at several moments over the past two decades, the wars set back those objectives
  • Few years proved to be more significant in the war on terror than 2011. Aside from being the year bin Laden was killed, it also was the year the Arab Spring took off and the year U.S. troops fully withdrew from Iraq. If the great strategic blunder of the Bush administration was to put troops into Iraq, then the great strategic blunder of the Obama administration was to pull all of them out. Both missteps created power vacuums. The first saw the flourishing of al Qaeda in Iraq; the second gave birth to that group’s successor, ISIS.
  • But what makes the war on terror different from other wars is that victory has never been based on achieving a positive outcome; the goal has been to prevent a negative one.
  • How, then, do you declare victory? How do you prove a negative?
  • it may seem odd to separate the wars in Afghanistan and Iraq from the war on terror,
  • In addition to blood and treasure, there is another metric by which the war on terror can be judged: opportunity cost
  • For the past two decades, while Washington was repurposing the U.S. military to engage in massive counterinsurgency campaigns and precision counterterrorism operations, Beijing was busy building a military to fight and defeat a peer-level competitor.
  • Today, the Chinese navy is the largest in the world. It boasts 350 commissioned warships to the U.S. Navy’s roughly 290.
  • it now seems inevitable that the two countries’ militaries will one day reach parity. China has spent 20 years building a chain of artificial islands throughout the South China Sea that can effectively serve as a defensive line of unsinkable aircraft carriers.
  • Culturally, China has become more militaristic, producing hypernationalist content such as the Wolf Warrior action movies.
  • After the century opened with 9/11, conventional wisdom had it that nonstate actors would prove to be the greatest threat to U.S. national security
  • Nonstate actors have compromised national security not by attacking the United States but by diverting its attention away from state actors. It is these classic antagonists—China, Iran, North Korea, and Russia—that have expanded their capabilities and antipathies in the face of a distracted United States.
  • The wars in Afghanistan and Iraq represented a familiar type of war, with an invasion to topple a government and liberate a people, followed by a long occupation and counterinsurgency campaigns.
  • The greatest minds in the U.S. military have now, finally, turned their attention to these concerns, with the U.S. Marine Corps, for example, shifting its entire strategic focus to a potential conflict with China. But it may be too late.
  • Americans’ fatigue—and rival countries’ recognition of it—has limited the United States’ strategic options. As a result, presidents have adopted policies of inaction, and American credibility has eroded.
  • When Obama went to legislators to gain support for a military strike against the Assad regime, he encountered bipartisan war fatigue that mirrored the fatigue of voters, and he called off the attack. The United States’ redline had been crossed, without incident or reprisal.
  • Fatigue may seem like a “soft” cost of the war on terror, but it is a glaring strategic liability.
  • This proved to be true during the Cold War when, at the height of the Vietnam War, in 1968, the Soviets invaded Czechoslovakia, and when, in the war’s aftermath, in 1979, the Soviets invaded Afghanistan. Because it was embroiled in a war in the first case and reeling from it in the second, the United States could not credibly deter Soviet military aggression
  • It is no coincidence that China, for instance, has felt empowered to infringe on Hong Kong’s autonomy and commit brazen human rights abuses against its minority Uyghur population. When American power recedes, other states fill the vacuum.
  • U.S. adversaries have also learned to obfuscate their aggression. The cyberwar currently being waged from Russia is one example, with the Russian government claiming no knowledge of the spate of ransomware attacks emanating from within its borders. With Taiwan, likewise, Chinese aggression probably wouldn’t manifest in conventional military ways. Beijing is more likely to take over the island through gradual annexation, akin to what it has done with Hong Kong, than stage an outright invasion.
  • From time to time, people have asked in what ways the war changed me. I have never known how to answer this question because ultimately the war didn’t change me; the war made me
  • Today, I have a hard time remembering what the United States used to be like. I forget what it was like to be able to arrive at the airport just 20 minutes before a flight. What it was like to walk through a train station without armed police meandering around the platforms. Or what it was like to believe—particularly in those heady years right after the Cold War—that the United States’ version of democracy would remain ascendant for all time and that the world had reached “the end of history.”
  • Today, the United States is different; it is skeptical of its role in the world, more clear-eyed about the costs of war despite having experienced those costs only in predominantly tangential ways. Americans’ appetite to export their ideals abroad is also diminished, particularly as they struggle to uphold those ideals at home, whether in violence around the 2020 presidential election, the summer of 2020’s civil unrest, or even the way the war on terror compromised the country through scandals from Abu Ghraib prison to Edward Snowden’s leaks. A United States in which Band of Brothers has near-universal appeal is a distant memory.
  • When I told him that even though we might have lost the war in Afghanistan, our generation could still claim to have won the war on terror, he was skeptical. We debated the issue but soon let it drop. The next day, I received an email from him. A southerner and a lover of literature, he had sent me the following, from The Sound and the Fury:
  • No battle is ever won. . . . They are not even fought. The field only reveals to man his own folly and despair, and victory is an illusion of philosophers and fools.
kennyn-77

Is Ukraine ready for a Russian attack? Yes and no : NPR - 0 views

  • Over the months that Russia amassed more than 100,000 troops on the borders of Ukraine
  • Ukraine is vulnerable to a major cyber attack
  • Ukraine has repeatedly been a target of cyberattacks, especially since the 2014 Russian invasion of Crimea. In the years since Crimea's annexation — which is unrecognized by the international community — near-constant cyber warfare, much of it from Russia, has targeted almost every sector in Ukraine, from its power grid to its treasury to its media companies.
  • ...11 more annotations...
  • Since 2014, the U.S. has spent tens of millions of dollars toward arming Ukraine with hardware, software and training to secure its critical infrastructure. Those efforts have ramped up in recent months.
  • But Russian disinformation has become less effective
  • When war broke out in eastern Ukraine in 2014, fake news from Russia flooded over the border with the aim of instilling panic in parts of the country with greater sympathy for Russia, like Crimea, turning them away from the Ukrainian government and toward Russia.
  • Russian state-owned TV broadcast false stories about "fascists" in the streets of Kyiv, a ban on the Russian language in Ukraine, and looming food riots and rationing. One story, broadcast on Russian state TV, claimed that Ukrainian soldiers had brutally murdered and crucified a three-year-old boy.
  • Authorities in Kyiv are working to prepare the city
  • One example: A series of bomb scares were called into Ukrainian schools in recent weeks, but many parents shrugged them off.
  • Although an invasion feels unlikely to many who live in Kyiv, city officials say they are not as prepared as they'd like to be.
  • Kyiv has thousands of bomb shelters that date back to the Soviet era, when some of the USSR's nuclear arsenal was based in Ukraine. Over the past several months, authorities have been working to bring as many shelters as possible back into operation. But many are still unusable. Some have been flooded, others are inaccessible. Some shelters have even been taken over by barbershops or bakeries that have set up shop inside. "Authorities will have to take care of this situation and take it more seriously," Mykhailova said.
  • Ukraine's military has strengthened since 2014
  • "Ukrainian troops are well-trained, they're well-equipped and they're very motivated. Ukrainians in general and the Ukrainian military are very patriotic. They love Ukraine. They're willing to fight to save it," said Kristina Kvien, the top U.S. diplomat in Kyiv, in an interview with All Things Considered on Friday.
  • That improvement has come with major help from international donors, primarily the United States. The U.S. has committed more than $5.4 billion in aid to Ukraine since 2014, according to the State Department. About half that total has been security assistance, with the Biden administration announcing another $200 million on Wednesday. Over the years, that military aid has taken many forms: Humvees, patrol boats, counter-artillery radar, a joint training center in western Ukraine.
Javier E

'Never summon a power you can't control': Yuval Noah Harari on how AI could threaten de... - 0 views

  • The Phaethon myth and Goethe’s poem fail to provide useful advice because they misconstrue the way humans gain power. In both fables, a single human acquires enormous power, but is then corrupted by hubris and greed. The conclusion is that our flawed individual psychology makes us abuse power.
  • What this crude analysis misses is that human power is never the outcome of individual initiative. Power always stems from cooperation between large numbers of humans. Accordingly, it isn’t our individual psychology that causes us to abuse power.
  • Our tendency to summon powers we cannot control stems not from individual psychology but from the unique way our species cooperates in large numbers. Humankind gains enormous power by building large networks of cooperation, but the way our networks are built predisposes us to use power unwisely
  • ...57 more annotations...
  • We are also producing ever more powerful weapons of mass destruction, from thermonuclear bombs to doomsday viruses. Our leaders don’t lack information about these dangers, yet instead of collaborating to find solutions, they are edging closer to a global war.
  • Despite – or perhaps because of – our hoard of data, we are continuing to spew greenhouse gases into the atmosphere, pollute rivers and oceans, cut down forests, destroy entire habitats, drive countless species to extinction, and jeopardise the ecological foundations of our own species
  • For most of our networks have been built and maintained by spreading fictions, fantasies and mass delusions – ranging from enchanted broomsticks to financial systems. Our problem, then, is a network problem. Specifically, it is an information problem. For information is the glue that holds networks together, and when people are fed bad information they are likely to make bad decisions, no matter how wise and kind they personally are.
  • Traditionally, the term “AI” has been used as an acronym for artificial intelligence. But it is perhaps better to think of it as an acronym for alien intelligence
  • AI is an unprecedented threat to humanity because it is the first technology in history that can make decisions and create new ideas by itself. All previous human inventions have empowered humans, because no matter how powerful the new tool was, the decisions about its usage remained in our hands
  • Nuclear bombs do not themselves decide whom to kill, nor can they improve themselves or invent even more powerful bombs. In contrast, autonomous drones can decide by themselves who to kill, and AIs can create novel bomb designs, unprecedented military strategies and better AIs.
  • AI isn’t a tool – it’s an agent. The biggest threat of AI is that we are summoning to Earth countless new powerful agents that are potentially more intelligent and imaginative than us, and that we don’t fully understand or control.
  • repreneurs such as Yoshua Bengio, Geoffrey Hinton, Sam Altman, Elon Musk and Mustafa Suleyman have warned that AI could destroy our civilisation. In a 2023 survey of 2,778 AI researchers, more than a third gave at least a 10% chance of advanced AI leading to outcomes as bad as human extinction.
  • As AI evolves, it becomes less artificial (in the sense of depending on human designs) and more alien
  • AI isn’t progressing towards human-level intelligence. It is evolving an alien type of intelligence.
  • generative AIs like GPT-4 already create new poems, stories and images. This trend will only increase and accelerate, making it more difficult to understand our own lives. Can we trust computer algorithms to make wise decisions and create a better world? That’s a much bigger gamble than trusting an enchanted broom to fetch water
  • it is more than just human lives we are gambling on. AI is already capable of producing art and making scientific discoveries by itself. In the next few decades, it will be likely to gain the ability even to create new life forms, either by writing genetic code or by inventing an inorganic code animating inorganic entities. AI could therefore alter the course not just of our species’ history but of the evolution of all life forms.
  • “Then … came move number 37,” writes Suleyman. “It made no sense. AlphaGo had apparently blown it, blindly following an apparently losing strategy no professional player would ever pursue. The live match commentators, both professionals of the highest ranking, said it was a ‘very strange move’ and thought it was ‘a mistake’.
  • as the endgame approached, that ‘mistaken’ move proved pivotal. AlphaGo won again. Go strategy was being rewritten before our eyes. Our AI had uncovered ideas that hadn’t occurred to the most brilliant players in thousands of years.”
  • “In AI, the neural networks moving toward autonomy are, at present, not explainable. You can’t walk someone through the decision-making process to explain precisely why an algorithm produced a specific prediction. Engineers can’t peer beneath the hood and easily explain in granular detail what caused something to happen. GPT‑4, AlphaGo and the rest are black boxes, their outputs and decisions based on opaque and impossibly intricate chains of minute signals.”
  • Yet during all those millennia, human minds have explored only certain areas in the landscape of Go. Other areas were left untouched, because human minds just didn’t think to venture there. AI, being free from the limitations of human minds, discovered and explored these previously hidden areas.
  • Second, move 37 demonstrated the unfathomability of AI. Even after AlphaGo played it to achieve victory, Suleyman and his team couldn’t explain how AlphaGo decided to play it.
  • Move 37 is an emblem of the AI revolution for two reasons. First, it demonstrated the alien nature of AI. In east Asia, Go is considered much more than a game: it is a treasured cultural tradition. For more than 2,500 years, tens of millions of people have played Go, and entire schools of thought have developed around the game, espousing different strategies and philosophies
  • The rise of unfathomable alien intelligence poses a threat to all humans, and poses a particular threat to democracy. If more and more decisions about people’s lives are made in a black box, so voters cannot understand and challenge them, democracy ceases to functio
  • Human voters may keep choosing a human president, but wouldn’t this be just an empty ceremony? Even today, only a small fraction of humanity truly understands the financial system
  • As the 2007‑8 financial crisis indicated, some complex financial devices and principles were intelligible to only a few financial wizards. What happens to democracy when AIs create even more complex financial devices and when the number of humans who understand the financial system drops to zero?
  • Translating Goethe’s cautionary fable into the language of modern finance, imagine the following scenario: a Wall Street apprentice fed up with the drudgery of the financial workshop creates an AI called Broomstick, provides it with a million dollars in seed money, and orders it to make more money.
  • n pursuit of more dollars, Broomstick not only devises new investment strategies, but comes up with entirely new financial devices that no human being has ever thought about.
  • many financial areas were left untouched, because human minds just didn’t think to venture there. Broomstick, being free from the limitations of human minds, discovers and explores these previously hidden areas, making financial moves that are the equivalent of AlphaGo’s move 37.
  • For a couple of years, as Broomstick leads humanity into financial virgin territory, everything looks wonderful. The markets are soaring, the money is flooding in effortlessly, and everyone is happy. Then comes a crash bigger even than 1929 or 2008. But no human being – either president, banker or citizen – knows what caused it and what could be done about it
  • AI, too, is a global problem. Accordingly, to understand the new computer politics, it is not enough to examine how discrete societies might react to AI. We also need to consider how AI might change relations between societies on a global level.
  • As long as humanity stands united, we can build institutions that will regulate AI, whether in the field of finance or war. Unfortunately, humanity has never been united. We have always been plagued by bad actors, as well as by disagreements between good actors. The rise of AI poses an existential danger to humankind, not because of the malevolence of computers, but because of our own shortcomings.
  • errorists might use AI to instigate a global pandemic. The terrorists themselves may have little knowledge of epidemiology, but the AI could synthesise for them a new pathogen, order it from commercial laboratories or print it in biological 3D printers, and devise the best strategy to spread it around the world, via airports or food supply chain
  • desperate governments request help from the only entity capable of understanding what is happening – Broomstick. The AI makes several policy recommendations, far more audacious than quantitative easing – and far more opaque, too. Broomstick promises that these policies will save the day, but human politicians – unable to understand the logic behind Broomstick’s recommendations – fear they might completely unravel the financial and even social fabric of the world. Should they listen to the AI?
  • Human civilisation could also be devastated by weapons of social mass destruction, such as stories that undermine our social bonds. An AI developed in one country could be used to unleash a deluge of fake news, fake money and fake humans so that people in numerous other countries lose the ability to trust anything or anyone.
  • Many societies – both democracies and dictatorships – may act responsibly to regulate such usages of AI, clamp down on bad actors and restrain the dangerous ambitions of their own rulers and fanatics. But if even a handful of societies fail to do so, this could be enough to endanger the whole of humankind
  • Thus, a paranoid dictator might hand unlimited power to a fallible AI, including even the power to launch nuclear strikes. If the AI then makes an error, or begins to pursue an unexpected goal, the result could be catastrophic, and not just for that country
  • magine a situation – in 20 years, say – when somebody in Beijing or San Francisco possesses the entire personal history of every politician, journalist, colonel and CEO in your country: every text they ever sent, every web search they ever made, every illness they suffered, every sexual encounter they enjoyed, every joke they told, every bribe they took. Would you still be living in an independent country, or would you now be living in a data colony?
  • What happens when your country finds itself utterly dependent on digital infrastructures and AI-powered systems over which it has no effective control?
  • In the economic realm, previous empires were based on material resources such as land, cotton and oil. This placed a limit on the empire’s ability to concentrate both economic wealth and political power in one place. Physics and geology don’t allow all the world’s land, cotton or oil to be moved to one country
  • t is different with the new information empires. Data can move at the speed of light, and algorithms don’t take up much space. Consequently, the world’s algorithmic power can be concentrated in a single hub. Engineers in a single country might write the code and control the keys for all the crucial algorithms that run the entire world.
  • AI and automation therefore pose a particular challenge to poorer developing countries. In an AI-driven global economy, the digital leaders claim the bulk of the gains and could use their wealth to retrain their workforce and profit even more
  • Meanwhile, the value of unskilled labourers in left-behind countries will decline, causing them to fall even further behind. The result might be lots of new jobs and immense wealth in San Francisco and Shanghai, while many other parts of the world face economic ruin.
  • AI is expected to add $15.7tn (£12.3tn) to the global economy by 2030. But if current trends continue, it is projected that China and North America – the two leading AI superpowers – will together take home 70% of that money.
  • uring the cold war, the iron curtain was in many places literally made of metal: barbed wire separated one country from another. Now the world is increasingly divided by the silicon curtain. The code on your smartphone determines on which side of the silicon curtain you live, which algorithms run your life, who controls your attention and where your data flows.
  • Cyberweapons can bring down a country’s electric grid, but they can also be used to destroy a secret research facility, jam an enemy sensor, inflame a political scandal, manipulate elections or hack a single smartphone. And they can do all that stealthily. They don’t announce their presence with a mushroom cloud and a storm of fire, nor do they leave a visible trail from launchpad to target
  • The two digital spheres may therefore drift further and further apart. For centuries, new information technologies fuelled the process of globalisation and brought people all over the world into closer contact. Paradoxically, information technology today is so powerful it can potentially split humanity by enclosing different people in separate information cocoons, ending the idea of a single shared human reality
  • For decades, the world’s master metaphor was the web. The master metaphor of the coming decades might be the cocoon.
  • Other countries or blocs, such as the EU, India, Brazil and Russia, may try to create their own digital cocoons,
  • Instead of being divided between two global empires, the world might be divided among a dozen empires.
  • The more the new empires compete against one another, the greater the danger of armed conflict.
  • The cold war between the US and the USSR never escalated into a direct military confrontation, largely thanks to the doctrine of mutually assured destruction. But the danger of escalation in the age of AI is bigger, because cyber warfare is inherently different from nuclear warfare.
  • US companies are now forbidden to export such chips to China. While in the short term this hampers China in the AI race, in the long term it pushes China to develop a completely separate digital sphere that will be distinct from the American digital sphere even in its smallest buildings.
  • The temptation to start a limited cyberwar is therefore big, and so is the temptation to escalate it.
  • A second crucial difference concerns predictability. The cold war was like a hyper-rational chess game, and the certainty of destruction in the event of nuclear conflict was so great that the desire to start a war was correspondingly small
  • Cyberwarfare lacks this certainty. Nobody knows for sure where each side has planted its logic bombs, Trojan horses and malware. Nobody can be certain whether their own weapons would actually work when called upon
  • Such uncertainty undermines the doctrine of mutually assured destruction. One side might convince itself – rightly or wrongly – that it can launch a successful first strike and avoid massive retaliation
  • Even if humanity avoids the worst-case scenario of global war, the rise of new digital empires could still endanger the freedom and prosperity of billions of people. The industrial empires of the 19th and 20th centuries exploited and repressed their colonies, and it would be foolhardy to expect new digital empires to behave much better
  • Moreover, if the world is divided into rival empires, humanity is unlikely to cooperate to overcome the ecological crisis or to regulate AI and other disruptive technologies such as bioengineering.
  • The division of the world into rival digital empires dovetails with the political vision of many leaders who believe that the world is a jungle, that the relative peace of recent decades has been an illusion, and that the only real choice is whether to play the part of predator or prey.
  • Given such a choice, most leaders would prefer to go down in history as predators and add their names to the grim list of conquerors that unfortunate pupils are condemned to memorise for their history exams.
  • These leaders should be reminded, however, that there is a new alpha predator in the jungle. If humanity doesn’t find a way to cooperate and protect our shared interests, we will all be easy prey to AI.
1 - 7 of 7
Showing 20 items per page