Group items tagged

Authoritarian governments have created seemingly realistic news broadcasters to advance their political goals

Experts fear the technology could hasten an erosion of trust in media, in government and in society. If any image can be manufactured — and manipulated — how can we believe anything we see?

“The tools are going to get better, they’re going to get cheaper, and there will come a day when nothing you see on the internet can be believed,” said Wasim Khaled, chief executive of Blackbird.AI, a company that helps clients fight disinformation.

Artificial intelligence allows virtually anyone to create complex artworks, like those now on exhibit at the Gagosian art gallery in New York, or lifelike images that blur the line between what is real and what is fiction. Plug in a text description, and the technology can produce a related image — no special skills required.

Midjourney’s images, he said, were able to pass muster in facial-recognition programs that Bellingcat uses to verify identities, typically of Russians who have committed crimes or other abuses. It’s not hard to imagine governments or other nefarious actors manufacturing images to harass or discredit their enemies.

In February, Getty accused Stability AI of illegally copying more than 12 million Getty photos, along with captions and metadata, to train the software behind its Stable Diffusion tool. In its lawsuit, Getty argued that Stable Diffusion diluted the value of the Getty watermark by incorporating it into images that ranged “from the bizarre to the grotesque.”

Getty’s lawsuit reflects concerns raised by many individual artists — that A.I. companies are becoming a competitive threat by copying content they do not have permission to use.

Trademark violations have also become a concern: Artificially generated images have replicated NBC’s peacock logo, though with unintelligible letters, and shown Coca-Cola’s familiar curvy logo with extra O’s looped into the name.

The threat to photographers is fast outpacing the development of legal protections, said Mickey H. Osterreicher, general counsel for the National Press Photographers Association

Newsrooms will increasingly struggle to authenticate conten

Social media users are ignoring labels that clearly identify images as artificially generated, choosing to believe they are real photographs, he said.

The video explained that the deepfake had been created, with Ms. Schick’s consent, by the Dutch company Revel.ai and Truepic, a California company that is exploring broader digital content verification

The companies described their video, which features a stamp identifying it as computer-generated, as the “first digitally transparent deepfake.” The data is cryptographically sealed into the file; tampering with the image breaks the digital signature and prevents the credentials from appearing when using trusted software.

The companies hope the badge, which will come with a fee for commercial clients, will be adopted by other content creators to help create a standard of trust involving A.I. images.

“The scale of this problem is going to accelerate so rapidly that it’s going to drive consumer education very quickly,” said Jeff McGregor, chief executive of Truepic

Adobe unveiled its own image-generating product, Firefly, which will be trained using only images that were licensed or from its own stock or no longer under copyright. Dana Rao, the company’s chief trust officer, said on its website that the tool would automatically add content credentials — “like a nutrition label for imaging” — that identified how an image had been made. Adobe said it also planned to compensate contributors.

hearing on Tuesday that was intended to give committee members, particularly Democrats, a chance to explore the issue of civilian control of the military,

Mr. Cohen, who signed a letter during the campaign arguing that Donald J. Trump was unfit to serve as commander in chief, argued that an exception should be made because General Mattis was a person of integrity, had important experience at a time when the Pentagon has to contend with multiple threats and might dissuade the incoming administration from acting recklessly.

Hicks, with the Center for Strategic and International Studies, told the hearing that it was appropriate to make an exception for General Mattis, and praised his character and expertise. But she stressed that this was the sort of exception that should be made only rarely.

The only previous case in which a legal exception was made so that a military officer could become defense secretary was George C. Marshall.

Faced with the Korean War and growing tensions with the Soviet Union, Congress passed an amendment in 1950 allowing General Marshall to become the Pentagon chief.

Senator Jeane Shaheen, Democrat of New Hampshire, said that Mr. Cohen’s assertion that General Mattis could be a stabilizing force within the Trump administration was the “strongest argument” in favor of confirming the retired Marine general.

asked for advice on crafting legislation to ensure that confirming General Mattis would not open the door for similar nominations of recently retired officers to run the Pentagon.

General Mattis’s supporters hope President Obama will sign the legislation before leaving office.

today’s generation gap is not based just on temporary intellectual postures. It is based on concrete, lived experience that is never going to go away.

Unlike the Silent Generation and the boomers, millennials and Gen Z voters live with difference every single day. Only 16 percent of the Silent Generation is minority, but 44 percent of the millennial generation is

Young voters approve of these trends. Seventy-nine percent of millennials think immigration is good for America. Sixty-one percent think racial diversity is good for America.

The generation gap is even more powerful when it comes to Republicans. To put it bluntly, young adults hate them.

They are much less likely to say the U.S. is the best country in the world.

Matthew Continetti recently identified the key blocs on the new right in an essay in The Washington Free Beacon. These included the Jacksonians (pugilistic populists), the Paleos (Tucker Carlson-style economic nationalists), the Post-Liberals (people who oppose pluralism and seek a return to pre-Enlightenment orthodoxy). To most young adults, these tendencies will look like cloud cuckooland.

There is a conservative way to embrace pluralism and diversity. It’s to point out that there is a deep strain of pessimism in progressive multiculturalism: blacks and whites will never really understand each other; racism is endemic; the American project is fatally flawed; American structures are so oppressive, the only option is to burn them down

A better multiculturalism would be optimistic: We can communicate across difference; the American creed is the right recipe for a thick and respectful pluralism; American structures are basically sound and can be realistically reformed

My mentor William F. Buckley vowed to stand athwart history yelling “Stop!” Today’s Republicans don’t even seem to see the train that is running them over.

A quick succession of sexual harassment claims against Cuomo in the ensuing weeks has knocked him from his political perch

Trump might be in even greater peril. Since 2019, James’s office has been conducting an investigation of business practices inside the Trump Organization and family. Trump has fought fiercely in court, but month after month, James has succeeded in unearthing financial records that appear to be adding up to a giant legal hazard for the former president, analysts say.

The Trump case and the Cuomo nursing home scandal have generated a torrent of national attention for James, with people outside New York politics wondering how a single state officer could make such big legal waves.

As state attorney general, James has aggressively pursued a full catalogue of progressive causes.She sued the police department over brutality against people of color, blocked unlawful evictions during the pandemic, won a major sexual harassment settlement for women in the construction industry, filed an amicus brief before the supreme court opposing a rushed census, and sued to dissolve the National Rifle Association.She also sued Amazon for allegedly failing to protect workers, sued Facebook as an alleged monopoly and investigated Google on similar grounds. She has asked federal regulators to clamp down on toxins in baby food and called for student debt relief

“I see the law both as a shield and as a sword,” she said in a public discussion last year about Black leadership. “And so I wake up every day with a fire in my belly, and I march into the office – well, I actually march into my kitchen – and the question is, what can I do today to make a difference in the life of somebody? Who can I sue?”

she argues that “the law should be a tool for social change”

“When I looked around the courtroom, all the defendants and all the family members looked like me, but everyone in a position of power did not, and there was something really unbalanced about that and unfair about that,” James told Miller

Before her election to the New York city council in 2003, James worked as a public defender, as counsel to the speaker of the state assembly and as an assistant attorney general for Brooklyn, where she targeted predatory lenders, advocated for working families and brought the first case against the New York City police department for so-called stop-and-frisk abuses.

“She told us that she would be independent of the governor and I think she’s proven that,” he said.

“I think she wants to be governor, I think that’s clear, and she’d be a formidable candidate,” said Albro.“I think she’d be a formidable candidate because she is very well liked and known in the city and that’s a big chunk of the vote.”

Perhaps some are jealous of what appear to be greater opportunities afforded to younger people, bemused by younger generations’ lifestyles, and fearful that their own values are seen as outdated.

The trouble was the sheer number of Boomers. As a big generation, the Boomers had achieved political and cultural dominance. They were no more self-interested than any other group, but they warped government priorities. And that was unfair to everyone else. Boomers, Willetts argued, were not okay.

Both sides claim that the other is being condescending. Some Boomers argue that the word itself has become a cover for ageism; Millennials roll their eyes and reply with the phrase that has come to encapsulate their weariness: “Okay, Boomer.”

Boomers have bent the gravity of politics toward themselves and their needs. They buy newspapers. They vote. They wield their spending power effectively. Their voice is loud. To build a fair and just society, the question then must be: On everything from elderly care to housing, how do you persuade them to vote against their own interests?

Generational arguments are essentially family dramas, with all the friction that implies.

“When we have all this power, we shouldn’t be surprised when younger people are rather resentful,” he said. “I’m surprised they are aren’t angrier.”

the rage tends to come not from Millennials, who feel disadvantaged, but from the Boomers, who feel attacked.

In Britain, for example, Boomers have opposed housebuilding, leaving the country with a chronic shortage that protects the value of their homes but traps younger people in the expensive private-rental sector. (In 1980, the average private tenant spent 10 percent of their income on rent. That figure is now 30 percent.

Boomers have successfully deterred politicians from devaluing the state pension, even as salaries and working-age benefits have stagnated. The result is that pensioner poverty has halved since 2000, whereas poverty among people of working age has risen

defensiveness can sometimes manifest as retaliatory accusations that younger generations have it easy. The intergenerational debate has spawned its own weird jargon: “Avocado toast,” for example, has become shorthand for the argument that Millennials splurge their salaries on good living, rather than saving for a home like their parents did

the problem is particularly acute in Britain, because of the country’s steep fall in home ownership in recent decades. The British rental sector is much more “mom and pop”—literally. “Something like 20 percent of Boomers have a second property that they rent out,” Willetts said. That means there is a direct transfer of wealth from younger renters to older asset-owners.

How, though, do you explain to otherwise reasonable retirement-age voters how much damage their demands are causing to their children’s generation—without completely alienating them? “In politics, you’re not a kamikaze pilot, you’re not on a suicide mission,” Willetts said. He told the Boomers that the houses they owned had been largely built in the 1960s and ’70s so their parents had somewhere to live; they now had a similar obligation to allow more building for their own kids. “That was the only argument that gave them pause,”

differences within generations do matter, though, because rich Boomers, the luckiest part of a lucky generation, will leave their money to their children, further entrenching inequality. If the value of assets is rising faster than incomes, we are heading for a society where wealth matters more, and earnings matter less. The problem will not resolve itself without intervention.

One obvious answer is to build more houses (bad news for the residents’ associations who want to preserve their unblocked views or quiet roads) and ease lending criteria for younger people, to make it easier for them to get mortgages.

Willetts has a more radical idea: Offer younger people £10,000 when they turn 30, money that they could put into a pension, use to start a business, combine into a down payment, or spend on education or training

I’d add a few more: the conservative influence of John Paul II’s papacy for Generation-X Catholics

the seemingly positive trendlines on race relations (visible in polls of African-Americans as well as whites) from the 1990s through the early Obama years

By virtue of having “adulted” more successfully than millennials — marrying, homebuying and having kids earlier and in larger numbers — Generation X enjoys a certain bourgeois realism about what sustains human societies, what choices in your 20s will make you happiest in your 40s, that’s absent from the very-online progressivism of the young

and the effects of the Reagan and Clinton economic growth spurts, which enabled my generation to enter adulthood under more prosperous conditions than the Great Recession-era landscape that hobbled millennials

On economics, meanwhile, Gen X conservatives can be tempted into uncharity toward younger Americans, interpreting their struggles and sympathies for socialism as a moral failure, as opposed to a response to a more hostile economic landscape than we faced

Zombie Reaganism, sticking with a conservative policy agenda that’s lost much of its relevance, precisely because the Reagan agenda helped make the world in which we came of age.

the characteristic Gen X weakness on race is a complacent assumption that the Clinton-to-Obama period resolved issues like the wealth gap or police misconduct, instead of just tabling them

There is an emotivism and narcissism that millennial liberalism and boomer liberalism seem to share, and in strong doses it’s poison for institutions.

The ironic communitarianism of Gen-X conservatism probably isn’t the perfect antidote, but it may be all we’ve got.

To grow up in the ’70s or ’80s was to come of age just after liberalism’s last high tide, and to see evidence of its failures all around — from the urban blight and ugliness left by utopian renewal projects to the adult disarray and childhood misery sowed by the ideology of sexual liberation in its Hefnerian phase.

In War and Peace and War (2006), his most accessible book, he likens himself to Hari Seldon, the “maverick mathematician” of Isaac Asimov’s Foundation series, who can foretell the rise and fall of empires. In those 10,000 years’ worth of data, Turchin believes he has found iron laws that dictate the fates of human societies.

The fate of our own society, he says, is not going to be pretty, at least in the near term. “It’s too late,”

The problems are deep and structural—not the type that the tedious process of demo­cratic change can fix in time to forestall mayhem.

Turchin likens America to a huge ship headed directly for an iceberg: “If you have a discussion among the crew about which way to turn, you will not turn in time, and you hit the iceberg directly.” The past 10 years or so have been discussion. That sickening crunch you now hear—steel twisting, rivets popping—­­is the sound of the ship hitting the iceberg.

Of the three factors driving social violence, Turchin stresses most heavily “elite overproduction”—­the tendency of a society’s ruling classes to grow faster than the number of positions for their members to fill.

Don’t we want everyone to be rich and educated? The problems begin when money and Harvard degrees become like royal titles in Saudi Arabia. If lots of people have them, but only some have real power, the ones who don’t have power eventually turn on the ones who do.

“You have a situation now where there are many more elites fighting for the same position, and some portion of them will convert to counter-elites,” Turchin said.

Elite jobs do not multiply as fast as elites do. There are still only 100 Senate seats, but more people than ever have enough money or degrees to think they should be running the country

Turchin noted that a person can be part of an ideological elite rather than an economic one.

Elite overproduction creates counter-elites, and counter-elites look for allies among the commoners. If commoners’ living standards slip—not relative to the elites, but relative to what they had before—they accept the overtures of the counter-elites and start oiling the axles of their tumbrels

Commoners’ lives grow worse, and the few who try to pull themselves onto the elite lifeboat are pushed back into the water by those already aboard.

The final trigger of impending collapse, Turchin says, tends to be state insolvency. At some point rising in­security becomes expensive. The elites have to pacify unhappy citizens with handouts and freebies—and when these run out, they have to police dissent and oppress people.

Eventually the state exhausts all short-term solutions, and what was heretofore a coherent civilization disintegrates.

“I gave up because I solved the problem.” Turchin published one final monograph, Complex Population Dynamics: A Theoretical / Empirical Synthesis (2003), then broke the news to his UConn colleagues that he would be saying a permanent sayonara to the field

“Does population ecology have general laws?” Turchin asked. Most ecologists said no: Populations have their own dynamics, and each situation is different.

All sciences go through this transition to mathematization,” Turchin told me. “When I had my midlife crisis, I was looking for a subject where I could help with this transition to a mathematized science. There was only one left, and that was history.”

After its long adolescence of collecting and cataloging, ecology had enough data to describe these universal laws—and to stop pretending that every species had its own idiosyncrasies. “Ecologists know these laws and should call them laws,” he said.

The laws Turchin applied to ecology—and his insistence on calling them laws—­generated respectful controversy at the time. Now they are cited in textbooks.

Having left ecology, Turchin began similar research that attempted to formulate general laws for a different animal species: human beings.

Turchin suggested that “there are several very general law-like propositions” that could be applied to ecology.

If the historians weren’t going to usher in a mathematical revolution themselves, he would storm their departments and do it for them.

“There is a longstanding debate among scientists and philosophers as to whether history has general laws,” he and a co-author wrote in Secular Cycles (2009). “A basic premise of our study is that historical societies can be studied with the same methods physicists and biologists used to study natural systems.”

he likened historians reluctant to build general principles to his colleagues in biology “who care most for the private life of warblers.” “Let history continue to focus on the particular,” he wrote. Cliodynamics would be a new science

To seed the journal’s research, Turchin masterminded a digital archive of historical and archaeological data.

The coding of its records requires finesse, he told me, because (for example) the method of determining the size of the elite-aspirant class of medieval France might differ from the measure of the same class in the present-day United States. (For medieval France, a proxy is the membership in its noble class, which became glutted with second and third sons who had no castles or manors to rule over. One American proxy, Turchin says, is the number of lawyers.)

Historians of religion have long pondered the relationship between the rise of complex civilization and the belief in gods—especially “moralizing gods,” the kind who scold you for sinning. Last year, Turchin and a dozen co-authors mined the database (“records from 414 societies that span the past 10,000 years from 30 regions around the world, using 51 measures of social complexity and 4 measures of supernatural enforcement of morality”) to answer the question conclusively. They found that complex societies are more likely to have moralizing gods, but the gods tend to start their scolding after the societies get complex, not before

One of Turchin’s most unwelcome conclusions is that complex societies arise through war. The effect of war is to reward communities that organize themselves to fight and survive, and it tends to wipe out ones that are simple and small-scale

the data are clear: Darwinian processes select for complex socie­ties because they kill off simpler ones.

Certain aspects of this cyclical view require relearning portions of American history, with special attention paid to the numbers of elites. The industrialization of the North, starting in the mid-19th century, Turchin says, made huge numbers of people rich. The elite herd was culled during the Civil War, which killed off or impoverished the southern slaveholding class, and during Reconstruction, when America experienced a wave of assassinations of Republican politicians.

“There is a very close correlation between adopting democratic institutions and having to fight a war for survival.”

Also unwelcome: the conclusion that civil unrest might soon be upon us, and might reach the point of shattering the country. In 2012, Turchin published an analysis of political violence in the United States, again starting with a database. He classified 1,590 incidents—riots, lynchings, any political event that killed at least one person—from 1780 to 2010. Some periods were placid and others bloody, with peaks of brutality in 1870, 1920, and 1970, a 50-year cycle.

In 2010, when Nature surveyed scientists about their predictions for the coming decade, most took the survey as an invitation to self-promote and rhapsodize, dreamily, about coming advances in their fields. Turchin retorted with his prophecy of doom and said that nothing short of fundamental change would stop another violent turn.

It wasn’t until the Progressive reforms of the 1920s, and later the New Deal, that elite overproduction actually slowed, at least for a time.

This oscillation between violence and peace, with elite over­production as the first horseman of the recurring American apocalypse, inspired Turchin’s 2020 prediction

The notion that democracy finds its strength in its essential goodness and moral improvement over its rival systems is likewise fanciful. Instead, democratic societies flourish because they have a memory of being nearly obliterated by an external enemy. They avoided extinction only through collective action, and the memory of that collective action makes democratic politics easier to conduct in the present,

Some sound like ideas that might have come from Senator Elizabeth Warren—tax the elites until there are fewer of them

others, such as a call to reduce immigration to keep wages high for American workers, resemble Trumpian protectionism.

He opposes credential-­oriented higher education, for example, which he says is a way of mass-producing elites without also mass-­producing elite jobs for them to occupy. Architects of such policies, he told me, are “creating surplus elites, and some become counter-elites.” A smarter approach would be to keep the elite numbers small, and the real wages of the general population on a constant rise.

We need to stop the runaway process of elite overproduction, but I don’t know what will work to do that, and nobody else does. Do you increase taxation? Raise the minimum wage? Universal basic income?” He conceded that each of these possibilities would have unpredictable effects

practice “adaptive management,” changing and modulating your approach as you go.

Eventually, Turchin hopes, our understanding of historical dynamics will mature to the point that no government will make policy without reflecting on whether it is hurtling toward a mathematically pre­ordained disaster.

He says he could imagine an Asimovian agency that keeps tabs on leading indicators and advises accordingly. It would be like the Federal Reserve, but instead of monitoring inflation and controlling monetary supply, it would be tasked with averting total civilizational collapse.

Since at least the 19th century, the discipline has embraced the idea that history is irreducibly complex, and by now most historians believe that the diversity of human activity will foil any attempt to come up with general laws, especially predictive ones.

The idea that one thing causes another, and that the causal pattern can tell you about sequences of events in another place or century, is foreign territory.

Turchin counters that he has heard claims of irreducible complexity before, and that steady application of the scientific method has succeeded in managing that complexity.

One social scientist who can speak to Turchin in his own mathematical argot is Dingxin Zhao, a sociology professor at the University of Chicago who is—incredibly—­also a former mathematical ecologist.

in a way I am sympathetic to Turchin. If you come to social science from natural sciences, you have a powerful way of looking at the world. But you may also make big mistakes.”

Turchin is nonetheless filling a historiographical niche left empty by academic historians with allergies not just to science but to a wide-angle view of the past.

humans are much wilier social creatures, Zhao said. A woodpecker will eat a termite, but it “will not explain that he is doing so because it is his divine right.” Humans pull ideological power moves like this all the time, Zhao said, and to understand “the decisions of a Donald Trump, or a Xi Jinping,” a natural scientist has to incorporate the myriad complexities of human strategy, emotion, and belief. “I made that change,” Zhao told me, “and Peter Turchin has not.”

Zhao said that human beings are just much more complicated than bugs.

He places himself in a Russian tradition prone to thinking sweeping, Tolstoyan thoughts about the path of history. By comparison, American historians mostly look like micro-historians.

Rather than bending toward progress, the arc in his view bends all the way back on itself, in a never-­ending loop of boom and bust. This puts him at odds with American historians, many of whom harbor an unspoken faith that liberal democracy is the end state of all history.

Writing history in this sweeping, cyclical way is easier if you are trained outside the field. “If you look at who is doing these megahistories, more often than not, it’s not actual historians,”

The genre’s most famous book, Guns, Germs, and Steel (1997), beheld 13,000 years of human history in a single volume. Its author, Jared Diamond, spent the first half of his career as one of the world’s foremost experts on the physiology of the gall­bladder.

Steven Pinker, a cognitive psychologist who studies how children acquire parts of speech, has written a megahistory about the decline of violence across thousands of years, and about human flourishing since the Enlightenment

Most historians I asked about these men—and for some reason megahistory is nearly always a male pursuit—used terms like laughingstock and patently tendentious to describe them.

Pinker retorts that historians are resentful of the attention “disciplinary carpet­baggers” like himself have received for applying scientific methods to the humanities and coming up with conclusions that had eluded the old methods.

“Given the noisiness of human behavior and the prevalence of cognitive biases, it’s easy to delude oneself about a historical period or trend by picking whichever event suits one’s narrative,” he says. The only answer is to use large data sets.

“There’s no reason that traditional history and data science can’t merge into a cooperative enterprise,” Pinker wrote. “Knowing stuff is hard; we need to use every available tool.”

Turchin’s conclusions are only as good as his databases, she told me, and any database that tries to code something as complex as who constitutes a society’s elites—then tries to make like-to-like comparisons across millennia and oceans—will meet with skepticism from traditional historians

Turchin’s data are also limited to big-­picture characteristics observed over 10,000 years, or about 200 lifetimes. By scientific standards, a sample size of 200 is small, even if it is all humanity has.

Privately, some historians have told me they consider the tools he uses powerful, if a little crude. Clio­dynamics is now on a long list of methods that arrived on the scene promising to revolutionize history. Many were fads, but some survived that stage to take their rightful place in an expanding historiographical tool kit

Turchin’s methods have already shown their power. Cliodynamics offers scientific hypotheses, and human history will give us more and more opportunities to check its predictions—­revealing whether Peter Turchin is a Hari Seldon or a mere Nostradamus.

Reading or rereading a collection of such books today is like watching an old movie that feels more anguishing and frustrating than you remember. The anguish comes from knowing how the tale will unfold; the frustration from realizing that this was hardly the only possible outcome.

This conclusion is laid bare in the sprawling literature to emerge from 9/11 over the past two decades

Whatever individual stories the 9/11 books tell, too many describe the repudiation of U.S. values, not by extremist outsiders but by our own hand.

In these works, indifference to the growing terrorist threat gives way to bloodlust and vengeance after the attacks. Official dissembling justifies wars, then prolongs them. In the name of counterterrorism, security is politicized, savagery legalized and patriotism weaponized.

that state of exception became our new American exceptionalism.

The latest works on the legacy of 9/11 show how war-on-terror tactics were turned on religious groups, immigrants and protesters in the United States. The war on terror came home, and it walked in like it owned the place.

It happened fast. By 2004, when the 9/11 Commission urged America to “engage the struggle of ideas,” it was already too late; the Justice Department’s initial torture memos were already signed, the Abu Ghraib images had already eviscerated U.S. claims to moral authority.

“It is for now far easier for a researcher to explain how and why September 11 happened than it is to explain the aftermath,” Steve Coll writes in “Ghost Wars,” his 2004 account of the CIA’s pre-9/11 involvement in Afghanistan. Throughout that aftermath, Washington fantasized about remaking the world in its image, only to reveal an ugly image of itself to the world.

“We anticipate a black future for America,” bin Laden told ABC News more than three years before the 9/11 attacks. “Instead of remaining United States, it shall end up separated states and shall have to carry the bodies of its sons back to America.”

bin Laden also came to grasp, perhaps self-servingly, the benefits of luring Washington into imperial overreach, of “bleeding America to the point of bankruptcy,” as he put it in 2004, through endless military expansionism, thus beating back its global sway and undermining its internal unity.

To an unnerving degree, the United States moved toward the enemy’s fantasies of what it might become — a nation divided in its sense of itself, exposed in its moral and political compromises, conflicted over wars it did not want but would not end.

“The most frightening aspect of this new threat . . . was the fact that almost no one took it seriously. It was too bizarre, too primitive and exotic.” That is how Lawrence Wright depicts the early impressions of bin Laden and his terrorist network among U.S. officials

The books traveling that road to 9/11 have an inexorable, almost suffocating feel to them, as though every turn invariably leads to the first crush of steel and glass.

With the system “blinking red,” as CIA Director George Tenet later told the 9/11 Commission, why were all these warnings not enough? Wright lingers on bureaucratic failings

Clarke’s conclusion is simple, and it highlights America’s we-know-better swagger, a national trait that often masquerades as courage or wisdom. “America, alas, seems only to respond well to disasters, to be undistracted by warnings,” he writes. “Our country seems unable to do all that must be done until there has been some awful calamity.”

The problem with responding only to calamity is that underestimation is usually replaced by overreaction. And we tell ourselves it is the right thing, maybe the only thing, to do.

A last-minute flight change. A new job at the Pentagon. A retirement from the fire station. The final tilt of a plane’s wings before impact. If the books about the lead-up to 9/11 are packed with unbearable inevitability, the volumes on the day itself highlight how randomness separated survival from death.

Had the World Trade Center, built in the late 1960s and early 1970s, been erected according to the city building code in effect since 1938, Dwyer and Flynn explain, “it is likely that a very different world trade center would have been built.

Instead, it was constructed according to a new code that the real estate industry had avidly promoted, a code that made it cheaper and more lucrative to build and own skyscrapers. “It increased the floor space available for rent . . . by cutting back on the areas that had been devoted, under the earlier law, to evacuation and exit,” the authors write. The result: Getting everybody out on 9/11 was virtually impossible.

The towers embodied the power of American capitalism, but their design embodied the folly of American greed. On that day, both conditions proved fatal.

Garrett Graff quotes Defense Department officials marveling at how American Airlines Flight 77 struck a part of the Pentagon that, because of new anti-terrorism standards, had recently been reinforced and renovated

“In any other wedge of the Pentagon, there would have been 5,000 people, and the plane would have flown right through the middle of the building.” Instead, fewer than 200 people were killed in the attack on the Pentagon, including the passengers on the hijacked jet. Chance and preparedness came together.

The bravery of police and firefighters is the subject of countless 9/11 retrospectives, but these books also emphasize the selflessness of civilians who morphed into first responders

The passengers had made phone calls when the hijacking began and had learned the fate of other aircraft that day. “According to one call, they voted on whether to rush the terrorists in an attempt to retake the plane,” the commission report states. “They decided, and acted.”

The civilians aboard United Airlines Flight 93, whose resistance forced the plane to crash into a Pennsylvania field rather than the U.S. Capitol, were later lionized as emblems of swashbuckling Americana

Such episodes, led by ordinary civilians, embodied values that the 9/11 Commission called on the nation to display. Except those values would soon be dismantled, in the name of security, by those entrusted to uphold them.

Lawyering to death.The phrase appears in multiple 9/11 volumes, usually uttered by top officials adamant that they were going to get things done, laws and rules be damned

“I had to show the American people the resolve of a commander in chief that was going to do whatever it took to win,” Bush explains. “No yielding. No equivocation. No, you know, lawyering this thing to death.” In “Against All Enemies,” Clarke recalls the evening of Sept. 11, 2001, when Bush snapped at an official who suggested that international law looked askance at military force as a tool of revenge. “I don’t care what the international lawyers say, we are going to kick some ass,” the president retorted.

The message was unmistakable: The law is an obstacle to effective counterterrorism

Except, they did lawyer this thing to death. Instead of disregarding the law, the Bush administration enlisted it. “Beginning almost immediately after September 11, 2001, [Vice President Dick] Cheney saw to it that some of the sharpest and best-trained lawyers in the country, working in secret in the White House and the United States Department of Justice, came up with legal justifications for a vast expansion of the government’s power in waging war on terror,

Through public declarations and secret memos, the administration sought to remove limits on the president’s conduct of warfare and to deny terrorism suspects the protections of the Geneva Conventions by redefining them as unlawful enemy combatants. Nothing, Mayer argues of the latter effort, “more directly cleared the way for torture than this.”

Tactics such as cramped confinement, sleep deprivation and waterboarding were rebranded as “enhanced interrogation techniques,” legally and linguistically contorted to avoid the label of torture. Though the techniques could be cruel and inhuman, the OLC acknowledged in an August 2002 memo, they would constitute torture only if they produced pain equivalent to organ failure or death, and if the individual inflicting such pain really really meant to do so: “Even if the defendant knows that severe pain will result from his actions, if causing such harm is not his objective, he lacks the requisite specific intent.” It’s quite the sleight of hand, with torture moving from the body of the interrogated to the mind of the interrogator.

the memo concludes that none of it actually matters. Even if a particular interrogation method would cross some legal line, the relevant statute would be considered unconstitutional because it “impermissibly encroached” on the commander in chief’s authority to conduct warfare

You have informed us. Experts you have consulted. Based on your research. You do not anticipate. Such hand-washing words appear throughout the memos. The Justice Department relies on information provided by the CIA to reach its conclusions; the CIA then has the cover of the Justice Department to proceed with its interrogations. It’s a perfect circle of trust.

In these documents, lawyers enable lawlessness. Another May 2005 memo concludes that, because the Convention Against Torture applies only to actions occurring under U.S. jurisdiction, the CIA’s creation of detention sites in other countries renders the convention “inapplicable.”

avid Cole describes the documents as “bad-faith lawyering,” which might be generous. It is another kind of lawyering to death, one in which the rule of law that the 9/11 Commission urged us to abide by becomes the victim.

Similarly, because the Eighth Amendment’s prohibition on cruel and unusual punishment is meant to protect people convicted of crimes, it should not apply to terrorism detainees — because they have not been officially convicted of anything. The lack of due process conveniently eliminates constitutional protections

Years later, the Senate Intelligence Committee would investigate the CIA’s post-9/11 interrogation program. Its massive report — the executive summary of which appeared as a 549-page book in 2014 — found that torture did not produce useful intelligence, that the interrogations were more brutal than the CIA let on, that the Justice Department did not independently verify the CIA’s information, and that the spy agency impeded oversight by Congress and the CIA inspector general.

“The CIA’s effectiveness representations were almost entirely inaccurate,” the Senate report concluded. It is one of the few lies of the war on terror unmasked by an official government investigation and public report, but just one of the many documented in the 9/11 literature.

Officials in the war on terror didn’t deceive or dissemble just with lawmakers or the public. In the recurring tragedy of war, they lied just as often to themselves.

“The decision to invade Iraq was one made, finally and exclusively, by the president of the United States, George W. Bush,” he writes.

n Woodward’s “Bush at War,” the president admitted that before 9/11, “I didn’t feel that sense of urgency [about al-Qaeda], and my blood was not nearly as boiling.”

A president initially concerned about defending and preserving the nation’s moral goodness against terrorism found himself driven by darker impulses. “I’m having difficulty controlling my bloodlust,” Bush confessed to religious leaders in the Oval Office on Sept. 20, 2001,

Bloodlust, moral certainty and sudden vulnerability make a dangerous combination. The belief that you are defending good against evil can lead to the belief that whatever you do to that end is good, too.

Draper distills Bush’s worldview: “The terrorists’ primary objective was to destroy America’s freedom. Saddam hated America. Therefore, he hated freedom. Therefore, Saddam was himself a terrorist, bent on destroying America and its freedom.”

The president assumed the worst about what Hussein had done or might do, yet embraced best-case scenarios of how an American invasion would proceed.

“Iraqis would rejoice at the sight of their Western liberators,” Draper recaps. “Their newly shared sense of national purpose would overcome any sectarian allegiances. Their native cleverness would make up for their inexperience with self-government. They would welcome the stewardship of Iraqi expatriates who had not set foot in Baghdad in decades. And their oil would pay for everything.”

It did not seem to occur to Bush and his advisers that Iraqis could simultaneously hate Hussein and resent the Americans — feelings that could have been discovered by speaking to Iraqis and hearing their concerns.

few books on the war that gets deep inside Iraqis’ aversion to the Americans in their midst. “What gives them the right to change something that’s not theirs in the first place?” a woman in a middle-class Baghdad neighborhood asks him. “I don’t like your house, so I’m going to bomb it and you can rebuild it again the way I want it, with your money?

The occupation did not dissuade such impressions when it turned the former dictator’s seat of government into its own luxurious Green Zone, or when it retrofitted the Abu Ghraib prison (“the worst of Saddam’s hellholes,” Shadid calls it) into its own chamber of horrors.

Shadid hears early talk of the Americans as “kuffar” (heathens), a 51-year-old former teacher complains that “we’ve exchanged a tyrant for an occupier.”

Shadid understood that governmental legitimacy — who gets to rule, and by what right — was a matter of overriding importance for Iraqis. “The Americans never understood the question,” he writes; “Iraqis never agreed on the answer.

When the United States so quickly shifted from liberation to occupation, it lost whatever legitimacy it enjoyed. “Bush handed that enemy precisely what it wanted and needed, proof that America was at war with Islam, that we were the new Crusaders come to occupy Muslim land,” Clarke writes. “It was as if Usama bin Laden, hidden in some high mountain redoubt, were engaging in long-range mind control of George Bush, chanting ‘invade Iraq, you must invade Iraq.’ ”

The foolishness and arrogance of the American occupation didn’t help. In “Imperial Life in the Emerald City: Inside Iraq’s Green Zone,” Rajiv Chandrasekaran explains how, even as daily security was Iraqis’ overwhelming concern, viceroy L. Paul Bremer, Bush’s man in Baghdad, was determined to turn the country into a model free-market economy, complete with new investment laws, bankruptcy courts and a state-of-the-art stock exchange.

a U.S. Army general, when asked by local journalists why American helicopters must fly so low at night, thus scaring Iraqi children, replied that the kids were simply hearing “the sound of freedom.”Message: Freedom sounds terrifying.

For some Americans, inflicting that terror became part of the job, one more tool in the arsenal. In “The Forever War” by Dexter Filkins, a U.S. Army lieutenant colonel in Iraq assures the author that “with a heavy dose of fear and violence, and a lot of money for projects, I think we can convince these people that we are here to help them.”

Chandrasekaran recalls the response of a top communications official under Bremer, when reporters asked about waves of violence hitting Baghdad in the spring of 2004. “Off the record: Paris is burning,” the official told the journalists. “On the record: Security and stability are returning to Iraq.”

the Iraq War, conjured in part on the false connections between Iraq and al-Qaeda, ended up helping the terrorist network: It pulled resources from the war in Afghanistan, gave space for bin Laden’s men to regroup and spurred a new generation of terrorists in the Middle East. “A bigger gift to bin Laden was hard to imagine,” Bergen writes.

“U.S. officials had no need to lie or spin to justify the war,” Washington Post reporter Craig Whitlock writes in “The Afghanistan Papers,” a damning contrast of the war’s reality vs. its rhetoric. “Yet leaders at the White House, the Pentagon and the State Department soon began to make false assurances and to paper over setbacks on the battlefield.” As the years passed, the deceit became entrenched, what Whitlock calls “an unspoken conspiracy” to hide the truth.

Afghanistan was where al-Qaeda, supported by the Taliban, had made its base — it was supposed to be the good war, the right war, the war of necessity and not choice, the war endorsed at home and abroad.

If Iraq was the war born of lies, Afghanistan was the one nurtured by them

Whitlock finds commanding generals privately admitting that they long fought the war “without a functional strategy.” That, two years into the conflict, Rumsfeld complained that he had “no visibility into who the bad guys are.”

That Army Lt. Gen. Douglas Lute, a former coordinator of Iraq and Afghanistan policy, acknowledged that “we didn’t have the foggiest idea of what we were undertaking.”

That U.S. officials long wanted to withdraw American forces but feared — correctly so, it turns out — that the Afghan government might collapse. “Bin Laden had hoped for this exact scenario,” Whitlock observes. “To lure the U.S. superpower into an unwinnable guerrilla conflict that would deplete its national treasury and diminish its global influence.”

All along, top officials publicly contradicted these internal views, issuing favorable accounts of steady progress

Bad news was twisted into good: Rising suicide attacks in Kabul meant the Taliban was too weak for direct combat, for instance, while increased U.S. casualties meant America was taking the fight to the enemy.

deceptions transpired across U.S. presidents, but the Obama administration, eager to show that its first-term troop surge was working, “took it to a new level, hyping figures that were misleading, spurious or downright false,” Whitlock writes. And then under President Donald Trump, he adds, the generals felt pressure to “speak more forcefully and boast that his war strategy was destined to succeed.”

in public, almost no senior government officials had the courage to admit that the United States was slowly losing,” Whitlock writes. “With their complicit silence, military and political leaders avoided accountability and dodged reappraisals that could have changed the outcome or shortened the conflict.”

Deputy Secretary of State Richard Armitage traveled to Moscow shortly after 9/11 to give officials a heads up about the coming hostilities in Afghanistan. The Russians, recent visitors to the graveyard of empires, cautioned that Afghanistan was an “ambush heaven” and that, in the words of one of them, “you’re really going to get the hell kicked out of you.”

a war should not be measured only by the timing and the competence of its end. We still face an equally consequential appraisal: How good was this good war if it could be sustained only by lies?

In the two decades since the 9/11 attacks, the United States has often attempted to reconsider its response

They are written as though intending to solve problems. But they can be read as proof that the problems have no realistic solution, or that the only solution is to never have created them.

the report sets the bar for staying so high that an exit strategy appears to be its primary purpose.

he counterinsurgency manual is an extraordinary document. Implicitly repudiating notions such as “shock and awe” and “overwhelming force,” it argues that the key to battling an insurgency in countries such as Iraq and Afghanistan is to provide security for the local population and to win its support through effective governance

It also attempts to grasp the nature of America’s foes. “Most enemies either do not try to defeat the United States with conventional operations or do not limit themselves to purely military means,” the manual states. “They know that they cannot compete with U.S. forces on those terms. Instead, they try to exhaust U.S. national will.” Exhausting America’s will is an objective that al-Qaeda understood well.

“Counterinsurgents should prepare for a long-term commitment,” the manual states. Yet, just a few pages later, it admits that “eventually all foreign armies are seen as interlopers or occupiers.” How to accomplish the former without descending into the latter? No wonder so many of the historical examples of counterinsurgency that the manual highlights, including accounts from the Vietnam War, are stories of failure.

“Soldiers and Marines are expected to be nation builders as well as warriors,” the manual proclaims, but the arduous tasks involved — reestablishing government institutions, rebuilding infrastructure, strengthening local security forces, enforcing the rule of law — reveal the tension at the heart of the new doctrine

In his foreword, Army Lt. Col. John Nagl writes that the document’s most lasting impact may be as a catalyst not for remaking Iraq or Afghanistan, but for transforming the Army and Marine Corps into “more effective learning organizations,” better able to adapt to changing warfare. And in her introduction, Sarah Sewall, then director of Harvard’s Carr Center for Human Rights Policy, concludes that its “ultimate value” may be in warning civilian officials to think hard before engaging in a counterinsurgency campaign.

“The thing that got to everyone,” Finkel explains in the latter book, “was not having a defined front line. It was a war in 360 degrees, no front to advance toward, no enemy in uniform, no predictable patterns, no relief.” It’s a powerful summation of battling an insurgency.

Hitting the wrong house is what counterinsurgency doctrine is supposed to avoid. Even successfully capturing or killing a high-value target can be counterproductive if in the process you terrorize a community and create more enemies. In Iraq, the whole country was the wrong house. America’s leaders knew it was the wrong house. They hit it anyway.

Another returning soldier, Nic DeNinno, struggles to tell his wife about the time he and his fellow soldiers burst into an Iraqi home in search of a high-value target. He threw a man down the stairs and held another by the throat. After they left, the lieutenant told him it was the wrong house. “The wrong f---ing house,” Nic says to his wife. “One of the things I want to remember is how many times we hit the wrong house.”

“As time passes, more documents become available, and the bare facts of what happened become still clearer,” the report states. “Yet the picture of how those things happened becomes harder to reimagine, as that past world, with its preoccupations and uncertainty, recedes.” Before making definitive judgments, then, they ask themselves “whether the insights that seem apparent now would really have been meaningful at the time.”

Two of the latest additions to the canon, “Reign of Terror” by Spencer Ackerman and “Subtle Tools” by Karen Greenberg, draw straight, stark lines between the earliest days of the war on terror and its mutations in our current time, between conflicts abroad and divisions at home. These works show how 9/11 remains with us, and how we are still living in the ruins.

When Trump declared that “we don’t have victories anymore” in his 2015 speech announcing his presidential candidacy, he was both belittling the legacy of 9/11 and harnessing it to his ends. “His great insight was that the jingoistic politics of the War on Terror did not have to be tied to the War on Terror itself,” Ackerman writes. “That enabled him to tell a tale of lost greatness.” And if greatness is lost, someone must have taken it.

“Trump had learned the foremost lesson of 9/11,” Ackerman writes, “that the terrorists were whomever you said they were.”

The backlash against Muslims, against immigrants crossing the southern border and against protesters rallying for racial justice was strengthened by the open-ended nature of the global war on terror.

the war is not just far away in Iraq or Afghanistan, in Yemen or Syria, but it’s happening here, with mass surveillance, militarized law enforcement and the rebranding of immigration as a threat to the nation’s security rather than a cornerstone of its identity

the Authorization for Use of Military Force, drafted by administration lawyers and approved by Congress just days after the attacks, as the moment when America’s response began to go awry. The brief joint resolution allowed the president to use “all necessary and appropriate force” against any nation, organization or person who committed the attacks, and to prevent any future ones.

It was the “Ur document in the war on terror and its legacy,” Greenberg writes. “Riddled with imprecision, its terminology was geared to codify expansive powers.” Where the battlefield, the enemy and the definition of victory all remain vague, war becomes endlessly expansive, “with neither temporal nor geographical boundaries.”

This was the moment the war on terror was “conceptually doomed,” Ackerman concludes. This is how you get a forever war.

There were moments when an off-ramp was visible. The killing of bin Laden in 2011 was one such instance, Ackerman argues, but “Obama squandered the best chance anyone could ever have to end the 9/11 era.”

The author assails Obama for making the war on terror more “sustainable” through a veneer of legality — banning torture yet failing to close the detention camp at Guantánamo Bay and relying on drone strikes that “perversely incentivized the military and the CIA to kill instead of capture.”

There would always be more targets, more battlefields, regardless of president or party. Failures became the reason to double down, never wind down.

The longer the war went on, the more that what Ackerman calls its “grotesque subtext” of nativism and racism would move to the foreground of American politics

Absent the war on terror, it is harder to imagine a presidential candidate decrying a sitting commander in chief as foreign, Muslim, illegitimate — and using that lie as a successful political platform.

Absent the war on terror, it is harder to imagine a travel ban against people from Muslim-majority countries. Absent the war on terror, it is harder to imagine American protesters labeled terrorists, or a secretary of defense describing the nation’s urban streets as a “battle space” to be dominated

In his latest book on bin Laden, Bergen argues that 9/11 was a major tactical success but a long-term strategic failure for the terrorist leader. Yes, he struck a vicious blow against “the head of the snake,” as he called the United States, but “rather than ending American influence in the Muslim world, the 9/11 attacks greatly amplified it,” with two lengthy, large-scale invasions and new bases established throughout the region.

“A vastly different America has taken root” in the two decades since 9/11, Greenberg writes. “In the name of retaliation, ‘justice,’ and prevention, fundamental values have been cast aside.”

the legacy of the 9/11 era is found not just in Afghanistan or Iraq, but also in an America that drew out and heightened some of its ugliest impulses — a nation that is deeply divided (like those “separated states” bin Laden imagined); that bypasses inconvenient facts and embraces conspiracy theories; that demonizes outsiders; and that, after failing to spread freedom and democracy around the world, seems less inclined to uphold them here

Seventeen years after the 9/11 Commission called on the United States to offer moral leadership to the world and to be generous and caring to our neighbors, our moral leadership is in question, and we can barely be generous and caring to ourselves.

Still reeling from an attack that dropped out of a blue sky, America is suffering from a sort of post-traumatic stress democracy. It remains in recovery, still a good country, even if a broken good country.

9/11 was a test. Thebooks of the lasttwo decades showhow America failed.

Deep within the catalogue of regrets that is the 9/11 Commission report

Senate Majority Leader Charles E. Schumer (D-N.Y.) last month urged Congress to adopt “comprehensive” regulations on the AI industry.

Restrictions on access to the most advanced chips, which are needed to run AI models, have added to these difficulties.

n a recent study, Ding found that most of the large language models developed in China were nearly two years behind those developed in the U.S., a gap that would be a challenge to close — even if American firms had to adjust to regulation.

This gap also makes it difficult for Chinese firms to attract the world’s top engineering talent. Many would prefer to work at firms that have the resources and flexibility to experiment on frontier research areas.

Rather than focusing on AI technology that lets the general public create unique content like the chatbots and image generators, Chinese companies have instead focused on technologies with clear commercial uses, like surveillance tech.

Recent research identified 17 large language models in China that relied on Nvidia chips, and just three models that used Chinese-made chips.

No Chinese tech company has yet been able to release a large language model on the scale of OpenAI’s ChatGPT to the general public, in which the company has asked the public to play with and test a generative AI model, said Ding, the professor at George Washington University.

Despite the obstacles, Chinese AI companies have made major advances in some types of AI technologies, including facial recognition, gait recognition, and artificial and virtual reality.

These technologies have also fueled the development of China’s vast surveillance industry, giving Chinese tech giants an edge that they market around the world, such as Huawei’s contracts for smart city surveillance from Belgrade, Serbia, to Nairobi.

Companies developing AI in China need to comply with specific laws on intellectual property rights, personal information protection, recommendation algorithms and synthetic content, also called deep fakes. In April, regulators also released a draft set of rules on generative AI, the technology behind image generator Stable Diffusion and chatbots such as OpenAI’s ChatGPT and Google’s Bard.

They also need to ensure AI generated content complies with Beijing’s strict censorship regime. Chinese tech companies such as Baidu have become adept at filtering content that contravenes these rules. But it has hampered their ability to test the limits of what AI can do.

While Beijing pushes to make comparable chips at home, Chinese AI companies have to source their chips any way they can — including from a black market that has sprung up in Shenzhen, where, according to Reuters, the most advanced Nvidia chips sell for nearly $20,000, more than twice what they go for elsewhere.

“That level of freedom has not been allowed in China, in part because the Chinese government is very worried about people creating politically sensitive content,” Ding said.

Although Beijing’s regulations have created major burdens for Chinese AI companies, analysts say that they contain several key principles that Washington can learn from — like protecting personal information, labeling AI-generated content and alerting the government if an AI develops dangerous capabilities.

AI regulation in the United States could easily fall short of Beijing’s heavy-handed approach while still preventing discrimination, protecting people’s rights and adhering to existing laws, said Johanna Costigan, a research associate at the Asia Society Policy Institute.

“There can be alignment between regulation and innovation,” Costigan said. “But it’s a question of rising to the occasion of what this moment represents — do we care enough to protect people who are using this technology? Because people are using it whether the government regulates it or not.”

Obama’s resistance to direct intervention only grew. After several months of deliberation, he authorized the CIA to train and fund Syrian rebels, but he also shared the outlook of his former defense secretary, Robert Gates, who had routinely asked in meetings, “Shouldn’t we finish up the two wars we have before we look for another?”

In his first term, he came to believe that only a handful of threats in the Middle East conceivably warranted direct U.S. military intervention. These included the threat posed by al‑Qaeda; threats to the continued existence of Israel (“It would be a moral failing for me as president of the United States” not to defend Israel, he once told me); and, not unrelated to Israel’s security, the threat posed by a nuclear-armed Iran.

Bush and Scowcroft removed Saddam Hussein’s army from Kuwait in 1991, and they deftly managed the disintegration of the Soviet Union; Scowcroft also, on Bush’s behalf, toasted the leaders of China shortly after the slaughter in Tiananmen Square.

As Obama was writing his campaign manifesto, The Audacity of Hope, in 2006, Susan Rice, then an informal adviser, felt it necessary to remind him to include at least one line of praise for the foreign policy of President Bill Clinton, to partially balance the praise he showered on Bush and Scowcroft.

“When you have a professional army,” he once told me, “that is well armed and sponsored by two large states”—Iran and Russia—“who have huge stakes in this, and they are fighting against a farmer, a carpenter, an engineer who started out as protesters and suddenly now see themselves in the midst of a civil conflict …” He paused. “The notion that we could have—in a clean way that didn’t commit U.S. military forces—changed the equation on the ground there was never true.”

The message Obama telegraphed in speeches and interviews was clear: He would not end up like the second President Bush—a president who became tragically overextended in the Middle East, whose decisions filled the wards of Walter Reed with grievously wounded soldiers, who was helpless to stop the obliteration of his reputation, even when he recalibrated his policies in his second term. Obama would say privately that the first task of an American president in the post-Bush international arena was “Don’t do stupid shit.”

Hillary Clinton, when she was Obama’s secretary of state, argued for an early and assertive response to Assad’s violence. In 2014, after she left office, Clinton told me that “the failure to help build up a credible fighting force of the people who were the originators of the protests against Assad … left a big vacuum, which the jihadists have now filled.” When The Atlantic published this statement, and also published Clinton’s assessment that “great nations need organizing principles, and ‘Don’t do stupid stuff’ is not an organizing principle,” Obama became “rip-shit angry,” according to one of his senior advisers. The president did not understand how “Don’t do stupid shit” could be considered a controversial slogan.

The Iraq invasion, Obama believed, should have taught Democratic interventionists like Clinton, who had voted for its authorization, the dangers of doing stupid shit. (Clinton quickly apologized to Obama for her comments,

Obama, unlike liberal interventionists, is an admirer of the foreign-policy realism of President George H. W. Bush and, in particular, of Bush’s national-security adviser, Brent Scowcroft (“I love that guy,” Obama once told me).

The danger to the United States posed by the Assad regime did not rise to the level of these challenges.

Obama generally believes that the Washington foreign-policy establishment, which he secretly disdains, makes a fetish of “credibility”—particularly the sort of credibility purchased with force. The preservation of credibility, he says, led to Vietnam. Within the White House, Obama would argue that “dropping bombs on someone to prove that you’re willing to drop bombs on someone is just about the worst reason to use force.”

American national-security credibility, as it is conventionally understood in the Pentagon, the State Department, and the cluster of think tanks headquartered within walking distance of the White House, is an intangible yet potent force—one that, when properly nurtured, keeps America’s friends feeling secure and keeps the international order stable.

All week, White House officials had publicly built the case that Assad had committed a crime against humanity. Kerry’s speech would mark the culmination of this campaign.

But the president had grown queasy. In the days after the gassing of Ghouta, Obama would later tell me, he found himself recoiling from the idea of an attack unsanctioned by international law or by Congress. The American people seemed unenthusiastic about a Syria intervention; so too did one of the few foreign leaders Obama respects, Angela Merkel, the German chancellor. She told him that her country would not participate in a Syria campaign. And in a stunning development, on Thursday, August 29, the British Parliament denied David Cameron its blessing for an attack. John Kerry later told me that when he heard that, “internally, I went, Oops.”

Obama was also unsettled by a surprise visit early in the week from James Clapper, his director of national intelligence, who interrupted the President’s Daily Brief, the threat report Obama receives each morning from Clapper’s analysts, to make clear that the intelligence on Syria’s use of sarin gas, while robust, was not a “slam dunk.” He chose the term carefully. Clapper, the chief of an intelligence community traumatized by its failures in the run-up to the Iraq War, was not going to overpromise, in the manner of the onetime CIA director George Tenet, who famously guaranteed George W. Bush a “slam dunk” in Iraq.

While the Pentagon and the White House’s national-security apparatuses were still moving toward war (John Kerry told me he was expecting a strike the day after his speech), the president had come to believe that he was walking into a trap—one laid both by allies and by adversaries, and by conventional expectations of what an American president is supposed to do.

Late on Friday afternoon, Obama determined that he was simply not prepared to authorize a strike. He asked McDonough, his chief of staff, to take a walk with him on the South Lawn of the White House. Obama did not choose McDonough randomly: He is the Obama aide most averse to U.S. military intervention, and someone who, in the words of one of his colleagues, “thinks in terms of traps.” Obama, ordinarily a preternaturally confident man, was looking for validation, and trying to devise ways to explain his change of heart, both to his own aides and to the public

The third, and most important, factor, he told me, was “our assessment that while we could inflict some damage on Assad, we could not, through a missile strike, eliminate the chemical weapons themselves, and what I would then face was the prospect of Assad having survived the strike and claiming he had successfully defied the United States, that the United States had acted unlawfully in the absence of a UN mandate, and that that would have potentially strengthened his hand rather than weakened it.

Others had difficulty fathoming how the president could reverse himself the day before a planned strike. Obama, however, was completely calm. “If you’ve been around him, you know when he’s ambivalent about something, when it’s a 51–49 decision,” Ben Rhodes told me. “But he was completely at ease.”

Obama also shared with McDonough a long-standing resentment: He was tired of watching Washington unthinkingly drift toward war in Muslim countries. Four years earlier, the president believed, the Pentagon had “jammed” him on a troop surge for Afghanistan. Now, on Syria, he was beginning to feel jammed again.

The fourth factor, he said, was of deeper philosophical importance. “This falls in the category of something that I had been brooding on for some time,” he said. “I had come into office with the strong belief that the scope of executive power in national-security issues is very broad, but not limitless.”

Obama’s decision caused tremors across Washington as well. John McCain and Lindsey Graham, the two leading Republican hawks in the Senate, had met with Obama in the White House earlier in the week and had been promised an attack. They were angered by the about-face. Damage was done even inside the administration. Neither Chuck Hagel, then the secretary of defense, nor John Kerry was in the Oval Office when the president informed his team of his thinking. Kerry would not learn about the change until later that evening. “I just got fucked over,” he told a friend shortly after talking to the president that night. (When I asked Kerry recently about that tumultuous night, he said, “I didn’t stop to analyze it. I figured the president had a reason to make a decision and, honestly, I understood his notion.”)

The president asked Congress to authorize the use of force—the irrepressible Kerry served as chief lobbyist—and it quickly became apparent in the White House that Congress had little interest in a strike. When I spoke with Biden recently about the red-line decision, he made special note of this fact. “It matters to have Congress with you, in terms of your ability to sustain what you set out to do,” he said. Obama “didn’t go to Congress to get himself off the hook. He had his doubts at that point, but he knew that if he was going to do anything, he better damn well have the public with him, or it would be a very short ride.” Congress’s clear ambivalence convinced Biden that Obama was correct to fear the slippery slope. “What happens when we get a plane shot down? Do we not go in and rescue?,” Biden asked. “You need the support of the American people.”

At the G20 summit in St. Petersburg, which was held the week after the Syria reversal, Obama pulled Putin aside, he recalled to me, and told the Russian president “that if he forced Assad to get rid of the chemical weapons, that that would eliminate the need for us taking a military strike.” Within weeks, Kerry, working with his Russian counterpart, Sergey Lavrov, would engineer the removal of most of Syria’s chemical-weapons arsenal—a program whose existence Assad until then had refused to even acknowledge.

The arrangement won the president praise from, of all people, Benjamin Netanyahu, the Israeli prime minister, with whom he has had a consistently contentious relationship. The removal of Syria’s chemical-weapons stockpiles represented “the one ray of light in a very dark region,” Netanyahu told me not long after the deal was announced.

John Kerry today expresses no patience for those who argue, as he himself once did, that Obama should have bombed Assad-regime sites in order to buttress America’s deterrent capability. “You’d still have the weapons there, and you’d probably be fighting isil” for control of the weapons, he said, referring to the Islamic State, the terror group also known as isis. “It just doesn’t make sense. But I can’t deny to you that this notion about the red line being crossed and [Obama’s] not doing anything gained a life of its own.”

today that decision is a source of deep satisfaction for him.

“I’m very proud of this moment,” he told me. “The overwhelming weight of conventional wisdom and the machinery of our national-security apparatus had gone fairly far. The perception was that my credibility was at stake, that America’s credibility was at stake. And so for me to press the pause button at that moment, I knew, would cost me politically. And the fact that I was able to pull back from the immediate pressures and think through in my own mind what was in America’s interest, not only with respect to Syria but also with respect to our democracy, was as tough a decision as I’ve made—and I believe ultimately it was the right decision to make.”

By 2013, Obama’s resentments were well developed. He resented military leaders who believed they could fix any problem if the commander in chief would simply give them what they wanted, and he resented the foreign-policy think-tank complex. A widely held sentiment inside the White House is that many of the most prominent foreign-policy think tanks in Washington are doing the bidding of their Arab and pro-Israel funders. I’ve heard one administration official refer to Massachusetts Avenue, the home of many of these think tanks, as “Arab-occupied territory.”

over the past few months, I’ve spent several hours talking with him about the broadest themes of his “long game” foreign policy, including the themes he is most eager to discuss—namely, the ones that have nothing to do with the Middle East.

I have come to believe that, in Obama’s mind, August 30, 2013, was his liberation day, the day he defied not only the foreign-policy establishment and its cruise-missile playbook, but also the demands of America’s frustrating, high-maintenance allies in the Middle East—countries, he complains privately to friends and advisers, that seek to exploit American “muscle” for their own narrow and sectarian ends.

“Where am I controversial? When it comes to the use of military power,” he said. “That is the source of the controversy. There’s a playbook in Washington that presidents are supposed to follow. It’s a playbook that comes out of the foreign-policy establishment. And the playbook prescribes responses to different events, and these responses tend to be militarized responses. Where America is directly threatened, the playbook works. But the playbook can also be a trap that can lead to bad decisions. In the midst of an international challenge like Syria, you get judged harshly if you don’t follow the playbook, even if there are good reasons why it does not apply.”

For some foreign-policy experts, even within his own administration, Obama’s about-face on enforcing the red line was a dispiriting moment in which he displayed irresolution and naïveté, and did lasting damage to America’s standing in the world. “Once the commander in chief draws that red line,” Leon Panetta, who served as CIA director and then as secretary of defense in Obama’s first term, told me recently, “then I think the credibility of the commander in chief and this nation is at stake if he doesn’t enforce it.” Right after Obama’s reversal, Hillary Clinton said privately, “If you say you’re going to strike, you have to strike. There’s no choice.”

Obama’s defenders, however, argue that he did no damage to U.S. credibility, citing Assad’s subsequent agreement to have his chemical weapons removed. “The threat of force was credible enough for them to give up their chemical weapons,” Tim Kaine, a Democratic senator from Virginia, told me. “We threatened military action and they responded. That’s deterrent credibility.”

History may record August 30, 2013, as the day Obama prevented the U.S. from entering yet another disastrous Muslim civil war, and the day he removed the threat of a chemical attack on Israel, Turkey, or Jordan. Or it could be remembered as the day he let the Middle East slip from America’s grasp, into the hands of Russia, Iran, and isis

spoke with obama about foreign policy when he was a U.S. senator, in 2006. At the time, I was familiar mainly with the text of a speech he had delivered four years earlier, at a Chicago antiwar rally. It was an unusual speech for an antiwar rally in that it was not antiwar; Obama, who was then an Illinois state senator, argued only against one specific and, at the time, still theoretical, war. “I suffer no illusions about Saddam Hussein,” he said. “He is a brutal man. A ruthless man … But I also know that Saddam poses no imminent and direct threat to the United States or to his neighbors.” He added, “I know that an invasion of Iraq without a clear rationale and without strong international support will only fan the flames of the Middle East, and encourage the worst, rather than best, impulses of the Arab world, and strengthen the recruitment arm of al-Qaeda.”

This speech had made me curious about its author. I wanted to learn how an Illinois state senator, a part-time law professor who spent his days traveling between Chicago and Springfield, had come to a more prescient understanding of the coming quagmire than the most experienced foreign-policy thinkers of his party, including such figures as Hillary Clinton, Joe Biden, and John Kerry, not to mention, of course, most Republicans and many foreign-policy analysts and writers, including me.

This was the moment the president believes he finally broke with what he calls, derisively, the “Washington playbook.”

“isis is not an existential threat to the United States,” he told me in one of these conversations. “Climate change is a potential existential threat to the entire world if we don’t do something about it.” Obama explained that climate change worries him in particular because “it is a political problem perfectly designed to repel government intervention. It involves every single country, and it is a comparatively slow-moving emergency, so there is always something seemingly more urgent on the agenda.”

At the moment, of course, the most urgent of the “seemingly more urgent” issues is Syria. But at any given moment, Obama’s entire presidency could be upended by North Korean aggression, or an assault by Russia on a member of nato, or an isis-planned attack on U.S. soil. Few presidents have faced such diverse tests on the international stage as Obama has, and the challenge for him, as for all presidents, has been to distinguish the merely urgent from the truly important, and to focus on the important.

My goal in our recent conversations was to see the world through Obama’s eyes, and to understand what he believes America’s role in the world should be. This article is informed by our recent series of conversations, which took place in the Oval Office; over lunch in his dining room; aboard Air Force One; and in Kuala Lumpur during his most recent visit to Asia, in November. It is also informed by my previous interviews with him and by his speeches and prolific public ruminations, as well as by conversations with his top foreign-policy and national-security advisers, foreign leaders and their ambassadors in Washington, friends of the president and others who have spoken with him about his policies and decisions, and his adversaries and critics.

Over the course of our conversations, I came to see Obama as a president who has grown steadily more fatalistic about the constraints on America’s ability to direct global events, even as he has, late in his presidency, accumulated a set of potentially historic foreign-policy achievements—controversial, provisional achievements, to be sure, but achievements nonetheless: the opening to Cuba, the Paris climate-change accord, the Trans-Pacific Partnership trade agreement, and, of course, the Iran nuclear deal.

These he accomplished despite his growing sense that larger forces—the riptide of tribal feeling in a world that should have already shed its atavism; the resilience of small men who rule large countries in ways contrary to their own best interests; the persistence of fear as a governing human emotion—frequently conspire against the best of America’s intentions. But he also has come to learn, he told me, that very little is accomplished in international affairs without U.S. leadership.

Obama talked me through this apparent contradiction. “I want a president who has the sense that you can’t fix everything,” he said. But on the other hand, “if we don’t set the agenda, it doesn’t happen.” He explained what he meant. “The fact is, there is not a summit I’ve attended since I’ve been president where we are not setting the agenda, where we are not responsible for the key results,” he said. “That’s true whether you’re talking about nuclear security, whether you’re talking about saving the world financial system, whether you’re talking about climate.”

One day, over lunch in the Oval Office dining room, I asked the president how he thought his foreign policy might be understood by historians. He started by describing for me a four-box grid representing the main schools of American foreign-policy thought. One box he called isolationism, which he dismissed out of hand. “The world is ever-shrinking,” he said. “Withdrawal is untenable.” The other boxes he labeled realism, liberal interventionism, and internationalism. “I suppose you could call me a realist in believing we can’t, at any given moment, relieve all the world’s misery,” he said. “We have to choose where we can make a real impact.” He also noted that he was quite obviously an internationalist, devoted as he is to strengthening multilateral organizations and international norms.

If a crisis, or a humanitarian catastrophe, does not meet his stringent standard for what constitutes a direct national-security threat, Obama said, he doesn’t believe that he should be forced into silence. He is not so much the realist, he suggested, that he won’t pass judgment on other leaders.

Though he has so far ruled out the use of direct American power to depose Assad, he was not wrong, he argued, to call on Assad to go. “Oftentimes when you get critics of our Syria policy, one of the things that they’ll point out is ‘You called for Assad to go, but you didn’t force him to go. You did not invade.’ And the notion is that if you weren’t going to overthrow the regime, you shouldn’t have said anything. That’s a weird argument to me, the notion that if we use our moral authority to say ‘This is a brutal regime, and this is not how a leader should treat his people,’ once you do that, you are obliged to invade the country and install a government you prefer.”

“I am very much the internationalist,” Obama said in a later conversation. “And I am also an idealist insofar as I believe that we should be promoting values, like democracy and human rights and norms and values

“Having said that,” he continued, “I also believe that the world is a tough, complicated, messy, mean place, and full of hardship and tragedy. And in order to advance both our security interests and those ideals and values that we care about, we’ve got to be hardheaded at the same time as we’re bighearted, and pick and choose our spots, and recognize that there are going to be times where the best that we can do is to shine a spotlight on something that’s terrible, but not believe that we can automatically solve it. There are going to be times where our security interests conflict with our concerns about human rights. There are going to be times where we can do something about innocent people being killed, but there are going to be times where we can’t.”

If Obama ever questioned whether America really is the world’s one indispensable nation, he no longer does so. But he is the rare president who seems at times to resent indispensability, rather than embrace it.

“Free riders aggravate me,” he told me. Recently, Obama warned that Great Britain would no longer be able to claim a “special relationship” with the United States if it did not commit to spending at least 2 percent of its GDP on defense. “You have to pay your fair share,” Obama told David Cameron, who subsequently met the 2 percent threshold.

Part of his mission as president, Obama explained, is to spur other countries to take action for themselves, rather than wait for the U.S. to lead. The defense of the liberal international order against jihadist terror, Russian adventurism, and Chinese bullying depends in part, he believes, on the willingness of other nations to share the burden with the U.S

This is why the controversy surrounding the assertion—made by an anonymous administration official to The New Yorker during the Libya crisis of 2011—that his policy consisted of “leading from behind” perturbed him. “We don’t have to always be the ones who are up front,” he told me. “Sometimes we’re going to get what we want precisely because we are sharing in the agenda.

The president also seems to believe that sharing leadership with other countries is a way to check America’s more unruly impulses. “One of the reasons I am so focused on taking action multilaterally where our direct interests are not at stake is that multilateralism regulates hubris,”

He consistently invokes what he understands to be America’s past failures overseas as a means of checking American self-righteousness. “We have history,” he said. “We have history in Iran, we have history in Indonesia and Central America. So we have to be mindful of our history when we start talking about intervening, and understand the source of other people’s suspicions.”

In his efforts to off-load some of America’s foreign-policy responsibilities to its allies, Obama appears to be a classic retrenchment president in the manner of Dwight D. Eisenhower and Richard Nixon. Retrenchment, in this context, is defined as “pulling back, spending less, cutting risk, and shifting burdens to allies

One difference between Eisenhower and Nixon, on the one hand, and Obama, on the other, Sestanovich said, is that Obama “appears to have had a personal, ideological commitment to the idea that foreign policy had consumed too much of the nation’s attention and resources.”

But once he decides that a particular challenge represents a direct national-security threat, he has shown a willingness to act unilaterally. This is one of the larger ironies of the Obama presidency: He has relentlessly questioned the efficacy of force, but he has also become the most successful terrorist-hunter in the history of the presidency, one who will hand to his successor a set of tools an accomplished assassin would envy

“He applies different standards to direct threats to the U.S.,” Ben Rhodes says. “For instance, despite his misgivings about Syria, he has not had a second thought about drones.” Some critics argue he should have had a few second thoughts about what they see as the overuse of drones. But John Brennan, Obama’s CIA director, told me recently that he and the president “have similar views. One of them is that sometimes you have to take a life to save even more lives. We have a similar view of just-war theory. The president requires near-certainty of no collateral damage. But if he believes it is necessary to act, he doesn’t hesitate.”

Those who speak with Obama about jihadist thought say that he possesses a no-illusions understanding of the forces that drive apocalyptic violence among radical Muslims, but he has been careful about articulating that publicly, out of concern that he will exacerbate anti-Muslim xenophobia

He has a tragic realist’s understanding of sin, cowardice, and corruption, and a Hobbesian appreciation of how fear shapes human behavior. And yet he consistently, and with apparent sincerity, professes optimism that the world is bending toward justice. He is, in a way, a Hobbesian optimist.

The contradictions do not end there. Though he has a reputation for prudence, he has also been eager to question some of the long-standing assumptions undergirding traditional U.S. foreign-policy thinking. To a remarkable degree, he is willing to question why America’s enemies are its enemies, or why some of its friends are its friends.

It is assumed, at least among his critics, that Obama sought the Iran deal because he has a vision of a historic American-Persian rapprochement. But his desire for the nuclear agreement was born of pessimism as much as it was of optimism. “The Iran deal was never primarily about trying to open a new era of relations between the U.S. and Iran,” Susan Rice told me. “It was far more pragmatic and minimalist. The aim was very simply to make a dangerous country substantially less dangerous. No one had any expectation that Iran would be a more benign actor.”

once mentioned to obama a scene from The Godfather: Part III, in which Michael Corleone complains angrily about his failure to escape the grasp of organized crime. I told Obama that the Middle East is to his presidency what the Mob is to Corleone, and I started to quote the Al Pacino line: “Just when I thought I was out—”“It pulls you back in,” Obama said, completing the thought

When I asked Obama recently what he had hoped to accomplish with his Cairo reset speech, he said that he had been trying—unsuccessfully, he acknowledged—to persuade Muslims to more closely examine the roots of their unhappiness.“My argument was this: Let’s all stop pretending that the cause of the Middle East’s problems is Israel,” he told me. “We want to work to help achieve statehood and dignity for the Palestinians, but I was hoping that my speech could trigger a discussion, could create space for Muslims to address the real problems they are confronting—problems of governance, and the fact that some currents of Islam have not gone through a reformation that would help people adapt their religious doctrines to modernity. My thought was, I would communicate that the U.S. is not standing in the way of this progress, that we would help, in whatever way possible, to advance the goals of a practical, successful Arab agenda that provided a better life for ordinary people.”

But over the next three years, as the Arab Spring gave up its early promise, and brutality and dysfunction overwhelmed the Middle East, the president grew disillusioned. Some of his deepest disappointments concern Middle Eastern leaders themselves. Benjamin Netanyahu is in his own category: Obama has long believed that Netanyahu could bring about a two-state solution that would protect Israel’s status as a Jewish-majority democracy, but is too fearful and politically paralyzed to do so

Obama has also not had much patience for Netanyahu and other Middle Eastern leaders who question his understanding of the region. In one of Netanyahu’s meetings with the president, the Israeli prime minister launched into something of a lecture about the dangers of the brutal region in which he lives, and Obama felt that Netanyahu was behaving in a condescending fashion, and was also avoiding the subject at hand: peace negotiations. Finally, the president interrupted the prime minister: “Bibi, you have to understand something,” he said. “I’m the African American son of a single mother, and I live here, in this house. I live in the White House. I managed to get elected president of the United States. You think I don’t understand what you’re talking about, but I do.”

Other leaders also frustrate him immensely. Early on, Obama saw Recep Tayyip Erdoğan, the president of Turkey, as the sort of moderate Muslim leader who would bridge the divide between East and West—but Obama now considers him a failure and an authoritarian, one who refuses to use his enormous army to bring stability to Syria

In recent days, the president has taken to joking privately, “All I need in the Middle East is a few smart autocrats.” Obama has always had a fondness for pragmatic, emotionally contained technocrats, telling aides, “If only everyone could be like the Scandinavians, this would all be easy.”

The unraveling of the Arab Spring darkened the president’s view of what the U.S. could achieve in the Middle East, and made him realize how much the chaos there was distracting from other priorities. “The president recognized during the course of the Arab Spring that the Middle East was consuming us,”

But what sealed Obama’s fatalistic view was the failure of his administration’s intervention in Libya, in 2011

Obama says today of the intervention, “It didn’t work.” The U.S., he believes, planned the Libya operation carefully—and yet the country is still a disaster.

“So we actually executed this plan as well as I could have expected: We got a UN mandate, we built a coalition, it cost us $1 billion—which, when it comes to military operations, is very cheap. We averted large-scale civilian casualties, we prevented what almost surely would have been a prolonged and bloody civil conflict. And despite all that, Libya is a mess.”

Mess is the president’s diplomatic term; privately, he calls Libya a “shit show,” in part because it’s subsequently become an isis haven—one that he has already targeted with air strikes. It became a shit show, Obama believes, for reasons that had less to do with American incompetence than with the passivity of America’s allies and with the obdurate power of tribalism.

Of France, he said, “Sarkozy wanted to trumpet the flights he was taking in the air campaign, despite the fact that we had wiped out all the air defenses and essentially set up the entire infrastructure” for the intervention. This sort of bragging was fine, Obama said, because it allowed the U.S. to “purchase France’s involvement in a way that made it less expensive for us and less risky for us.” In other words, giving France extra credit in exchange for less risk and cost to the United States was a useful trade-off—except that “from the perspective of a lot of the folks in the foreign-policy establishment, well, that was terrible. If we’re going to do something, obviously we’ve got to be up front, and nobody else is sharing in the spotlight.”

Obama also blamed internal Libyan dynamics. “The degree of tribal division in Libya was greater than our analysts had expected. And our ability to have any kind of structure there that we could interact with and start training and start providing resources broke down very quickly.”

Libya proved to him that the Middle East was best avoided. “There is no way we should commit to governing the Middle East and North Africa,” he recently told a former colleague from the Senate. “That would be a basic, fundamental mistake.”

Obama did not come into office preoccupied by the Middle East. He is the first child of the Pacific to become president—born in Hawaii, raised there and, for four years, in Indonesia—and he is fixated on turning America’s attention to Asia

For Obama, Asia represents the future. Africa and Latin America, in his view, deserve far more U.S. attention than they receive. Europe, about which he is unromantic, is a source of global stability that requires, to his occasional annoyance, American hand-holding. And the Middle East is a region to be avoided—one that, thanks to America’s energy revolution, will soon be of negligible relevance to the U.S. economy.

Advisers recall that Obama would cite a pivotal moment in The Dark Knight, the 2008 Batman movie, to help explain not only how he understood the role of isis, but how he understood the larger ecosystem in which it grew. “There’s a scene in the beginning in which the gang leaders of Gotham are meeting,” the president would say. “These are men who had the city divided up. They were thugs, but there was a kind of order. Everyone had his turf. And then the Joker comes in and lights the whole city on fire. isil is the Joker. It has the capacity to set the whole region on fire. That’s why we have to fight it.”

The rise of the Islamic State deepened Obama’s conviction that the Middle East could not be fixed—not on his watch, and not for a generation to come.

The traveling White House press corps was unrelenting: “Isn’t it time for your strategy to change?” one reporter asked. This was followed by “Could I ask you to address your critics who say that your reluctance to enter another Middle East war, and your preference of diplomacy over using the military, makes the United States weaker and emboldens our enemies?” And then came this imperishable question, from a CNN reporter: “If you’ll forgive the language—why can’t we take out these bastards?” Which was followed by “Do you think you really understand this enemy well enough to defeat them and to protect the homeland?”

This rhetoric appeared to frustrate Obama immensely. “When I hear folks say that, well, maybe we should just admit the Christians but not the Muslims; when I hear political leaders suggesting that there would be a religious test for which person who’s fleeing from a war-torn country is admitted,” Obama told the assembled reporters, “that’s not American. That’s not who we are. We don’t have religious tests to our compassion.”

he has never believed that terrorism poses a threat to America commensurate with the fear it generates. Even during the period in 2014 when isis was executing its American captives in Syria, his emotions were in check. Valerie Jarrett, Obama’s closest adviser, told him people were worried that the group would soon take its beheading campaign to the U.S. “They’re not coming here to chop our heads off,” he reassured her.

Obama frequently reminds his staff that terrorism takes far fewer lives in America than handguns, car accidents, and falls in bathtubs do

Several years ago, he expressed to me his admiration for Israelis’ “resilience” in the face of constant terrorism, and it is clear that he would like to see resilience replace panic in American society. Nevertheless, his advisers are fighting a constant rearguard action to keep Obama from placing terrorism in what he considers its “proper” perspective, out of concern that he will seem insensitive to the fears of the American people.

When I noted to Kerry that the president’s rhetoric doesn’t match his, he said, “President Obama sees all of this, but he doesn’t gin it up into this kind of—he thinks we are on track. He has escalated his efforts. But he’s not trying to create hysteria … I think the president is always inclined to try to keep things on an appropriate equilibrium. I respect that.”

Obama modulates his discussion of terrorism for several reasons: He is, by nature, Spockian. And he believes that a misplaced word, or a frightened look, or an ill-considered hyperbolic claim, could tip the country into panic. The sort of panic he worries about most is the type that would manifest itself in anti-Muslim xenophobia or in a challenge to American openness and to the constitutional order.

The president also gets frustrated that terrorism keeps swamping his larger agenda, particularly as it relates to rebalancing America’s global priorities. For years, the “pivot to Asia” has been a paramount priority of his. America’s economic future lies in Asia, he believes, and the challenge posed by China’s rise requires constant attention. From his earliest days in office, Obama has been focused on rebuilding the sometimes-threadbare ties between the U.S. and its Asian treaty partners, and he is perpetually on the hunt for opportunities to draw other Asian nations into the U.S. orbit. His dramatic opening to Burma was one such opportunity; Vietnam and the entire constellation of Southeast Asian countries fearful of Chinese domination presented others.

Obama believes, Carter said, that Asia “is the part of the world of greatest consequence to the American future, and that no president can take his eye off of this.” He added, “He consistently asks, even in the midst of everything else that’s going on, ‘Where are we in the Asia-Pacific rebalance? Where are we in terms of resources?’ He’s been extremely consistent about that, even in times of Middle East tension.”

“Right now, I don’t think that anybody can be feeling good about the situation in the Middle East,” he said. “You have countries that are failing to provide prosperity and opportunity for their people. You’ve got a violent, extremist ideology, or ideologies, that are turbocharged through social media. You’ve got countries that have very few civic traditions, so that as autocratic regimes start fraying, the only organizing principles are sectarian.”

He went on, “Contrast that with Southeast Asia, which still has huge problems—enormous poverty, corruption—but is filled with striving, ambitious, energetic people who are every single day scratching and clawing to build businesses and get education and find jobs and build infrastructure. The contrast is pretty stark.”

In Asia, as well as in Latin America and Africa, Obama says, he sees young people yearning for self-improvement, modernity, education, and material wealth.“They are not thinking about how to kill Americans,” he says. “What they’re thinking about is How do I get a better education? How do I create something of value?”

He then made an observation that I came to realize was representative of his bleakest, most visceral understanding of the Middle East today—not the sort of understanding that a White House still oriented around themes of hope and change might choose to advertise. “If we’re not talking to them,” he said, referring to young Asians and Africans and Latin Americans, “because the only thing we’re doing is figuring out how to destroy or cordon off or control the malicious, nihilistic, violent parts of humanity, then we’re missing the boat.

He does resist refracting radical Islam through the “clash of civilizations” prism popularized by the late political scientist Samuel Huntington. But this is because, he and his advisers argue, he does not want to enlarge the ranks of the enemy. “The goal is not to force a Huntington template onto this conflict,” said John Brennan, the CIA director.

“It is very clear what I mean,” he told me, “which is that there is a violent, radical, fanatical, nihilistic interpretation of Islam by a faction—a tiny faction—within the Muslim community that is our enemy, and that has to be defeated.”

“There is also the need for Islam as a whole to challenge that interpretation of Islam, to isolate it, and to undergo a vigorous discussion within their community about how Islam works as part of a peaceful, modern society,” he said. But he added, “I do not persuade peaceful, tolerant Muslims to engage in that debate if I’m not sensitive to their concern that they are being tagged with a broad brush.”

In private encounters with other world leaders, Obama has argued that there will be no comprehensive solution to Islamist terrorism until Islam reconciles itself to modernity and undergoes some of the reforms that have changed Christianity.

, Obama described how he has watched Indonesia gradually move from a relaxed, syncretistic Islam to a more fundamentalist, unforgiving interpretation; large numbers of Indonesian women, he observed, have now adopted the hijab, the Muslim head covering.

Why, Turnbull asked, was this happening?Because, Obama answered, the Saudis and other Gulf Arabs have funneled money, and large numbers of imams and teachers, into the country. In the 1990s, the Saudis heavily funded Wahhabist madrassas, seminaries that teach the fundamentalist version of Islam favored by the Saudi ruling family, Obama told Turnbull. Today, Islam in Indonesia is much more Arab in orientation than it was when he lived there, he said.

“Aren’t the Saudis your friends?,” Turnbull asked.Obama smiled. “It’s complicated,” he said.

But he went on to say that the Saudis need to “share” the Middle East with their Iranian foes. “The competition between the Saudis and the Iranians—which has helped to feed proxy wars and chaos in Syria and Iraq and Yemen—requires us to say to our friends as well as to the Iranians that they need to find an effective way to share the neighborhood and institute some sort of cold peace,”

“An approach that said to our friends ‘You are right, Iran is the source of all problems, and we will support you in dealing with Iran’ would essentially mean that as these sectarian conflicts continue to rage and our Gulf partners, our traditional friends, do not have the ability to put out the flames on their own or decisively win on their own, and would mean that we have to start coming in and using our military power to settle scores. And that would be in the interest neither of the United States nor of the Middle East.”

One of the most destructive forces in the Middle East, Obama believes, is tribalism—a force no president can neutralize. Tribalism, made manifest in the reversion to sect, creed, clan, and village by the desperate citizens of failing states, is the source of much of the Muslim Middle East’s problems, and it is another source of his fatalism. Obama has deep respect for the destructive resilience of tribalism—part of his memoir, Dreams From My Father, concerns the way in which tribalism in post-colonial Kenya helped ruin his father’s life—which goes some distance in explaining why he is so fastidious about avoiding entanglements in tribal conflicts.

“It is literally in my DNA to be suspicious of tribalism,” he told me. “I understand the tribal impulse, and acknowledge the power of tribal division. I’ve been navigating tribal divisions my whole life. In the end, it’s the source of a lot of destructive acts.”

“Look, I am not of the view that human beings are inherently evil,” he said. “I believe that there’s more good than bad in humanity. And if you look at the trajectory of history, I am optimistic.

“I believe that overall, humanity has become less violent, more tolerant, healthier, better fed, more empathetic, more able to manage difference. But it’s hugely uneven. And what has been clear throughout the 20th and 21st centuries is that the progress we make in social order and taming our baser impulses and steadying our fears can be reversed very quickly. Social order starts breaking down if people are under profound stress. Then the default position is tribe—us/them, a hostility toward the unfamiliar or the unknown.”

He continued, “Right now, across the globe, you’re seeing places that are undergoing severe stress because of globalization, because of the collision of cultures brought about by the Internet and social media, because of scarcities—some of which will be attributable to climate change over the next several decades—because of population growth. And in those places, the Middle East being Exhibit A, the default position for a lot of folks is to organize tightly in the tribe and to push back or strike out against those who are different.

“A group like isil is the distillation of every worst impulse along these lines. The notion that we are a small group that defines ourselves primarily by the degree to which we can kill others who are not like us, and attempting to impose a rigid orthodoxy that produces nothing, that celebrates nothing, that really is contrary to every bit of human progress—it indicates the degree to which that kind of mentality can still take root and gain adherents in the 21st century.”

“We have to determine the best tools to roll back those kinds of attitudes,” he said. “There are going to be times where either because it’s not a direct threat to us or because we just don’t have the tools in our toolkit to have a huge impact that, tragically, we have to refrain from jumping in with both feet.”

I asked Obama whether he would have sent the Marines to Rwanda in 1994 to stop the genocide as it was happening, had he been president at the time. “Given the speed with which the killing took place, and how long it takes to crank up the machinery of the U.S. government, I understand why we did not act fast enough,” he said. “Now, we should learn from tha

I actually think that Rwanda is an interesting test case because it’s possible—not guaranteed, but it’s possible—that this was a situation where the quick application of force might have been enough.

“Ironically, it’s probably easier to make an argument that a relatively small force inserted quickly with international support would have resulted in averting genocide [more successfully in Rwanda] than in Syria right now, where the degree to which the various groups are armed and hardened fighters and are supported by a whole host of external actors with a lot of resources requires a much larger commitment of forces.”

The Turkey press conference, I told him, “was a moment for you as a politician to say, ‘Yeah, I hate the bastards too, and by the way, I am taking out the bastards.’ ” The easy thing to do would have been to reassure Americans in visceral terms that he will kill the people who want to kill them. Does he fear a knee-jerk reaction in the direction of another Middle East invasion? Or is he just inalterably Spockian?

“Every president has strengths and weaknesses,” he answered. “And there is no doubt that there are times where I have not been attentive enough to feelings and emotions and politics in communicating what we’re doing and how we’re doing it.”

But for America to be successful in leading the world, he continued, “I believe that we have to avoid being simplistic. I think we have to build resilience and make sure that our political debates are grounded in reality. It’s not that I don’t appreciate the value of theater in political communications; it’s that the habits we—the media, politicians—have gotten into, and how we talk about these issues, are so detached so often from what we need to be doing that for me to satisfy the cable news hype-fest would lead to us making worse and worse decisions over time.”

“During the couple of months in which everybody was sure Ebola was going to destroy the Earth and there was 24/7 coverage of Ebola, if I had fed the panic or in any way strayed from ‘Here are the facts, here’s what needs to be done, here’s how we’re handling it, the likelihood of you getting Ebola is very slim, and here’s what we need to do both domestically and overseas to stamp out this epidemic,’ ” then “maybe people would have said ‘Obama is taking this as seriously as he needs to be.’ ” But feeding the panic by overreacting could have shut down travel to and from three African countries that were already cripplingly poor, in ways that might have destroyed their economies—which would likely have meant, among other things, a recurrence of Ebola. He added, “It would have also meant that we might have wasted a huge amount of resources in our public-health systems that need to be devoted to flu vaccinations and other things that actually kill people” in large numbers in America

“I have friends who have kids in Paris right now,” he said. “And you and I and a whole bunch of people who are writing about what happened in Paris have strolled along the same streets where people were gunned down. And it’s right to feel fearful. And it’s important for us not to ever get complacent. There’s a difference between resilience and complacency.” He went on to describe another difference—between making considered decisions and making rash, emotional ones. “What it means, actually, is that you care so much that you want to get it right and you’re not going to indulge in either impetuous or, in some cases, manufactured responses that make good sound bites but don’t produce results. The stakes are too high to play those games.”

The other meeting took place two months later, in the Oval Office, between Obama and the general secretary of the Vietnamese Communist Party, Nguyen Phu Trong. This meeting took place only because John Kerry had pushed the White House to violate protocol, since the general secretary was not a head of state. But the goals trumped decorum: Obama wanted to lobby the Vietnamese on the Trans-Pacific Partnership—his negotiators soon extracted a promise from the Vietnamese that they would legalize independent labor unions—and he wanted to deepen cooperation on strategic issues. Administration officials have repeatedly hinted to me that Vietnam may one day soon host a permanent U.S. military presence, to check the ambitions of the country it now fears most, China. The U.S. Navy’s return to Cam Ranh Bay would count as one of the more improbable developments in recent American history. “We just moved the Vietnamese Communist Party to recognize labor rights in a way that we could never do by bullying them or scaring them,” Obama told me, calling this a key victory in his campaign to replace stick-waving with diplomatic persuasion.

I noted that the 200 or so young Southeast Asians in the room earlier that day—including citizens of Communist-ruled countries—seemed to love America. “They do,” Obama said. “In Vietnam right now, America polls at 80 percent.”

The resurgent popularity of America throughout Southeast Asia means that “we can do really big, important stuff—which, by the way, then has ramifications across the board,” he said, “because when Malaysia joins the anti-isil campaign, that helps us leverage resources and credibility in our fight against terrorism. When we have strong relations with Indonesia, that helps us when we are going to Paris and trying to negotiate a climate treaty, where the temptation of a Russia or some of these other countries may be to skew the deal in a way that is unhelpful.

Obama then cited America’s increased influence in Latin America—increased, he said, in part by his removal of a region-wide stumbling block when he reestablished ties with Cuba—as proof that his deliberate, nonthreatening, diplomacy-centered approach to foreign relations is working. The alba movement, a group of Latin American governments oriented around anti-Americanism, has significantly weakened during his time as president. “When I came into office, at the first Summit of the Americas that I attended, Hugo Chávez”—the late anti-American Venezuelan dictator—“was still the dominant figure in the conversation,” he said. “We made a very strategic decision early on, which was, rather than blow him up as this 10-foot giant adversary, to right-size the problem and say, ‘We don’t like what’s going on in Venezuela, but it’s not a threat to the United States.’

Obama said that to achieve this rebalancing, the U.S. had to absorb the diatribes and insults of superannuated Castro manqués. “When I saw Chávez, I shook his hand and he handed me a Marxist critique of the U.S.–Latin America relationship,” Obama recalled. “And I had to sit there and listen to Ortega”—Daniel Ortega, the radical leftist president of Nicaragua—“make an hour-long rant against the United States. But us being there, not taking all that stuff seriously—because it really wasn’t a threat to us”—helped neutralize the region’s anti-Americanism.

“The truth is, actually, Putin, in all of our meetings, is scrupulously polite, very frank. Our meetings are very businesslike. He never keeps me waiting two hours like he does a bunch of these other folks.” Obama said that Putin believes his relationship with the U.S. is more important than Americans tend to think. “He’s constantly interested in being seen as our peer and as working with us, because he’s not completely stupid. He understands that Russia’s overall position in the world is significantly diminished. And the fact that he invades Crimea or is trying to prop up Assad doesn’t suddenly make him a player.

“The argument is made,” I said, “that Vladimir Putin watched you in Syria and thought, He’s too logical, he’s too rational, he’s too into retrenchment. I’m going to push him a little bit further in Ukraine.”

“Look, this theory is so easily disposed of that I’m always puzzled by how people make the argument. I don’t think anybody thought that George W. Bush was overly rational or cautious in his use of military force. And as I recall, because apparently nobody in this town does, Putin went into Georgia on Bush’s watch, right smack dab in the middle of us having over 100,000 troops deployed in Iraq.” Obama was referring to Putin’s 2008 invasion of Georgia, a former Soviet republic, which was undertaken for many of the same reasons Putin later invaded Ukraine—to keep an ex–Soviet republic in Russia’s sphere of influence.

“Putin acted in Ukraine in response to a client state that was about to slip out of his grasp. And he improvised in a way to hang on to his control there,” he said. “He’s done the exact same thing in Syria, at enormous cost to the well-being of his own country. And the notion that somehow Russia is in a stronger position now, in Syria or in Ukraine, than they were before they invaded Ukraine or before he had to deploy military forces to Syria is to fundamentally misunderstand the nature of power in foreign affairs or in the world generally. Real power means you can get what you want without having to exert violence. Russia was much more powerful when Ukraine looked like an independent country but was a kleptocracy that he could pull the strings on.”

Obama’s theory here is simple: Ukraine is a core Russian interest but not an American one, so Russia will always be able to maintain escalatory dominance there.“The fact is that Ukraine, which is a non-nato country, is going to be vulnerable to military domination by Russia no matter what we do,” he said.

“I think that the best argument you can make on the side of those who are critics of my foreign policy is that the president doesn’t exploit ambiguity enough. He doesn’t maybe react in ways that might cause people to think, Wow, this guy might be a little crazy.”“The ‘crazy Nixon’ approach,” I said: Confuse and frighten your enemies by making them think you’re capable of committing irrational acts.

“But let’s examine the Nixon theory,” he said. “So we dropped more ordnance on Cambodia and Laos than on Europe in World War II, and yet, ultimately, Nixon withdrew, Kissinger went to Paris, and all we left behind was chaos, slaughter, and authoritarian governments

“There is no evidence in modern American foreign policy that that’s how people respond. People respond based on what their imperatives are, and if it’s really important to somebody, and it’s not that important to us, they know that, and we know that,” he said. “There are ways to deter, but it requires you to be very clear ahead of time about what is worth going to war for and what is not.

Now, if there is somebody in this town that would claim that we would consider going to war with Russia over Crimea and eastern Ukraine, they should speak up and be very clear about it. The idea that talking tough or engaging in some military action that is tangential to that particular area is somehow going to influence the decision making of Russia or China is contrary to all the evidence we have seen over the last 50 years.”

“If you think about, let’s say, the Iran hostage crisis, there is a narrative that has been promoted today by some of the Republican candidates that the day Reagan was elected, because he looked tough, the Iranians decided, ‘We better turn over these hostages,’ ” he said. “In fact what had happened was that there was a long negotiation with the Iranians and because they so disliked Carter—even though the negotiations had been completed—they held those hostages until the day Reagan got elected

When you think of the military actions that Reagan took, you have Grenada—which is hard to argue helped our ability to shape world events, although it was good politics for him back home. You have the Iran-Contra affair, in which we supported right-wing paramilitaries and did nothing to enhance our image in Central America, and it wasn’t successful at all.” He reminded me that Reagan’s great foe, Daniel Ortega, is today the unrepentant president of Nicaragua.

Obama also cited Reagan’s decision to almost immediately pull U.S. forces from Lebanon after 241 servicemen were killed in a Hezbollah attack in 1983. “Apparently all these things really helped us gain credibility with the Russians and the Chinese,” because “that’s the narrative that is told,” he said sarcastically.

“Now, I actually think that Ronald Reagan had a great success in foreign policy, which was to recognize the opportunity that Gorbachev presented and to engage in extensive diplomacy—which was roundly criticized by some of the same people who now use Ronald Reagan to promote the notion that we should go around bombing people.”

“As I survey the next 20 years, climate change worries me profoundly because of the effects that it has on all the other problems that we face,” he said. “If you start seeing more severe drought; more significant famine; more displacement from the Indian subcontinent and coastal regions in Africa and Asia; the continuing problems of scarcity, refugees, poverty, disease—this makes every other problem we’ve got worse. That’s above and beyond just the existential issues of a planet that starts getting into a bad feedback loop.”

Terrorism, he said, is also a long-term problem “when combined with the problem of failed states.”