Group items tagged

Code is too hard to think about. Before trying to understand the attempts themselves, then, it’s worth understanding why this might be: what it is about code that makes it so foreign to the mind, and so unlike anything that came before it.

Technological progress used to change the way the world looked—you could watch the roads getting paved; you could see the skylines rise. Today you can hardly tell when something is remade, because so often it is remade by code.

Software has enabled us to make the most intricate machines that have ever existed. And yet we have hardly noticed, because all of that complexity is packed into tiny silicon chips as millions and millions of lines of cod

The programmer, the renowned Dutch computer scientist Edsger Dijkstra wrote in 1988, “has to be able to think in terms of conceptual hierarchies that are much deeper than a single mind ever needed to face before.” Dijkstra meant this as a warning.

As programmers eagerly poured software into critical systems, they became, more and more, the linchpins of the built world—and Dijkstra thought they had perhaps overestimated themselves.

What made programming so difficult was that it required you to think like a computer.

The introduction of programming languages like Fortran and C, which resemble English, and tools, known as “integrated development environments,” or IDEs, that help correct simple mistakes (like Microsoft Word’s grammar checker but for code), obscured, though did little to actually change, this basic alienation—the fact that the programmer didn’t work on a problem directly, but rather spent their days writing out instructions for a machine.

“The problem is that software engineers don’t understand the problem they’re trying to solve, and don’t care to,” says Leveson, the MIT software-safety expert. The reason is that they’re too wrapped up in getting their code to work.

“The serious problems that have happened with software have to do with requirements, not coding errors.” When you’re writing code that controls a car’s throttle, for instance, what’s important is the rules about when and how and by how much to open it. But these systems have become so complicated that hardly anyone can keep them straight in their head. “There’s 100 million lines of code in cars now,” Leveson says. “You just cannot anticipate all these things.”

a nearly decade-long investigation into claims of so-called unintended acceleration in Toyota cars. Toyota blamed the incidents on poorly designed floor mats, “sticky” pedals, and driver error, but outsiders suspected that faulty software might be responsible

software experts spend 18 months with the Toyota code, picking up where NASA left off. Barr described what they found as “spaghetti code,” programmer lingo for software that has become a tangled mess. Code turns to spaghetti when it accretes over many years, with feature after feature piling on top of, and being woven around

Using the same model as the Camry involved in the accident, Barr’s team demonstrated that there were actually more than 10 million ways for the onboard computer to cause unintended acceleration. They showed that as little as a single bit flip—a one in the computer’s memory becoming a zero or vice versa—could make a car run out of control. The fail-safe code that Toyota had put in place wasn’t enough to stop it

. In all, Toyota recalled more than 9 million cars, and paid nearly $3 billion in settlements and fines related to unintended acceleration.

The problem is that programmers are having a hard time keeping up with their own creations. Since the 1980s, the way programmers work and the tools they use have changed remarkably little.

“Visual Studio is one of the single largest pieces of software in the world,” he said. “It’s over 55 million lines of code. And one of the things that I found out in this study is more than 98 percent of it is completely irrelevant. All this work had been put into this thing, but it missed the fundamental problems that people faced. And the biggest one that I took away from it was that basically people are playing computer inside their head.” Programmers were like chess players trying to play with a blindfold on—so much of their mental energy is spent just trying to picture where the pieces are that there’s hardly any left over to think about the game itself.

The fact that the two of them were thinking about the same problem in the same terms, at the same time, was not a coincidence. They had both just seen the same remarkable talk, given to a group of software-engineering students in a Montreal hotel by a computer researcher named Bret Victor. The talk, which went viral when it was posted online in February 2012, seemed to be making two bold claims. The first was that the way we make software is fundamentally broken. The second was that Victor knew how to fix it.

Though he runs a lab that studies the future of computing, he seems less interested in technology per se than in the minds of the people who use it. Like any good toolmaker, he has a way of looking at the world that is equal parts technical and humane. He graduated top of his class at the California Institute of Technology for electrical engineering,

in early 2012, Victor had finally landed upon the principle that seemed to thread through all of his work. (He actually called the talk “Inventing on Principle.”) The principle was this: “Creators need an immediate connection to what they’re creating.” The problem with programming was that it violated the principle. That’s why software systems were so hard to think about, and so rife with bugs: The programmer, staring at a page of text, was abstracted from whatever it was they were actually making.

“Our current conception of what a computer program is,” he said, is “derived straight from Fortran and ALGOL in the late ’50s. Those languages were designed for punch cards.”

WYSIWYG (pronounced “wizzywig”) came along. It stood for “What You See Is What You Get.”

Victor’s point was that programming itself should be like that. For him, the idea that people were doing important work, like designing adaptive cruise-control systems or trying to understand cancer, by staring at a text editor, was appalling.

With the right interface, it was almost as if you weren’t working with code at all; you were manipulating the game’s behavior directly.

When the audience first saw this in action, they literally gasped. They knew they weren’t looking at a kid’s game, but rather the future of their industry. Most software involved behavior that unfolded, in complex ways, over time, and Victor had shown that if you were imaginative enough, you could develop ways to see that behavior and change it, as if playing with it in your hands. One programmer who saw the talk wrote later: “Suddenly all of my tools feel obsolete.”

hen John Resig saw the “Inventing on Principle” talk, he scrapped his plans for the Khan Academy programming curriculum. He wanted the site’s programming exercises to work just like Victor’s demos. On the left-hand side you’d have the code, and on the right, the running program: a picture or game or simulation. If you changed the code, it’d instantly change the picture. “In an environment that is truly responsive,” Resig wrote about the approach, “you can completely change the model of how a student learns ... [They] can now immediately see the result and intuit how underlying systems inherently work without ever following an explicit explanation.” Khan Academy has become perhaps the largest computer-programming class in the world, with a million students, on average, actively using the program each month.

The ideas spread. The notion of liveness, of being able to see data flowing through your program instantly, made its way into flagship programming tools offered by Google and Apple. The default language for making new iPhone and Mac apps, called Swift, was developed by Apple from the ground up to support an environment, called Playgrounds, that was directly inspired by Light Table.

“Everyone thought I was interested in programming environments,” he said. Really he was interested in how people see and understand systems—as he puts it, in the “visual representation of dynamic behavior.” Although code had increasingly become the tool of choice for creating dynamic behavior, it remained one of the worst tools for understanding it. The point of “Inventing on Principle” was to show that you could mitigate that problem by making the connection between a system’s behavior and its code immediate.

In a pair of later talks, “Stop Drawing Dead Fish” and “Drawing Dynamic Visualizations,” Victor went one further. He demoed two programs he’d built—the first for animators, the second for scientists trying to visualize their data—each of which took a process that used to involve writing lots of custom code and reduced it to playing around in a WYSIWYG interface.

Victor suggested that the same trick could be pulled for nearly every problem where code was being written today. “I’m not sure that programming has to exist at all,” he told me. “Or at least software developers.” In his mind, a software developer’s proper role was to create tools that removed the need for software developers. Only then would people with the most urgent computational problems be able to grasp those problems directly, without the intermediate muck of code.

Victor implored professional software developers to stop pouring their talent into tools for building apps like Snapchat and Uber. “The inconveniences of daily life are not the significant problems,” he wrote. Instead, they should focus on scientists and engineers—as he put it to me, “these people that are doing work that actually matters, and critically matters, and using really, really bad tools.”

“people are not so easily transitioning to model-based software development: They perceive it as another opportunity to lose control, even more than they have already.”

In a model-based design tool, you’d represent this rule with a small diagram, as though drawing the logic out on a whiteboard, made of boxes that represent different states—like “door open,” “moving,” and “door closed”—and lines that define how you can get from one state to the other. The diagrams make the system’s rules obvious: Just by looking, you can see that the only way to get the elevator moving is to close the door, or that the only way to get the door open is to stop.

Bantegnie’s company is one of the pioneers in the industrial use of model-based design, in which you no longer write code directly. Instead, you create a kind of flowchart that describes the rules your program should follow (the “model”), and the computer generates code for you based on those rules

“Typically the main problem with software coding—and I’m a coder myself,” Bantegnie says, “is not the skills of the coders. The people know how to code. The problem is what to code. Because most of the requirements are kind of natural language, ambiguous, and a requirement is never extremely precise, it’s often understood differently by the guy who’s supposed to code.”

On this view, software becomes unruly because the media for describing what software should do—conversations, prose descriptions, drawings on a sheet of paper—are too different from the media describing what software does do, namely, code itself.

for this approach to succeed, much of the work has to be done well before the project even begins. Someone first has to build a tool for developing models that are natural for people—that feel just like the notes and drawings they’d make on their own—while still being unambiguous enough for a computer to understand. They have to make a program that turns these models into real code. And finally they have to prove that the generated code will always do what it’s supposed to.

tice brings order and accountability to large codebases. But, Shivappa says, “it’s a very labor-intensive process.” He estimates that before they used model-based design, on a two-year-long project only two to three months was spent writing code—the rest was spent working on the documentation.

uch of the benefit of the model-based approach comes from being able to add requirements on the fly while still ensuring that existing ones are met; with every change, the computer can verify that your program still works. You’re free to tweak your blueprint without fear of introducing new bugs. Your code is, in FAA parlance, “correct by construction.”

. In traditional programming, your task is to take complex rules and translate them into code; most of your energy is spent doing the translating, rather than thinking about the rules themselves. In the model-based approach, all you have is the rules. So that’s what you spend your time thinking about. It’s a way of focusing less on the machine and more on the problem you’re trying to get it to solve.

The bias against model-based design, sometimes known as model-driven engineering, or MDE, is in fact so ingrained that according to a recent paper, “Some even argue that there is a stronger need to investigate people’s perception of MDE than to research new MDE technologies.”

“Human intuition is poor at estimating the true probability of supposedly ‘extremely rare’ combinations of events in systems operating at a scale of millions of requests per second,” he wrote in a paper. “That human fallibility means that some of the more subtle, dangerous bugs turn out to be errors in design; the code faithfully implements the intended design, but the design fails to correctly handle a particular ‘rare’ scenario.”

Newcombe was convinced that the algorithms behind truly critical systems—systems storing a significant portion of the web’s data, for instance—ought to be not just good, but perfect. A single subtle bug could be catastrophic. But he knew how hard bugs were to find, especially as an algorithm grew more complex. You could do all the testing you wanted and you’d never find them all.

An algorithm written in TLA+ could in principle be proven correct. In practice, it allowed you to create a realistic model of your problem and test it not just thoroughly, but exhaustively. This was exactly what he’d been looking for: a language for writing perfect algorithms.

TLA+, which stands for “Temporal Logic of Actions,” is similar in spirit to model-based design: It’s a language for writing down the requirements—TLA+ calls them “specifications”—of computer programs. These specifications can then be completely verified by a computer. That is, before you write any code, you write a concise outline of your program’s logic, along with the constraints you need it to satisfy

Programmers are drawn to the nitty-gritty of coding because code is what makes programs go; spending time on anything else can seem like a distraction. And there is a patient joy, a meditative kind of satisfaction, to be had from puzzling out the micro-mechanics of code. But code, Lamport argues, was never meant to be a medium for thought. “It really does constrain your ability to think when you’re thinking in terms of a programming language,”

Code makes you miss the forest for the trees: It draws your attention to the working of individual pieces, rather than to the bigger picture of how your program fits together, or what it’s supposed to do—and whether it actually does what you think. This is why Lamport created TLA+. As with model-based design, TLA+ draws your focus to the high-level structure of a system, its essential logic, rather than to the code that implements it.

But TLA+ occupies just a small, far corner of the mainstream, if it can be said to take up any space there at all. Even to a seasoned engineer like Newcombe, the language read at first as bizarre and esoteric—a zoo of symbols.

this is a failure of education. Though programming was born in mathematics, it has since largely been divorced from it. Most programmers aren’t very fluent in the kind of math—logic and set theory, mostly—that you need to work with TLA+. “Very few programmers—and including very few teachers of programming—understand the very basic concepts and how they’re applied in practice. And they seem to think that all they need is code,” Lamport says. “The idea that there’s some higher level than the code in which you need to be able to think precisely, and that mathematics actually allows you to think precisely about it, is just completely foreign. Because they never learned it.”

“In the 15th century,” he said, “people used to build cathedrals without knowing calculus, and nowadays I don’t think you’d allow anyone to build a cathedral without knowing calculus. And I would hope that after some suitably long period of time, people won’t be allowed to write programs if they don’t understand these simple things.”

Programmers, as a species, are relentlessly pragmatic. Tools like TLA+ reek of the ivory tower. When programmers encounter “formal methods” (so called because they involve mathematical, “formally” precise descriptions of programs), their deep-seated instinct is to recoil.

Formal methods had an image problem. And the way to fix it wasn’t to implore programmers to change—it was to change yourself. Newcombe realized that to bring tools like TLA+ to the programming mainstream, you had to start speaking their language.

he presented TLA+ as a new kind of “pseudocode,” a stepping-stone to real code that allowed you to exhaustively test your algorithms—and that got you thinking precisely early on in the design process. “Engineers think in terms of debugging rather than ‘verification,’” he wrote, so he titled his internal talk on the subject to fellow Amazon engineers “Debugging Designs.” Rather than bemoan the fact that programmers see the world in code, Newcombe embraced it. He knew he’d lose them otherwise. “I’ve had a bunch of people say, ‘Now I get it,’” Newcombe says.

In the world of the self-driving car, software can’t be an afterthought. It can’t be built like today’s airline-reservation systems or 911 systems or stock-trading systems. Code will be put in charge of hundreds of millions of lives on the road and it has to work. That is no small task.

Women are disproportionately likely to stay at home to look after their children, so encouraging them to work in the formal sector could increase gender equality.

spending on some high-quality programmes for children from birth until their fifth year generated an internal rate of return of 14%.

The system must not only free up parents to work and be good for children; the benefits must also exceed the costs to the public purse.

Many studies find that universal schemes (ie, those that apply to families of all incomes) boost labour-force participation. In 1997 the Canadian province of Quebec implemented a full-time universal scheme, costing parents just C$5 (and later C$7, $4-5.50) a day.

The large returns on investment identified by Mr Heckman and his colleagues, for instance, relate to targeted programmes for poor families. The outcomes of universal schemes, though, are less glowing.

Only a third found a positive effect of the schemes on children’s outcomes, and a fifth found negative effects.

a study by Michael Baker of the University of Toronto, Jonathan Gruber of the Massachusetts Institute of Technology and Kevin Milligan of the University of British Columbia found that children suffered worse cognitive and health outcomes.

The literature review also found that poor children gained the most from universal programmes

as a heavily subsidised child-care scheme began expanding. They found strong positive effects on future earnings for poor children, but negative effects on rich ones, whose parents would otherwise have provided better child care than the state.

“that the benefits of providing subsidised child care to middle and upper-class children are unlikely to exceed the costs”.

low-income families are a third less likely to use early child-care schemes than richer ones. In America poorer families are more likely to tell surveys that they prefer informal, family-based child care to formal care.

Full-time programmes do not necessarily deliver better results than part-time ones. The disappointing results from Quebec are often attributed to wildly disparate standards.

Left-leaning American politicians like Elizabeth Warren tend to talk in terms of “underinvestment” and “child-care deserts”.

But if existing child-care arrangements are low-quality, then spending alone will not improve outcomes for children.

“The extent to which there was a connection between the two arrested persons and the alleged assassin is currently the subject of ongoing clarifications and investigations which are being carried out by the responsible authorities.”

the terrorist had managed to deceive his mentors in such a way that no early warning signs pointing to his radicalisation had been registered.

The young man had deliberately created the impression that he was eager to reintegrate into Austrian society in his meetings with the deradicalisation programme

“Fact is: the terrorist managed to deceive the judiciary’s deradicalisation programme … We need to evaluate and optimise the system on the side of the judiciary.”

One of the appeals of deradicalisation programmes is that they allow authorities to monitor individuals who are considered a potential risk to society for a longer period than if they were to simply sit out a prison sentence.

“Our enemies are not the members of a religious community, these are terrorists. This is not a fight between Christians and Muslims, or Austrians and migrants, but a fight between civilisation and barbarity.”

“Jihadi terrorism is not new to Austria but [in recent years] we have only seen low-profile attacks by people using any available weapon … and not able to acquire explosives or AK-47s. What was surprising was not that there was an attack was not surprising, but the way it was carried out,”

Wait a second, though — wasn’t coding supposed to be one of the can’t-miss careers of the digital age?

computer programming grew from a nerdy hobby into a vocational near-imperative, the one skill to acquire to survive technological dislocation

Joe Biden to coal miners: Learn to code! Twitter trolls to laid-off journalists: Learn to code! Tim Cook to French kids: Apprendre à programmer!

Over time, from the development of assembly language through more human-readable languages like C and Python and Java, programming has climbed what computer scientists call increasing levels of abstraction — at each step growing more removed from the electronic guts of computing and more approachable to the people who use them.

A.I. might now be enabling the final layer of abstraction: The level on which you can tell a computer to do something the same way you’d tell another human.

GitHub, the coder’s repository owned by Microsoft, surveyed 2,000 programmers last year about how they’re using GitHub’s A.I. coding assistant, Copilot. A majority said Copilot helped them feel less frustrated and more fulfilled in their jobs; 88 percent said it improved their productivity. Researchers at Google found that among the company’s programmers, A.I. reduced “coding iteration time” by 6 percent.

By now the Haigazian College Rocket Society had become a source of national pride. Manougian was invited to a reception held by President Chehab to be told that the Ministry of Education would provide limited funding for 1962 and 1963. It was renamed the Lebanese Rocket Society and the national emblem was adopted for its Cedar rocket programme.

By the time of the Six Day War in 1967, Manougian was back in the US where he stayed for the rest of his academic career.

"Yes, it was a tiny country, but Lebanon could have done it."

"China has really been at the forefront of success in conversion of all vehicles to electric vehicles, especially buses," says Heather Thompson, chief executive officer of the Institute for Transportation and Development Policy (ITDP), a non-profit focusing on sustainable transport solutions. "The rest of the world is trying to do the same, but I think China is really out ahead."

At the time of China's 2001 entry into the World Trade Organisation, the international automotive industry was dominated by European, US and Japanese brands. These companies had spent decades perfecting internal combustion engine technology. To compete, Beijing decided to find a new track for its auto industry: making cars that did not use conventional engines.

That same year, the central government launched the so-called "863 plan" for EV research and development. There were numerous practical challenges, however, in the way of mass electrification. Not many manufacturers were making new energy vehicles, buyers were few and there was a lack of charging infrastructure in existence. The answer? Buses.

"The Chinese government adopted a very smart strategy," says Liu Daizong, ITDP's East Asia director. "They realised quite early on that they should drive [the EV industry] through electric buses," he notes, since their public service status meant Beijing "could have a strong hand on their electrification".

"Bus routes were fixed. This means when an electric bus finished a round, it could return to the depot to recharge," explains Xue Lulu, a mobility manager at the World Resources Institute (WRI) China. The typical daily mileage of a Chinese bus ­– 200km (120 miles) – was a realistic range for battery makers to meet.

The following year, the country began its large-scale rollout of new energy buses, with the "Ten Cities and Thousand Vehicles" programme. Over three years, the programme aimed to provide 10 cities with financial subsidies to promote 1,000 public-sector new energy vehicles in each, annually. Its goal was to have 10% new energy vehicles in the country by the end of 2012.

Strong policy support from both central and regional governments "gave manufacturers confidence in setting up production lines and stepping up research efforts," says Liu.

Together, these strong and consistent government signals encouraged Chinese manufacturers to expand their EV production capacity, bring down costs and improve their technologies. One such company was Build Your Dream, better known as BYD. The Shenzhen-based firm, the world's largest EV maker in 2022, ballooned its business a decade before by supplying electric buses and taxis for China's EV pilot cities.

"Back then, most buses used diesel, which was a main source of nitrogen oxides (NOx) emissions," says Xue, referring to the air pollution that smothered Beijing and other Chinese cities in the early 2010s. Yet in 2013, a new plan from central government cited tackling air pollution as one of the reasons for rolling out EVs.

This addition proved to be critical: it not only connected EV uptake with people's health, it also indirectly tied the e-bus campaign to local officials' political performance, as the central government would soon hand air-quality targets to all provinces.

The years 2013 and 2014 proved to be important for China's EV push. For the first time, the central government made EV purchase subsidies available to individual consumers, not just the public sector, opening the floodgate to private ownership. Additionally, it offered discounted electricity tariffs to bus operators to make sure the cost of running electric buses would be "significantly lower than" that of their oil or gas-powered equivalents.

The new economic push, plus local government's determination to battle air pollution, generated great enthusiasm for e-buses. By the end of 2015, the number of EV pilot cities rocketed from 25 to 88. In the same year, the central government set a target of 200,000 new energy buses on the road by 2020 and announced a plan to phase out its subsidies for fossil-fuel-powered buses.

To further stimulate the market, many cities devised various local policies on top of national incentives. For example, Shenzhen, a southern city with a population of more than 17 million, encouraged government agencies to work with private companies to create a full range of renting mechanisms for bus operators

Different cities' bus operators also designed different charging strategies. "Buses in Shenzhen had bigger batteries, so they normally charged overnight," says Xue, of WRI China. Between 2016 and 2020, Shanghai, another electric bus hub, subsidised the electricity e-buses used -- regardless of the hours of the day -- to give them more flexibility in charging.

Generous financial support did lead to problems. In 2016, an EV subsidy fraud shook China, with some bus operators found to have exaggerated the number of e-buses they had purchased. So that same year Beijing shifted its EV subsidy rules so bus operators could only receive financial support when a bus's mileage reached 30,000km (19,000 miles).

one year later, the government announced the so-called "dual-credit" policy. This allowed new energy vehicle makers to rake up credits which they could sell for cash to those needing to offset "negative credits" generated from making conventional cars.

it wasn't only China's buses that had benefitted.China's e-bus campaign helped create a big and stable market for its wider EV industry, brought down the costs and created economies of scale. In 2009, the year the e-bus campaign was rolled out, the total number of new energy vehicles sold stood at 2,300; by 2022, it was 6.9 million, analysis by Huang Zheng,

By 2022, the country had also built the world's largest EV charging network, with 1.8 million public charging stations – or two-thirds of the global total – and 3.4 million private equivalents. This means that on average, there is one charging pillar for every 2.5 of China's 13.1 million new energy vehicles.

Cold weather is a problem, too, as it can make a battery's charging time longer and its range shorter. The reason China has not achieved 100% electrification for its buses is its northern regions, which have harsh winters, says Xue.

To make e-buses truly "green", they should also be charged with renewable power, Wang says. But last year coal power still accounted for 58.4% of China's energy mix, according to the China Electricity Council, a trade body..

Globally, however, China is now in a league of its own in uptake of e-buses. By 2018, about 421,000 of the world's 425,000 electric buses were located in China; Europe had about 2,250 and the US owned around 300. A

But earlier this year, the European Commission announced a zero-emission target for all new city buses by 2030. And some countries are increasing their overall funding for the transition.

In 2020, the European Commission approved Germany's plan to double its aid for e-buses to €650m (£558m/$707m), then again in 2021 to €1.25 billion euros (£1.07m/$1.3bn). And the UK, which last year had the largest electric bus fleet in Europe with 2,226 pure electric and hybrid buses, has announced another £129m ($164m) to help bus operators buy zero-emissions fleets.

Countries have thus responded to China's manufacturing lead in divergent ways. "While the US has opted for a more competitive angle by fostering its own e-bus production, regions like Latin America are more open to trade with China due to a more friendly trading setup through [China's] Belt and Road Initiative,"

In order to avoid direct competition from Chinese manufacturers, the US has come up with a "school-bus strategy", says Liu. The Chinese don't make the iconic yellow vehicles, so this could ignite American e-bus manufacturing and create a local industry chain, he suggests. Backed by the US Environmental Protection Agency's $5bn (£3.9bn) Clean School Bus Programme, the national effort has so far committed to providing 5,982 buses.

In contrast, many Latin American cities, such as the Colombian capital of Bogota and the Chilean capital of Santiago, are greening their traditional bus sectors with the help of Chinese manufacturers, who are the largest providers to the region. In 2020, Chile became the country that had the most Chinese e-buses outside of China, and this year Santiago's public transport operator announced it has ordered 1,022 e-buses from Beijing-based Foton Motor, the biggest overseas deal the firm had received.

Chinese manufacturers are likely to receive a lot more orders from Chile and its neighbours in this decade. According to latest research by the global C40 Cities network, the number of electric buses in 32 Latin American cities is expected to increase by more than seven times by 2030, representing an investment opportunity of over $11.3bn (£8.9bn)

In June 2023, BloombergNEF forecast half of the world's buses to be entirely battery-powered by 2032, a decade ahead of cars. And by 2026, 36% and 24% of municipal bus sales in Europe and the US, respectively, are expected to be EVs as they begin to catch up with China

To meet the global climate goals set by the Paris Agreement, simply switching the world's existing bus fleets might not be enough. According to ITDP, the cumulative greenhouse gas emissions from urban passenger transport globally must stay below the equivalent of 66 gigatonnes CO2 between 2020 and 2050 for the world to meet the 1.5C temperature goal. This emissions limit will only be possible when the world not only adopts electric buses, but goes through a broader shift away from private transport

"We can't just focus on [replacing] the buses that exist, we need to actually get many, many more buses on the streets," Thompson adds. She and her team estimate that the world would need about 10 million more buses through 2030, and 46 million more buses cumulatively through 2050, to make public transport good enough to have a shot at achieving the Paris Agreement. And all those buses will need to be electric.

In China therefore, even though EVs are being sold faster than ever, its central government has instructed cities to encourage public transport use, as well as walking and riding bikes.

In Wang's hometown, meanwhile, which has just over three million residents, the local government has gone one step further and made all bus rides free. All citizens need to do is to swipe an app, with no charge, to get onto the bus. "My aunt loves taking buses now," says Wang. "She says it is so convenient."

This flexibility has convinced many social conservatives that Mr Trump cannot be trusted to appoint a Supreme Court justice who would oppose abortion rights.

advocated deporting nearly 11 million undocumented workers

Almost all Republicans oppose abortion. In recent years, Republican-controlled state legislatures have supported a wave of regulations that have limited access to abortions - new laws that have been met with legal challenges.

Although the group is one of the leading abortion providers in the US, the health care organisation also provides cancer screenings, contraception and screening and treatment for sexual transmitted diseases.

Both President Ronald Reagan and President George HW Bush extended amnesty to millions of undocumented workers while in office. Mainstream Republican figures such as Florida Senator Marco Rubio initially favoured similar immigration reforms that would have provided a "path to citizenship",

any Republicans in the Congress currently support the Trans-Pacific Partnership, a pending trade agreement between the US and many Pacific Rim countries.

Most Republicans oppose tariffs, saying they would spark a trade war that would damage the economy.

Republicans have long supported a muscular foreign policy and have not shied away from supporting the use of military force aboard. While generally opposed to government spending,

While Mr Trump has supported strengthening the military, he says he would do so by extracting concessions from allies.

A key faction of the Republican Party is made of fiscal conservatives who view the federal deficit as a major long-term problem for the country.

have long supported changes to Social Security and Medicare that would turn those programmes over to the private market.

Mr Trump has said he would not make cuts or changes to those programmes and instead he would bolster their funding sources by strengthening the US economy and reallocating some foreign aid to the coffers of Social Security and Medicare.

Last month’s manifesto not only declared Islam incompatible with German legal and cultural values, but also endorsed a ban on burqas and the call to prayer.

First, despite having a woman at the helm in the figure of Frauke Petry (as well as trigger-happy aristocrat Beatrix von Storch, who has advocated using deadly force  against illegal migrants at the border, as deputy party chief), AfD supporters are predominantly male.

As the German daily Die Zeit pointed out, that means AfD support follows roughly the same pattern as support for the intensely anti-Islamic pan-European movement PEGIDA (“Patriotic Europeans Against the Islamization of the West”).

Theories abound as to why and to what extent men are more likely to vote for far-right or xenophobic platforms than women—a pattern that holds with Trump supporters in the United States, as well as voters for Austria’s far-right presidential candidate Norbert Hofer, who just barely lost that country’s election this week.

A second trend in AfD demographics involves class. Originally, professors, journalists, and business leaders dominated the party, with over half the founding members in 2013 sporting a “Dr.” in front of their names.

Third comes age. “[AfD supporters] are youngish to middle-aged,” said Arzheimer. “Interestingly, voters over 60 seem to shy from voting for the AfD because they're still tied to the Christian Democrats,” Merkel’s center-right party.

When Bernd Lucke founded the AfD, he intended to win voters both from the Christian Democrats and Germany’s liberal party, the Free Democratic Party (FDP).

Crucially, Arzheimer pointed out, the AfD manages to attract NPD voters while also remaining “acceptable for a much larger group of the German population.”

Part of AfD’s strength so far has been its ability to capitalize on intense concerns about the economy and immigration with increasingly inflammatory rhetoric while maintaining a sheen of respectability—crucial in German politics, where incitement to ethnic or racial hatred is a criminal offense.

The AfD’s fragility may be what sets it apart both from right-wing parties further east and the newly nativist turn in the United States.

Art made a similar point, but turned westward. “There’s been a major containment of this far-right nativism in Germany … but it’s the United States in which it’s become in fact a part of the political system.”

There’s a term in German, he mused: ausgegrenzt, translating roughly to “excluded” or “marginalized,” but with a literal translation closer to “beyond limits” or “out of bounds.” Those who wanted the NPD banned wanted it “ausgegrenzt.”

The problem is these people were tested positive in competition. What that means is months before you know the date of the test and the approximate time of the test.

So if you fail an in-competition test you haven't only failed a drugs test, you have failed an IQ test.

That funding - with the help of additional money from Wada - would be used to hire more senior executives to run the anti-doping programme and to hire and train additional drug testers.

Our athletes, as confirmed by the IAAF, were the most tested in the world of athletics, so to say your athletes weren't tested is not exactly true.

There is a problem worldwide with the use of supplements," said Fennell. "The whole world is induced to use supplements for one thing or another.

Athletes are no different. This is not with a view to cheating and I would put my head on the block and say our athletes do not set out to cheat.

We do have rigorous testing. If you look at the record for this year you will see our testing record is amazing. Those of our top athletes are on the registered international programmes.

"I understand why people pay more attention to Jamaica," said Carter, who won an individual bronze medal in the 100m in Moscow in August to add to his sprint relay gold from the London Olympics.

"It was the same when the US dominated. People said they were on drugs and should be tested. That's a part of the sport and we have to accept that. It's going to hurt fans and athletes because no-one wants to be associated with what's going on.

He rejected claims by former Conservative leader Iain Duncan Smith, one of six Cabinet ministers campaigning for the UK to leave the EU, that the UK's membership actually exposed it to greater security risks, pointing out that the EU had taken the lead in confronting Russia over its annexation of Crimea and Iran over its nuclear programme.

"It is through the EU that you exchange criminal records and passenger records and work together on counter-terrorism...We need the collective weight of the EU when you are dealing with Russian aggression or terrorism. You need to be part of these big partnerships."

It is less than 48 hours since the referendum date was announced, but already the campaigning is in full swing. The leave campaign has been given a major boost by Boris Johnson, who says the only way to change the EU is to vote to go.

In a 2,000-word column for the Daily Telegraph, Mr Johnson said staying inside the union would lead to "an erosion of democracy".

"There is only one way to get the change we need - and that is to vote to go; because all EU history shows that they only really listen to a population when it says no," he wrote.

Several other senior Tories - including Justice Secretary Michael Gove - have already said they will join the Out campaign.

Leaving his home in north London, Mr Johnson said his immediate focus was his remaining time in City Hall and there would be plenty of time to discuss the issue of Europe, and the UK's "great future" outside it, over the next four months.

The prime minister, who argues EU membership offers more power to the UK, will take his case to the Commons this afternoon.

However, his father, Stanley Johnson, told BBC Radio 5 live he disagreed with his son's argument.He denied Mr Johnson's decision had been a "career move", saying he had "completely thrown away" any chance of a post inside Mr Cameron's cabinet by aligning himself against the prime minister.

The prime minister announced the date of the in/out referendum outside Number 10 on Saturday, having returned from agreeing a deal in Brussels that he argued gave the UK a "special status" within the EU.

Mr Cowen's view of dispassionate progress in macroeconomics is just not how things usually work. In the 1970s it was not the case, for example, that rival macroeconomic camps settled their differences, then alerted the world of the new consensus so it could be acted upon. Instead you had bitterly divided academics; you had a political ideology which saw some things it liked in one of the camps, which made those things a part of a successful political programme, and which took a policy gamble; and that gamble created new evidence which informed (though by no means settled) the debate over how inflation and monetary policy and expectations all work. The same thing happened in the 1930s. And in the 1980s, when the original voodoo economics had its day in the sun.

Economists might not like it, but this is how the world will find its way out of the current mess. Not by the calm resolution of disagreements between Larry Summers and John Cochrane, but by the increasing politicisation of a set of radical economic ideas, of one sort or another, which eventually find their way into the practical political programme of a party with a mandate to govern.

And then they'll do what they do and we will learn something about who was right and who was wrong, and a few economists will change their minds, but most will find a way to tweak their old models so that the new evidence looks like an affirmation of what they believed all along.

So what does that tell us about how macroeconomists ought to behave? Well, as scientists, they have an obligation to state their hypotheses as clearly as possible, to make testable predictions whenever possible, and to be rigorous and transparent in gathering evidence to support or falsify those predictions

But macroeconomics is also inherently political, and the practitioners who seek to "politicise" their ideas and make them a political reality play as vital a role in the advancement of the field as the scrupulously apolitical academics

Mr Bernhardt's review of the drone programme reflects a growing concern among US officials about Chinese technology and espionage.President Donald Trump has spoken in dark terms about China, saying that its leaders have "cheated" the US and that its intelligence agents spy on people here. Chinese officials deny the accusations.

US officials have said in the past that Huawei, the telecommunications company, and other Chinese companies could pose a security threat. Some Chinese analysts say the fight is not over national security but market share. The Chinese are better at making products, they say, and Americans are jealous. The Chinese analysts see the US policies as a form of protectionism.

The drones are now at the centre of the US-China dispute.Many of the drones that are used by US scientists are made by a Shenzhen-based company called Da Jiang Innovations Science and Technology Company, or, DJI. The company dominates the drone market, according to a research company, Skylogic.

Rules and norms are different for private companies in China than they are in the US. Business executives in China stay in close contact with government officials. US officials worry about the information that Chinese drones could collect and what might be done with the data.

Executives who work for DJI say their drones are trustworthy. Michael Oldenburg, a spokesman for DJI Technology Inc, tells the BBC there is no "credible evidence to support a broad country-of-origin restriction on drone technology".Many US analysts agree with Oldenburg's assessment. "I doubt the Chinese government is using the drones to conduct massive surveillance," says David Fidler, an adjunct senior fellow at the Council on Foreign Relations.

The real assessment, the one from the secretary of the interior, is yet to be announced, however. In the meantime, scientists and others wait - and wonder - about the fate of the drones.

these catastrophising billionaires are the presumptive winners of the digital economy – the supposed champions of the survival-of-the-fittest business landscape that’s fuelling most of this speculation to begin with.

What I came to realise was that these men are actually the losers. The billionaires who called me out to the desert to evaluate their bunker strategies are not the victors of the economic game so much as the victims of its perversely limited rules. More than anything, they have succumbed to a mindset where “winning” means earning enough money to insulate themselves from the damage they are creating by earning money in that way.

Never before have our society’s most powerful players assumed that the primary impact of their own conquests would be to render the world itself unliveable for everyone else

Nor have they ever before had the technologies through which to programme their sensibilities into the very fabric of our society. The landscape is alive with algorithms and intelligences actively encouraging these selfish and isolationist outlooks. Those sociopathic enough to embrace them are rewarded with cash and control over the rest of us. It’s a self-reinforcing feedback loop. This is new.

C is no hippy environmentalist but his business model is based in the same communitarian spirit I tried to convey to the billionaires: the way to keep the hungry hordes from storming the gates is by getting them food security now. So for $3m, investors not only get a maximum security compound in which to ride out the coming plague, solar storm, or electric grid collapse. They also get a stake in a potentially profitable network of local farm franchises that could reduce the probability of a catastrophic event in the first place. His business would do its best to ensure there are as few hungry children at the gate as possible when the time comes to lock down.

So far, JC Cole has been unable to convince anyone to invest in American Heritage Farms. That doesn’t mean no one is investing in such schemes. It’s just that the ones that attract more attention and cash don’t generally have these cooperative components. They’re more for people who want to go it alone

Most billionaire preppers don’t want to have to learn to get along with a community of farmers or, worse, spend their winnings funding a national food resilience programme. The mindset that requires safe havens is less concerned with preventing moral dilemmas than simply keeping them out of sight.

Rising S Company in Texas builds and installs bunkers and tornado shelters for as little as $40,000 for an 8ft by 12ft emergency hideout all the way up to the $8.3m luxury series “Aristocrat”, complete with pool and bowling lane. The enterprise originally catered to families seeking temporary storm shelters, before it went into the long-term apocalypse business. The company logo, complete with three crucifixes, suggests their services are geared more toward Christian evangelist preppers in red-state America than billionaire tech bros playing out sci-fi scenarios.

Ultra-elite shelters such as the Oppidum in the Czech Republic claim to cater to the billionaire class, and pay more attention to the long-term psychological health of residents. They provide imitation of natural light, such as a pool with a simulated sunlit garden area, a wine vault, and other amenities to make the wealthy feel at home.

On closer analysis, however, the probability of a fortified bunker actually protecting its occupants from the reality of, well, reality, is very slim. For one, the closed ecosystems of underground facilities are preposterously brittle. For example, an indoor, sealed hydroponic garden is vulnerable to contamination. Vertical farms with moisture sensors and computer-controlled irrigation systems look great in business plans and on the rooftops of Bay Area startups; when a palette of topsoil or a row of crops goes wrong, it can simply be pulled and replaced. The hermetically sealed apocalypse “grow room” doesn’t allow for such do-overs.

while a private island may be a good place to wait out a temporary plague, turning it into a self-sufficient, defensible ocean fortress is harder than it sounds. Small islands are utterly dependent on air and sea deliveries for basic staples. Solar panels and water filtration equipment need to be replaced and serviced at regular intervals. The billionaires who reside in such locales are more, not less, dependent on complex supply chains than those of us embedded in industrial civilisation.

If they wanted to test their bunker plans, they’d have hired a security expert from Blackwater or the Pentagon. They seemed to want something more. Their language went far beyond questions of disaster preparedness and verged on politics and philosophy: words such as individuality, sovereignty, governance and autonomy.

it wasn’t their actual bunker strategies I had been brought out to evaluate so much as the philosophy and mathematics they were using to justify their commitment to escape. They were working out what I’ve come to call the insulation equation: could they earn enough money to insulate themselves from the reality they were creating by earning money in this way? Was there any valid justification for striving to be so successful that they could simply leave the rest of us behind –apocalypse or not?

All the empathy and humility in the world will not mean much against the pressures of intolerance and tribalism without an invaluable quality that Sulzberger did not emphasise: courage.

Sulzberger seems to underestimate the struggle he is in, that all journalism and indeed America itself is in

In describing the essential qualities of independent journalism in his essay, he unspooled a list of admirable traits – empathy, humility, curiosity and so forth. These qualities have for generations been helpful in contending with the Times’s familiar problem, which is liberal bias

on their own, these qualities have no chance against the Times’s new, more dangerous problem, which is in crucial respects the opposite of the old one.

The Times’s problem has metastasised from liberal bias to illiberal bias, from an inclination to favour one side of the national debate to an impulse to shut debate down altogether

the internet knocked the industry off its foundations. Local newspapers were the proving ground between college campuses and national newsrooms. As they disintegrated, the national news media lost a source of seasoned reporters and many Americans lost a journalism whose truth they could verify with their own eyes.

far more than when I set out to become a journalist, doing the work right today demands a particular kind of courage:

the moral and intellectual courage to take the other side seriously and to report truths and ideas that your own side demonises for fear they will harm its cause.

One of the glories of embracing illiberalism is that, like Trump, you are always right about everything, and so you are justified in shouting disagreement down.

leaders of many workplaces and boardrooms across America find that it is so much easier to compromise than to confront – to give a little ground today in the belief you can ultimately bring people around

This is how reasonable Republican leaders lost control of their party to Trump and how liberal-minded college presidents lost control of their campuses. And it is why the leadership of the New York Times is losing control of its principles.

Over the decades the Times and other mainstream news organisations failed plenty of times to live up to their commitments to integrity and open-mindedness. The relentless struggle against biases and preconceptions, rather than the achievement of a superhuman objective omniscience, is what mattered

. I thought, and still think, that no American institution could have a better chance than the Times, by virtue of its principles, its history, its people and its hold on the attention of influential Americans, to lead the resistance to the corruption of political and intellectual life, to overcome the encroaching dogmatism and intolerance.

As the country became more polarised, the national media followed the money by serving partisan audiences the versions of reality they preferred

This relationship proved self-reinforcing. As Americans became freer to choose among alternative versions of reality, their polarisation intensified.

as the top editors let bias creep into certain areas of coverage, such as culture, lifestyle and business, that made the core harder to defend and undermined the authority of even the best reporters.

here have been signs the Times is trying to recover the courage of its convictions

The paper was slow to display much curiosity about the hard question of the proper medical protocols for trans children; but once it did, the editors defended their coverage against the inevitable criticism.

As Sulzberger told me in the past, returning to the old standards will require agonising change. He saw that as the gradual work of many years, but I think he is mistaken. To overcome the cultural and commercial pressures the Times faces, particularly given the severe test posed by another Trump candidacy and possible presidency, its publisher and senior editors will have to be bolder than that.

As a Democrat from a family of Democrats, a graduate of Yale and a blossom of the imagined meritocracy, I had my first real chance, at Buchanan’s rallies, to see the world through the eyes of stalwart opponents of abortion, immigration and the relentlessly rising tide of modernity.

the Times is failing to face up to one crucial reason: that it has lost faith in Americans, too.

For now, to assert that the Times plays by the same rules it always has is to commit a hypocrisy that is transparent to conservatives, dangerous to liberals and bad for the country as a whole.

It makes the Times too easy for conservatives to dismiss and too easy for progressives to believe.

The reality is that the Times is becoming the publication through which America’s progressive elite talks to itself about an America that does not really exist.

It is hard to imagine a path back to saner American politics that does not traverse a common ground of shared fact.

It is equally hard to imagine how America’s diversity can continue to be a source of strength, rather than become a fatal flaw, if Americans are afraid or unwilling to listen to each other.

I suppose it is also pretty grandiose to think you might help fix all that. But that hope, to me, is what makes journalism worth doing.

Since Adolph Ochs bought the paper in 1896, one of the most inspiring things the Times has said about itself is that it does its work “without fear or favour”. That is not true of the institution today – it cannot be, not when its journalists are afraid to trust readers with a mainstream conservative argument such as Cotton’s, and its leaders are afraid to say otherwise.

Most important, the Times, probably more than any other American institution, could influence the way society approached debate and engagement with opposing views. If Times Opinion demonstrated the same kind of intellectual courage and curiosity that my colleagues at the Atlantic had shown, I hoped, the rest of the media would follow.

You did not have to go along with everything that any tribe said. You did not have to pretend that the good guys, much as you might have respected them, were right about everything, or that the bad guys, much as you might have disdained them, never had a point. You did not, in other words, ever have to lie.

This fundamental honesty was vital for readers, because it equipped them to make better, more informed judgments about the world. Sometimes it might shock or upset them by failing to conform to their picture of reality. But it also granted them the respect of acknowledging that they were able to work things out for themselves.

The Atlantic did not aspire to the same role as the Times. It did not promise to serve up the news of the day without any bias. But it was to opinion journalism what the Times’s reporting was supposed to be to news: honest and open to the world.

Those were the glory days of the blog, and we hit on the idea of creating a living op-ed page, a collective of bloggers with different points of view but a shared intellectual honesty who would argue out the meaning of the news of the day

They were brilliant, gutsy writers, and their disagreements were deep enough that I used to joke that my main work as editor was to prevent fistfights.

Under its owner, David Bradley, my colleagues and I distilled our purpose as publishing big arguments about big ideas

we also began producing some of the most important work in American journalism: Nicholas Carr on whether Google was “making us stupid”; Hanna Rosin on “the end of men”; Taylor Branch on “the shame of college sports”; Ta-Nehisi Coates on “the case for reparations”; Greg Lukianoff and Jonathan Haidt on “the coddling of the American mind”.

I was starting to see some effects of the new campus politics within the Atlantic. A promising new editor had created a digital form for aspiring freelancers to fill out, and she wanted to ask them to disclose their racial and sexual identity. Why? Because, she said, if we were to write about the trans community, for example, we would ask a trans person to write the story

There was a good argument for that, I acknowledged, and it sometimes might be the right answer. But as I thought about the old people, auto workers and abortion opponents I had learned from, I told her there was also an argument for correspondents who brought an outsider’s ignorance, along with curiosity and empathy, to the story.

A journalism that starts out assuming it knows the answers, it seemed to me then, and seems even more so to me now, can be far less valuable to the reader than a journalism that starts out with a humbling awareness that it knows nothing.

In the age of the internet it is hard even for a child to sustain an “innocent eye”, but the alternative for journalists remains as dangerous as ever, to become propagandists. America has more than enough of those already.

When I looked around the Opinion department, change was not what I perceived. Excellent writers and editors were doing excellent work. But the department’s journalism was consumed with politics and foreign affairs in an era when readers were also fascinated by changes in technology, business, science and culture.

Fairly quickly, though, I realised two things: first, that if I did my job as I thought it should be done, and as the Sulzbergers said they wanted me to do it, I would be too polarising internally ever to lead the newsroom; second, that I did not want that job, though no one but my wife believed me when I said that.

there was a compensating moral and psychological privilege that came with aspiring to journalistic neutrality and open-mindedness, despised as they might understandably be by partisans. Unlike the duelling politicians and advocates of all kinds, unlike the corporate chieftains and their critics, unlike even the sainted non-profit workers, you did not have to pretend things were simpler than they actually were

On the right and left, America’s elites now talk within their tribes, and get angry or contemptuous on those occasions when they happen to overhear the other conclave. If they could be coaxed to agree what they were arguing about, and the rules by which they would argue about it, opinion journalism could serve a foundational need of the democracy by fostering diverse and inclusive debate. Who could be against that?

The large staff of op-ed editors contained only a couple of women. Although the 11 columnists were individually admirable, only two of them were women and only one was a person of colour

Not only did they all focus on politics and foreign affairs, but during the 2016 campaign, no columnist shared, in broad terms, the worldview of the ascendant progressives of the Democratic Party, incarnated by Bernie Sanders. And only two were conservative.

This last fact was of particular concern to the elder Sulzberger. He told me the Times needed more conservative voices, and that its own editorial line had become predictably left-wing. “Too many liberals,” read my notes about the Opinion line-up from a meeting I had with him and Mark Thompson, then the chief executive, as I was preparing to rejoin the paper. “Even conservatives are liberals’ idea of a conservative.” The last note I took from that meeting was: “Can’t ignore 150m conservative Americans.”

As I knew from my time at the Atlantic, this kind of structural transformation can be frightening and even infuriating for those understandably proud of things as they are. It is hard on everyone

experience at the Atlantic also taught me that pursuing new ways of doing journalism in pursuit of venerable institutional principles created enthusiasm for change. I expected that same dynamic to allay concerns at the Times.

If Opinion published a wider range of views, it would help frame a set of shared arguments that corresponded to, and drew upon, the set of shared facts coming from the newsroom.

New progressive voices were celebrated within the Times. But in contrast to the Wall Street Journal and the Washington Post, conservative voices – even eloquent anti-Trump conservative voices – were despised, regardless of how many leftists might surround them.

The Opinion department mocked the paper’s claim to value diversity. It did not have a single black editor

Eventually, it sank in that my snotty joke was actually on me: I was the one ignorantly fighting a battle that was already lost. The old liberal embrace of inclusive debate that reflected the country’s breadth of views had given way to a new intolerance for the opinions of roughly half of American voters.

Out of naivety or arrogance, I was slow to recognise that at the Times, unlike at the Atlantic, these values were no longer universally accepted, let alone esteemed

After the 9/11 attacks, as the bureau chief in Jerusalem, I spent a lot of time in the Gaza Strip interviewing Hamas leaders, recruiters and foot soldiers, trying to understand and describe their murderous ideology. Some readers complained that I was providing a platform for terrorists, but there was never any objection from within the Times.

Our role, we knew, was to help readers understand such threats, and this required empathetic – not sympathetic – reporting. This is not an easy distinction but good reporters make it: they learn to understand and communicate the sources and nature of a toxic ideology without justifying it, much less advocating it.

Today’s newsroom turns that moral logic on its head, at least when it comes to fellow Americans. Unlike the views of Hamas, the views of many Americans have come to seem dangerous to engage in the absence of explicit condemnation

Focusing on potential perpetrators – “platforming” them by explaining rather than judging their views – is believed to empower them to do more harm.

After the profile of the Ohio man was published, media Twitter lit up with attacks on the article as “normalising” Nazism and white nationalism, and the Times convulsed internally. The Times wound up publishing a cringing editor’s note that hung the writer out to dry and approvingly quoted some of the criticism, including a tweet from a Washington Post opinion editor asking, “Instead of long, glowing profiles of Nazis/White nationalists, why don’t we profile the victims of their ideologies”?

the Times lacked the confidence to defend its own work

The editor’s note paraded the principle of publishing such pieces, saying it was important to “shed more light, not less, on the most extreme corners of American life”. But less light is what the readers got. As a reporter in the newsroom, you’d have to have been an idiot after that explosion to attempt such a profile

Empathetic reporting about Trump supporters became even more rare. It became a cliché among influential left-wing columnists and editors that blinkered political reporters interviewed a few Trump supporters in diners and came away suckered into thinking there was something besides racism that could explain anyone’s support for the man.

After a year spent publishing editorials attacking Trump and his policies, I thought it would be a demonstration of Timesian open-mindedness to give his supporters their say. Also, I thought the letters were interesting, so I turned over the entire editorial page to the Trump letters.

I wasn’t surprised that we got some criticism on Twitter. But I was astonished by the fury of my Times colleagues. I found myself facing an angry internal town hall, trying to justify what to me was an obvious journalistic decision

Didn’t he think other Times readers should understand the sources of Trump’s support? Didn’t he also see it was a wonderful thing that some Trump supporters did not just dismiss the Times as fake news, but still believed in it enough to respond thoughtfully to an invitation to share their views?

And if the Times could not bear to publish the views of Americans who supported Trump, why should it be surprised that those voters would not trust it?

Two years later, in 2020, Baquet acknowledged that in 2016 the Times had failed to take seriously the idea that Trump could become president partly because it failed to send its reporters out into America to listen to voters and understand “the turmoil in the country”. And, he continued, the Times still did not understand the views of many Americans

Speaking four months before we published the Cotton op-ed, he said that to argue that the views of such voters should not appear in the Times was “not journalistic”.

Conservative arguments in the Opinion pages reliably started uproars within the Times. Sometimes I would hear directly from colleagues who had the grace to confront me with their concerns; more often they would take to the company’s Slack channels or Twitter to advertise their distress in front of each other

This environment of enforced group-think, inside and outside the paper, was hard even on liberal opinion writers. One left-of-centre columnist told me that he was reluctant to appear in the New York office for fear of being accosted by colleagues.

An internal survey shortly after I left the paper found that barely half the staff, within an enterprise ostensibly devoted to telling the truth, agreed “there is a free exchange of views in this company” and “people are not afraid to say what they really think”.)

Even columnists with impeccable leftist bona fides recoiled from tackling subjects when their point of view might depart from progressive orthodoxy.

The bias had become so pervasive, even in the senior editing ranks of the newsroom, as to be unconscious

Trying to be helpful, one of the top newsroom editors urged me to start attaching trigger warnings to pieces by conservatives. It had not occurred to him how this would stigmatise certain colleagues, or what it would say to the world about the Times’s own bias

By their nature, information bubbles are powerfully self-reinforcing, and I think many Times staff have little idea how closed their world has become, or how far they are from fulfilling their compact with readers to show the world “without fear or favour”

sometimes the bias was explicit: one newsroom editor told me that, because I was publishing more conservatives, he felt he needed to push his own department further to the left.

The Times’s failure to honour its own stated principles of openness to a range of views was particularly hard on the handful of conservative writers, some of whom would complain about being flyspecked and abused by colleagues. One day when I relayed a conservative’s concern about double standards to Sulzberger, he lost his patience. He told me to inform the complaining conservative that that’s just how it was: there was a double standard and he should get used to it.

A publication that promises its readers to stand apart from politics should not have different standards for different writers based on their politics. But I delivered the message. There are many things I regret about my tenure as editorial-page editor. That is the only act of which I am ashamed.

I began to think of myself not as a benighted veteran on a remote island, but as Rip Van Winkle. I had left one newspaper, had a pleasant dream for ten years, and returned to a place I barely recognised.

The new New York Times was the product of two shocks – sudden collapse, and then sudden success. The paper almost went bankrupt during the financial crisis, and the ensuing panic provoked a crisis of confidence among its leaders. Digital competitors like the HuffPost were gaining readers and winning plaudits within the media industry as innovative. They were the cool kids; Times folk were ink-stained wrinklies.

In its panic, the Times bought out experienced reporters and editors and began hiring journalists from publications like the HuffPost who were considered “digital natives” because they had never worked in print. This hiring quickly became easier, since most digital publications financed by venture capital turned out to be bad businesses

Though they might have lacked deep or varied reporting backgrounds, some of the Times’s new hires brought skills in video and audio; others were practised at marketing themselves – building their brands, as journalists now put it – in social media. Some were brilliant and fiercely honest, in keeping with the old aspirations of the paper.

critically, the Times abandoned its practice of acculturation, including those months-long assignments on Metro covering cops and crime or housing. Many new hires who never spent time in the streets went straight into senior writing and editing roles.

All these recruits arrived with their own notions of the purpose of the Times. To me, publishing conservatives helped fulfil the paper’s mission; to them, I think, it betrayed that mission.

then, to the shock and horror of the newsroom, Trump won the presidency. In his article for Columbia Journalism Review, Sulzberger cites the Times’s failure to take Trump’s chances seriously as an example of how “prematurely shutting down inquiry and debate” can allow “conventional wisdom to ossify in a way that blinds society.

Many Times staff members – scared, angry – assumed the Times was supposed to help lead the resistance. Anxious for growth, the Times’s marketing team implicitly endorsed that idea, too.

As the number of subscribers ballooned, the marketing department tracked their expectations, and came to a nuanced conclusion. More than 95% of Times subscribers described themselves as Democrats or independents, and a vast majority of them believed the Times was also liberal

A similar majority applauded that bias; it had become “a selling point”, reported one internal marketing memo. Yet at the same time, the marketers concluded, subscribers wanted to believe that the Times was independent.

As that memo argued, even if the Times was seen as politically to the left, it was critical to its brand also to be seen as broadening its readers’ horizons, and that required “a perception of independence”.

Readers could cancel their subscriptions if the Times challenged their worldview by reporting the truth without regard to politics. As a result, the Times’s long-term civic value was coming into conflict with the paper’s short-term shareholder value

The Times has every right to pursue the commercial strategy that makes it the most money. But leaning into a partisan audience creates a powerful dynamic. Nobody warned the new subscribers to the Times that it might disappoint them by reporting truths that conflicted with their expectations

When your product is “independent journalism”, that commercial strategy is tricky, because too much independence might alienate your audience, while too little can lead to charges of hypocrisy that strike at the heart of the brand.

It became one of Dean Baquet’s frequent mordant jokes that he missed the old advertising-based business model, because, compared with subscribers, advertisers felt so much less sense of ownership over the journalism

The Times was slow to break it to its readers that there was less to Trump’s ties to Russia than they were hoping, and more to Hunter Biden’s laptop, that Trump might be right that covid came from a Chinese lab, that masks were not always effective against the virus, that shutting down schools for many months was a bad idea.

there has been a sea change over the past ten years in how journalists think about pursuing justice. The reporters’ creed used to have its foundation in liberalism, in the classic philosophical sense. The exercise of a reporter’s curiosity and empathy, given scope by the constitutional protections of free speech, would equip readers with the best information to form their own judgments. The best ideas and arguments would win out

The journalist’s role was to be a sworn witness; the readers’ role was to be judge and jury. In its idealised form, journalism was lonely, prickly, unpopular work, because it was only through unrelenting scepticism and questioning that society could advance. If everyone the reporter knew thought X, the reporter’s role was to ask: why X?

Illiberal journalists have a different philosophy, and they have their reasons for it. They are more concerned with group rights than individual rights, which they regard as a bulwark for the privileges of white men. They have seen the principle of  free speech used to protect right-wing outfits like Project Veritas and Breitbart News and are uneasy with it.

They had their suspicions of their fellow citizens’ judgment confirmed by Trump’s election, and do not believe readers can be trusted with potentially dangerous ideas or facts. They are not out to achieve social justice as the knock-on effect of pursuing truth; they want to pursue it head-on

The term “objectivity” to them is code for ignoring the poor and weak and cosying up to power, as journalists often have done.

And they do not just want to be part of the cool crowd. They need to be

To be more valued by their peers and their contacts – and hold sway over their bosses – they need a lot of followers in social media. That means they must be seen to applaud the right sentiments of the right people in social media

The journalist from central casting used to be a loner, contrarian or a misfit. Now journalism is becoming another job for joiners, or, to borrow Twitter’s own parlance, “followers”, a term that mocks the essence of a journalist’s role.

The new newsroom ideology seems idealistic, yet it has grown from cynical roots in academia: from the idea that there is no such thing as objective truth; that there is only narrative, and that therefore whoever controls the narrative – whoever gets to tell the version of the story that the public hears – has the whip hand

What matters, in other words, is not truth and ideas in themselves, but the power to determine both in the public mind.

By contrast, the old newsroom ideology seems cynical on its surface. It used to bug me that my editors at the Times assumed every word out of the mouth of any person in power was a lie.

And the pursuit of objectivity can seem reptilian, even nihilistic, in its abjuration of a fixed position in moral contests. But the basis of that old newsroom approach was idealistic: the notion that power ultimately lies in truth and ideas, and that the citizens of a pluralistic democracy, not leaders of any sort, must be trusted to judge both.

Our role in Times Opinion, I used to urge my colleagues, was not to tell people what to think, but to help them fulfil their desire to think for themselves.

It seems to me that putting the pursuit of truth, rather than of justice, at the top of a publication’s hierarchy of values also better serves not just truth but justice, too

over the long term journalism that is not also sceptical of the advocates of any form of justice and the programmes they put forward, and that does not struggle honestly to understand and explain the sources of resistance,

will not assure that those programmes will work, and it also has no legitimate claim to the trust of reasonable people who see the world very differently. Rather than advance understanding and durable change, it provokes backlash.

The impatience within the newsroom with such old ways was intensified by the generational failure of the Times to hire and promote women and non-white people

Pay attention if you are white at the Times and you will hear black editors speak of hiring consultants at their own expense to figure out how to get white staff to respect them

As wave after wave of pain and outrage swept through the Times, over a headline that was not damning enough of Trump or someone’s obnoxious tweets, I came to think of the people who were fragile, the ones who were caught up in Slack or Twitter storms, as people who had only recently discovered that they were white and were still getting over the shock.

Having concluded they had got ahead by working hard, it has been a revelation to them that their skin colour was not just part of the wallpaper of American life, but a source of power, protection and advancement.

I share the bewilderment that so many people could back Trump, given the things he says and does, and that makes me want to understand why they do: the breadth and diversity of his support suggests not just racism is at work. Yet these elite, well-meaning Times staff cannot seem to stretch the empathy they are learning to extend to people with a different skin colour to include those, of whatever race, who have different politics.

The digital natives were nevertheless valuable, not only for their skills but also because they were excited for the Times to embrace its future. That made them important allies of the editorial and business leaders as they sought to shift the Times to digital journalism and to replace staff steeped in the ways of print. Partly for that reason, and partly out of fear, the leadership indulged internal attacks on Times journalism, despite pleas from me and others, to them and the company as a whole, that Times folk should treat each other with more respect

My colleagues and I in Opinion came in for a lot of the scorn, but we were not alone. Correspondents in the Washington bureau and political reporters would take a beating, too, when they were seen as committing sins like “false balance” because of the nuance in their stories.

My fellow editorial and commercial leaders were well aware of how the culture of the institution had changed. As delighted as they were by the Times’s digital transformation they were not blind to the ideological change that came with it. They were unhappy with the bullying and group-think; we often discussed such cultural problems in the weekly meetings of the executive committee, composed of the top editorial and business leaders, including the publisher. Inevitably, these bitch sessions would end with someone saying a version of: “Well, at some point we have to tell them this is what we believe in as a newspaper, and if they don’t like it they should work somewhere else.” It took me a couple of years to realise that this moment was never going to come.

There is a lot not to miss about the days when editors like Boyd could strike terror in young reporters like me and Purdum. But the pendulum has swung so far in the other direction that editors now tremble before their reporters and even their interns. “I miss the old climate of fear,” Baquet used to say with a smile, in another of his barbed jokes.

I wish I’d pursued my point and talked myself out of the job. This contest over control of opinion journalism within the Times was not just a bureaucratic turf battle (though it was that, too)

The newsroom’s embrace of opinion journalism has compromised the Times’s independence, misled its readers and fostered a culture of intolerance and conformity.

The Opinion department is a relic of the era when the Times enforced a line between news and opinion journalism.

Editors in the newsroom did not touch opinionated copy, lest they be contaminated by it, and opinion journalists and editors kept largely to their own, distant floor within the Times building. Such fastidiousness could seem excessive, but it enforced an ethos that Times reporters owed their readers an unceasing struggle against bias in the news

But by the time I returned as editorial-page editor, more opinion columnists and critics were writing for the newsroom than for Opinion. As at the cable news networks, the boundaries between commentary and news were disappearing, and readers had little reason to trust that Times journalists were resisting rather than indulging their biases

The Times newsroom had added more cultural critics, and, as Baquet noted, they were free to opine about politics.

Departments across the Times newsroom had also begun appointing their own “columnists”, without stipulating any rules that might distinguish them from columnists in Opinion

I checked to see if, since I left the Times, it had developed guidelines explaining the difference, if any, between a news columnist and opinion columnist. The paper’s spokeswoman, Danielle Rhoades Ha, did not respond to the question.)

The internet rewards opinionated work and, as news editors felt increasing pressure to generate page views, they began not just hiring more opinion writers but also running their own versions of opinionated essays by outside voices – historically, the province of Opinion’s op-ed department.

Yet because the paper continued to honour the letter of its old principles, none of this work could be labelled “opinion” (it still isn’t). After all, it did not come from the Opinion department.

And so a newsroom technology columnist might call for, say, unionisation of the Silicon Valley workforce, as one did, or an outside writer might argue in the business section for reparations for slavery, as one did, and to the average reader their work would appear indistinguishable from Times news articles.

By similarly circular logic, the newsroom’s opinion journalism breaks another of the Times’s commitments to its readers. Because the newsroom officially does not do opinion – even though it openly hires and publishes opinion journalists – it feels free to ignore Opinion’s mandate to provide a diversity of views

When I was editorial-page editor, there were a couple of newsroom columnists whose politics were not obvious. But the other newsroom columnists, and the critics, read as passionate progressives.

I urged Baquet several times to add a conservative to the newsroom roster of cultural critics. That would serve the readers by diversifying the Times’s analysis of culture, where the paper’s left-wing bias had become most blatant, and it would show that the newsroom also believed in restoring the Times’s commitment to taking conservatives seriously. He said this was a good idea, but he never acted on it

I couldn’t help trying the idea out on one of the paper’s top cultural editors, too: he told me he did not think Times readers would be interested in that point of view.

opinion was spreading through the newsroom in other ways. News desks were urging reporters to write in the first person and to use more “voice”, but few newsroom editors had experience in handling that kind of journalism, and no one seemed certain where “voice” stopped and “opinion” began

The Times magazine, meanwhile, became a crusading progressive publication

Baquet liked to say the magazine was Switzerland, by which he meant that it sat between the newsroom and Opinion. But it reported only to the news side. Its work was not labelled as opinion and it was free to omit conservative viewpoints.

his creep of politics into the newsroom’s journalism helped the Times beat back some of its new challengers, at least those on the left

Competitors like Vox and the HuffPost were blending leftish politics with reporting and writing it up conversationally in the first person. Imitating their approach, along with hiring some of their staff, helped the Times repel them. But it came at a cost. The rise of opinion journalism over the past 15 years changed the newsroom’s coverage and its culture

The tiny redoubt of never-Trump conservatives in Opinion is swamped daily not only by the many progressives in that department but their reinforcements among the critics, columnists and magazine writers in the newsroom

They are generally excellent, but their homogeneity means Times readers are being served a very restricted range of views, some of them presented as straight news by a publication that still holds itself out as independent of any politics.

And because the critics, newsroom columnists and magazine writers are the newsroom’s most celebrated journalists, they have disproportionate influence over the paper’s culture.

By saying that it still holds itself to the old standard of strictly separating its news and opinion journalists, the paper leads its readers further into the trap of thinking that what they are reading is independent and impartial – and this misleads them about their country’s centre of political and cultural gravity.

And yet the Times insists to the public that nothing has changed.

“Even though each day’s opinion pieces are typically among our most popular journalism and our columnists are among our most trusted voices, we believe opinion is secondary to our primary mission of reporting and should represent only a portion of a healthy news diet,” Sulzberger wrote in the Columbia Journalism Review. “For that reason, we’ve long kept the Opinion department intentionally small – it represents well under a tenth of our journalistic staff – and ensured that its editorial decision-making is walled off from the newsroom.”

When I was editorial-page editor, Sulzberger, who declined to be interviewed on the record for this article, worried a great deal about the breakdown in the boundaries between news and opinion

He told me once that he would like to restructure the paper to have one editor oversee all its news reporters, another all its opinion journalists and a third all its service journalists, the ones who supply guidance on buying gizmos or travelling abroad. Each of these editors would report to him

That is the kind of action the Times needs to take now to confront its hypocrisy and begin restoring its independence.

The Times could learn something from the Wall Street Journal, which has kept its journalistic poise

It has maintained a stricter separation between its news and opinion journalism, including its cultural criticism, and that has protected the integrity of its work.

After I was chased out of the Times, Journal reporters and other staff attempted a similar assault on their opinion department. Some 280 of them signed a letter listing pieces they found offensive and demanding changes in how their opinion colleagues approached their work. “Their anxieties aren’t our responsibility,” shrugged the Journal’s editorial board in a note to readers after the letter was leaked. “The signers report to the news editors or other parts of the business.” The editorial added, in case anyone missed the point, “We are not the New York Times.” That was the end of it.

Unlike the publishers of the Journal, however, Sulzberger is in a bind, or at least perceives himself to be

The confusion within the Times over its role, and the rising tide of intolerance among the reporters, the engineers, the business staff, even the subscribers – these are all problems he inherited, in more ways than one. He seems to feel constrained in confronting the paper’s illiberalism by the very source of his authority

The paradox is that in previous generations the Sulzbergers’ control was the bulwark of the paper’s independence.

if he is going to instil the principles he believes in, he needs to stop worrying so much about his powers of persuasion, and start using the power he is so lucky to have.

Shortly after we published the op-ed that Wednesday afternoon, some reporters tweeted their opposition to Cotton’s argument. But the real action was in the Times’s Slack channels, where reporters and other staff began not just venting but organising. They turned to the union to draw up a workplace complaint about the op-ed.

The next day, this reporter shared the byline on the Times story about the op-ed. That article did not mention that Cotton had distinguished between “peaceful, law-abiding protesters” and “rioters and looters”. In fact, the first sentence reported that Cotton had called for “the military to suppress protests against police violence”.

This was – and is – wrong. You don’t have to take my word for that. You can take the Times’s

Three days later in its article on my resignation it also initially reported that Cotton had called “for military force against protesters in American cities”. This time, after the article was published on the Times website, the editors scrambled to rewrite it, replacing “military force” with “military response” and “protesters” with “civic unrest”

That was a weaselly adjustment – Cotton wrote about criminality, not “unrest” – but the article at least no longer unambiguously misrepresented Cotton’s argument to make it seem he was in favour of crushing democratic protest. The Times did not publish a correction or any note acknowledging the story had been changed.

Seeking to influence the outcome of a story you cover, particularly without disclosing that to the reader, violates basic principles I was raised on at the Times

s Rhoades Ha disputes my characterisation of the after-the-fact editing of the story about my resignation. She said the editors changed the story after it was published on the website in order to “refine” it and “add context”, and so the story did not merit a correction disclosing to the reader that changes had been made.

In retrospect what seems almost comical is that as the conflict over Cotton’s op-ed unfolded within the Times I acted as though it was on the level, as though the staff of the Times would have a good-faith debate about Cotton’s piece and the decision to publish it

Instead, people wanted to vent and achieve what they considered to be justice, whether through Twitter, Slack, the union or the news pages themselves

My colleagues in Opinion, together with the PR team, put together a series of connected tweets describing the purpose behind publishing Cotton’s op-ed. Rather than publish these tweets from the generic Times Opinion Twitter account, Sulzberger encouraged me to do it from my personal one, on the theory that this would humanise our defence. I doubted that would make any difference, but it was certainly my job to take responsibility. So I sent out the tweets, sticking my head in a Twitter bucket that clangs, occasionally, to this day

What is worth recalling now from the bedlam of the next two days? I suppose there might be lessons for someone interested in how not to manage a corporate crisis. I began making my own mistakes that Thursday. The union condemned our publication of Cotton, for supposedly putting journalists in danger, claiming that he had called on the military “to ‘detain’ and ‘subdue’ Americans protesting racism and police brutality” – again, a misrepresentation of his argument. The publisher called to tell me the company was experiencing its largest sick day in history; people were turning down job offers because of the op-ed, and, he said, some people were quitting. He had been expecting for some time that the union would seek a voice in editorial decision-making; he said he thought this was the moment the union was making its move. He had clearly changed his own mind about the value of publishing the Cotton op-ed.

I asked Dao to have our fact-checkers review the union’s claims. But then I went a step further: at the publisher’s request, I urged him to review the editing of the piece itself and come back to me with a list of steps we could have taken to make it better. Dao’s reflex – the correct one – was to defend the piece as published. He and three other editors of varying ages, genders and races had helped edit it; it had been fact-checked, as is all our work

This was my last failed attempt to have the debate within the Times that I had been seeking for four years, about why it was important to present Times readers with arguments like Cotton’s. The staff at the paper never wanted to have that debate. The Cotton uproar was the most extreme version of the internal reaction we faced whenever we published conservative arguments that were not simply anti-Trump. Yes, yes, of course we believe in the principle of publishing diverse views, my Times colleagues would say, but why this conservative? Why this argument?

I doubt these changes would have mattered, and to extract this list from Dao was to engage in precisely the hypocrisy I claimed to despise – that, in fact, I do despise. If Cotton needed to be held to such standards of politesse, so did everyone else. Headlines such as “Tom Cotton’s Fascist Op-ed”, the headline of a subsequent piece, should also have been tranquillised.

As that miserable Thursday wore on, Sulzberger, Baquet and I held a series of Zoom meetings with reporters and editors from the newsroom who wanted to discuss the op-ed. Though a handful of the participants were there to posture, these were generally constructive conversations. A couple of people, including Baquet, even had the guts to speak up in favour of publishing the op-ed

Two moments stick out. At one point, in answer to a question, Sulzberger and Baquet both said they thought the op-ed – as the Times union and many journalists were saying – had in fact put journalists in danger. That was the first time I realised I might be coming to the end of the road.

The other was when a pop-culture reporter asked if I had read the op-ed before it was published. I said I had not. He immediately put his head down and started typing, and I should have paid attention rather than moving on to the next question. He was evidently sharing the news with the company over Slack.

Every job review I had at the Times urged me to step back from the daily coverage to focus on the long term. (Hilariously, one review, urging me to move faster in upending the Opinion department, instructed me to take risks and “ask for forgiveness not permission”.)

I learned when these meetings were over that there had been a new eruption in Slack. Times staff were saying that Rubenstein had been the sole editor of the op-ed. In response, Dao had gone into Slack to clarify to the entire company that he had also edited it himself. But when the Times posted the news article that evening, it reported, “The Op-Ed was edited by Adam Rubenstein” and made no mention of Dao’s statement

Early that morning, I got an email from Sam Dolnick, a Sulzberger cousin and a top editor at the paper, who said he felt “we” – he could have only meant me – owed the whole staff “an apology for appearing to place an abstract idea like open debate over the value of our colleagues’ lives, and their safety”. He was worried that I and my colleagues had unintentionally sent a message to other people at the Times that: “We don’t care about their full humanity and their security as much as we care about our ideas.”

“I know you don’t like it when I talk about principles at a moment like this,” I began. But I viewed the journalism I had been doing, at the Times and before that at the Atlantic, in very different terms from the ones Dolnick presumed. “I don’t think of our work as an abstraction without meaning for people’s lives – quite the opposite,” I continued. “The whole point – the reason I do this – is to have an impact on their lives to the good. I have always believed that putting ideas, including potentially dangerous one[s], out in the public is vital to ensuring they are debated and, if dangerous, discarded.” It was, I argued, in “edge cases like this that principles are tested”, and if my position was judged wrong then “I am out of step with the times.” But, I concluded, “I don’t think of us as some kind of debating society without implications for the real world and I’ve never been unmindful of my colleagues’ humanity.”

in the end, one thing he and I surely agree on is that I was, in fact, out of step with the Times. It may have raised me as a journalist – and invested so much in educating me to what were once its standards – but I did not belong there any more.