Skip to main content

Home/ History Readings/ Group items tagged performance

Rss Feed Group items tagged

Javier E

Mistral, the 9-Month-Old AI Startup Challenging Silicon Valley's Giants - WSJ - 0 views

  • Mensch, who started in academia, has spent much of his life figuring out how to make AI and machine-learning systems more efficient. Early last year, he joined forces with co-founders Timothée Lacroix, 32, and Guillaume Lample, 33, who were then at Meta Platforms’ artificial-intelligence lab in Paris. 
  • hey are betting that their small team can outmaneuver Silicon Valley titans by finding more efficient ways to build and deploy AI systems. And they want to do it in part by giving away many of their AI systems as open-source software.
  • Eric Boyd, corporate vice president of Microsoft’s AI platform, said Mistral presents an intriguing test of how far clever engineering can push AI systems. “So where else can you go?” he asked. “That remains to be seen.”
  • ...7 more annotations...
  • Mensch said his new model cost less than €20 million, the equivalent of roughly $22 million, to train. By contrast OpenAI Chief Executive Sam Altman said last year after the release of GPT-4 that training his company’s biggest models cost “much more than” $50 million to $100 million.
  • Brave Software made a free, open-source model from Mistral the default to power its web-browser chatbot, said Brian Bondy, Brave’s co-founder and chief technology officer. He said that the company finds the quality comparable with proprietary models, and Mistral’s open-source approach also lets Brave control the model locally.
  • “We want to be the most capital-efficient company in the world of AI,” Mensch said. “That’s the reason we exist.” 
  • Mensch joined the Google AI unit then called DeepMind in late 2020, where he worked on the team building so-called large language models, the type of AI system that would later power ChatGPT. By 2022, he was one of the lead authors of a paper about a new AI model called Chinchilla, which changed the field’s understanding of the relationship among the size of an AI model, how much data is used to build it and how well it performs, known as AI scaling laws.
  • Mensch took a role lobbying French policymakers, including French President Emmanuel Macron, against certain elements of the European Union’s new AI Act, which Mensch warned could slow down companies and would, in his view, do nothing to make AI safer. After changes to the text in Brussels, it will be a manageable burden for Mistral, Mensch says, even if he thinks the law should have remained focused on how AI is used rather than also regulating the underlying technology.  
  • For Mensch and his co-founders, releasing their initial AI systems as open source that anyone could use or adapt free of charge was an important principle. It was also a way to get noticed by developers and potential clients eager for more control over the AI they use
  • Mistral’s most advanced models, including the one unveiled Monday, aren’t available open source. 
Javier E

For the Love of Justice - by Damon Linker - 0 views

  • Thanks to social media, gaining widespread public attention for oneself and one’s favored causes has never been easier.
  • This has incentivized a lot of performative outrage that sometimes manifests itself in acts of protest, from environmental activists throwing soup on paintings in European museums to pro-Palestinian demonstrators halting traffic in major cities by sitting down en masse in the middle of roadways.
  • I don’t think they do much to advance the aims of the activists. In fact, I think they often backfire, generating ill-will among ordinary citizens inconvenienced by the protest. (As for the activists hoping to fight climate change by destroying works of art, I don’t even grasp what they think they’re doing with their lives.)
  • ...10 more annotations...
  • there’s a deeper reason for my harsh judgment, which is that I’m fully committed to the liberal project of domesticating and taming the most intense political passions, ultimately channeling them into representative political institutions, where they are forced to reach accommodation and compromise with contrary views held by other members of the polity.
  • The love of justice can be noble, but it can also be incredibly destructive.
  • (This is hard to see if you conveniently associate such love exclusively with positions staked out by your ideological or partisan allies. In reality, the political ambitions of one’s opponents are often fueled by their own contrary convictions about justice and its demands.
  • My liberal commitments therefore make me maximally suspicious of most examples of “street politics,” especially forms of it in which the activists risk very little and primarily appear to be engaging in a spiritually fulfilling form of socializing with likeminded peers.
  • But Bushnell’s act of self-immolation belongs in a different category altogether—one distinct from just about every other form of protest,
  • Bushnell could have written an op-ed. He could have joined, organized, or led a march and delivered a speech. He could have built up a loud social-media presence and used it to accuse the United States of complicity in genocide and publicize the accusation. He could have leveraged his position in the Air Force to draw added attention to his dissent from Biden administration policy in the Middle East. He could even have embraced terrorism and sought to gain entry to the Israeli embassy with a weapon or explosive
  • But Bushnell didn’t do any of these things. Instead, a few hours before his act of protest, he posted the following message on Facebook:
  • Many of us like to ask ourselves, “What would I do if I was alive during slavery? Or the Jim Crow South? Or apartheid? What would I do if my country was committing genocide?”The answer is, you’re doing it. Right now.
  • I will no longer be complicit in genocide…. I am about to engage in an extreme act of protest. But compared to what people have been experiencing in Palestine at the hands of their colonizers, it’s not extreme at all. This is what our ruling class has decided will be normal.
  • And then, like a small number of other intensely committed individuals down through the decades, he doused himself in a flammable liquid and set himself ablaze, opting to sacrifice his own life in a public act of excruciating self-torture, without doing anything at all to harm anyone but himself, in order to draw attention to what he considered an ongoing, intolerable injustice.
Javier E

Opinion | A.I. Is Endangering Our History - The New York Times - 0 views

  • Fortunately, there are numerous reasons for optimism about society’s ability to identify fake media and maintain a shared understanding of current events
  • While we have reason to believe the future may be safe, we worry that the past is not.
  • History can be a powerful tool for manipulation and malfeasance. The same generative A.I. that can fake current events can also fake past ones
  • ...15 more annotations...
  • there is a world of content out there that has not been watermarked, which is done by adding imperceptible information to a digital file so that its provenance can be traced. Once watermarking at creation becomes widespread, and people adapt to distrust content that is not watermarked, then everything produced before that point in time can be much more easily called into question.
  • countering them is much harder when the cost of creating near-perfect fakes has been radically reduced.
  • There are many examples of how economic and political powers manipulated the historical record to their own ends. Stalin purged disloyal comrades from history by executing them — and then altering photographic records to make it appear as if they never existed
  • Slovenia, upon becoming an independent country in 1992, “erased” over 18,000 people from the registry of residents — mainly members of the Roma minority and other ethnic non-Slovenes. In many cases, the government destroyed their physical records, leading to their loss of homes, pensions, and access to other services, according to a 2003 report by the Council of Europe Commissioner for Human Rights.
  • The infamous Protocols of the Elders of Zion, first published in a Russian newspaper in 1903, purported to be meeting minutes from a Jewish conspiracy to control the world. First discredited in August 1921, as a forgery plagiarized from multiple unrelated sources, the Protocols featured prominently in Nazi propaganda, and have long been used to justify antisemitic violence, including a citation in Article 32 of Hamas’s 1988 founding Covenant.
  • In 1924, the Zinoviev Letter, said to be a secret communiqué from the head of the Communist International in Moscow to the Communist Party of Great Britain to mobilize support for normalizing relations with the Soviet Union, was published by The Daily Mail four days before a general election. The resulting scandal may have cost Labour the election.
  • As it becomes easier to generate historical disinformation, and as the sheer volume of digital fakes explodes, the opportunity will become available to reshape history, or at least to call our current understanding of it into question.
  • Decades later Operation Infektion — a Soviet disinformation campaign — used forged documents to spread the idea that the United States had invented H.I.V., the virus that causes AIDS, as a biological weapon.
  • Fortunately, a path forward has been laid by the same companies that created the risk.
  • In indexing a large share of the world’s digital media to train their models, the A.I. companies have effectively created systems and databases that will soon contain all of humankind’s digitally recorded content, or at least a meaningful approximation of it.
  • They could start work today to record watermarked versions of these primary documents, which include newspaper archives and a wide range of other sources, so that subsequent forgeries are instantly detectable.
  • many of the intellectual property concerns around providing a searchable online archive do not apply to creating watermarked and time-stamped versions of documents, because those versions need not be made publicly available to serve their purpose. One can compare a claimed document to the recorded archive by using a mathematical transformation of the document known as a “hash,” the same technique the Global Internet Forum to Counter Terrorism, uses to help companies screen for known terrorist content.
  • creating verified records of historical documents can be valuable for the large A.I. companies. New research suggests that when A.I. models are trained on A.I.-generated data, their performance quickly degrades. Thus separating what is actually part of the historical record from newly created “facts” may be critical.
  • Preserving the past will also mean preserving the training data, the associated tools that operate on it and even the environment that the tools were run in.
  • Such a vellum will be a powerful tool. It can help companies to build better models, by enabling them to analyze what data to include to get the best content, and help regulators to audit bias and harmful content in the models
Javier E

AI scientist Ray Kurzweil: 'We are going to expand intelligence a millionfold by 2045' ... - 0 views

  • American computer scientist and techno-optimist Ray Kurzweil is a long-serving authority on artificial intelligence (AI). His bestselling 2005 book, The Singularity Is Near, sparked imaginations with sci-fi like predictions that computers would reach human-level intelligence by 2029 and that we would merge with computers and become superhuman around 2045, which he called “the Singularity”. Now, nearly 20 years on, Kurzweil, 76, has a sequel, The Singularity Is Nearer
  • no longer seem so wacky.
  • Your 2029 and 2045 projections haven’t changed…I have stayed consistent. So 2029, both for human-level intelligence and for artificial general intelligence (AGI) – which is a little bit different. Human-level intelligence generally means AI that has reached the ability of the most skilled humans in a particular domain and by 2029 that will be achieved in most respects. (There may be a few years of transition beyond 2029 where AI has not surpassed the top humans in a few key skills like writing Oscar-winning screenplays or generating deep new philosophical insights, though it will.) AGI means AI that can do everything that any human can do, but to a superior level. AGI sounds more difficult, but it’s coming at the same time.
  • ...15 more annotations...
  • Why write this book? The Singularity Is Near talked about the future, but 20 years ago, when people didn’t know what AI was. It was clear to me what would happen, but it wasn’t clear to everybody. Now AI is dominating the conversation. It is time to take a look again both at the progress we’ve made – large language models (LLMs) are quite delightful to use – and the coming breakthroughs.
  • It is hard to imagine what this would be like, but it doesn’t sound very appealing… Think of it like having your phone, but in your brain. If you ask a question your brain will be able to go out to the cloud for an answer similar to the way you do on your phone now – only it will be instant, there won’t be any input or output issues, and you won’t realise it has been done (the answer will just appear). People do say “I don’t want that”: they thought they didn’t want phones either!
  • The most important driver is the exponential growth in the amount of computing power for the price in constant dollars. We are doubling price-performance every 15 months. LLMs just began to work two years ago because of the increase in computation.
  • What’s missing currently to bring AI to where you are predicting it will be in 2029? One is more computing power – and that’s coming. That will enable improvements in contextual memory, common sense reasoning and social interaction, which are all areas where deficiencies remain
  • LLM hallucinations [where they create nonsensical or inaccurate outputs] will become much less of a problem, certainly by 2029 – they already happen much less than they did two years ago. The issue occurs because they don’t have the answer, and they don’t know that. They look for the best thing, which might be wrong or not appropriate. As AI gets smarter, it will be able to understand its own knowledge more precisely and accurately report to humans when it doesn’t know.
  • What exactly is the Singularity? Today, we have one brain size which we can’t go beyond to get smarter. But the cloud is getting smarter and it is growing really without bounds. The Singularity, which is a metaphor borrowed from physics, will occur when we merge our brain with the cloud. We’re going to be a combination of our natural intelligence and our cybernetic intelligence and it’s all going to be rolled into one. Making it possible will be brain-computer interfaces which ultimately will be nanobots – robots the size of molecules – that will go noninvasively into our brains through the capillaries. We are going to expand intelligence a millionfold by 2045 and it is going to deepen our awareness and consciousness.
  • Why should we believe your dates? I’m really the only person that predicted the tremendous AI interest that we’re seeing today. In 1999 people thought that would take a century or more. I said 30 years and look what we have.
  • I have a chapter on perils. I’ve been involved with trying to find the best way to move forward and I helped to develop the Asilomar AI Principles [a 2017 non-legally binding set of guidelines for responsible AI development]
  • All the major companies are putting more effort into making sure their systems are safe and align with human values than they are into creating new advances, which is positive.
  • Not everyone is likely to be able to afford the technology of the future you envisage. Does technological inequality worry you? Being wealthy allows you to afford these technologies at an early point, but also one where they don’t work very well. When [mobile] phones were new they were very expensive and also did a terrible job. They had access to very little information and didn’t talk to the cloud. Now they are very affordable and extremely useful. About three quarters of people in the world have one. So it’s going to be the same thing here: this issue goes away over time.
  • The book looks in detail at AI’s job-killing potential. Should we be worried? Yes, and no. Certain types of jobs will be automated and people will be affected. But new capabilities also create new jobs. A job like “social media influencer” didn’t make sense, even 10 years ago. Today we have more jobs than we’ve ever had and US average personal income per hours worked is 10 times what it was 100 years ago adjusted to today’s dollars. Universal basic income will start in the 2030s, which will help cushion the harms of job disruptions. It won’t be adequate at that point but over time it will become so.
  • Everything is progressing exponentially: not only computing power but our understanding of biology and our ability to engineer at far smaller scales. In the early 2030s we can expect to reach longevity escape velocity where every year of life we lose through ageing we get back from scientific progress. And as we move past that we’ll actually get back more years.
  • What is your own plan for immortality? My first plan is to stay alive, therefore reaching longevity escape velocity. I take about 80 pills a day to help keep me healthy. Cryogenic freezing is the fallback. I’m also intending to create a replicant of myself [an afterlife AI avatar], which is an option I think we’ll all have in the late 2020s
  • I did something like that with my father, collecting everything that he had written in his life, and it was a little bit like talking to him. [My replicant] will be able to draw on more material and so represent my personality more faithfully.
  • What should we be doing now to best prepare for the future? It is not going to be us versus AI: AI is going inside ourselves. It will allow us to create new things that weren’t feasible before. It’ll be a pretty fantastic future.
Javier E

The Infantile Style in American Politics - The Atlantic - 0 views

  • Too many on the left wing of American politics have become inured to the effect of their overheated rhetoric and histrionic displays of fealty to in-group norms
  • Bowman’s supporters sought easy explanations for his defeat, including that redistricting had shifted his district northward out of much of the Bronx and into Westchester. But Bowman in fact had fared well in the predominantly Democratic suburban county in his 2020 and 2022 campaigns.
  • claims that the massive spending of pro-Israel groups was responsible for Bowman’s defeat warrant skepticism
  • ...9 more annotations...
  • Bowman also indulged a penchant—again shared broadly on the anti-Israel, anti-Zionist left—for performative and self-righteous politics.
  • For weeks, prominent left-wing organizers on social media slammed Latimer, a centrist liberal, as a reactionary white man backed by billionaires. The New York City chapter of the Democratic Socialists of America, which endorsed Bowman, decried Latimer as an AIPAC-picked, MAGA-bought racist.
  • using the term genocide has become de rigueur for candidates seeking an endorsement from DSA and Justice Democrats. Bowman obliged, repeatedly.
  • Bowman’s rhetoric was undisciplined and incendiary, while Latimer was a popular local politician whose internal polls showed him leading by double digits before AIPAC spent anything.
  • “The Paranoid Style in American Politics.” A modern left-wing update might be titled “The Infantile Style in American Politics”—as the conspiratorial mixes with obstinacy and braggadocio.
  • The Bronx rally offered a glimpse, too, of the sectarianism that routinely afflicts the left. Pro-Palestine protesters from Within Our Lifetime showed up and beat drums and chanted throughout the rally, doing their best to disrupt the proceedings. They denounced Bowman, Ocasio-Cortez, and Sanders as “Zionists” who backed “Genocide Joe” for president.
  • victories coexist with a growing shrillness and insistence by many on the left upon political purity. So longtime liberal Democratic politicians find themselves denounced as pro-genocide for supporting Israel and Biden’s position on the Gaza conflict.
  • Many mainstream Democrats seem less and less patient with the activist left. Hakeem Jeffries, the House minority leader and possible future speaker, would have none of the Bowman camp’s talk of martyrdom.
  • Jeffries took a noticeably removed and dispassionate view of that loss. “The results speak for themselves. The voters have spoken,” he said, sounding less than distraught. A senior Jeffries adviser later noted on social media that the minority leader has now supported six candidates challenged by DSA, and his candidates have won all six races.
« First ‹ Previous 681 - 685 of 685
Showing 20 items per page