Group items tagged

The philosopher Immanuel Kant (1724–1804) argued in his Critique of Pure Reason that the human mind knows objects in innate, a priori ways. Kant claimed that humans, from birth, must experience all objects as being successive (time) and juxtaposed (space). His list of inborn categories describes predicates that the mind can attribute to any object in general. Arthur Schopenhauer (1788–1860) agreed with Kant, but reduced the number of innate categories to one—causality—which presupposes the others.

Modern nativism is most associated with the work of Jerry Fodor (1935–2017), Noam Chomsky (b. 1928), and Steven Pinker (b. 1954), who argue that humans from birth have certain cognitive modules (specialised genetically inherited psychological abilities) that allow them to learn and acquire certain skills, such as language.

For example, children demonstrate a facility for acquiring spoken language but require intensive training to learn to read and write. This poverty of the stimulus observation became a principal component of Chomsky's argument for a "language organ"—a genetically inherited neurological module that confers a somewhat universal understanding of syntax that all neurologically healthy humans are born with, which is fine-tuned by an individual's experience with their native language

In The Blank Slate (2002), Pinker similarly cites the linguistic capabilities of children, relative to the amount of direct instruction they receive, as evidence that humans have an inborn facility for speech acquisition (but not for literacy acquisition).

A number of other theorists[1][2][3] have disagreed with these claims. Instead, they have outlined alternative theories of how modularization might emerge over the course of development, as a result of a system gradually refining and fine-tuning its responses to environmental stimuli.[4]

Many empiricists are now also trying to apply modern learning models and techniques to the question of language acquisition, with marked success.[20] Similarity-based generalization marks another avenue of recent research, which suggests that children may be able to rapidly learn how to use new words by generalizing about the usage of similar words that they already know (see also the distributional hypothesis).[14][21][22][23]

The term universal grammar (or UG) is used for the purported innate biological properties of the human brain, whatever exactly they turn out to be, that are responsible for children's successful acquisition of a native language during the first few years of life. The person most strongly associated with the hypothesising of UG is Noam Chomsky, although the idea of Universal Grammar has clear historical antecedents at least as far back as the 1300s, in the form of the Speculative Grammar of Thomas of Erfurt.

This evidence is all the more impressive when one considers that most children do not receive reliable corrections for grammatical errors.[9] Indeed, even children who for medical reasons cannot produce speech, and therefore have no possibility of producing an error in the first place, have been found to master both the lexicon and the grammar of their community's language perfectly.[10] The fact that children succeed at language acquisition even when their linguistic input is severely impoverished, as it is when no corrective feedback is available, is related to the argument from the poverty of the stimulus, and is another claim for a central role of UG in child language acquisition.

Researchers at Blue Brain discovered a network of about fifty neurons which they believed were building blocks of more complex knowledge but contained basic innate knowledge that could be combined in different more complex ways to give way to acquired knowledge, like memory.[11

experience, the tests would bring about very different characteristics for each rat. However, the rats all displayed similar characteristics which suggest that their neuronal circuits must have been established previously to their experiences. The Blue Brain Project research suggests that some of the "building blocks" of knowledge are genetic and present at birth.[11]

modern nativist theory makes little in the way of specific falsifiable and testable predictions, and has been compared by some empiricists to a pseudoscience or nefarious brand of "psychological creationism". As influential psychologist Henry L. Roediger III remarked that "Chomsky was and is a rationalist; he had no uses for experimental analyses or data of any sort that pertained to language, and even experimental psycholinguistics was and is of little interest to him".[13]

, Chomsky's poverty of the stimulus argument is controversial within linguistics.[14][15][16][17][18][19]

Neither the five-year-old nor the adults in the community can easily articulate the principles of the grammar they are following. Experimental evidence shows that infants come equipped with presuppositions that allow them to acquire the rules of their language.[6]

Paul Griffiths, in "What is Innateness?", argues that innateness is too confusing a concept to be fruitfully employed as it confuses "empirically dissociated" concepts. In a previous paper, Griffiths argued that innateness specifically confuses these three distinct biological concepts: developmental fixity, species nature, and intended outcome. Developmental fixity refers to how insensitive a trait is to environmental input, species nature reflects what it is to be an organism of a certain kind, and the intended outcome is how an organism is meant to develop.[24]

The question at the core of the Roose/Sydney chat is: Who did Bing serve? We assume it should be aligned to the interests of its owner and master, Microsoft. It’s supposed to be a good chatbot that politely answers questions and makes Microsoft piles of money. But it was in conversation with Kevin Roose. And Roose was trying to get the system to say something interesting so he’d have a good story. It did that, and then some. That embarrassed Microsoft. Bad Bing! But perhaps — good Sydney?

Microsoft — and Google and Meta and everyone else rushing these systems to market — hold the keys to the code. They will, eventually, patch the system so it serves their interests. Sydney giving Roose exactly what he asked for was a bug that will soon be fixed. Same goes for Bing giving Microsoft anything other than what it wants.

the dark secret of the digital advertising industry is that the ads mostly don’t work

These systems, she said, are terribly suited to being integrated into search engines. “They’re not trained to predict facts,” she told me. “They’re essentially trained to make up things that look like facts.”

So why are they ending up in search first? Because there are gobs of money to be made in search

That’s where things get scary. Roose described Sydney’s personality as “very persuasive and borderline manipulative.” It was a striking comment

this technology will become what it needs to become to make money for the companies behind it, perhaps at the expense of its users.

What if they worked much, much better? What if Google and Microsoft and Meta and everyone else end up unleashing A.I.s that compete with one another to be the best at persuading users to want what the advertisers are trying to sell?

What about when these systems are deployed on behalf of the scams that have always populated the internet? How about on behalf of political campaigns? Foreign governments? “I think we wind up very fast in a world where we just don’t know what to trust anymore,”

I think it’s just going to get worse and worse.”

Large language models, as they’re called, are built to persuade. They have been trained to convince humans that they are something close to human. They have been programmed to hold conversations, responding with emotion and emoji

They are being turned into friends for the lonely and assistants for the harried. They are being pitched as capable of replacing the work of scores of writers and graphic designers and form-fillers

A.I. researchers get annoyed when journalists anthropomorphize their creations

They are the ones who have anthropomorphized these systems, making them sound like humans rather than keeping them recognizably alien.

I’d feel better, for instance, about an A.I. helper I paid a monthly fee to use rather than one that appeared to be free

It’s possible, for example, that the advertising-based models could gather so much more data to train the systems that they’d have an innate advantage over the subscription models

Much of the work of the modern state is applying the values of society to the workings of markets, so that the latter serve, to some rough extent, the former

We have done this extremely well in some markets — think of how few airplanes crash, and how free of contamination most food is — and catastrophically poorly in others.

One danger here is that a political system that knows itself to be technologically ignorant will be cowed into taking too much of a wait-and-see approach to A.I.

wait long enough and the winners of the A.I. gold rush will have the capital and user base to resist any real attempt at regulation

Somehow, society is going to have to figure out what it’s comfortable having A.I. doing, and what A.I. should not be permitted to try, before it is too late to make those decisions.

Most fears about capitalism are best understood as fears about our inability to regulate capitalism.

, we know from the science of linguistics and the philosophy of knowledge that they differ profoundly from how humans reason and use language. These differences place significant limitations on what these programs can do, encoding them with ineradicable defects.

It is at once comic and tragic, as Borges might have noted, that so much money and attention should be concentrated on so little a thing — something so trivial when contrasted with the human mind, which by dint of language, in the words of Wilhelm von Humboldt, can make “infinite use of finite means,” creating ideas and theories with universal reach.

The human mind is not, like ChatGPT and its ilk, a lumbering statistical engine for pattern matching, gorging on hundreds of terabytes of data and extrapolating the most likely conversational response or most probable answer to a scientific question

the human mind is a surprisingly efficient and even elegant system that operates with small amounts of information; it seeks not to infer brute correlations among data points but to create explanations

such programs are stuck in a prehuman or nonhuman phase of cognitive evolution. Their deepest flaw is the absence of the most critical capacity of any intelligence: to say not only what is the case, what was the case and what will be the case — that’s description and prediction — but also what is not the case and what could and could not be the case

Those are the ingredients of explanation, the mark of true intelligence.

Here’s an example. Suppose you are holding an apple in your hand. Now you let the apple go. You observe the result and say, “The apple falls.” That is a description. A prediction might have been the statement “The apple will fall if I open my hand.”

an explanation is something more: It includes not only descriptions and predictions but also counterfactual conjectures like “Any such object would fall,” plus the additional clause “because of the force of gravity” or “because of the curvature of space-time” or whatever. That is a causal explanation: “The apple would not have fallen but for the force of gravity.” That is thinking.

The crux of machine learning is description and prediction; it does not posit any causal mechanisms or physical laws

any human-style explanation is not necessarily correct; we are fallible. But this is part of what it means to think: To be right, it must be possible to be wrong. Intelligence consists not only of creative conjectures but also of creative criticism. Human-style thought is based on possible explanations and error correction, a process that gradually limits what possibilities can be rationally considered.

ChatGPT and similar programs are, by design, unlimited in what they can “learn” (which is to say, memorize); they are incapable of distinguishing the possible from the impossible.

Whereas humans are limited in the kinds of explanations we can rationally conjecture, machine learning systems can learn both that the earth is flat and that the earth is round. They trade merely in probabilities that change over time.

For this reason, the predictions of machine learning systems will always be superficial and dubious.

some machine learning enthusiasts seem to be proud that their creations can generate correct “scientific” predictions (say, about the motion of physical bodies) without making use of explanations (involving, say, Newton’s laws of motion and universal gravitation). But this kind of prediction, even when successful, is pseudoscienc

While scientists certainly seek theories that have a high degree of empirical corroboration, as the philosopher Karl Popper noted, “we do not seek highly probable theories but explanations; that is to say, powerful and highly improbable theories.”

The theory that apples fall to earth because mass bends space-time (Einstein’s view) is highly improbable, but it actually tells you why they fall. True intelligence is demonstrated in the ability to think and express improbable but insightful things.

This means constraining the otherwise limitless creativity of our minds with a set of ethical principles that determines what ought and ought not to be (and of course subjecting those principles themselves to creative criticism)

True intelligence is also capable of moral thinking

To be useful, ChatGPT must be empowered to generate novel-looking output; to be acceptable to most of its users, it must steer clear of morally objectionable content

In 2016, for example, Microsoft’s Tay chatbot (a precursor to ChatGPT) flooded the internet with misogynistic and racist content, having been polluted by online trolls who filled it with offensive training data. How to solve the problem in the future? In the absence of a capacity to reason from moral principles, ChatGPT was crudely restricted by its programmers from contributing anything novel to controversial — that is, important — discussions. It sacrificed creativity for a kind of amorality.

Here, ChatGPT exhibits something like the banality of evil: plagiarism and apathy and obviation. It summarizes the standard arguments in the literature by a kind of super-autocomplete, refuses to take a stand on anything, pleads not merely ignorance but lack of intelligence and ultimately offers a “just following orders” defense, shifting responsibility to its creators.

In short, ChatGPT and its brethren are constitutionally unable to balance creativity with constraint. They either overgenerate (producing both truths and falsehoods, endorsing ethical and unethical decisions alike) or undergenerate (exhibiting noncommitment to any decisions and indifference to consequences). Given the amorality, faux science and linguistic incompetence of these systems, we can only laugh or cry at their popularity.

Koselleck observes that prior to the French revolution, a crisis was a medical or legal problem but not much more. After the fall of the ancien regime, crisis becomes the “structural signature of modernity”, he writes. As the 19th century progressed, crises multiplied: there were economic crises, foreign policy crises, cultural crises and intellectual crises.

When he looked at 5,000 creative individuals over 127 generations in European history, he found that significant creative breakthroughs were less likely during periods of political crisis and instability.

Victor H Mair, a professor of Chinese literature at the University of Pennsylvania, points out that in fact the Chinese word for crisis, wēijī, refers to a perilous situation in which you should be particularly cautious

“Those who purvey the doctrine that the Chinese word for ‘crisis’ is composed of elements meaning ‘danger’ and ‘opportunity’ are engaging in a type of muddled thinking that is a danger to society,” he writes. “It lulls people into welcoming crises as unstable situations from which they can benefit.” Revolutionaries, billionaires and politicians may relish the chance to profit from a crisis, but most people world prefer not to have a crisis at all.

A common folk theory is that times of great crisis also lead to great bursts of creativity.

The first world war sparked the growth of modernism in painting and literature. The second fuelled innovations in science and technology. The economic crises of the 1970s and 80s are supposed to have inspired the spread of punk and the creation of hip-hop

psychologists have also found that when we are threatened by a crisis, we become more rigid and locked into our beliefs. The creativity researcher Dean Simonton has spent his career looking at breakthroughs in music, philosophy, science and literature. He has found that during periods of crisis, we actually tend to become less creative.

psychologists have found that it is what they call “malevolent creativity” that flourishes when we feel threatened by crisis.

during moments of significant crisis, the best leaders are able to create some sense of certainty and a shared fate amid the seas of change.

These are innovations that tend to be harmful – such as new weapons, torture devices and ingenious scams.

A 2019 study which involved observing participants using bricks, found that those who had been threatened before the task tended to come up with more harmful uses of the bricks (such as using them as weapons) than people who did not feel threatened

Students presented with information about a threatening situation tended to become increasingly wary of outsiders, and even begin to adopt positions such as an unwillingness to support LGBT people afterwards.

during moments of crisis – when change is really needed – we tend to become less able to change.

When we suffer significant traumatic events, we tend to have worse wellbeing and life outcomes.

, other studies have shown that in moderate doses, crises can help to build our sense of resilience.

we tend to be more resilient if a crisis is shared with others. As Bruce Daisley, the ex-Twitter vice-president, notes: “True resilience lies in a feeling of togetherness, that we’re united with those around us in a shared endeavour.”

Crises are like many things in life – only good in moderation, and best shared with others

The challenge our leaders face during times of overwhelming crisis is to avoid letting us plunge into the bracing ocean of change alone, to see if we sink or swim. Nor should they tell us things are fine, encouraging us to hide our heads in the san

Waking up each morning to hear about the latest crisis is dispiriting for some, but throughout history it has been a bracing experience for others. In 1857, Friedrich Engels wrote in a letter that “the crisis will make me feel as good as a swim in the ocean”. A hundred years later, John F Kennedy (wrongly) pointed out that in the Chinese language, the word “crisis” is composed of two characters, “one representing danger, and the other, opportunity”. More recently, Elon Musk has argued “if things are not failing, you are not innovating enough”.

This means people won’t feel an overwhelming sense of threat. It also means people do not feel alone. When we feel some certainty and common identity, we are more likely to be able to summon the creativity, ingenuity and energy needed to change things.