Group items tagged

Clinical research can never prove that an intervention has an effect size of zero. Rather, clinical research assumes the null hypothesis, that the treatment does not work, and the burden of proof lies with demonstrating adequate evidence to reject the null hypothesis. So, when being technical, researchers will conclude that a negative study “fails to reject the null hypothesis.” Further, negative studies do not demonstrate an effect size of zero, but rather that any possible effect is likely to be smaller than the power of existing research to detect. The greater the number and power of such studies, however, the closer this remaining possible effect size gets to zero. At some point the remaining possible effect becomes clinically insignificant. In other words, clinical research may not be able to detect the difference between zero effect and a tiny effect, but at some point it becomes irrelevant. What David and I have convincingly argued, in my opinion, is that after decades of research and more than 3000 trials, acupuncture researchers have failed to reject the null hypothesis, and any remaining possible specific effect from acupuncture is so tiny as to be clinically insignificant.

It is clear from meta-analyses that results of acupuncture trials are variable and inconsistent, even for single conditions. After thousands of trials of acupuncture and hundreds of systematic reviews,18 arguments continue unabated. In 2011,Pain published an editorial31 that summed up the present situation well. “Is there really any need for more studies? Ernst et al.18 point out that the positive studies conclude that acupuncture relieves pain in some conditions but not in other very similar conditions. What would you think if a new pain pill was shown to relieve musculoskeletal pain in the arms but not in the legs? The most parsimonious explanation is that the positive studies are false positives. In his seminal article on why most published research findings are false, Ioannidis32 points out that when a popular but ineffective treatment is studied, false positive results are common for multiple reasons, including bias and low prior probability.” Since it has proved impossible to find consistent evidence after more than 3000 trials, it is time to give up. It seems very unlikely that the money that it would cost to do another 3000 trials would be well-spent.

Many modern language researchers agree with that premise. Not only does speaking multiple languages help us to communicate but bilingualism (or multilingualism) may actually confer distinct advantages to the developing brain. Because a bilingual child switches between languages, the theory goes, she develops enhanced executive control, or the ability to effectively manage what are called higher cognitive processes, such as problem-solving, memory, and thought. She becomes better able to inhibit some responses, promote others, and generally emerges with a more flexible and agile mind. It’s a phenomenon that researchers call the bilingual advantage.

Henrich’s work with the ultimatum game was an example of a small but growing countertrend in the social sciences, one in which researchers look straight at the question of how deeply culture shapes human cognition. His new colleagues in the psychology department, Heine and Norenzayan, were also part of this trend. Heine focused on the different ways people in Western and Eastern cultures perceived the world, reasoned, and understood themselves in relationship to others. Norenzayan’s research focused on the ways religious belief influenced bonding and behavior. The three began to compile examples of cross-cultural research that, like Henrich’s work with the Machiguenga, challenged long-held assumptions of human psychological universality.

As Heine, Norenzayan, and Henrich furthered their search, they began to find research suggesting wide cultural differences almost everywhere they looked: in spatial reasoning, the way we infer the motivations of others, categorization, moral reasoning, the boundaries between the self and others, and other arenas. These differences, they believed, were not genetic. The distinct ways Americans and Machiguengans played the ultimatum game, for instance, wasn’t because they had differently evolved brains. Rather, Americans, without fully realizing it, were manifesting a psychological tendency shared with people in other industrialized countries that had been refined and handed down through thousands of generations in ever more complex market economies. When people are constantly doing business with strangers, it helps when they have the desire to go out of their way (with a lawsuit, a call to the Better Business Bureau, or a bad Yelp review) when they feel cheated. Because Machiguengan culture had a different history, their gut feeling about what was fair was distinctly their own. In the small-scale societies with a strong culture of gift-giving, yet another conception of fairness prevailed. There, generous financial offers were turned down because people’s minds had been shaped by a cultural norm that taught them that the acceptance of generous gifts brought burdensome obligations. Our economies hadn’t been shaped by our sense of fairness; it was the other way around.

Studies show that Western urban children grow up so closed off in man-made environments that their brains never form a deep or complex connection to the natural world. While studying children from the U.S., researchers have suggested a developmental timeline for what is called “folkbiological reasoning.” These studies posit that it is not until children are around 7 years old that they stop projecting human qualities onto animals and begin to understand that humans are one animal among many. Compared to Yucatec Maya communities in Mexico, however, Western urban children appear to be developmentally delayed in this regard. Children who grow up constantly interacting with the natural world are much less likely to anthropomorphize other living things into late childhood.

Empathy research is thriving these days, as cognitive neuroscience undergoes what some call an “affective revolution.” There is increasing focus on the emotions, especially those involved in moral thought and action. We’ve learned, for instance, that some of the same neural systems that are active when we are in pain become engaged when we observe the suffering of others. Other researchers are exploring how empathy emerges in chimpanzee and other primates, how it flowers in young children, and the sort of circumstances that trigger it.

Rifkin calls for us to make the leap to “global empathic consciousness.” He sees this as the last best hope for saving the world from environmental destruction, and concludes with the plaintive question “Can we reach biosphere consciousness and global empathy in time to avoid planetary collapse?”

This enthusiasm may be misplaced, however. Empathy has some unfortunate features—it is parochial, narrow-minded, and innumerate. We’re often at our best when we’re smart enough not to rely on it.

There is a common narrative in science of the tragic genius who suffers for a great reward, and the tale of Curie, who died from exposure to radiation as a result of her pioneering work, is one of the most famous. There is a sense of grandeur in the idea that paying heavily is a means of advancing knowledge. But in truth, you can’t control what it is that you find — whether you’ve sacrificed your health for it, or simply years of your time.

“Estimating the Reproducibility of Psychological Science,” from Science This paper isn’t really a study; it’s the outcome of an important movement in the field of psychology. In an effort called the Reproducibility Project, researchers at dozens of universities collaborated to replicate a hundred psychology studies that were initially conducted in 2008. They ended up replicating between a third and half of the studies. Is that result bad or good? It’s inevitable that studies won’t always be replicable—if every study could be replicated, then every researcher would be right the first time; even legitimate findings can prove fragile when you try to repeat them. All the same, the paper concludes that there is “room for improvement” in psychology, especially when it comes to “cultural practices in scientific communication.” Specifically, the authors propose that “low-power research designs combined with publication bias favoring positive results together produce a literature with upwardly biased effect sizes.” In other words, the desire for novelty drives researchers to overestimate the conclusiveness of their own work. It’s a fascinating and valuable effort to make sure that psychology moves forward in the best way possible.

A landmark 2015 report that cast doubt on the results of dozens of published psychology studies has exposed deep divisions in the field, serving as a reality check for many working researchers but as an affront to others who continue to insist the original research was sound. On Thursday, a group of four researchers publicly challenged the report, arguing that it was statistically flawed and, as a result, wrong.The 2015 report, called the Reproducibility Project, found that less than 40 studies in a sample of 100 psychology papers in leading journals held up when retested by an independent team. The new critique by the four researchers countered that when that team’s statistical methodology was adjusted, the rate was closer to 100 percent.

As biological research races forward, ethical quandaries are piling up. In a report published Tuesday in the journal eLife, researchers at Harvard Medical School said it was time to ponder a startling new prospect: synthetic embryos.In recent years, scientists have moved beyond in vitro fertilization. They are starting to assemble stem cells that can organize themselves into embryolike structures.Soon, experts predict, they will learn how to engineer these cells into new kinds of tissues and organs. Eventually, they may take on features of a mature human being.

For decades, scientists have embarked on the long journey toward a medical breakthrough by first experimenting on laboratory animals. Mice or rats, pigs or dogs, they were usually male: Researchers avoided using female animals for fear that their reproductive cycles and hormone fluctuations would confound the results of delicately calibrated experiments.That laboratory tradition has had enormous consequences for women. Name a new drug or treatment, and odds are researchers know far more about its effect on men than on women. From sleeping pills to statins, women have been blindsided by side effects and dosage miscalculations that were not discovered until after the product hit the market.

SHOULD we worry that technology companies can secretly influence our emotions? Apparently so.

Research with human subjects is generally governed by strict ethical standards, including the informed consent of the people who are studied. Facebook’s generic click-through agreement, which almost no one reads and which doesn’t mention this kind of experimentation, was the only form of consent cited in the paper. The subjects in the study still, to this day, have not been informed that they were in the study. If there had been federal funding, such a complacent notion of informed consent would probably have been considered a crime. Subjects would most likely have been screened so that those at special risk would be excluded or handled with extra care.

It is unimaginable that a pharmaceutical firm would be allowed to randomly, secretly sneak an experimental drug, no matter how mild, into the drinks of hundreds of thousands of people, just to see what happens, without ever telling those people. Imagine a pharmaceutical researcher saying, “I was only looking at a narrow research question, so I don’t know if my drug harmed anyone, and I haven’t bothered to find out.” Unfortunately, this seems to be an acceptable attitude when it comes to experimenting with people over social networks. It needs to change.

If we’re going to rely on science as a means for reaching the truth — and it’s still the best tool we have — it’s important that we understand and respect just how difficult it is to get a rigorous result

Scientists’ overreliance on p-values has led at least one journal to decide it has had enough of them. In February, Basic and Applied Social Psychology announced that it will no longer publish p-values.

P-hacking and similar types of manipulations often arise from human biases. “You can do it in unconscious ways — I’ve done it in unconscious ways,” Simonsohn said. “You really believe your hypothesis and you get the data and there’s ambiguity about how to analyze it.” When the first analysis you try doesn’t spit out the result you want, you keep trying until you find one that does.

A newly published paper suggests that personality similarity affects teachers' estimation of student achievement. That is, how much you are like your teacher contributes to his or her feelings about you — and your abilities. "Astonishingly, little is known about the formation of teacher judgments and therefore about the biases in judgments," says Tobias Rausch, an author of the study and a research scientist at the Otto-Friedrich-Universität Bamberg. "However, research tells us that teacher judgments often are not accurate."

For example, a recent study from Israel showed that teachers gave girls lower grades on math tests when they knew their gender. And lots of researchers have looked at the importance of having teachers who share the racial and socioeconomic backgrounds of their students.

Five years ago, Google — one of the most public proselytizers of how studying workers can transform productivity — became focused on building the perfect team. In the last decade, the tech giant has spent untold millions of dollars measuring nearly every aspect of its employees’ lives. Google’s People Operations department has scrutinized everything from how frequently particular people eat together (the most productive employees tend to build larger networks by rotating dining companions) to which traits the best managers share (unsurprisingly, good communication and avoiding micromanaging is critical; more shocking, this was news to many Google managers).The company’s top executives long believed that building the best teams meant combining the best people. They embraced other bits of conventional wisdom as well, like ‘‘It’s better to put introverts together,’’ said Abeer Dubey, a manager in Google’s People Analytics division, or ‘‘Teams are more effective when everyone is friends away from work.’’ But, Dubey went on, ‘‘it turned out no one had really studied which of those were true.’’In 2012, the company embarked on an initiative — code-named Project Aristotle — to study hundreds of Google’s teams and figure out why some stumbled while others soared.

One of the more benign aspects of Chinese medicine is acupuncture, a practice deemed superstitious in China in the 17th century until Mao Zedong reemployed it for political purposes in the fifties. Two decades later it infiltrated the American imagination. A myth was reborn. As Jeneen Interlandi writes, research results have been murky at best—one 2013 report of over 3,000 studies showed acupuncture to be no more effective than placebos.