Group items tagged

At the heart of CTT is the notion that error is endemic to measurement.

By the beginning of the 20th century, the concept of (p. 462) measurement error was well recognized, and psychometricians focused their efforts on estimating and accounting for error.

In CTT, an observed measure or score (X) consists of two constituent parts—the true score (T) and measurement error (E):

. Measurement error, however, also will account for a certain portion of score variance.

According to CTT, measurement error arises because mental processes are idiosyncratic and in a state of change such that individuals are incapable of performing optimally on a single test or performance task.

random error and systematic error.

(SEM) represents the average of the total random error for all individuals

SEM represents the spread of observed scores for a single individual if that person were tested multiple times.

That score, however, is an imperfect measure of the student’s true ability.

For example, CTT provides in-depth analysis of item characteristics,

always evolving

We have to keep developing our capabilities and avoid falling behind.

no matter how well prepared people are in their formative years, few can achieve and maintain their best performance on their own.

outside ears, and eyes, are important

For decades, research has confirmed that the big factor in determining how much students learn is not class size or the extent of standardized testing but the quality of their teachers.

California researchers in the early nineteen-eighties conducted a five-year study of teacher-skill development in eighty schools, and noticed something interesting. Workshops led teachers to use new skills in the classroom only ten per cent of the time. Even when a practice session with demonstrations and personal feedback was added, fewer than twenty per cent made the change. But when coaching was introduced—when a colleague watched them try the new skills in their own classroom and provided suggestions—adoption rates passed ninety per cent. A spate of small randomized trials confirmed the effect. Coached teachers were more effective, and their students did better on tests.

they did not necessarily have any special expertise in a content area, like math or science.

The coaches let the teachers choose the direction for coaching. They usually know better than anyone what their difficulties are.

teaches coaches to observe a few specifics: whether the teacher has an effective plan for instruction; how many students are engaged in the material; whether they interact respectfully; whether they engage in high-level conversations; whether they understand how they are progressing, or failing to progress.

must engage in “deliberate practice”—sustained, mindful efforts to develop the full range of abilities that success requires. You have to work at what you’re not good at.

most people do not know where to start or how to proceed. Expertise, as the formula goes, requires going from unconscious incompetence to conscious incompetence to conscious competence and finally to unconscious competence.

The coach provides the outside eyes and ears, and makes you aware of where you’re falling short.

So coaches use a variety of approaches—showing what other, respected colleagues do, for instance, or reviewing videos of the subject’s performance. The most common, however, is just conversation.

“What worked?”

“How could you help her?”

“What else did you notice?”

something to try.

three colleagues on a lunch break

Good coaches, he said, speak with credibility, make a personal connection, and focus little on themselves.

“listened more than they talked,” Knight said. “They were one hundred per cent present in the conversation.”

coaching has definitely changed how satisfying teaching is

trying to get residents to think—to think like surgeons—and his questions exposed how much we had to learn.

a whole list of observations like this.

one twenty-minute discussion gave me more to consider and work on than I’d had in the past five years.

watch other colleagues operate in order to gather ideas about what I could do.

routine, high-quality video recordings of operations could enable us to figure out why some patients fare better than others.

I know that I’m learning again.

It’s teaching with a trendier name. Coaching aimed at improving the performance of people who are already professionals is less usual.

modern society increasingly depends on ordinary people taking responsibility for doing extraordinary things

coaching may prove essential to the success of modern society.

We care about results in sports, and if we care half as much about results in schools and in hospitals we may reach the same conclusion.

subjecting us to pop quizzes, cold calls, and pedagogical tactics that during an in-the-flesh seminar would have taken precious minutes of class time to arrange.

felt decidedly unlike a normal classroom. For one thing, it was exhausting: a continuous period of forced engagement, with no relief in the form of time when my attention could flag

One educational psychologist, Ludy Benjamin, likens lectures to Velveeta cheese—something lots of people consume but no one considers either delicious or nourishing.)

adically remake one of the most sclerotic sectors of the U.S. economy, one so shielded from the need for improvement that its biggest innovation in the past 30 years has been to double its costs and hire more administrators at higher salaries.

past half millennium, the technology of learning has hardly budge

Lectures are banned

attending class on Apple laptops

Lectures, Kosslyn says, are cost-effective but pedagogically unsound. “A great way to teach, but a terrible way to learn.”

Minerva boast is that it will strip the university experience down to the aspects that are shown to contribute directly to student learning. Lectures, gone. Tenure, gone. Gothic architecture, football, ivy crawling up the walls—gone, gone, gone.

“Your cash cow is the lecture, and the lecture is over,” he told a gathering of deans. “The lecture model ... will be obliterated.”

when you have a noncurated academic experience, you effectively don’t get educated.

Liberal-arts education is about developing the intellectual capacity of the individual, and learning to be a productive member of society. And you cannot do that without a curriculum.”

“The freshman year [as taught at traditional schools] should not exist,” Nelson says, suggesting that MOOCs can teach the basics. “Do your freshman year at home.”) Instead, Minerva’s first-year classes are designed to inculcate what Nelson calls “habits of mind” and “foundational concepts,” which are the basis for all sound systematic thought. In a science class, for example, students should develop a deep understanding of the need for controlled experiments. In a humanities class, they need to learn the classical techniques of rhetoric and develop basic persuasive skills. The curriculum then builds from that foundation.

What, he asks, does it mean to be educated?

methods will be tested against scientifically determined best practices

Subsidies, Nelson says, encourage universities to enroll even students who aren’t likely to thrive, and to raise tuition, since federal money is pegged to costs.

We have numerous sound, reproducible experiments that tell us how people learn, and what teachers can do to improve learning.” Some of the studies are ancient, by the standards of scientific research—and yet their lessons are almost wholly ignored.

memory of material is enhanced by “deep” cognitive tasks

he found the man’s view of education, in a word, faith-based

ask a student to explain a concept she has been studying, the very act of articulating it seems to lodge it in her memory. Forcing students to guess the answer to a problem, and to discuss their answers in small groups, seems to make them understand the problem better—even if they guess wrong.

e traditional concept of “cognitive styles”—visual versus aural learners, those who learn by doing versus those who learn by studying—is muddled and wrong.

Professors are able to sort students instantly, and by many metrics, for small-group work—

a pop quiz at the beginning of a class and (if the students are warned in advance) another one at a random moment later in the class greatly increases the durability of what is learned.

he could have alerted colleagues to best practices, but they most likely would have ignored them. “The classroom time is theirs, and it is sacrosanct,

I couldn’t wait for Minerva’s wrecking ball to demolish the ivory tower.

The MOOCs will eventually make lectures obsolete.”

Minerva’s model, Nelson says, will flourish in part because it will exploit free online content, rather than trying to compete with it, as traditional universities do.

The MOOCs will eventually make lectures obsolete.”

certain functions of universities have simply become less relevant as information has become more ubiquitous

Minerva challenges the field to return to first principles.

MOOCs will continue to get better, until eventually no one will pay Duke or Johns Hopkins for the possibility of a good lecture, when Coursera offers a reliably great one, with hundreds of thousands of five-star ratings, for free.

It took deep concentration,” he said. “It’s not some lecture class where you can just click ‘record’ on your tape.”

part of the process of education happens not just through good pedagogy but by having students in places where they see the scholars working and plying their trades.”

“hydraulic metaphor” of education—the idea that the main task of education is to increase the flow of knowledge into the student—an “old fallacy.”

I remembered what I was like as a teenager headed off to college, so ignorant of what college was and what it could be, and so reliant on the college itself to provide what I’d need in order to get a good education.

it is designed to convey not just information, as most MOOCs seem to, but whole mental tool kits that help students become morethoughtful citizens.

for all the high-minded talk of liberal education— of lighting fires and raising thoughtful citizens—is really just a credential, or an entry point to an old-boys network that gets you your first job and your first lunch with the machers at your alumni club.

professors and students increasingly separated geographically, mediated through technology that alters the nature of the student-teacher relationship

The idea that college will in two decades look exactly as it does today increasingly sounds like the forlorn, fingers-crossed hope of a higher-education dinosaur that retirement comes before extinction.

Countdown Timer

templates

Most popular