Group items tagged

Let’s start with what Khan Academy is. Khan Academy is a collection of video lectures that give demonstrations of mechanical processes. When it comes to this purpose, KA videos are, on the average, pretty good. Sal Khan is the main reason; he is approachable and has a knack for making mechanical processes seem understandable. Of course, his videos are not perfect. He tends to ramble a lot and get sidetracked; he doesn’t use visuals as effectively as he could; he’s often sloppy and sometimes downright wrong with his math; and he sometimes omits topics from his subjects that really need to be there (LU decomposition in linear algebra, for example). But on balance, KA is a great resource for the niche in which it was designed to work: giving demonstrations of mechanical processes.

But let’s also be honest about what Khan Academy is not. Khan Academy is not a substitute for an actual course of study in mathematics. It is not a substitute for a live teacher. And it is not a coherent curriculum of study that engages students at all the cognitive levels at which they need to be engaged. It’s OK that it’s not these things. We don’t walk into a Mexican restaurant and fault it for not serving spaghetti. I don’t fault Khan Academy for not being a complete educational resource, because it wasn’t designed for that purpose. Again, Khan Academy is a great resource for the niche in which it was designed to work. But when you try to extend it out of that niche — as Bill Gates and others would very much like to do — all kinds of things go wrong.

When we say that someone has “learned” a subject, we typically mean that they have shown evidence of mastery not only of basic cognitive processes like factual recall and working mechanical exercises but also higher-level tasks like applying concepts to new problems and judging between two equivalent concepts. A student learning calculus, for instance, needs to demonstrate that s/he can do things like take derivatives of polynomials and use the Chain Rule. But if this is all they can demonstrate, then it’s stretching it to say that the student has “learned calculus”, because calculus is a lot more than just executing mechanical processes correctly and quickly. To say that it is not — that knowledge of calculus consists in the ability to perform algorithmic processes quickly and accurately — is to adopt an impoverished definition of the subject that renders a great intellectual pursuit into a collection of party tricks.

Any accurate evaluation of adaptive-learning technology would have to isolate and account for all variables: increases or decreases in a class's size; whether the classroom was “flipped” (meaning homework was done in class and lectures were delivered via video on the students' own time); whether the material was delivered via video, text or game; and so on. Arizona State says 78 percent of students taking the Knewton-ized developmental math course passed, up from 56 percent before

in Japan, where it is common for managers who have studied English with the adaptive-learning software iKnow to list their iKnow scores on their resumes.

“The reality is that it's going to be done,” says Eva Baker, director of the Center for the Study of Evaluation at the University of California, Los Angeles. “It's not going to be a little part. It's going to be a big part. And it's going to be put in place partly because it's going to be less expensive than doing professional development.”