Group items tagged

Released in August, the U.S. Department of Education study mapping state proficiency standards onto the National Assessment of Educational Progress scales produced a remarkable statement from Joanne Weiss, the chief of staff to U.S. Secretary of Education Arne Duncan. According to an article in the Aug. 24 issue of Education Week, Weiss said the practice of permitting each state to set its own proficiency standards amounts to "lying to parents, lying to children, lying to teachers and principals about the work they're doing." Her intemperate outburst crosses the line, not only by the standards of what passes for civil discourse in Washington these days, but also for what it says about the assessment itself. Indeed, a plausible case can be made that when it comes to telling fibs about proficiency, NAEP has a nose that annually grows longer, for its definition of proficiency is seriously flawed.

Here's what the newly released scores for the 2011 administration of the National Assessment of Educational Progress show for fourth and eighth graders in reading and math, on a 500-point scale

Matthew DiCarlo, senior fellow of the Albert Shanker Institute, hit the nail on the head Monday. He predicted that no matter how students performed on the National Assessment of Educational Progress, the results would be proof positive for reform agendas. Sure enough, New York Education Commissioner John King Jr. released a statement: "The NAEP results for New York students are disappointing and unacceptable. New York needs change."

With the release of the NAEP TUDA stats, there's been a lot of conversation swirling around achievement gaps and the efficacy of neo-liberal education reforms in urban districts. In particular, there's been some talk about how to judge Michelle Rhee's legacy, especially in light of the fact that that DC has the largest achievement gap between black and white students and one of the highest between poor and non-poor of all the cities featured in the report. Education journalists such as Alexander Russo weighed in here and Dana Goldstein offered some mostly solid analysis here.

In response to my Nation piece on achievement gaps in Washington, D.C. district public schools, commenter E.B. wondered how things would look different if we measured student proficiency instead of raw NAEP scores. This is a great question, since proficiency--defined as "solid academic performance"--is the standard to which we should hold most children.

Despite ample evidence, we still fail to heed the lessons of what works in the world's top-performing school systems-an investment in teachers; a rich and robust curriculum; and wraparound services such as counseling, after-school programs and tutoring to counter factors outside the classroom, like poverty, that affect student performance.

Consider us optimists, but we think the high-stakes test movement has reached its apex and started its decline. It won't happen quickly given the powerful political forces aligned to promote the testing regime, but the test obsessed "accountability" package for education reform won't continue indefinitely. There are too many bad policies (NCLB, Race to the Top), bad performance reports (NAEP, CREDO, last week's Mathematica study), and corruption/cheating/score inflation scandals (ATL, DC, NY, and more). If you need hope, look back at how Diane Ravitch drove an intellectual stake into the heart of the education reform movement on the Daily Show. She asked the audience how they felt about tests. When the crowd booed, Jon Stewart complained that it couldn't be that simple. Tell that to Michelle Rhee now that her reforms have faced the scrutiny of the voting public (in the DC Mayoral race but again this past Tuesday). In a democracy, eventually, the people have their say.

Just when you thought we'd reached a consensus on the need to dramatically improve America's schools, a chorus is emerging to suggest all is well. First, a new book out from Harvard University Press, Is American Science In Decline? notes that "American high school students are … performing better in mathematics and science than in the past," helping explain why the authors' answer to the title question is "no." This comes on the heels of a USA Today op-ed last month urging us to "Quit Fretting: U.S. is Fine in Science Education." And why can the fretting end? Because, the pundits tell us, last year 65% of students had a "basic" grasp of science on the National Assessment of Educational Progress (NAEP), up from 63% in 2009. Their conclusion: "If it ain't broke, don't fix it."

A nice post from Mike Petrilli on the Florida NAEP score gains prompted a response from Kevin Welner from NEPC that shows that the spirit of Sutherland's Professor Dave Jennings is alive and well at the University of Colorado.

Variation and Change in State Standards for Reading and Mathematics, 2005-2009

I've already beaten the issue of the various flaws, misrepresentations and outright data abuse in the Third Way middle class report into the ground on this blog. And it's really about time for that to end. Time to move on. But here is one simple illustration which draws on the same NAEP data compiled and aggregated in the Middle Class report. For anyone reading this post who has not already read my others on the problems with the definition of "Middle Class," and related data abuse & misuse please start there

Recent analyses challenge common wisdom regarding the superiority of private schools relative to public schools, raising questions about the role of school processes and climate in shaping achievement in different types of schools. While holding demographic factors constant, this multilevel analysis of National Assessment of Educational Progress (NAEP) mathematics data on over 270,000 fourth and eighth graders in over 10,000 schools examines differences among schools on five critical factors: (1) school size, (2) class size, (3) school climate/parental involvement, (4) teacher certification, and (5) instructional practices. This study provides nationally representative evidence that both teacher certification and some reform-oriented mathematics teaching practices correlate positively with achievement and are more prevalent in public schools than in demographically similar private schools. Additionally, smaller class size, more prevalent in private schools, is significantly correlated with achievement.

In the latest issue of the New York Review of Books, Diane Ravitch, who has been writing critically and incisively for the last five years about the inadequacies of the "School Reform" movement, wrote a review of a book by Steven Brill called Class Warfare: Inside the Fight to Fix America's Schools (New York Review of Books, (9/29/2011) www.nybooks.com. ) The review itself convincingly dissects Brill's book for what it is: an advocacy for charter schools, standardized testing and other measures of the so-called "reformers" who are, essentially, defenders of the economic status quo. Since there has been no measurable improvement in student scores, as determined by reliable tests like the NAEP (National Assessment of Educational Progress) over the last decade, one would hope that some sensible policies might be considered to replace those failed ones. And there seem to be a few glimmers of hope, although they are only glimmers.

When reporting test scores, it's essential to understand whether the scores reflect changes in performance or changes in the tested population (see here and here for how this plays out with NAEP results). In this case, while I don't have enough data to know exactly what is going on with SAT scores, there's no doubt that the story is more complex than meets the eye.

"What they saw should chill the ardor of the most doctrinaire followers of Milton Friedman. Vouchers began in Milwaukee nearly 25 years ago based on the claim that they would save poor black children from "failing" public schools. Today, Milwaukee should be a national symbol of the failure of vouchers. Yet state after state is endorsing vouchers, egged on by the Friedman Foundation and rightwing think tanks. Let's be clear. Vouchers, charters, and choice have failed the children of Milwaukee. The city ranks near the bottom of all cities tested by the federal NAEP, barely ahead of Detroit. Black children in Milwaukee score behind their peers in most other cities and states. Study after study shows they don't get better test scores than their peers in public schools."

Mitt Romney is out on the campaign trail, pushing vouchers and charters and online learning and for-profit schools and larger class size as the answers to our "failing" public schools. I wish someone would give him some actual facts to work with. Are our schools failing? No, they are  not.

Focusing on NJ's student achievement gaps misses the broader -- and better -- picture

How to improve our schools? Let's start with what we know: Teachers are the most important factor in a child's schooling, and many of our teachers are not very good. But wait a moment. How do we know that? Given the current fascination with education policies that focus on teachers - typically market-oriented policies such as pink slips for bad teachers and bonuses for good ones - it would be wise to make certain that teachers are the problem we think they are.