Group items tagged

Interest in Student Growth Modeling (SGM) and Value Added Modeling (VAM) arises from educators concerned with measuring the effectiveness of teaching and other school activities through changes in student performance as a companion and perhaps even an alternative to status. Several formal statistical models have been proposed for year-to-year growth and these fall into at least three clusters: simple change (e.g., differences on a vertical scale), residualized change (e.g., simple linear or quantile regression techniques), and value tables  (varying salience of different achievement level outcomes across two years). Several of these methods have been implemented by states and districts.  This paper reviews relevant literature and reports results of a data-based comparison of six basic SGM models that may permit aggregating across teachers or schools to provide evaluative information.  Our investigation raises some issues that may compromise current efforts to implement VAM in teacher and school evaluations and makes suggestions for both practice and research based on the results.

Public education is by necessity an extension of our political system, resulting in schools being reduced to vehicles for implementing political mandates. For example, during the past thirty years, education has become federalized through indirect ("A Nation at Risk" spurring state-based accountability systems) and direct (No Child Left Behind and Race to the Top) dynamics. As government policy and practice, bureaucracy is unavoidable, but the central flaw with the need for structure and hierarchy is that politics prefers leadership characteristics above expertise. No politician can possibly have the expertise and experience needed in all the many areas a leader must address (notably in roles such as governor and president). But during the accountability era in education over the past three decade, the direct role of governors and presidents related to education has increased dramatically-often with education as a central plank in the campaigns and administrations of governors and presidents. One distinct flaw in that development has been a trickle-down effect reaching from presidents and governors to state superintendents of education as well as school board chairs and members: People attaining leadership positions that form and implement education policy have no or very little experience or expertise as educators or scholars.

The final drafts of the Common Core State Standards were released a year and a half ago-almost to the day. Anyone who's read the Race to the Top applications or the ESEA waivers knows that state departments of education have begun to put together statewide CCSS implementation plans. Some states are working to revise curricula. Others are adjusting current assessment blueprints to reflect CCSS priorities. And all are thinking about the changes that they will need to make to professional development and training in the coming months to make this sea change in standards work for kids.

It's fair to say that improved teacher evaluation is the cornerstone of most current education reform efforts. Although very few people have disagreed on the need to design and implement new evaluation systems, there has been a great deal of disagreement over how best to do so - specifically with regard to the incorporation of test-based measures of teacher productivity (i.e., value-added and other growth model estimates). The use of these measures has become a polarizing issue. Opponents tend to adamantly object to any degree of incorporation, while many proponents do not consider new evaluations meaningful unless they include test-based measures as a major element (say, at least 40-50 percent). Despite the air of certainty on both sides, this debate has mostly been proceeding based on speculation. The new evaluations are just getting up and running, and there is virtually no evidence as to their effects under actual high-stakes implementation.

District Awards for Teacher Excellence (D.A.T.E.) is a state-funded program in Texas that provides grants to districts for the implementation of locally-designed incentive pay plans. All districts in the state are eligible to receive grants, but participation is voluntary. D.A.T.E. incentive pay plans were first implemented in Texas districts during the 2008-09 school year, and the program is currently in its third year of operation during 2010-11 with approximately $197 million in annual state funding. 

The New York State Education Department (NYSED) is committed to providing district leaders support as they implement Student Learning Objectives (SLOs). Beginning in mid-December 2011 and running through the end of February 2012, NYSED will host a series of introductory webinars. Each webinar will introduce components of the SLO process that will help district leaders to communicate and begin the implementation process with stakeholders. The first webinar provides viewers with the following information: - the background and basics of SLOs; - the relationship between SLOs, the Common Core State Standards, Data Driven Instruction, evidence-based observations, and local measures of student achievement; and - the difference between the state/district/school/teacher's role within the SLO process.

Deborah Gist, Rhode Island's Commissioner of Elementary and Secondary Education, has implemented some major reforms since assuming her role in 2009. She has raised the score required to pass teacher-certification tests and allowed a superintendent to fire all of the teachers at a school that was resisting reforms. Perhaps most notably, she has overseen the implementation of a new teacher-evaluation system. The Hechinger Report recently interviewed Gist about her state's new approach to evaluating teachers.

Education policies cannot be successful if school districts are required to implement those policies in ineffective ways. While education policymakers passionately discuss the merits or flaws of big picture policy ideas, once policies actually make it into law few look back to see how the policies work in day-to-day practice. This is unfortunate, because overly burdensome or complicated administrative requirements can trip up policy goals.

"John King recently resigned as New York state's education commissioner after a tumultuous tenure in which he helped create and implement a controversial education evaluation system and rushed the implementation of the Common Core State Standards and aligned testing. (He is now going to work as a top assistant to U.S. Education Secretary Arne Duncan, who apparently thought the controversy that King created was just fine.)  That evaluation system, known as APPR, required that 20 percent of an educator's evaluation be based on student standardized test scores. Now, New York Schools Chancellor Merryl Tisch wants to make new changes. What are they and why would they take a flawed evaluation system from bad to worse? This post explains."

Efforts to revamp public education are increasingly focused on evaluating teachers using student test scores, but school districts nationwide are only beginning to deal with the practical challenges of implementing those changes.

New York State's educational community has come together in an unprecedented show of support for the broad education reforms detailed in the State's Race to the Top application.  Thanks to the leadership of the Governor, the State legislature, and the Board of Regents, New York State passed new legislation in May 2010 that will usher in a new era of educational excellence in the State and ensure that we are able to fully execute the innovative, coherent reform agenda outlined in our Race to the Top application. The new laws: (1) establish a new teacher and principal evaluation system that makes student achievement data a substantial component of how educators are assessed and supported; (2) raise our charter school cap from 200 to 460; (3) enable school districts to enter contracts with Educational Partnership Organizations for the management of their persistently lowest‐achieving schools and schools under registration review; and (4) appropriate more than $20 million to the State Education Department to implement its P‐20 longitudinal data system.

"School closings, the threat of which hang over Chicago public schools, and which have been a central feature of Bloomberg educational policies in New York, are perhaps the most controversial features of the Obama administration's "Race to the Top" initiative. The idea of closing low-performing schools, designated as such entirely on the basis of student test scores, removing half of their teaching staff and all of their administrators, and replacing them with a new (typically charter) school in the same building, is one which has tremendous appeal among business leaders and almost none among educators. Advocates see this policy as a way of removing ineffective teachers, adding competition to what had been a stagnant sphere of public service, and putting pressure on teachers in high-poverty areas to demand and get high performance from their students, once again based on performance on standardized tests. For a "data driven" initiative, school closings have produced surprisingly little data to support their implementation."

"Carol Burris, principal of South Side High School in Rockville Center, New York, explains her concerns about the Common Core. She previously wrote a book about how to implement the standards and now wishes she could retract it."

"Some see us as education's odd couple-one, the president of a democratic teachers' union; the other, a director at the world's largest philanthropy. While we don't agree on everything, we firmly believe that students have a right to effective instruction and that teachers want to do their very best. We believe that one of the most effective ways to strengthen both teaching and learning is to put in place evaluation systems that are not just a stamp of approval or disapproval but a means of improvement. We also agree that in too many places, teacher evaluation procedures are broken-unconstructive, superficial, or otherwise inadequate. And so, for the past four years, we have worked together to help states and districts implement effective teacher development and evaluation systems carefully designed to improve teacher practice and, ultimately, student learning."

"A big part of successful policy making is unyielding attention to detail (an argument that regular readers of this blog hear often). Choices about design and implementation that may seem unimportant can play a substantial role in determining how policies play out in practice. A new paper, co-authored by Elizabeth Davidson, Randall Reback, Jonah Rockoff and Heather Schwartz, and presented at last month's annual conference of The Association for Education Finance and Policy, illustrates this principle vividly, and on a grand scale: With an analysis of outcomes in all 50 states during the early years of NCLB."

"Today institutions of higher education, public and private, remain largely segregated by race, religion and economic condition. White colleges and universities remain primarily white, Black institutions remain primarily black, and denominational institutions remain even more religiously identifiable. Such segregation is sanctified with tons of federal and state money in the forms of tuition vouchers, tax credits and government subsidized loans. The Obama administration has been largely foreclosed from remedying the situation for fear of offending powerful political forces representing the investors and private institutions. The higher education voucher/loan dilemma portends a probable scenario for the future of tuition vouchers and charter schools at the primary and secondary levels. Stiglitz quotes Alexis de Tocqueville who said that the main element of the "peculiar genius of American society" is "self-interest properly understood." The last two words, "properly understood," are the key, says Stiglitz. According to Stiglitz, everyone possesses self-interest in the "narrow sense." This "narrow sense" with regard to educational choice is usually exercised for reasons other than educational quality, the chief reasons being race, religion, economic and social status, and similarity with persons with comparable information, biases and prejudices. But Stiglitz interprets Tocqueville's "properly understood" to mean a much broader and more desirable and moral objective, that of "appreciating" and paying attention to everyone else's self-interest. In other words, the common welfare is, in fact, "a precondition for one's own ultimate well being."17 Such commonality in the advancement of the public good is lost by the narrow self-interest. School tuition vouchers and charter schools are the operational models for implementation of the "narrow self-interest." It is easy to recognize, but difficult to justify. "

In public policy circles, crises are called "focusing events" - bringing to light a particular failing in government policy.  They require government agencies to switch rapidly into crisis mode to implement solutions. Creating the crisis itself is more novel. The right-wing, free market vision of University of Chicago economist Milton Friedman informed the blueprint for the rapid privatization of municipal services throughout the world due in no small part to what author Naomi Klein calls "Disaster Capitalism." Friedman wrote in his 1982 treatise Capitalism and Freedom, "When [a] crisis occurs, the actions that are taken depend on the ideas that are lying around" In Klein's book The Shock Doctrine, she explains how immediately after Hurricane Katrina, Friedman used the decimation of New Orleans' infrastructure to push for charter schools, a market-based policy preference of Friedman acolytes. Secretary of Education Arne Duncan was the CEO of Chicago Public Schools at the time, and later described Hurricane Katrina as "the best thing that happened to the education system in New Orleans." Duncan is of the liberal wing of the free market project and a major supporter of charter schools. There aren't any hurricanes in the Midwest, so how can proponents of privatization like Mayor Rahm Emanuel sell off schools to the highest bidder? They create a crisis.

Yesterday, the NY State Assembly Education Committee held a rare hearing in NYC on the state and city's implementation of the federal School Improvement Grant (SIG) program, the so-called "turnaround" schools, and how the entire program is in complete disarray.    The big news is that the city is determined to go ahead with turnaround model for 26 Persistently Low Achieving schools even if they receive any of the federal funds to do so. Turnaround  is an euphemism for closing these schools, firing much of the staff and reopening them in the fall with new names  There is massive confusion and no public input about the plans for these schools, and yet the city seems determined to close and reconstitute them, like lemmings going over a cliff, even at the city's taxpayers' expense.  Why?  Because they can. See Two Years In, Federal Grant Program To Improve Struggling City Schools Has Derailed (NY1); Plans to Close 26 Schools Will Proceed Regardless of Financing, City Says (Schoolbook) and Chancellor: Plan to Close, Reopen Schools Was Not Act of 'Revenge' (WNYC) and Walcott: Turnaround will happen even without federal funding (GothamSchools).  My testimony is here on how many these schools and their students have been systematically disadvantaged by overcrowding and extremely large class sizes; with no plans by the city or the state to do anything to address these deplorable conditions.

First, it should be noted that researchers are almost unanimous in their caution about this subject. There are inherent difficulties in the accurate assessment of very young children's learning in the fields of language, cognition, socio-emotional development, and even physical development. Young children's attention spans tend to be short and there are wide, natural variations in children's performance in any given domain and on any given day. Thus, great care is advised for both the design and implementation of such assessments (see here, here, and here for examples). The question of if and how to use these student assessments to determine program or staff effectiveness is even more difficult and controversial (for instance, here and here). Nevertheless, many states are already using various forms of assessment to oversee their preschool investments.

If your child's teacher seems a little bit on edge this year, it might not be your imagination. Education reforms now going into effect in Indiana, and similar ones sweeping the nation, are targeting something many Americans consider to be strictly off-limits: their paychecks. The laws passed in 2011 and being implemented over the next two or three years were partly based on the principle of merit pay. Under Indiana's new law, the state will ask that test performance of students be factored into pay raises for the first time. That is a major shift away from the rigid pay tables in most school districts that awarded raises primarily based on a teacher's years of experience and the academic degrees they earned.