Skip to main content

Home/ MVIFI Mount Vernon Institute for Innovation/ Group items tagged assessment research

Rss Feed Group items tagged

Meghan Cureton

transforming_teaching_learning_and_assessment.pdf - 1 views

  • T o make space for learner voice and to promote learner agency, teachers must set up learning environments that stimulate active learner engagement with meaningful and progressively challenging tasks that stimulate their thinking and enable them to develop competence over time. Unlike subject content, competence cannot be transmitted to learners. Rather, competence is progressively developed by learners through appropriate facilitation.
  • Table 1. The Role of Learners in Competence-Based Curricula
  • A “growth mindset” (Dweck, 2006). essential for developing intrinsic motivation.
  • ...15 more annotations...
  • Deep learning
  • The extent of emotional, cognitive, and behavioral engagement influences the effectiveness of learning, and thus, the development of competence.
  • These modes of learning blur boundaries between teachers and learners, as learners progressively take responsibility for their own learning.
  • Success also rests on profound teacher understanding of curricula that should accrue during curriculum design and development stages. Such understanding is crucial for the teachers’ buy-in, conviction, ownership, and commitment to effective curricula implementation.
  • Within the curriculum continuum, assessment has significant potential to support and reinforce curriculum reform. However, it equally has enormous potential to distort the official/intended curriculum.
  • When appropriate strategies are used in assessment, they can support the implementation of the official curriculum, enhance learning, and lead to an enrichment effect. However, gaining these benefits of appropriate assessment demands a specialized knowledge of assessment by all concerned.
  • Another critical policy message is that competence-based assessment and examinations systems require significant investment in the professionalization of teachers as assessors of learning. Competence-based assessments also require trust in teachers’ ability to make reliable judgements and to utilize assessment as an inherent and important part of teaching and learning.
  • A key policy message is that education and learning systems cannot succeed at adopting competence-based approaches to curriculum without similarly transforming teaching, learning, as well as assessment and examination systems. All the three elements must be aligned. Transforming curricula to competence-based approaches and leaving teaching, learning, assessment, tests, and examinations subject-based is tantamount to not transforming curricula.
  • In competence-based approaches, teachers are not just co-designers and co-developers of curricula. They are also pivotal co-assessors, co-testers, and co-examiners.
  • Most importantly, competence-based curricula must lead quality assessment rather than be led by poor practice assessments, tests, and examinations.
  • What "developmental progression" means, in general terms, and an understanding that progressing is neither linear nor necessarily agerelated. Rather, it is iterative, interactive, and dependent on making connections to prior learning and to context;
  • it is best to base judgements on a number of different criterion referenced assessments.
  • Effective teacher professional development must include all 4 componen ts: • Knowledge – worthwhile research-informed theory, content, and expertise; • Integrated pedagogical and assessment skills and strategies; • Modelling, demonstrating, and engaging with approaches, ideally in settings that approximate to the workplace; • Practicing the approaches frequently over a substantial period of time between professional inputs; (2–6 months a minimum) with ongoing and follow up evaluation of impact and refinement; • Concurrent dialogue/coaching/peer collaboration in activities such as lesson planning, preparing related resources, peer observation, discussion, and reflection on impact
  • Table 4. Success of different methods of professional development Training Components Outcomes % of participants who demonstrate Kno wledge % of participants who demonstrate new Skills % of participants who transfer into Classroom Practice Theoretical Knowledge and Discussion 10%5%0% Demonstration in Training 30%20%0% Practice and Feedback in Training 60%60%5% Coaching in Classroom Settings 95%95%95%
  • Teaching still lacks core characteristics that define a profession, vis: (i) a profession-specific, systematized, scientific body of knowledge that informs the daily activities of practitioners; (ii) a lengthy period of higher education training and induction; (iii) engagement in continuous professional development; and (iv) autonomy to exercise professional judgement and decision-making in practice and in governance over the profession
Meghan Cureton

Do historians miss the ideals of assessment, as some have suggested? - 1 views

  • Grading Smarter, Not Harder
  • Their recent finding that many students don’t learn critical thinking in undergraduate history courses -- a challenge to history’s sales pitch that its graduates are finely tuned critical thinkers.
  • A panel of professors here urged a sizable crowd of colleagues to embrace not just grades but formative, ongoing assessment to gauge student learning or lack thereof in real(er) time.
  • ...7 more annotations...
  • LASER, an acronym for Love history, Acquire and analyze information, Solve difficult problems, Envision new explanations, and Reveal what you know. Sourcing work, which Calder called a “threshold concept” in history, means asking students to evaluate the reliability of various historical texts. Who made it? When? Why? What value does it hold for historians, if any?
  • letter grades “do little to differentiate the level of student effort or the quality of student work or student growth over the course of a semester or program,”
  • to the idea of “transparency,” which they all agreed begins with articulating clear student learning goals -- for themselves and their classes.
  • Whatever the activity or assessment, Mintz said it needs to be aligned with a particular learning objective. Research suggests that the most effective activities and assessments when it comes to student learning are considered “authentic,” or those that mirror professional practice and address some meaningful question,
  • Project and performance-based assessments are much more likely to provide a “valid measure of student proficiencies and higher-order thinking skills than are multiple choice or short-answer questions,” Mintz continued. And evaluation needs to be based on a detailed rubric, he said, suggesting that students may help create these rubrics.
  • But “a paradigm shift is occurring in higher education,” Mintz said. “We all know this. We’re sifting from teaching to learning, shifting from a sink-or-swim mentality to a mentality where we have obligation to bring all students to minimum viable level of competency.” That is regardless of institution type, he said.
  • think of themselves as "learning architects" whose meaningful "forward-looking" assessment will be a "true learning opportunity" for students.
  •  
    HT @cmtbasecamp
Meghan Cureton

The Case Against Grades (##) - Alfie Kohn - 2 views

  • Collecting information doesn’t require tests, and sharing that information doesn’t require grades.  In fact, students would be a lot better off without either of these relics from a less enlightened age.
  • As I’ve reported elsewhere (Kohn, 1999a, 1999b, 1999c), when students from elementary school to college who are led to focus on grades are compared with those who aren’t, the results support three robust conclusions:
  • Grades tend to diminish students’ interest in whatever they’re learning.
  • ...20 more annotations...
  • Grades create a preference for the easiest possible task.
  • Grades tend to reduce the quality of students’ thinking. 
  • For example, a grade-oriented environment is associated with increased levels of cheating (Anderman and Murdock, 2007), grades (whether or not accompanied by comments) promote a fear of failure even in high-achieving students (Pulfrey et al., 2011), and the elimination of grades (in favor of a pass/fail system) produces substantial benefits with no apparent disadvantages in medical school (White and Fantone, 2010).
  • Extrinsic motivation, which includes a desire to get better grades, is not only different from, but often undermines, intrinsic motivation, a desire to learn for its own sake (Kohn 1999a). 
  • Achievement:  Two educational psychologists pointed out that “an overemphasis on assessment can actually undermine the pursuit of excellence” (Maehr and Midgley, 1996, p. 7). 
  • There is certainly value in assessing the quality of learning and teaching, but that doesn’t mean it’s always necessary, or even possible, to measure those things — that is, to turn them into numbers.  Indeed, “measurable outcomes may be the least significant results of learning” (McNeil, 1986, p. xviii)
  • It’s not enough to replace letters or numbers with labels (“exceeds expectations,” “meets expectations,” and so on).  If you’re sorting students into four or five piles, you’re still grading them.  Rubrics typically include numbers as well as labels, which is only one of several reasons they merit our skepticism (Wilson, 2006; Kohn, 2006).
  • Portfolios, for example, can be constructive if they replace grades rather than being used to yield them.  They offer a way to thoughtfully gather a variety of meaningful examples of learning for the students to review.  But what’s the point, “if instruction is dominated by worksheets so that every portfolio looks the same”? (Neill et al. 1995, p. 4).
  • Once we’re compelled to focus only on what can be reduced to numbers, such as how many grammatical errors are present in a composition or how many mathematical algorithms have been committed to memory, thinking has been severely compromised.  And that is exactly what happens when we try to fit learning into a four- or five- or (heaven help us) 100-point scale.
  • It’s not enough to disseminate grades more efficiently — for example, by posting them on-line.  There is a growing technology, as the late Gerald Bracey once remarked, “that permits us to do in nanoseconds things that we shouldn’t be doing at all” (quoted in Mathews, 2006).  In fact, posting grades on-line is a significant step backward because it enhances the salience of those grades and therefore their destructive effects on learning.
  • It’s not enough to add narrative reports.  “When comments and grades coexist, the comments are written to justify the grade” (Wilson, 2009, p. 60).  Teachers report that students, for their part, often just turn to the grade and ignore the comment, but “when there’s only a comment, they read it,”
  • It’s not enough to use “standards-based” grading.
  • Sometimes it’s only after grading has ended that we realize just how harmful it’s been.
  • To address one common fear, the graduates of grade-free high schools are indeed accepted by selective private colleges and large public universities — on the basis of narrative reports and detailed descriptions of the curriculum (as well as recommendations, essays, and interviews), which collectively offer a fuller picture of the applicant than does a grade-point average.  Moreover, these schools point out that their students are often more motivated and proficient learners, thus better prepared for college, than their counterparts at traditional schools who have been preoccupied with grades.
  • Even when administrators aren’t ready to abandon traditional report cards, individual teachers can help to rescue learning in their own classrooms with a two-pronged strategy to “neuter grades,” as one teacher described it.  First, they can stop putting letter or number grades on individual assignments and instead offer only qualitative feedback.
  • Second, although teachers may be required to submit a final grade, there’s no requirement for them to decide unilaterally what that grade will be.  Thus, students can be invited to participate in that process either as a negotiation (such that the teacher has the final say) or by simply permitting students to grade themselves.
  • Without grades, “I think my relationships with students are better,” Drier says.  “Their writing improves more quickly and the things they learn stay with them longer.
  • Drier’s final grades are based on students’ written self-assessments, which, in turn, are based on their review of items in their portfolios. 
  • A key element of authentic assessment for these and other teachers is the opportunity for students to help design the assessment and reflect on its purposes — individually and as a class. 
  • Grades don’t prepare children for the “real world” — unless one has in mind a world where interest in learning and quality of thinking are unimportant.  Nor are grades a necessary part of schooling, any more than paddling or taking extended dictation could be described that way.  Still, it takes courage to do right by kids in an era when the quantitative matters more than the qualitative, when meeting (someone else’s) standards counts for more than exploring ideas, and when anything “rigorous” is automatically assumed to be valuable.  We have to be willing to challenge the conventional wisdom, which in this case means asking not how to improve grades but how to jettison them once and for all.
  •  
    HT @tedwards
Meghan Cureton

Why I Don't Grade | Jesse Stommel - 2 views

  • grades are the biggest and most insidious obstacle to education.
  • Agency, dialogue, self-actualization, and social justice are not possible in a hierarchical system that pits teachers against students and encourages competition by ranking students against one another.
  • Certainly, metacognition, and the ability to self-assess, must be developed, but I see it as one of the most important skills we can teach in any educational environment.
  • ...9 more annotations...
  • You should consider this course a “busy-work-free zone.” If an assignment does not feel productive, we can find ways to modify, remix, or repurpose the instructions.
  • I find it strange that teachers and institutions would pre-determine outcomes before students even arrive upon the scene.
  • As educators, we have helped build (or are complicit in) a system that creates a great deal of pressure around grades. We shouldn't blame (or worse, degrade) students for the failures of that system.
  • Authentic feedback (and evaluation) means honoring subjectivity and requires that we show up as our full selves, both teachers and learners, to the work of education. Grades can't be “normed” if we recognize the complexity of learners and learning contexts. Bias can't be accounted for unless we acknowledge it.
  • Because I put myself outside of the grading loop, I can focus all my efforts on feedback and encouragement — on teaching, not grading.” Which leads me to wonder whether “graded participation” is actually an oxymoron. We can't participate authentically, can't dialogue, without first disrupting the power dynamics of grading.
  • “Research shows three reliable effects when students are graded: They tend to think less deeply, avoid taking risks, and lose interest in the learning itself.”
  • “There is an extreme mismatch between what we value and how we count.”
  • a mixture of things assessed and a mixture of kinds of assessment, because the work of being a doctor (or engineer, sociologist, teacher, etc.) is sufficiently complex that any one system of measurement or indicator of supposed mastery will necessarily fail.
  • “When the how’s of assessment preoccupy us, they tend to chase the why’s back into the shadows.” Grades are not something we should have ever allowed to be naturalized. Assessment should be, by its nature, an open question.
Meghan Cureton

Six Fixes for Proficiency-Based Learning « Competency Works - 0 views

  • Proficiency-based learning, at its core, is about redesigning the learning and teaching system of America. Instead of basing learning on how much time a student spends, it bases learning on what students can demonstrate—exactly the same as every other system students will encounter in the world outside of school.
  • In addition, schools should continue to share information pertaining to course grades and start to share information regarding student attainment of specific standards, including course-crossing skills such as problem solving, creativity, and analysis. While we would recommend that the course grades continue to use A-F or 0-100 scales, shifting to a 1-4 scale on the standards probably provides better insight for everyone involved. In this way, parents, students, and educators will know how students are doing within the structures of a class and how students are doing in regard to specific standards. This both/and approach will provide more information that can then be used to promote better learning.
  • Keep cohorts of kids together as they progress through their learning. Teachers can vary the learning strategies for various cohorts of students, supporting some students to dig deeper into various standards while others realize initial achievement—and then bringing everyone back together again to start the next unit of learning. Further, as research on learning has demonstrated, learning is a social endeavor, not meant to be undertaken alone. A cohort model supports this research.
  • ...3 more annotations...
  • Hold students accountable to key and important standards, designating a small handful of “graduation standards” while using the other standards in the Common Core or various state standards to develop curriculum, guide instruction, and build classroom assessments. This strategy focuses learning on key and endurable concepts, skills, and themes; ensures that instructional support is targeted at the most important learning; and pushes students to think about and analyze ideas deeply rather than memorize an unwieldly number of discrete facts.
  • Educators need to clearly define top levels of performance and provide explicit expectations and opportunities for students to achieve these levels of learning. While we should not expect students to “exceed” standards in all cases, educators should require students to do so in areas of particular interest and aptitude for students.
  • Schools must establish both incentives and consequences for critical work habits such as time management and meeting deadlines. Rather than ignore these, they must teach, model, assess, and report them separately and eliminate the practice of controlling behavior by reducing grades. We have seen numerous effective strategies where late work requires coming in after school, not attending co-curricular activities, or mandatory guided study halls, to name a few examples.
Meghan Cureton

NAIS - One School's Approach to Equitable Grading - 1 views

  • a student’s grade could be more reflective of the teacher’s approach to grading than the student’s academic performance.
  • because many of the teachers’ grading practices rewarded or punished students for every assignment, activity, and behavior in the classroom, students often were less willing to take risks and make mistakes, and cared less about learning
  • But Previna didn’t blame the teachers. After all, none of them—herself included—had ever received any training or support with how to grade
  • ...9 more annotations...
  • She started by sharing a few articles about the weaknesses of common grading practices with the entire middle school faculty
  • Then she invited all faculty to research, examine, and imagine ways to align grading to their vision for progressive and equitable education
  • first learned how many common grading practices were created during the Industrial Revolution and are based on century-old beliefs about teaching, learning, and human potential that have long since been debunked. By continuing to use these practices, we contradict our current understanding about effective teaching and learning
  • After studying the research about grading and learning about research-supported grading practices that are more accurate, more bias-resistant, and develop intrinsic motivation in students, the pilot group of middle school faculty members was excited to start using them. These more equitable practices included using alternatives to the 0–100 scale, not including behavior in the grade, ending extra credit, using rubrics, and developing a culture of retakes and redos
  • Students were less stressed, and classroom environments felt more relaxed and supportive of learning.
  • Grade inflation decreased
  • Grades are more accurate and less biased
  • Students’ motivation increased
  • Changes to grading practices leverage other aspects of programmatic reimagining
Jim Tiffin Jr

Feedback In Lieu of Grades - LiveBinder HT @JoyKirr - 0 views

  •  
    Joy Kirr's incredible collection of inquiry/research around feedback as a replacement for grades.
Bo Adams

Inside the School Silicon Valley Thinks Will Save Education | WIRED - 0 views

  • But what are they betting on? AltSchool is a decidedly Bay Area experiment with an educational philosophy known as student-centered learning. The approach, which many schools have adopted, holds that kids should pursue their own interests, at their own pace. To that, however, AltSchool mixes in loads of technology to manage the chaos, and tops it all off with a staff of forward-thinking teachers set free to custom-teach to each student. The result, they fervently say, is a superior educational experience.
  • heir own weekly “playlists,” queues of individual and group activities tailored to the specific strengths and weaknesses of each kid.
  • This puts AltSchool at the intersection of two rapidly growing movements in education. Along one axis are the dozens of edtech startups building apps for schools; along the other are the dozens of progressive schools rallying around the increasingly popular concept of personalized education. The difference is: AltSchool is not just building apps or building schools. It’s doing both. In that way, AltSchools are more than just schools. They’re mini-research and development labs, where both teachers and engineers are diligently developing the formula for a 21st century education, all in hopes of applying that formula not only to other AltSchools, but to private, public, and charter schools across the country.
  • ...6 more annotations...
  • obsession with constant feedback
  • Ventilla likes to call AltSchool’s approach to teaching “Montessori 2.0.” The Montessori method emphasizes letting kids learn primarily through independent projects rather than direct instruction.
  • AltSchool has built a digital platform, called My.Altschool
  • “We think assessment can be much less invasive and much more accurate when you’re collecting data from many sources.”
  • The team is also working on a recommendation engine for teachers, not unlike those used by companies like Amazon and Netflix. This tool would take into account everything that My.Altschool knows about a student—from her playlist history to how she learns best to what her strengths and weaknesses are—to recommend activities. “It’d be great if the system could figure out that Johnny’s an auditory learner, who loves castles, and that he’s struggling with estimating,” Bhatia says, adding that an early version of that tool will likely be available this year.
  • Once these tools have been validated within the AltSchool environment, Ventilla’s goal is to bundle them up into what he calls an “operating system for a 21st century education” and license them to the education system at large.
  •  
    HT @MikeyCanup
Meghan Cureton

Learning's Not a River - Dan Cristiani - Medium - 0 views

  • the word ‘course’ is related to the running of a river
  • Its hallmarks include rapidity, unidirectionality, linearity, and dependency.
  • when a student takes a course, she is being led at pace down a narrow path in one direction.
  • ...9 more annotations...
  • The overwhelming bulk of our personal growth happens in open environments, without constraints or schedules, and often without guidance.
  • Scholarly research on implicit learning and anecdotal studies of self-taught experts (musicians, chefs, athletes, and more) speak to the power of unstructured study.
  • In truth, courses are not how we organize learning; they are how we organize assessment.
  • what are the alternatives?
  • Perhaps schools would do well to offer up learning experiences rather than formalized courses in all grades
  • Schools can honor learning opportunities that exist outside of traditional coursework.
  • Schools can look for ways to decouple reporting on student performance from arbitrary time frames.
  • how can we create space for students who need more time to consolidate their learning, to master a curriculum or set of skills?
  • Administration and faculty should be willing to acknowledge that courses offer venues for intellectual and personal growth but do not have a monopoly on it.
Bo Adams

NAIS - One School's Conversation About Open Gradebook - 1 views

  • The critical difference is that at Harpeth Hall, and most likely any all-girls school, we know a student’s numeric average at any given moment will never provide the whole picture of her educational journey
  • At this time, we can find no research showing that open gradebooks have improved students’ grades or helped teachers know their students better.
  • The current system, while technically old-fashioned, preserves the teacher-student relationship and still allows students to have ownership.
  • ...1 more annotation...
  • In order to address this confidence gap, we have identified several primary inhibitors we see in our students. Three of these five inhibitors could be exacerbated by an open gradebook.
Bo Adams

Inverse Relationship Between GPA and Innovative Orientation - 0 views

  • “I think academic environments are artificial environments.
  • People who succeed there are sort of finely trained, they’re conditioned to succeed in that environment.
  • You want people who like figuring out stuff where there is no obvious answer.
  • ...3 more annotations...
  • the more experience Google has with hiring, the more inclined they are to hire people with no college at all
  • Increasingly, controlled research studies are also showing no correlation, or even an inverse correlation, between college GPA and innovative orientation or ability.
  • Ironically and tragically, rather than adapt our educational system to the needs of our modern times we have doubled down on the old system, so it is harder today than ever before for young people to retain and build upon their natural curiosity and creativity
Bo Adams

The Monthly Recharge - Risk Over Safety - 0 views

  • The learning classroom is active, collaborative, and full of real, thoughtful, academic-discipline-informed discussion with students working together to solve challenging problems
  • But when the teachers see it, really get it, there is no going back. It is what they are after for their students and classes: problem-based, project-based, inquiry-based, discussion-based-all student-centered deep learning.
  • And to pursue learning for their students, teachers must be pedagogical scientists. Every day, in every class, teachers must conduct research and experiments into the most compelling learning experiences for their students. In these experiments is unavoidably innovation.
  • ...1 more annotation...
  • We can support teacherly innovation/experimentation a host of ways: Establish it as an expectation in posts for jobs and at the time of hiring new teachers. Discuss it in teacher evaluations and self-assessments. Feature examples of it in faculty meetings. Provide innovation grants for summer design work. Give time to teachers (through course loads, class enrollments, course reductions, and even sabbaticals) for innovation work.
1 - 12 of 12
Showing 20 items per page