Skip to main content

Home/ OLLIE Iowa/ Group items tagged Constitution

Rss Feed Group items tagged

Evan Abbey

ollie-afe-2020: Educational Leadership: The Quest for Quality--article - 7 views

  • The assessor must begin with a clear picture of why he or she is conducting the assessment.
    • bhauswirth
       
      I feel like sometimes we get caught up on we have to assess our students on all topics. One nice thing about mastery in certain topics is with math, math concepts keep coming up in chapter 1 then in chapter 3.
  • The assessor needs to have a clear picture of what achievement he or she intends to measure.
    • bhauswirth
       
      This also goes with the why am I assessing on this.
    • jnewmanfd
       
      I'm not sure that this works for science classes. In these classes, students are to be figuring out. They are not supposed to know what they are learning about until they have discovered it. I thinking that making the assessment clear at the beginning would ruin this. Now I will say that you could be clear on how students will be assessed. For example, you will have to support your claims using reasoning and evidence.
    • jessed44
       
      I often wonder where this argument fits with discovery learning, and other forms of self-directed methods. Are we constraining ourselves too much here?
  • "I can make good inferences.
  • ...51 more annotations...
  • "I can make good inferences.
    • bhauswirth
       
      Student-friendly language has been a huge part of our school district. Especially when dealing with many ELL and Sp.Ed students. Also, referring to the learning target multiple times throughout the lesson. One thing I could do in my class is to put the learning target on my quizzes.
    • nkrager
       
      I could also do this more/better. It does get challenging when you teach multiple classes if you want them posted on your board etc.
    • kshadlow
       
      I agree. I started adding hyperlinks to vocabulary.com for any words I thought they might struggle with.
  • identify struggling students and the areas in which they struggle.
    • bhauswirth
       
      This is a huge part for me in my teaching. I use our three question quizzes to allow myself to better understand misconceptions that I have over seen and to see what I need to do to better my students.
    • ravelinga
       
      Agree! In my economics class I do periodic checkpoint quizzes. These formative assessments have two purposes. One to check how well my students are understanding the content. And secondly, how well am I teaching the material. Sometimes the students are not getting the content, because my teaching was ineffective.
  • As a "big picture" beginning point in planning for the use of multiple measures, assessors need to consider each assessment level in light of four key questions, along with their formative and summative applications1 :
    • bhauswirth
       
      These four points are things that we do everyday. Understanding what I need to do for students, understanding what the information will tell me and where do I go next.
  • But NCLB has exposed students to an unprecedented overflow of testing.
    • Val Rosenthal
       
      too many tests; students get anxiety when taking a test
    • Evan Abbey
       
      I agree! Testing not only causes anxiety, but it can give students the wrong impression of their abilities.
    • parkerv
       
      Unfortunately over testing takes away from quality instructional time and student learning. What's really sad but all too true is that we are seeing over testing being pushed down on even our youngest learners, our 3 and 4 year old preschoolers.
    • tkofoot
       
      The concern of all my Special Ed students is testing. I teach them test-taking strategies, but they get to a test and can't use them.
    • jessed44
       
      I don't think the act of retrieving information is bad, in fact, research says it is good. It is the importance and finality that is often attached to it that can be detrimental.
  • the use of multiple measures does not, by itself, translate into high-quality evidence.
    • Val Rosenthal
       
      more tests doesn't necessarily produce good results
  • Students learn best when they monitor and take responsibility for their own learning.
    • Val Rosenthal
       
      Education has to make this happen more. I'd like to find a good way for them to monitor their learning.
    • nkrager
       
      Yes, agreed! We know that this true but we need to help build this in our students. The internal motivation is hard to build!
    • leipoldc
       
      Taking responsibility is the key to learning. The best years to help students understand and take responsibility is middle school. They want to be in charge and they need support to do it well.
  • assessment-literate teachers
    • Val Rosenthal
       
      I really don't seem to have a good background on assessment and would like to be assessment-literate.
  • Clear Purpose
    • nkrager
       
      The purpose is so important! I feel like sometimes we test just to test...and then send the results off to someone else. The kids need to understand the purpose as internal motivation is not always there.
    • kshadlow
       
      So important! I think about myself and the hoops we need to jump through in our lives without understanding the purpose. That purpose definitely leads to motivation.
    • jhatcher
       
      The purpose has to be tied to helping the students discover information about himself. How to improve? What has been learned? Then move forward.
  • Teachers have choices in the assessment methods they use, including selected-response formats, extended written response, performance assessment, and personal communication. Selecting an assessment method that is incapable of reflecting the intended learning will compromise the accuracy of the results.
    • nkrager
       
      All teachers know that they have choice in the types of assessments to give students but I wonder if we all really think through what type we are giving every time. Do we just give what we did last year? Do we give what is easiest? The fastest to grade? Things to think about...
  • This key relates directly back to the purpose of the assessment.
    • nkrager
       
      Feedback can be challenging as we all know. I tend to get frustrated when I have taken the time to provide detailed feedback and the students could care less about it, they just want to know a grade and move on.
    • kshadlow
       
      so true...
  • From a formative point of view, decision makers at the classroom assessment level need evidence of where students are on the learning continuum toward each standard,
    • nkrager
       
      This would go along with students taking ownership for their own learning....we would WANT them to want to know where they are at for individual purposes!
    • ravelinga
       
      Most of my formative assessments have been multiple choice or short answer quizzes. After learning more about rubrics, I would like to start using rubrics in two ways for formative assessments. One the students will do a self assessment on where they feel they are at. Then a teacher to student-conference with the rubric to see where they are at. With the end goal of making the assessment portion less stressful for my students, because they know where they are at.
    • nkrager
       
      ^^^ Love this idea! I hope I can get there also with some projects!
    • jhatcher
       
      I was thinking the same thing about rubrics that you wrote here. Students would hopefully see themselves moving on the rubric as they improve their skills /learn. This should be motivating and students would know exactly what is expected.
  • not only are they limited in key formative uses, but they also cannot measure more complex learning targets at the heart of instruction.
    • nkrager
       
      which leads to frustration...
  • Given the rise in testing, especially in light of a heightened focus on using multiple measures
    • lwinter14
       
      Although I would say this is definitely still true in the courses we teach (we still emphasize bigger, summative assessments), I think we have changed how we view student progress. Our summative assessments aren't all tests, some of them are projects or performance assessments. Those assessments are also no longer considered "one-and-done" opportunities. Students can retake assessments or make corrections, etc. to show progress in their learning even if they didn't get it right the first time. It's less focused on the final grade and instead, assessing what students have learned.
    • jessed44
       
      This is great. However, when juxtaposed with having 200 students like I do, it is not always feasible to have numerous projects and reassessments. How do we change the change the way that teachers spend their day so this is possible?
  • the assessment formatively—as practice or to inform students about their own progress
    • lwinter14
       
      I find this distinction between summative and formative assessment interesting. In our freshman group of teachers, we have a category for both formative and summative assessment. Formative is weighted at 20% and summative is weighted at 80%. So although in my courses we were taught not to grade formatives, we still assign a score to it and put it into the gradebook. Also, if formatives weren't graded, I wonder how much of them would actually be completed by students?
    • ravelinga
       
      This has been a goal of mine this year, to use formative assessments to help make instructional decisions in my class. It has been a work in progress, but I have seen some success. I use the information from the formative assessment to decide is it a small group that needs reteaching or is it an entire class that needs reteaching. I don't normally grade my formative assessments, but I go give them completion points. For the most part if a student sees they are not getting something, they appreciate the reteaching opportunity.
    • parkerv
       
      Too often I see teachers not fully use the formative assessment data they have to intentionally inform instruction. If done properly formative assessment is very powerful. I also like the idea of giving participation points for formative assessments.
    • tkofoot
       
      Some teachers give 0% for formative assessments at my school. The Science department has figured out a way to have labs count as a way to assess a standard. I think practice is important and should have some weight.
  • it's important to know the learning targets represented in the written curriculum.
    • lwinter14
       
      My school has increased its emphasis on learning targets this year. We are all using a 5D+ template to write unit plans and the learning targets are similarly broken down into knowledge targets, academic targets (transferable skills), and performance targets. I think that writing unit plans and sitting down and thinking about the individual types of targets has really strengthened the types of instruction teachers are carrying out in their classrooms. They are more familiar with the targets they want students to meet, and in turn, students are also more familiar with what's expected of them.
    • kshadlow
       
      I like the specific targets here. I guess I have been generalizing them for awhile. My plans would be better defined for myself and students if I focused on them more.
    • jnewmanfd
       
      Our middle school is beginning this work as well. We are trying to get a system wide learning plan template developed and going. Our goal is to help all teachers fully understand their learning targets and how they relate to student understanding. I know that all teachers look at them, but I'm not sure how many break them down to fully understand them and what students outcomes should be.
  • highlight crucial words (for instance, most, least, except, not).
    • lwinter14
       
      I also do this on other assessment types such as short answer. I've gotten into the habit of bolding things that I want to make sure students don't forget to do. For example, they may be required to answer a question but then they need to follow that with explanation or justification. I often bold the second half so that they don't forget to include the explanation, which often highlights their thinking, which can be more important than the first half of the answer.
    • jhatcher
       
      I do this too. I find this is very helpful for kids. Sometimes in rubrics when going through them, I'll have kids underline or circle key words instead just to force their attention a bit. It does help.
  • it is not capable of informing the student about the next steps in learning.
    • lwinter14
       
      It is SO important that our feedback is more than a score or letter grade if we want to emphasize progress and the ability to improve for our students.
    • emilysjohnson
       
      Agreed! And if the targets are clear and communicated to students, they should know what steps they need to take to grow! It shouldn't be a mystery!
    • maryhumke
       
      "Do the results provide clear direction for what to do next?"
  • The purpose is to inform others—policymakers, program planners, supervisors, teachers, parents, and the students themselves—about the overall level of students' performance.
    • kshadlow
       
      Wouldn't that be interesting if the "we" mentioned here were all actually on the same page, wanting and assessing the same things. A common purpose. Nothing like focusing on the negative here, but all of these people are being informed in different ways and gathering different data for a different endpoint.
    • benrobison
       
      The piece of policymakers is the most frustrating to me (and most likely all educators). I have always struggled with the notion that the people making the majority of decisions are not the ones in the trenches, nor do they have the background to make those. I have been pleased with the direction PLC work has gone as of late; I think this gives more valid work to inform decision making on part of the teachers.
  • Do the results provide clear direction for what to do next?
    • kshadlow
       
      Sometimes an assessment is just an end. Information is used in the next unit, but the assessment doesn't always tell the student they are ready for what is coming next.
    • anonymous
       
      Yes, and it makes me wonder why so many of us provide copious amounts of feedback on summative assessments when students do not have the opportunity to do anything with the learning and provide less feedback on formative assessments along the way when students could actually do something with that feedback.
    • benrobison
       
      In the SBG system we use, which seems to evolve constantly, we don't really every get to a summative assessment. Kids are (supposed to be) constantly re-learning and re-assessing. Their results on assessment give the kids, and the teacher for that matter, a path on how to proceed.
    • leipoldc
       
      Our students are allowed to re-take summative assessments, so notes and conversations can assist in their learning (I guess they are not really summative then are they?)
  • Using data from these assessments, schools now make decisions about individual students, groups of students, instructional programs, resource allocation, and more.
    • kshadlow
       
      How much money and time was spent in areas unnecessarily? Data is no good if it is tainted. I am glad we have moved farther away from the traditional state testing.
  • better instructional decisions and improved high-stakes test scores.
    • aripperger
       
      I see some teachers more hopeful that ISASP, with its better alignment to state standards, will be a truer indicator of success. Other teachers, however, are still so jaded toward standardized testing.
    • jhatcher
       
      Good point! ISASP should be a better indicator of student achievement.Some of the best indicators are teacher formative and summative tests. These are still the most useful for teachers.
  • four categories of learning targets
    • aripperger
       
      This is a helpful breakdown of learning targets for me. In a core discipline area like history, it's easy to forget about performance skill and product targets. But there are definitely areas where these type of learning targets are present, and knowing those areas can help me decide how best to assess.
  • erode accurate results
    • aripperger
       
      Easy to forget about bias! So many other things take our time and attention when we write tests, that it's easy to forget about spelling, formatting mistakes, and other unintentional things that give students a clue as to the right answer in ways that don't truly test mastery of content.
  • Annual state and local district standardized tests serve annual accountability purposes, provide comparable data, and serve functions related to student placement and selection, guidance, progress monitoring, and program evaluation
    • aripperger
       
      One of our school's frustrations with the new ISASP format is that no itemization or further guidance is provided at the building/district level as to how our students performed on specific components of the test. Perhaps this will change, or maybe we're missing it, but it's difficult to program evaluate without this breakdown.
  • will be capable of informing sound decisions.
    • jnewmanfd
       
      I think this is an important thing to think about. How often do we really use assessments to make changes in our instruction. When I was a student I was thankful for tests. I could cram the material into my head and once the test was over, I could forget it and move on; clearing the way for new information. As a teacher, I realize that isn't the intent, but I wonder how often we still get caught up the type of thinking. Are we assessing so we feel better about moving on or are we assessing so we can make course corrections to support student learning and understanding?
  • Teachers should design the assessment so students can use the results to self-assess and set goals.
    • anonymous
       
      This reminds me of self-reported grading. Hattie says self-reported grading has an effect size of 1.33 but it seems that it is rare for teachers to actually use it.
  • all available assessment methods
    • anonymous
       
      This article focused solely on formal assessment, but I also think it is important to discuss the role and value of informal assessment opportunities and how powerful immediate feedback based on informal assessment can be in a F2F setting.
  • enable them to immediately take action
    • anonymous
       
      One of the easiest ways to ensure that students respond to feedback is to design opportunities that require them to engage with the feedback and do something with the feedback, but this is frequently dismissed due to the quantity of standards and learning required of students at each grade level. Many teachers feel like they need to prioritize "covering" all the standards over students truly engaging in their learning.
  • Are results communicated in time to inform the intended decisions
    • jhatcher
       
      I have 140 students so it can take a while to get results back to them. I know the quicker I can get the results back in their hands, the more they care about their score and the assessment. They are more likely to want to fix mistakes and learn from it. If I take too long it has a negative impact on motivation. We have to correct quickly but correctly.
  • affect individuals and groups of students on the basis of a single measure is part of our past and current practice.
    • mkanost
       
      This is detrimental to English Learners-Kanost
  • assessments
    • mkanost
       
      Using data from multiple assessments can help determine where exactly a student is at in their learning. Kanost
  • cultural insensitivity.
    • mkanost
       
      This can really hurt our students with that lack background knowledge obtained in white, christian, middle class society. Kanost
  • clear and understandable to everyone, including students
    • emilysjohnson
       
      It is especially important that students know what the intended learning is! Unfortunately, too many students think grades are given to them by their teacher instead of earned by their work. When they don't know what is being assessed, this adds to that narrative.
    • tkofoot
       
      This is where it is important to have a clear rubric with student language. Students, even learning adults, need to have guidance on why they are learning so they can be assessed accurately.
  • Reasoning targets
    • emilysjohnson
       
      This is an area I feel like we don't capture as much as we should as teachers. It's the process over product idea!
  • appropriate balance of points in relation to the importance of each target
    • emilysjohnson
       
      I'm glad to see a number of items for each target instead of just one or two in order to get a better understanding of the learning.
  • Figure 2 clarifies which assessment methods are most likely to produce accurate results for different learning targets.
    • parkerv
       
      This chart is really helpful, I will refer back to it often. I like that it gives some of the rationale for saying it is a good match or not.
  • Specific, descriptive feedback
    • parkerv
       
      This is so important. Feedback that is too general, not clear and/or not descriptive enough to lead to concrete actions on the students part limit their effectiveness as an instructional tool.
    • leipoldc
       
      I agree. Providing complete and clear feedback in language the student can comprehend is key to helping them move forward.
  • Inherent in its design is the need for all assessors and users of assessment results to be assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results—thereby reducing the risk of applying data to decisions for which they aren't suited.
    • parkerv
       
      The term assessment literate is a great term. Often is seems teachers don't get all the information they could from an assessment because they haven't sufficiently thought through this question. And then sometimes they are used to make decisions in inappropriate ways.
  • For each assessment, regardless of purpose, the assessor should organize the learning targets represented in the assessment into a written test plan that matches the learning targets represented in the curriculum.
    • jnewmanfd
       
      This is something that I have been improving on and is not something I knew about when I first started teaching. I actually used to think that a good test was a simple repeat of information that I told the students during the unit. I wrote tests over the "facts" that I taught them. Wow, have I learned a lot. Now in my PLC we take the time to organize the learning targets and make sure that our assessments match the learning targets in our curriculum.
  • The classroom is also a practical location to give students multiple opportunities to demonstrate what they know and can do, adding to the accuracy of the information available from that level of assessment.
    • jnewmanfd
       
      My administrator and I were just talking about something similar. We are trying to work on grading practices in our building. We both agree that students need multiple opportunities to show what they know and that assessments shouldn't be viewed as a one a done item that is checked off. We even got into the idea if a student is assessed once and gets a 58%, a second time and gets a 78% and third time and gets a 98% do you average all those scores, or do you think to yourself, "It took them three times but they finally go it, let's celebrate, here's your A"?
  • If we don't begin with clear statements of the intended learning
    • benrobison
       
      In our district, there has been a major focus on writing clear, concise learning targets as "I CAN" statements to introduce learning. These are posted throughout the lesson, and are written out on the assessment for our kids. In my own teaching, it has really focused my attention to the task at hand, and I've eliminated a lot of the fluff I had in there previously. I'm only assessing the things I want them to learn/do...not the extra stuff that just kind of happened.
  • Performance skill targets, which ask students to use knowledge to perform or demonstrate a specific skill
    • benrobison
       
      This is 75% of grading in PhysEd (well, at least our PhysEd program). We have gone away from sport-ed, and moved to almost completely fitness-based education. We grade on heart rate data, specifically time spent in the Target Heart Rate Zone. Our goal is to make competent movers to enhance health beyond the school setting.
  • they involve where and how teachers can improve instruction—next year
    • benrobison
       
      This has been tough to do when results from assessments don't come back to us in a timely matter. Side note: Not that PhysEd is targeted area, but I'm so glad Iowa isn't a high-stakes testing state. I cannot imagine having that pressure on top of balancing all of the other things asked of us. I cannot imagine teacher morale being high.
    • leipoldc
       
      I agree - it is so tough to improve instruction - next time when the data arrives after instruction has begun. This makes the need for multiple types of assessment an vital part of the educational setting.
  • quality and balance
    • tkofoot
       
      What does quality and balance look like compared to the instruction?
  • through the use of clear curriculum maps for each standard
    • leipoldc
       
      The curriculum map needs to ensure standards are addressed at multiple grades levels. If standards are missed at a level, this needs to be communicated so we dont create gaps in our kids' learning. Gaps make for students who are insecure in their understanding and hesitant to try new ideas. :(
  • The assessor must begin with a clear picture of why he or she is conducting the assessment.
    • jessed44
       
      Teachers and students are both culpable in this 'teaching to the test' mode. My students will often ask if something is on the test, and if not, they show less attentiveness. And I think there may be some implicit pressure on teachers to emphasize the assessments we are to give. It really is sad.
  • e assessor must begin with a clear picture of why he or she is conducting the assessment. Who will use the results to inform what decisions? The assessor might use the assessment formatively
    • maryhumke
       
      In a data driven world, which I totally agree with, the data is only valid if the reason for the data is clear and understood.
  • Do the results provide clear direction for what to do next?
    • maryhumke
       
      This must be the purpose for data. What direction will come from the results? Otherwise, it becomes busy work.
  • At the level of annual state/district standardized assessments, they involve where and how teachers can improve instruction—next year.
    • maryhumke
       
      Intersting it is not the same the same sampling of students.
  • Inherent in its design is the need for all assessors and users of assessment results to be assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results—thereby reducing the risk of applying data to decisions for which they aren't suited.
    • maryhumke
       
      I think too often we are told what data to take but do not know why and don't have a genuine investment in the collection. How many teachers have been involved in taking data from an IEP goal and have no idea what the actual goal says.
  • No Child Left Behind (NCLB)
parsonsbrandi

ollie_4_1: Educational Leadership: The Quest for Quality--article - 0 views

  • In the past, few educators, policymakers, or parents would have considered questioning the accuracy of these tests
    • parsonsbrandi
       
      I wonder if the pendulum has swung too far in the other direction, where now everyone is questioning everything.
  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores.
  • The assessor must begin with a clear picture of why he or she is conducting the assessment
  • ...17 more annotations...
    • parsonsbrandi
       
      Begin with the end in mind.
  • If we don't begin with clear statements of the intended learning—clear and understandable to everyone, including students—we won't end up with sound assessments
    • parsonsbrandi
       
      Making this understandable to students is key. I ventured out and taught my own children a series of swim lessons (I usually teach other people's kids) and when I talked to my daughter about being able to go off the diving board this summer, she stayed more focused on improving.
    • Elizabeth Fritz
       
      A clear learning target contributes to better measurement and incentive for improvement.
  • cultural insensitivity
  • Are results communicated in time to inform the intended decisions?
    • parsonsbrandi
       
      We've come a long ways technologically speaking in the ability to use real-time data to instruct students since the publication date of this article, but unfortunately a lot of the decisions (as far as policy goes) are to still completed on an annual basis.
    • Barbara Day
       
      I agree. A perfect example of that is with Iowa Assessments. In my school district, teachers usually don't see the results until the end of the school year when those students will no longer be in their class.
    • Elizabeth Fritz
       
      Technology tools within LMS platforms can allow for better "real-time" feedback from assessments
  • Teachers should design the assessment so students can use the results to self-assess and set goals
    • parsonsbrandi
       
      We're working on self-assessing and setting goals for our adult learners, which is leading to a higher persistence rate in continuing in the program. 
  • Inherent in its design is the need for all assessors and users of assessment results to be assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results—thereby reducing the risk of applying data to decisions for which they aren't suited.
    • parsonsbrandi
       
      It is so important for all stakeholders to be assessment literate - and far too often, that doesn't happen.
  • Using misinformation to triangulate on student needs defeats the purpose of bringing in more results to inform our decisions.
    • Barbara Day
       
      I think sometimes that misinformation takes the form of not understanding how the student is thinking, or misunderstanding the skill.
  • Creating a plan like this for each assessment helps assessors sync what they taught with what they're assessing. It also helps them assign the appropriate balance of points in relation to the importance of each target as well as the number of items for each assessed target.
    • Barbara Day
       
      You have to be sure you are testing what you think you are testing.  So identifying the learning target for each question is key.
    • erichillman
       
      Agreed- while it may be easy to say having clear learning targets is just "more on my plate", my answer is that it is "stacking the plates" so they are easier to carry!
    • parsonsbrandi
       
      I like that analogy - "stacking the plates."
  • Sound Assessment DesignThis key ensures that the assessor has translated the learning targets into assessments that will yield accurate results. It calls attention to the proper assessment method and to the importance of minimizing any bias that might distort estimates of student learning.
  • Bias can also creep into assessments and erode accurate results. Examples of bias include poorly printed test forms, noise distractions, vague directions, and
  • keep wording simple and focused, aim for the lowest possible reading level, avoid providing clues or making the correct answer obvious, and highlight crucial words (for instance, most, least, except, not).
    • Barbara Day
       
      This is a pet peeve of mine. We need to be clear and direct in defining our learning goals. We need to ask questions using vocabulary that is appropriate to the age and skill of the students.
  • Student Involvement in the Assessment ProcessStudents learn best when they monitor and take responsibility for their own learning. This means that teachers need to write learning targets in terms that students will understand.
  • we might put the learning target in student-friendly language: "I can make good inferences. This means I can use information from what I read to draw a reasonable conclusion." If we were working with 2nd graders, the student-friendly language might look like this: "I can make good inferences. This means I can make a guess that is based on clues."
    • Barbara Day
       
      If we don't put the target in student friendly language it is meaningless.  
  • Selecting an assessment method that is incapable of reflecting the intended learning will compromise the accuracy of the results.
    • Elizabeth Fritz
       
      match the assessment method to reflect intended learning 
    • erichillman
       
      So important in science with the move to NGSS. You just can't assess a performance task with a multiple choice test (unless the performace task is taking multiple choice tests, of course)
    • parsonsbrandi
       
      Really, in all the NGLM, you need to be able to assess performance tasks. I hated that there was less focus on actually speaking a world language when I taught Spanish than on the assessments of vocabulary. If I were to go back in the classroom, my classes would look a lot different now.
  • This is done using both formative and summative assessments, large-group and individual testing, assessing a range of relevant learning targets using a range of appropriate assessment methods.
    • Elizabeth Fritz
       
      multiple types of assessments AND both formative and summative
  • The assessor must begin with a clear picture of why he or she is conducting the assessment
    • erichillman
       
      A question we forget to ask all too often.  Why am I testing? To put a grade in the grade book?  To see if they "know" it?  What happens if they don't? (besides just moving on)...
    • erichillman
       
      This is such an important foundational piece. When we haven't done backwards design we often have misalignment between the assessment and what we are assessing
    • parsonsbrandi
       
      So true! - When I teach swimming I always think with the end in mind, but so many times we forget to do that when we're doing things like creating a rubric.
Marcia Jensen

ollie_4: Educational Leadership: The Quest for Quality--article - 1 views

  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores.
    • Marcia Jensen
       
      The teachers in my high school are not as optimistic about this. We are starting to use data teams this year, so I wonder if they will change their minds when they are in that sort of setting.
  • Only assessments that satisfy these standards—whether teachers' classroom assessments, department or grade-level common assessments, or benchmark or interim tests—will be capable of informing sound decisions.
    • Marcia Jensen
       
      I like having criteria with which to judge my products. An informal rubric, I guess.
  • If we don't begin with clear statements of the intended learning—clear and understandable to everyone, including students—we won't end up with sound assessments.
    • Marcia Jensen
       
      This is harder to do than I thought. If the lesson/teaching unit is written correctly and has a clear purpose it is easier to do
  • ...27 more annotations...
  • Knowledge targets
  • Reasoning targets
  • Performance skill targets,
  • Product targets,
  • the proper assessment method
  • minimizing any bias
  • Figure 2 clarifies which assessment methods are most likely to produce accurate results for different learning targets.
    • Marcia Jensen
       
      The table in the article is really helpful. You can find it at http://tinyurl.com/44woaj
  • vague directions
    • Marcia Jensen
       
      I find that students really get confused by directions, even ones I think are clear. It is probably good to test out the directions on a couple of people to be sure they are clear to others.
    • keyna day
       
      I find that most students don't read directions:)! Many times I will do a practice test in class that mimic the test so that they will know what they need to show me for that section.
  • Will the users of the results understand them and see the connection to learning? Do the results provide clear direction for what to do next?
  • Feedback to students can use the language of the rubric: "What you have written is a hypothesis because it is a prediction about what will happen. You can improve it by explaining why you think that will happen."
    • Marcia Jensen
       
      So does this imply the rubric returned with the student work is different than the one given out with the project directions? Or does it mean that written commentary needs to be part of the returned rubric?
  • assessors need to consider each assessment level in light of four key question
  • What decisions will the assessment inform?
  • Who is the decision maker?
  • What information do the decision makers need?
  • What are the essential assessment conditions?
  • Use a reading score from a state accountability test as a diagnostic instrument for reading group placement.
  • The assessor needs to have a clear picture of what achievement he or she intends to measure.
    • keyna day
       
      Sounds like such a simple concept to have clear learning targets but until recently, many teachers would not line up their assessments (tests/quizzes) with what they were teaching in the classroom. They might have spent 10-25 minutes on a concept but assess that for 75% of a test. Clear learning targets and lining them up with assessments keeps teachers accountable for what they are doing in the classroom.
  • A mechanism should be in place for students to track their own progress on learning targets and communicate their status to others
    • keyna day
       
      Many times the rubric or learning target checklist can be given to students before, during or after (if there are multiple goals) their learning/formative assessments to gadge how they are progressing.
    • Marcia Jensen
       
      If there were a checklist, it could be done in 3 columns so they could see the progress in one place.
  • Periodic interim/benchmark assessments can also serve program evaluation purposes, as well as inform instructional improvement and identify struggling students and the areas in which they struggle.
  • the use of clear curriculum maps for each standard,
  • teachers can choose among the four assessment methods (selected-response, extended written response, performance assessment, and personal communication)
  • Although it may seem as though having more assessments will mean we are more accurately estimating student achievement, the use of multiple measures does not, by itself, translate into high-quality evidence.
    • Tina Wahlert
       
      This statement is SO true. Administering multiple measures does not necessaarily mean that educators will make data-driven decisions. The assessment results must be used well.
  • nherent in its design is the need for all assessors and users of assessment results to be assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results
    • Susie Peterson
       
      Assessment literate - that is the key to all of "assessment" problems with education. Very few people are trained in teacher training to become literate in the use of data, interpreting data correctly, and using data to assess learning needs and teaching goals. SP
    • Marcia Jensen
       
      I see this all the time. I started learning things the minute I started on topic 1 of this course!
  • Are results communicated in time to inform the intended decisions?
    • Tina Wahlert
       
      Time - this is my biggest issue with Iowa Testing. This year districts had to wait months to get their results back. By the time they arrived teachers were a bit dismissive because they felt the measure of student performance had already changed too much. Districts I work with that were Spring testers will not even be sharing results until the end of August or Sept. because they did not have time at the end of the last school year.
  • Given the rise in testing, especially in light of a heightened focus on using multiple measures, it's increasingly important to address two essential components of reliable assessments: quality and balance.
    • Susie Peterson
       
      But how are we to attain quality and balance in our state testing in Iowa. The tests are predetermined for us and they keep changing -- ITEDs, Iowa Assessment, and soon Smarter Balance, if the rumors are true. I would love to see schools using their own assessments based on the standards, but our students are judged by the BIG tests, not district tests. Balance is also questionable. Who determines how much and when, in addition to what?
  • Students learn best when they monitor and take responsibility for their own learning. This means that teachers need to write learning targets in terms that students will understand.
    • Tina Wahlert
       
      This is very important that students take responsibility for their learning. As educators, we are responsible for making sure the learning targets are clear and students understand.
    • Marcia Jensen
       
      How do you set up procedures that facilitate this process? I don't see much of it happening.
  •  
    Clear Learning Targets
Jamie Van Horn

ollie_4: Educational Leadership: The Quest for Quality--article - 5 views

  • multiple measures
    • Mary Trent
       
      I think quality, multiple measures are important. Too often we give students one shot to get it beacuse we are so focused on covering the content or getting through the book that we miss the most important part....are the students learning the material?
    • Mary Overholtzer
       
      As an educator, I have found that I am expected to give multiple measures from directives "on high" only to find myself not able to look at the data,analyze it, and make decisions about it. Yes, we are all at different periods of our lives, yet we all have been given only so much time.
  • responsibility for their own learning
    • Mary Trent
       
      Absolutely! Students should feel as though they are in control of their grades. They should be giving a clear picture of what is expected of them and offered options to get back on track if they fall to the way side.
    • Lorilee Hamel
       
      I so agree. Giving students power and knowledge about their own learning is extremely engaging and motivating for the student.
    • Brooke Maine
       
      I also agree- my best students have always been the ones who take responsibility for their learning and not just because they want to earn an A, but because they actually care about their learning.
    • Dan Jones
       
      I will concur as well, when they have a clear picture of what is expected of them, they learn more and when the don't hit the target, they are still motivated to learn. Testing should promote learning
  • Effectively planning for the use of multiple measures means providing assessment balance throughout these three levels, meeting student, teacher, and district information needs.
    • anonymous
       
      It is so important to use many different measures to meet the needs of students, teachers and districts because of the large group at hand.  There needs to be a balanced use of these measures.  There are many things to consider with these assessments that the key is to find out what is important to know and how to go about presenting these assessments.
  • ...55 more annotations...
  • they can provide information about student progress not typically available from student information systems or standardized test results. The classroom is also a practical location to give students multiple opportunities to demonstrate what they know and can do, adding to the accuracy of the information available from that level of assessment.
    • anonymous
       
      Standardized test only give a certain amount of information for teachers to see.  Often times, it's a guessing game for kids.  In the classroom, students can be creative and add their style to the assessment with different opportunities to present the information.  
    • Dan Jones
       
      I like seeing teachers use a combination of testing approaches. I think kids get burned out filling in ovals, students like to be creative and can show that better through other means beside multiple choice or darkening ovals.
  • demonstrate
  • Stephen Chappuis, Jan Chappuis and Rick Stiggins
    • Lorilee Hamel
       
      This is crazy--I have spent the entire day reading about assessment and this entire year have been working with Carol Commodore a colleague of Stiggins on this exact material. In fact, I am preparing it for professional development with my groups. Crazy!
  • Knowledge targets
    • Lorilee Hamel
       
      These are vital to know since when you (see below) are ready to assess these, it is important to link the correct type of  target with the type of assessment/s that is/are best for assessing the target.
  • Reasoning targets
  • Performance skill targets
  • Product targets
    • Lorilee Hamel
       
      I was unable to see the figures on this page regardless of the browser that I used. FYI.
    • Jason Martin-Hiner
       
      Same here....
    • Jodi Leimkuehler
       
      Same here...I tried both Firefox and Chrome.
  • Selecting an assessment method that is incapable of reflecting the intended learning will compromise the accuracy of the results.
    • Dan Jones
       
      I think teachers create an assessment tool and think if they have a variety of response types, they have a good test. I think there needs to be an added emphasis on making sure the respones format matches the learning that has taken place.
  • This key ensures that the assessor has translated the learning targets into assessments that will yield accurate results. It calls attention to the proper assessment method and to the importance of minimizing any bias that might distort estimates of student learning.
    • Lorilee Hamel
       
      This information aligns the assessment with the type of target that  is being assessed.
  • Specific, descriptive feedback linked to the targets of instruction and arising from the assessment items or rubrics communicates to students in ways that enable them to immediately take action, thereby promoting further learning.
    • Lorilee Hamel
       
      I became very adept over the years as a writing teacher (and eventually began applying it to my teaching in general--reading and social studies) at descriptive feedback. I am an advocate and proponent because I have seen that feedback instead of scores/marks promotes learning. 
    • Jason Martin-Hiner
       
      This certainly aligns well with the information from last week and writing rubrics with "fix" correctives in order to promote student improvement. A great way to focus on the formative piece.
    • Holly Palmersheim
       
      I would like to see something added here about timely. Specific descriptive is great but if the student doesn't receive the feedback in a timely fashion it becomes more difficult for them.
  • The goal of a balanced assessment system is to ensure that all assessment users have access to the data they want when they need it, which in turn directly serves the effective use of multiple measures.
    • Lorilee Hamel
       
      Our district is really moving in the direction of standards-based assessment and reporting. This really does present to all stakeholders the specific and most important data---how well is each student meeting the standards of the Iowa Core?
    • Jason Martin-Hiner
       
      I know one question that comes up frequently with groups when we discuss SBAR - how many times must students demonstrate they can meet a standard before they are "checked off"?
    • Mary Overholtzer
       
      This creates a concern for me because so many students have it today and it's gone tomorrow. The forgetful hormones set in- in middle school.
  • In such an intentionally designed and comprehensive system, a wealth of data emerges. Inherent in its design is the need for all assessors and users of assessment results to be assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results—thereby reducing the risk of applying data to decisions for which they aren't suited.
    • Lorilee Hamel
       
      This really should be taught in pre-service courses--but is not. And now that the information exists--I wonder why it isn't taught. Why aren't new/pre-service teachers entering the workforce with this information in their tool box?
  • Sound Assessment Design
    • Jason Martin-Hiner
       
      This entire realm is both challenging and time-consuming. In order to have a high level of confidence, assessments usually need to be used many times and checked for validity and reliability…especially if they are being used as a summative assessment.This entire realm is both challenging and time-consuming.
  • Assess learning targets requiring the "doing" of science with a multiple-choice test.
    • Jason Martin-Hiner
       
      As obvious as this statement is, and even though "doing science" has been an expectation in the Iowa Core (and now the NGSS), there is a general lack of 'performance assessments' in science - especially at the elementary level.
    • anonymous
       
      I'm not typically in the classroom, so I'm asking... why is that? Is it because performance assessments aren't readily available, not easy to score, not easy to administer, messy to set up, time consuming? If these are true, I see lots of barriers in the way of performance testing. Even though they may be more authentic and reliable.
    • Mary Overholtzer
       
      I have found many districts concentrate on reading and math at the elementary level...as a result, science is on the back "burner".
    • Andrea Compton
       
      Mary, I absolutely agree! The publishers of the elementary reading series' are caught up in trying to include the required amount of non-fiction reading material for the students and so they have focused on material that is also grade level appropriate to what should be studied in the science and social studies curriculum at each grade level. Teachers are beginning to use the reading series' material as a substitute for real science and social studies lessons as a way to "save time" in their day and still cover all the required material. This does not bode well for the science and social studies learning of our younger students.
  • Figure 1 shows a 3rd grade math test plan
    • anonymous
       
      Figure 1& 2: can be seen in this version of this article: ( http://goo.gl/9S26Q )
    • Jodi Leimkuehler
       
      Thanks Clair!
    • Sally Rigeman
       
      Strange that only "Number Sense" has 4 items worth 10 points! Could one question be weighted or did they really assign each correct answer 2.5 points?
  • Effective Communication of Results
  • results communicated in tim
  • Will the users of the results understand them and see the connection to learning
    • Andrea Compton
       
      This is my contention with MAP testing. As an AEA consultant, I think it's wonderful for tracking student progress, and making instructional decisions for students, but I have found in more than one school I work with that the teachers receive this data from the testing and then have no idea what it means or what to do with it. It is so sad! They have received training on how to use the results, but by the time the test takes place and they receive the data, they have forgotten how to access it and what to do with it, so in essence the test was a waste of time because it's not going to bring about instructional change for the students in the classroom
  • results provide clear direction for what to do next?
  • Students learn best when they monitor
    • anonymous
       
      I once read a study where students with behavior disabilities saw an improvement in their behavior when they began to track and chart their actions in a spreadsheet. When they could see the change in a chart it became a positive goal to make improvements and watch the trendline go up. Monitoring and taking responsibility.
  • Ongoing classroom assessments
  • Periodic interim/benchmark assessments
  • Annual state and local district standardized tests
  • betting
    • Holly Palmersheim
       
      It is difficult to think we are betting on these practices.
    • Mary Overholtzer
       
      Great point. I have always said, when we are assessing, we are not instructing. I have found as an educator, it's during the test that students will ask the most questions. I consider it low stakes testing when I can tutor them one on one and as a result, some of the best learning takes place.
  • summative tests, the reason for assessing is to document individual or group achievement or mastery of standards and measure achievement status at a point in time.
    • Mary Overholtzer
       
      I have found it interesting that we give semester tests, yet very few supervisors, parents, administrators, or students want to know the overall level of student performance....they just want to know the "grade". As a result, I see a need for doing summative testing a bit differently.
    • Jodi Leimkuehler
       
      How would you do summative testing differently? This makes me think about the cumulative projects I have my students complete. Very rarely do students come in to find out how they did. I think I need to move the end date of those projects up a couple of days so I can sit down with the student and go over the project before the last day of class.
  • Teachers should design the assessment so students can use the results to self-assess and set goals.
    • Mary Overholtzer
       
      As an educator, I have found that having students self-assess is a lesson in itself. So many students think they are excellent, even after seeing many of their peers doing the same task with varying degrees.
    • Pam Rust
       
      I agree that we must teach our students how to self-assess. In some classrooms we have never asked them to do this, so we can't expect them to fully grasp the concept unless we provide ongoing support while they learn to self-assess.
    • Mike Todd
       
      I give a lot of written assessments in science, but have failed to make goal setting explicit. I think this could be really effective at getting students to view the feedback differently, especially if the student had to talk with the teacher about the goal.
  • Use a reading score from a state accountability test as a diagnostic instrument for reading group placement.
  • annual accountability purposes
    • Pam Rust
       
      How do we get our students to care when taking these tests (i.e. Iowa Assessments) so we can truly monitor their knowledge?
  • sacrificed to testing
    • Jodi Leimkuehler
       
      Is it possible to over-assess? If new assessments are being added, will students get burned out from being tested?
    • Brooke Maine
       
      Yes! I definitely think students get burned out from testing. My district did away with a few non-required standardized tests and the students did better on what they were required to complete, because they felt it was more necessary and appreciated that they weren't being forced to do all of it.
  • students
    • Jodi Leimkuehler
       
      I think this is key - writing the learning targets in student/parent friendly language. I have started to transition mine into "I can" statements.
  • the use of multiple measures does not, by itself, translate into high-quality evidence. Using misinformation to triangulate on student needs defeats the purpose of bringing in more results to inform our decisions.
    • Brooke Maine
       
      I wish more people understood this! It seems like non-educators (and maybe some people in the education field) just think adding more measurements and assessments means that it is high quality evidence because they equate more evidence as high-quality evidence.
  • The assessor must begin with a clear picture of why he or she is conducting the assessment. Who will use the results to inform what decisions?
    • Brooke Maine
       
      Unfortunately, I feel like this is not something I was ever taught in college and it took me several years of teaching to really think about this and understand it. I definitely feel like I (and my students) missed out on some things in class that could have been better because my knowledge was lacking in this area.
  • selected-response formats
    • Mike Todd
       
      I would have liked to see more specific discussion about the creation of selected-response format questions. I know "concept inventory" type questions that were developed using student misconceptions from previous written assessments are extremely valuable at assessing student learning, especially when compared with traditional questions from a textbook publisher.
  • etter instructional decision
    • Andrea Compton
       
      I wish this were the case. So often I work with schools that are giving multiple forms of assessments in an attempt to insure that students are learning the core material and will do well on the Iowa Assessment only to find that the teachers have no idea how to interpret the scores and data they receive from the tests. This leads to no instructional decisions being made for the student after taking the tests and the testing being nothing but a waste of time.
  • it is not capable of informing the student about the next steps in learning.
    • Andrea Compton
       
      This is so true!! Unless a teacher provides feedback in some way - whether in a conference style or a written style - the student will have no idea how to improve. Too often high school students receive a composition paper back with a letter grade and no comments or only spelling corrections underlined. This does not help the student to know what it is that was done poorly - other than the spelling - or how to improve on the next paper. I firmly believe that even papers that are considered to be "A" papers need to have feedback given - what was done well, what areas might the student extend themselves in next time, what areas could be better even though they were sufficient for this assignment.
  • considered questioning the accuracy of these tests
    • Dan Jones
       
      I create very few tests as I am in special education at the high school level. I am most often proctoring, administering or trying to interpret test results. I actually find myself questioning the accuracy of tests more often than you would think. The students are often asking me what a particular question means. Without giving any clue to the answer, I find myself trying to clarify when I am asking the same question. The way tests are framed and questions are asked can affect the accuracy of tests. I think creating a test that provides accurate results is an incredibly hard task. Kudos to those that are good at it, we need more of you
  • This means that teachers need to write learning targets in terms that students will understand.
  • This means that teachers need to write learning targets in terms that students will understand.
  • This means that teachers need to write learning targets in terms that students will understand.
  • This means that teachers need to write learning targets in terms that students will understand.
  • This means that teachers need to write learning targets in terms that students will understand.
  • The assessor needs to have a clear picture of what achievement he or she intends to measure. If we don't begin with clear statements of the intended learning—clear and understandable to everyone, including students—we won't end up with sound assessments.
    • kellie kendrick
       
      This is very important to keep and mind, and is something that I had an issue with at the beginning of my teaching career. It is imperative that a teacher knows what the intended outcome of an assessment is going to be before writing that assessment, so that they can look to those outcomes for guidance when writing questions, creating rubrics, or deciding a number of points for the assessment.
  • and highlight crucial words (for instance, most, least, except, not).
  • and highlight crucial words (for instance, most, least, except, not).
  • and highlight crucial words (for instance, most, least, except, not).
  • and highlight crucial words (for instance, most, least, except, not).
    • kellie kendrick
       
      I have found that highlighting, bolding, or putting words in italics has really helped my students to pay closer attention to the directions or questions and has led to students increasingly getting answers correct.
  • , and highlight crucial words (for instance, most, least, except, not).
  • You can improve it by explaining why you think that will happen
    • Sally Rigeman
       
      Better - ask the student, "How could this statement be more complete? Are you missing something in this component of the rubric?
  • effective feedback
    • Sally Rigeman
       
      Resource: "The Power of Feedback" by John Hattie & Helen Timperley (2007) in Review of Educational Research.
  • For each assessment, regardless of purpose, the assessor should organize the learning targets represented in the assessment into a written test plan that matches the learning targets represented in the curriculum.
  • Quality
  • the assessor should organize the learning targets represented in the assessment into a written test plan
    • Jamie Van Horn
       
      This seems necessary if we are to achieve the highest level of assessment making sure we are actually assessing the learning targets appropriately, but I struggle with the fact that teachers have the time in their busy schedules or will take the time to create a test plan for every assessment they give.
  • Assessment literacy is the foundation for a system that can take advantage of a wider use of multiple measures
    • Jamie Van Horn
       
      Sadly, I feel assessment literacy is lacking in education. We not only need to focus on the assessments we give our students but also on training our educators and classroom teachers on assessment creation and effective use of assessment results.
  • Most assessments developed beyond the classroom rely largely on selected-response or short-answer formats and are not designed to meet the daily, ongoing information needs of teachers and students
    • Jamie Van Horn
       
      It's too bad that these tests are being used to make so many decisions in the education system when they are not fully assessing the students learning and mastery of skills.
amorarend

PLE Articles - 1 views

  • Not every student is ready for this responsibility, so teachers need to have strategies in place to guide and support these learners. In addition, teachers must pursue training and be knowledgeable of how to utilize PLEs to enhance learning and ensure that students are using this e-learning tool in a meaningful way
    • anonymous
       
      It is not enough just to have PLEs and use them in the classroom, a teacher needs to be able to provide intervention, conferring, and reteaching strategies to help the student understand the expectations. They need to know how to use the tool correctly. 
    • lkmace
       
      Having the opportunity to collaborate with, visit schools supporting PLEs, or receive support from other professionals already comfortable with implementing PLEs would prove valuable on my journey to create learning environments to best meet my student needs. I so agree with your comment of teacher role.
    • wolson86
       
      This is a very powerful statement. I agree it is not just enough to have PLE's and use them. It is very important to have time to collaborate and have some professional development. Using PLE's teachers will be in a different role than in previous settings and will need the tools to support their students through this learning journey. 
  • Some instructors empower students to use their own mobile devices such as tablets and smartphones as a means to create PLEs. Others utilize sites such as Symbaloo or NetVibesas a foundation to help learners create and maintain their personal learning environments. Below is a video that shows how a 7th grade student uses Symbaloo as a PLE in her science class:
    • amorarend
       
      How do students learn how to use their PLE? Do they take a class to learn how to correctly and effectively them or does each classroom teacher teach bits and pieces of it?
    • Megan Schulte
       
      I think this depends on the students.  Some kids can naturally figure out how things work and others will need a tutorial.  Ultimately the kids will choose a PLE that they feel comfortable with or already know how to use.
  • Teachers, she explains, are no longer the primary or even the best source of information available to students, and our work must increasingly attend to supporting students in developing their skills and motivations for becoming themselves networked and sophisticated online learners.
    • amorarend
       
      Are schools going to provide training for teachers so they know how to use all of these PLE tools? I feel I would want to fully understand how to use all of these online tools before I teach my students how to use them.
    • kelsi-johnson
       
      We also need to teach our students to think and learn on their own. They are used to being provided with resources, graphic organizers, and other tools to guide their thinking. This is a big shift in processing and responsibility for our students. Because they have never done this in earlier education, some will really struggle to adapt.
    • wolson86
       
      You pose great questions, "are schools going to provide training for teachers so they know how to use all of the PLE tools?" I agree educators will need more training to properly implement PLE's into their classrooms. The statement that teachers are no longer the primary or even the best source of information is a huge shift in thinking. Our jobs as educators will be to support our students on their on learning pathway. 
  • ...17 more annotations...
  • as an instructor, you can make a webmix quite interactive.
    • amorarend
       
      Using this in a classroom would be helpful to catch students up who have been absent. 
    • kelsi-johnson
       
      Yes! Or to be able to access it on their own if they are absent. There isn't an excuse to not be current or up to date if resources are always at their fingertips.
  • PLEs place a large amount of responsibility on students and thus requires a high level of self-management and awareness.
    • amorarend
       
      This definitely seems more geared towards middle and high school students. Are their ways to create PLE's in the elementary classroom?
    • Megan Schulte
       
      I read in one of our assigned readings/videos that a PLE sometimes looks like the homescreen on a smart phone.  So an elementary student may have a variety of educational games that they have found/been provided that they would use for practice. Other kids' PLE may not involve technology at all, but instead be a manipulative, like counting blocks.  I know my own children (by birth) have been practicing multiplication with their Pokemon cards? My first grader couldn't handle using the iPad for sight word practice and had to go back to flash cards.  He learned what was acceptable and regained access.  While this classroom isn't necessarily PL, I would think the same concept applies? 
  • We also discussed that as they begin to work in inquiry circles next week and to collaborate on their digital research projects, they can create, publish, and share their topic webmixes with their peers so that they can collaborate and discover information sources through this form of networking/information sharing–I find this possibility exciting for the students, and they seemed impressed by this concept as well.
    • anonymous
       
      This networking in inquiry circles sounds like a wonderful way for students to share their learning. It would also give students a way to have a voice for those you are more hesitant to share in the regular classroom. I have a lot of questions about how it all works. How do we prepare students for this work? Do they have basic grammar structures so their writing makes sense? I am unfamiliar with the websites being used. Do we need to have inservices to get all teachers "up-to-date" on what students will be using? And lastly, what constitutes a finished project? How do students know when they are done?  
  • we are in a new era where information is abundantly available and professionalism is far more about the effective manipulation– access, evaluation, & application– it only makes sense to reorient learning toward facilitation of students’ “active role in the learning process” and teachers’ provision of the right balance between structured lessons and autonomy; let’s never forget it is an ongoing balancing act. 
    • anonymous
       
      It is very clear the teacher and student roles are making a major shift. While we are changing the roles in the process, as educators, we need to have a unified understanding of what the balance needs to be or we will be giving students mixed messages. Students can quickly determine how to access what they need once they are given the tools but evaluation and process will require some lessons for the students AND the teachers. 
  • you can create tiles that link to challenges, quiz questions, polls, discussion forums, chat pages, and other types of content and media that will facilitate more student involvement and creativity
    • anonymous
       
      Versatility and Opportunity which will allow for student work and communication in a personal learning environment with classroom connections. 
  • Personal learning environments (PLE) are a new approach to personalized learning that allows students to direct and manage their own learning experience while pursuing educational goals.
    • lkmace
       
      Every Wednesday my district has a late start for students while teachers are receiving PD. Just this morning a discussion at my table involved brainstorming how to move students past doing just what's expected of them. How do we get their thinking to move past, "How many paragraphs/sentences do I need to write?" PL could be a tool to develop that independent learner.
    • kelsi-johnson
       
      I agree, this will be the hardest step for our students! They are used to the traditional model of education with clear expectations and guidelines always structured and provided for them. We are trying to increase opportunities for students to be independent and accountable for their own learning and many are resistant. They know how to "play the game" of the traditional model of a school, so change can be intimidating.
  • Instead of a teacher providing resources that everyone uses, students can utilize their PLE to acquire information using preferred apps and resources such as blogs, YouTube, Pinterest, Ning or Delicious. The development of PLEs represents a shift in focus from teacher centered classrooms to more learner centered classrooms.
    • Megan Schulte
       
      As I have been talking to my kids about PL, I heard (and have feared) someone say, "So we're doing the teacher's job?"  I think, like most changes in education, it's going to take some convincing/educating the parents as to what PL is and the role of the teacher.  Of course, I feel that it's all about how it's presented.  If you get the kids to understand their role and the teacher's role, you may not have these issues.
    • kelsi-johnson
       
      This needs to start in elementary for it to be truly effective; I don't think we can expect secondary students who have not been taught how to learn in this environment to suddenly run with personal learning. While many of them think it sounds great, they haven't been conditioned to independence in their learning. They want everything provided for them and often don't know where to start when set off on their own. We need to teach students how to learn in this manner in order for it to be successful.
  • those policies are not going to change.
    • Megan Schulte
       
      This is a systematic problem that needs to change in order to make PL work.  Restricting access is not the answer, and I believe we'll get there as a society.  If we want real life, the students need to understand when it's acceptable to do what.  I already know my students will struggle with this issue, but if they're engaged in their PL, they may not need those distractions.  As with any classroom management issue, expectations will need to be established and enforced when violated.  We read that adults even struggle with using technology appropriately in the workplace, so of course this will need addressed with students.
    • lkmace
       
      On that thought, will our lifting those access restrictions at the elementary through secondary grade levels assist learners beyond the K-12 walls with using technology appropriately? Would it reduce the occurrence of workplace and adult inappropriate use of technology which seems to be sadly common place today?
    • kelsi-johnson
       
      We have so many problems with restrictions on our devices. At our school, teachers have the same filters as the students also! They give us no passwords for administrative access or even the WiFi. How can we teach students to think critically when using the web if we simply restrict everything? Especially when it comes to teachers, this seems a bit demeaning. People will always use resources inappropriately. Unfortunately, that's just the way it works. Why restrict everyone due to the poor actions of a few?
  • ong have educators, from Aristotle to Dewey to Sizer, called for “learning by doing” and “student as worker,”
    • Megan Schulte
       
      I feel that this is where we are at as educators as well.  We need to "learn by doing" because a lot of us are doing a job we were never trained to do...and I'm not even that old!  I currently have a student teacher, and she's amazed (and a little scared) at what we're doing with our students with blended learning and also standards based grading.  She hasn't even graduated and she knows nothing of either of them!  Get ready, honey!  :)
  • The notion of a PLE for students, grounding them intentionally in an environment of information tools and productive applications, is a great way to seek, develop, and structure that balanced approach.
    • Megan Schulte
       
      As much of this as we can implement in our class is a step in the right direction.  We can only control so many variables of the school day, and that's ultimately what is holding a lot of us back from implementing true PL.  
  • Because you can link to an infinite variety of web pages and you can embed media
    • Megan Schulte
       
      We do SOOO much on Google Drive in our school, I'm interested in seeing how we could use them together or if this would be separate.
  • The concept of PLE is not a way to replace classroom learning,
    • lkmace
       
      This is an important declarative to use when persuading teammates or administration to support the personal learning environment in your school. Like any differentiation piece, collaboration, individual student consideration of needs, and building a rigorous, yet attainable structure to learning is included with that design. Creating the PL to include technology students are frequenting, motivates students buying in to the idea at first.
    • wolson86
       
      I agree with this statement about not here to replace classroom learning but to enhance it. I also agree with your comment about how it is an important declarative when bringing the topic to co-teachers or administration. Education is always changing and administrators will want to listen if you have a way to enhance student learning. 
  • parents, email conversations, Facebook posts or even twitter hashtags. These interactions among their learning community reinforces learning and combats the often negative stereotypes associated with traditional learning techniques. Because PLEs are learner controlled, they are easily adapted to the learner’s day-to-day activities and interests both inside and outside of the classroom
    • lkmace
       
      This all sounds great! I could easily believe my students would enjoy these social network interaction learning communities. However, it does form a question connecting to student safety. I'm wondering how districts already implementing PLEs are assuring students they are responsible for will be involved with a secure/safe learning experience?
  • my main priority is for students to have a tool they can use to organize their information streams and to create their own topic webmixes, and from what I’ve seen so far, Symbaloo definitely will meet those needs. As we begin venturing into our research the next two weeks and students begin developing their Symbaloo webmixes, I’ll continue to collect feedback from students on how this learning tool is working for them and how they are using it for themselves as well as within their groups–I’m excited to see what will happen.
    • lkmace
       
      This grabs my interest! Not quite ready to plunge into this just yet, but could envision how this could greatly enhance students' research connected to problem-based learning situations I propose as extended learning projects with classroom teachers.
  • ymbaloo EDU
    • lkmace
       
      In taking a glimpse at the Symbaloo EDU page, I was glad to find out it's compatibility with tablets. My students have personal Chrome Books, we often find certain apps and programs that aren't available to use with these.
  • ruth be told, I could stand to be more savvy in my own organizing of online learning and networking: I’ve been slow to use tools and develop skills for managing online resource, such as the use of vehicles like Symbaloo, Evernote, or Diigo, and I want to take inspiration from the 7th grade student in the video above to move forward in this way and learn and practive better these skills and with these tools.
    • lkmace
       
      I often feel the same - slow to utilize the tools available. It's always well intent, but priority address other items at hand. I'm hoping this evolves as I develop more understanding of PLEs and their use for enhancing learning opportunities of those I instruct.
    • kelsi-johnson
       
      Not to mention, once we master one tool...another one pops up! I try to stay current in technology through classes and our PD opportunity, but it is tough to stay on top of things. I think the best way to do this is to stick with one tool and work to know it well. Otherwise we fall into the trap of "jack of all trades, master of none!"
  • Learning isn’t germane to structured classroom environments alone; it occurs in both formal and informal settings.
    • wolson86
       
      I think this statement is very important for the heading why PLE's are beneficial. Showing learning can take place in both formal and informal settings. Often with the push to meet the standards and standardized tests teachers feel the need to focus on the formal learning setting, however the informal learning setting can actually prove to be more beneficial in my opinion.  
mschutjer

ollie-afe-2019: Educational Leadership: The Quest for Quality--article - 6 views

    • nealjulie
       
      I thought this quote was interesting. I always believe that having more than one data point helps a teacher see more of a rounded picture of that student. Relying on just one assessment isn't fair to the student. I believe we should look at multiple assessments, formative assessments, check points to help our students grow. JN
  • assessor needs to have a clear picture of what achievement he or she intends to measure. I
    • rhoadsb_
       
      Assessment needs to be directly tied to the standard you are teaching too.
    • Deborah Cleveland
       
      When we were rolling out the Iowa Core, we really emphasized how content, instruction, and assessment were part of the "curriculum". Each piece playing an integral part in student learning.
    • nealjulie
       
      I think we as teachers need to make sure we are focused on what essentials we need to assess. We have the mindset that we must teach the content, and not the process. JN
  • ...66 more annotations...
  • Do the results provide clear direction for what to do next?
    • nealjulie
       
      Do we use the data for reteaching? JN
  • Students learn best when they monitor and take responsibility for their own learning
    • kmolitor
       
      I really like this idea of having students take responsibility for their own learning, and putting the learning target in language they can understand would definitely help!
    • mpercy
       
      I agree that students do learn best when they take on the responsibility but I also think this is the ideal situation and often does not happen. How do we motivate more students to do this?
    • alisauter
       
      I agree with this, but it seems so foreign to students. I think we need to plan on a lot of modeling to shift the responsibility to them.
    • nealjulie
       
      Student friendly learning targets! I believe involving students in tracking their own learning targets is very powerful! It's high on the Hattie scale. JN
  • f we don't begin with clear statements of the intended learning—clear and understandable to everyone, including students—we won't end up with sound assessments.
    • Wendy Arch
       
      While this seems like a straightforward idea, in reality, making a learning purpose clear and understandable to everyone - students included - can be difficult. Especially in English, the skill were teaching is not clear cut. CCSS Reading Literature 11-12.6 asks students to "Analyze a case in which grasping a point of view requires distinguishing what is directly stated in a text from what is really meant." However, there's no "right" answer to this skill. Student analysis of "what is really meant" could encompass a huge range of ideas. Crafting an assessment and teaching/learning opportunities that clearly delineate "proficient" analysis from "poor" analysis can't always be put into clear and understandable language. How can you quantify the qualitative?
    • kimgrissom
       
      There is truth in the challenge. But I know I have been guilty of knowing what I was looking for but not clearly communicating it to students. Then they are left to guess...which means they are likely to guess in at least some ways incorrectly. I think the more modeling we do, the more "anchor papers" we provide, the better students achieve our expectations. Putting those expectations into words and examples is its own challenge, but a worthy one.
    • cathy84
       
      It is nice to hear from other high school English teachers about the difficulty of measuring such subjective skills. I always struggled. One strategy I did find helpful was assigning paragraph writing as an assessment and scoring them 1-5, with a 3 being adequate and a 5 outstanding Then we would do several together and discuss what constituted a 3 and the differences between 3-4-5. That did seem to help, and students personalized the challenge of getting at least a 3 to show competency and reaching for outstanding.
  • t also helps them assign the appropriate balance of points in relation to the importance of each target as well as the number of items for each assessed target.
    • annott
       
      I really like this chart, it's easy to follow and easy to read.
  • minimizing any bias that might distort estimates of student learning.
    • Wendy Arch
       
      This is where I know as an English teacher, I can get bogged down in the details. All of my writing assignments have an assessment category for "M.U.G.S." as we call them (mechanics, usage, grammar, spelling), but those aren't actively taught and retaught every unit. We just expect students to have a certain level of proficiency at this point. However, that isn't always the case. There are MANY students who have not internalized the "rules" of writing. Their mechanics (punctuation) seems haphazard, grammar atrocious, usage nonexistent, and spelling like they fell asleep on their keyboard. However, a complete lack of those skills might not prevent them from being able to distinguish "what is directly stated in a text from what is really meant." I have to be careful to not allow my internal bias against poor writing ability to distort an accurate estimate of a student's learning and demonstration of the skill.
    • kmolitor
       
      When I read through this about minimizing bias it made me think of the old ITBS/ITED tests and a student we had that was new to this country. The student was very bright but he did not perform well on the test because of bias. One example I recall was he had no idea what a fir tree was as where he was from there was no such thing.
  • Will the users of the results understand them and see the connection to learning?
    • Wendy Arch
       
      This is also where I struggle. Our department uses the online program Turnitin.com to give students feedback on written assessments and grade almost all work. This is partially to alleviate issues with plagiarism, but mostly because it gives students and teachers a one access point to communicate feedback. The program allows users to submit rubrics that students can see. We've started assessing rough draft using the final rubric so students can see where their work is in the rough draft stage so they know which paper criteria need work. They also can view my feedback on the paper that tells them how to fix what they need to fix. My frustration is when students aren't willing to go back and look at the feedback on the paper or rubric so they know what learning skills they still need to work on. How can we motivate them to look at the results, see the connections, and make the progress in learning?
    • kmolitor
       
      That is a great point! How do we motivate kids to go back and look at the feedback and make changes. Many of our kids just want to know what do I need to know to pass the test or assignment and once they pass that's all that matters.
    • jennham
       
      You have mentioned before that kids always want to know what they have to do in order to get an A or pass...but that's what I want to know when I take a course. I want/need to know what the expected outcomes are. I feel that kids have so many classes, tests, and assignments that if they don't ask those questions or think in that kind of a structured fashion that they will crash and burn. I get that we want them to LEARN and be passionate, but especially in required courses, the passion just isn't always there and the class literally is a box to check off.
  • From a formative point of view, decision makers at the classroom assessment level need evidence of where students are on the learning continuum toward each standard
    • Wendy Arch
       
      This is another area where I personally struggle. The time and flexibility needed to be truly responsive is astronomical. I currently teach 4 of the 10 sections of English 10 at Indianola High School. As a class cohort, we try to be within a day or two of each other in content delivery. However, if my students don't get a concept, it's difficult to take a day to reteach since that throws off my alignment with the other teachers. It also means that I would have would have different periods at different places. I'm hoping the flipped and blended learning opportunities will help with the time and organization issues I currently have. If I can break groups up into smaller cohorts based on skill, then use flipped/blended methods for each group, I can (hopefully) accomplish more within the time frame. It makes organization more complicated, but allows more flexibility.
    • kimgrissom
       
      This is why common formative assessments can be so helpful. If some of your students aren't getting something, it's likely that others aren't either. If you look at the whole team's formative data, it could be that everyone needs to adjust rather than just you.
    • barbkfoster
       
      And if your class is doing more poorly than another class, you can have conversations about the different instructional practices being used. We all do our best but it's ok to not be the best. Together we can do what is best for our students.
  • Do the results provide clear direction for what to do next?
    • mgast40diigo
       
      We receive a lot data but never do much with it. What do other schools do with their data? There are great questions within this paragraph that should be asked when the results are in. MG
  • A grade of D+, on the other hand, may be sufficient to inform a decision about a student's athletic eligibility, but it is not capable of informing the student about the next steps in learning.
    • mgast40diigo
       
      SBL and transitioning from all letter grades is a lengthy process but very beneficial for feedback purposes. MG
    • tommuller4
       
      I agree with you about the SBL and how it shows a student exactly what they know or what they need to improve on. A letter grade just give them a percentage of the time they have a correct answer. Doesn't give them any information at what they know or don't know.
    • kmolitor
       
      I agree Matt, but how do we get kids to go back and internalize the feedback?
  • aim for the lowest possible reading level,
    • mgast40diigo
       
      I am curious to see if the new Iowa Assessments focus on this. MG
    • kimgrissom
       
      I think this is also interesting because I know there are some tests that do this purposefully to "increase the rigor" of the test. For instance, AP exams notoriously use vocabulary to make the questions harder. This is saying it could be not just separating those who know less about the content, but also those who have different background, cultural knowledge, or just English as a first language. I, too, wonder how the ISASP will do with this.
    • mpercy
       
      Are we challenging our top students and preparing them for their futures when we use low reading levels? Seems to contradict what we are trying to accomplish.
    • rhoadsb_
       
      This is so very important as we are seeing a dramatic increase in student populations that are not fluent in English.
    • jennham
       
      I have developed a system where I always read math tests out loud. That way students are not missing information due to not understanding the vocabulary.
    • chriskyhl
       
      Jenn that's an interesting concept of reading the tests outloud....have never thought of doing that in a HS classroom but might help!
  • The classroom is also a practical location to give students multiple opportunities to demonstrate what they know and can do, adding to the accuracy of the information available from that level of assessment.
    • rhoadsb_
       
      This is an important thing to consider in the design of your course.
    • tmolitor
       
      I agree, providing students multiple opportunities to show their knowledge, and understanding needs to be done.
  • Most assessments developed beyond the classroom rely largely on selected-response or short-answer formats and are not designed to meet the daily, ongoing information needs of teachers and students.
    • mgast40diigo
       
      I fall into this trap with assessments. I do need to incorporate more questions that focus on higher DOK levels. MG
    • jennham
       
      You are not alone. So do I. When I have an average of 70+ students to assess on math skills, these are easier.
  • Five keys to assessment quality
    • sjensen21
       
      To summarize, the 5 keys to assessment quality are: 1. clear purpose 2. clear learning targets 3. sound assessment design 4. effective communication of results 5. student involvement in the assessment process
    • cathy84
       
      Great idea on how to use an annotation tool. I can see this being very beneficial to high school students
    • chriskyhl
       
      thats a really cool usage! Could see teaching my kids to do this when doing technical reading
  • grouping the assessments
    • sjensen21
       
      Grouping assessments into levels: ongoing classroom assessment (daily work/observation), periodic interim/benchmark assessment (weekly quizzes/ group work), and annual state/district standardized assessments. I would add summative unit assessments (tests/projects) here also.
    • kmolitor
       
      Grouping assessments should give us a better picture of where students are at and help to identify where they need help.
  • cannot measure more complex learning targets at the heart of instruction
    • sjensen21
       
      Our school district is doing the ISASP this year for the first time. This is a computer based test based on the Iowa Core. I worry how these results will be used to evaluate student mastery of content specific standards. How much effort will students put into the test and are there too many distractors that will bias the results?
    • kimgrissom
       
      Those are legitimate concerns. On the other hand, what this quote makes me think of regarding the ISASP is that at least the types of questions are not only selected response. So many of the standards in the Core can not be measured by the only multi-choice questions in the previous test.
  • Bias can also creep into assessments and erode accurate results.
    • sjensen21
       
      On the new computer based standardized tests, ISASP, I worry that there will be skewed results, because this if the first time students have had to take a standardized test online.
  • descriptive feedback
    • kmolitor
       
      We do need to make sure that our feedback is helpful. Telling students "fix this" or "revise this paragraph" doesn't help them learn, the feedback needs to be more specific and point to the learning target.
    • tommuller4
       
      I totally agree with giving feedback about why they missed a question or problem. If you just count it wrong the student might now have any idea why they got the question wrong.
  • The assessor must begin with a clear picture of why he or she is conducting the assessment.
    • kimgrissom
       
      I think a lot of times we default to "for a grade" but there are lots of other reasons to consider.
    • tommuller4
       
      I think this is very important sentence. I know I don't do the greatest job of outlining learning goals everyday and explaining value in each. It's same thing for test. Are testing because its end of chapter or because you want to assess learning goals from the chapter that were the most important from the chapter and meet the standards for your class.
    • annott
       
      I agree Tom, I am not the best at covering learning targets with students. And maybe standards based learning will help focus my lesson designing and improve student learning.
    • rhoadsb_
       
      I think it is very important that we focus on the learning that is taking place within our classrooms and not on grading. Our assessments should be an avenue to strengthen learning and to inform the teacher what they need to do for learning to continue to occur.
    • alisauter
       
      This reminds me of UBD, or working backwards. The teacher knows the outcome first, and then builds the learning and assessments.
  • Selecting an assessment method that is incapable of reflecting the intended learning will compromise the accuracy of the results.
    • kimgrissom
       
      I thought the assessment brainstorming we did at the end of last week with ways to assess face-to-face vs. online was an interesting way to think of all the ways we can assess. I think as teachers we often default to a couple content-specific norms and it would be good to open up to other alternatives on occasion.
    • barbkfoster
       
      Many years ago I remember assessing my math students at the end of the year with a multiple choice test. None of my tests during the year were multiple choice, but finals were required and it was the most efficient way to get my grades done :( I'm sure it did compromise the accuracy of the results.
  • This means that teachers need to write learning targets in terms that students will understand.
    • kimgrissom
       
      I was a part of a John Hattie book study this year. In Visible Learning he talks a lot about success criteria being so clear that students can accurately self-assess their work. I think that's a really great goal for any rubric or learning target.
    • rhoadsb_
       
      Again here we should aim to write them in the lowest reading level possible
  • common assessments.
    • kylelehman
       
      I totally agree with this statement that we are assessing more than ever before. I don't think that it has to be a bad thing. However, I could see from a student's point of view that it could be overkill if they don't understand why.
  • Teachers have choices in the assessment methods they use
    • mpercy
       
      Is it important for assessments to contain all 4 types of responses?
    • jennham
       
      I don't think so. I think the teacher is to pick the best assessment method for that particular learning target.
    • tmolitor
       
      I agree with Jen. I think the teacher would need to use professional judgement to decide what the best assessment method would be. Sometimes it may include all 4 types though.
  • inform what decisions?
    • kylelehman
       
      This has been a large debate that we have been having at our district. We need some sort of feedback roll out that will say how we have managed the data and what the data is and will be used for.
    • tommuller4
       
      I think is important part for a teacher after each assessment to use results to maybe modify teaching topics that students performed poorly on. Maybe need an extra day to cover certain topics more in depth if students struggled with it on test or maybe we have a poorly written question on the test causing students to miss points.
  • communicated
    • kylelehman
       
      This has been another large debate that we have had. We want to make sure that our assessments are given back in a timely manner but we also want to make sure that they have correct and accurate feedback as well as to help the student know what they did well and where to improve and all of that takes time.
    • barbkfoster
       
      TIME! It's a four-letter word in teaching! The feedback we give students is WAY more important than the grade, and way more time consuming. How do we effectively give the feedback necessary for student growth in a timely manner? I'd love to hear strategies from others here.
  • Summative applications
    • kylelehman
       
      I think that this becomes more and more important as we look into SBG. Summatives are what tell you the story of how the students mastered something and if you want to see the evidence along the way, that becomes the formatives.
  • Periodic interim/benchmark assessments can also serve program evaluation purposes, as well as inform instructional improvement and identify struggling students and the areas in which they struggle.
    • mpercy
       
      Our math department has been looking at the AAIMS tests for Algebra students which could be used as data to support the learning taking place.
    • annott
       
      This makes me think of the concept of scaffolding. Which I have used in my classroom when lesson designing. Now I need to do the same thing with assessing. Assess students periodically both formative and summative.
  • minimizing any bias that might distort estimates of student learning.
    • kmolitor
       
      As teachers we do have to be careful of bias and making assumptions. When I read through this about minimizing bias it made me think of the old ITBS/ITED tests and a student we had that was new to this country. The student was very bright but he did not perform well on the test because of bias. One example I recall was he had no idea what a fir tree was as where he was from there was no such thing.
    • cathy84
       
      I completely understand this. Teaching writing and reading at the secondary level is so very difficult.
  • Creating a plan like this for each assessment helps assessors sync what they taught with what they're assessing
  • Knowledge targets, which are the facts and concepts we want students to know.
    • annott
       
      As our district moves toward standards based grading, understanding our knowledge targets is naturally happening during this process.
    • alisauter
       
      We are working on Power Standards in our buildings. I think this would fit with those too.
    • barbkfoster
       
      It all goes back to 1) what do we want them to know and 2) how will we know when they know it. We are working hard on choosing power standards. It is a long and exhausting process but a necessary one. Even after power standards are chosen, we need to break them down into learning targets our students can understand.
  • students to track their own progress on learning targets
    • whsfieldbio
       
      I have seen this done throughout a unit of student with a Red Light, Yellow Light, Green Light rating for students to self assess their percieved understading of a learning target. This self assessment was revisited frequently and used to drive student to specific learning activities that they needed to work on.
    • tmolitor
       
      I think allowing the students to self-assess and set goals is really beneficial. I like the idea of using red light, green light, and yellow light for students to show the teacher their understanding.
  • performance assessment or personal communication may be less effective and too time-consuming
    • whsfieldbio
       
      One dilema that teacher face is the factor of time which we all know. I have worked with teacher who have over 200 students in their classes and often default to a selected response assessment item even when a performance based would be more appropriate. It is challenging to assess and provide feedback in timely manner with this many students. This is not an excuse, but a barrier that needs to be explored.
  • or making the correct answer obvious
    • whsfieldbio
       
      I would also suggest to make non correct answers plausible and avoid answers that are glaringly impossible. If student select the incorrect answer then teachers could be able to identify misconceptions from an item analysis.
  • dependable data generated at every level of assessment.
    • whsfieldbio
       
      I wonder how much professional develoment or preservice teacher training is spent on looking at data to make decisions. There is most likely a range of understanding of what data should be used to design instruction. This is why is it good to have a strong PLC for teachers to work through data and assessment creation (which is really challenging in itself).
    • chriskyhl
       
      we are starting this assessment process and it is very challenging
    • mistermohr
       
      It is amazing to me that data acquisition/analysis and student feedback/scores are largely two separate endeavors. In this day and age, these should be the same step. Without some automation, I don't think this can actually be done. At least not in a meaningful manner.
  • track their own progress on learning targets
    • whsfieldbio
       
      I have seen this done throughout a unit of student with a Red Light, Yellow Light, Green Light rating for students to self-assess their perceived understanding of a learning target. This self-assessment was revisited frequently and used to drive student to specific learning activities that they needed to work on.
  • if students will be the users of the results because the assessment is formative
    • rhoadsb_
       
      Use of formative assessment is vital to the success of students and to inform teachers. this should be a daily practice and done through multiple types of measures.
  • n the past, few educators, policymakers, or parents would have considered questioning the accuracy of these tests.
    • alisauter
       
      Is this because educators had more trust among these stakeholders back in the day?
  • Assessment literacy is the foundation for a system that can take advantage of a wider use of multiple measures.
    • alisauter
       
      We need to be teaching assessment literacy in teacher prep classes.
  • inform students about their own progress
    • mrsmeganmorgan
       
      Shouldn't this be the goal of all assessments? If it serves other purposes great. If this does not become the focus of the assessment, then a student will start chasing points.
    • mschutjer
       
      Ideally testing should serve the purpose of helping the teacher and student see areas where they need improvement...
  • clear curriculum maps for each standard, accurate assessment results, effective feedback, and results that point student and teacher clearly to next step
    • mrsmeganmorgan
       
      I believe that this is important because highlights the role feedback plays in the assessment process. I think we often forget feedback.
    • tmolitor
       
      I agree, feedback is really important. It also needs to be provided as quickly as possible.
    • zackkaz
       
      Feedback is most certainly key for something that can be so subjective like writing, but I also think providing feedback on LOT can also improve students understanding. I know that is something I struggle with - leaving the necessary feedback. There's always a time crunch, and sometime students that assessed well receive little feedback even though they could use it too.
  • students can use the results to self-assess and set goals.
    • mrsmeganmorgan
       
      We need to model how to self-assess and set goals. I was guilty of expecting that my students knew how to do this.
    • Deborah Cleveland
       
      Yes. It is indeed a paradigm shift for teachers and students. Modeling the process to students and talking about it will help them get the most out of the assessment process.
  • learning targets represented in the assessment into a written test plan that matches the learning targets represented in the curriculum.
    • mrsmeganmorgan
       
      I wonder if the creators of ISASP has taken this into consideration. It would be interesting to learn how they accomplished this.
    • cathy84
       
      Excellent point!
    • cathy84
       
      I wonder who "we" are when the authors say "we're betting." I don't think it's the teachers, for we know the limits of testing.
  • cultural insensitivity.
    • cathy84
       
      I think this is a way bigger problem than ,most people realize.
    • cathy84
       
      I think this is a real problem with ISASP
    • zackkaz
       
      I'm willing to let ISASP run its course though - I think it is vastly improved from the old ITBS. At least it does have open ended questions and require students to process and write instead of the good ole A, B, C, or D.
  • Making decisions that affect individuals and groups of students on the basis of a single measure
    • robertsreads
       
      The idea that a single measure can accurately assess students is absolutely baffling to me. ~KMR
    • chriskyhl
       
      definitely a scary concept with the large presence and weight placed on these assessments
    • mschutjer
       
      it seems this concept totally contradicts what education stands for. Only good test takers like these tests.
  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores
    • robertsreads
       
      I could not agree with this more. The amount of hours we spend preparing students for a single test is astounding. The time would be better served to actually teaching students content.
  • The goal of a balanced assessment system is to ensure that all assessment users have access to the data they want when they need it, which in turn directly serves the effective use of multiple measures.
    • robertsreads
       
      Given the requests for data from our administrators and other stakeholders, this is imperative.
  • From a summative point of view, users at the classroom and periodic assessment levels want evidence of mastery of particular standards; at the annual testing level, decision makers want the percentage of students meeting each standard.
    • robertsreads
       
      It is more beneficial for students to demonstrate mastery of standards than for students to test well.
  • assessment formatively
    • barbkfoster
       
      I feel like we could do a better job of formatively assessing students. When students hear the word assessment, they think quiz or test and they get apprehensive. We need to change their mindset and show them how they can use formative assessments (exit tickets, class polls, one-minute papers, etc) to help them take control of their own learning.
  • the use of multiple measures does not, by itself, translate into high-quality evidence
    • jennham
       
      I happy to say that in our district we are working very hard at using only those assessments that we find useful to both the teachers as well as the students. We have drastically cut back on the number of assessments our students take.
  • At the level of annual state/district standardized assessments, they involve where and how teachers can improve instruction—next year.
    • jennham
       
      I feel this takes us dangerously close to teaching to the test. Is that really what is best for students? Changing everything around in order for them to score well on standardized tests? If the goal is truly to benefit students and how they learn, I am all for it no matter what.
  • "I can make good inferences. This means I can make a guess that is based on clues."
  • Who is the decision maker?This will vary. The decision makers might be students and teachers at the classroom level; instructional leaders, learning teams, and teachers at the periodic level; or curriculum and instructional leaders and school and community leaders at the annual testing level.
    • zackkaz
       
      For those that teach AP they also have the AP board to assess
  • or summatively—to feed results into the grade book.
    • zackkaz
       
      Evan, just curious since you suggested that potentially the answer is no grade book? How would use summative assessments? Would students just keep repeating until they were garnered proficient?
  • Effectively planning for the use of multiple measures means providing assessment balance throughout these three levels, meeting student, teacher, and district information needs.
    • chriskyhl
       
      so important to consider all 3 levels when planning
  • Reasoning targets, which require students to use their knowledge to reason and problem solve. A reasoning target in math might be to use statistical methods to describe, analyze, and evaluate data. Performance skill targets, which ask students to use knowledge to perform or demonstrate a specific skill, such as reading aloud with fluency. Product targets, which specify that students will create something, such as a personal health-related fitness plan.
    • Deborah Cleveland
       
      These categories of learning targets seem to tie in nicely with authentic learning.
  • balanced system
  • balanced system
    • Deborah Cleveland
       
      Do districts map out these different groups of assessments on a yearly calendar? It would be interesting to see how many days a year are students engaging in assessment and also the types of assessment.
  • overflow of testing
    • Deborah Cleveland
       
      Yes. There is a lot of testing these days One of my friends mentioned that between testing and snow days she hadn't "taught" from MLK day to almost President's day. Needless to say she was anxious about how well students wee going to demonstrate learning when they hadn't had much instruction for over a month.
  • schools now make decisions about individual students, groups of students, instructional programs, resource allocation, and more.
    • mistermohr
       
      I think that these decisions are made too infrequently. One test may place a student in a group that is not in your zone of proximal development. They may be stuck there for quite some time.
  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores
    • mistermohr
       
      and to think of the potential impact on opportunities available to students...crazy
    • mschutjer
       
      too much time is spent testing....
  • about the overall level of students' performance.
    • mistermohr
       
      From my experience, most of the high stakes testing explicitly states that the results should not be used on the individual student decision making level. Oh the irony....
  • ults
hansenn

ollie-afe-2018: Building a Better Mousetrap - 3 views

  • we ought to illicit student input when constructing rubrics
    • leighbellville
       
      Student input when creating rubrics would assist them in fully understanding the expectations set forth. It would be interesting to see examples of rubrics constructed with student input.
    • bbraack
       
      Having students illicit input in making of the rubric gives the students ownership and feel like they have a say in what should be assessed.
    • dykstras
       
      This would be tough for me to do in an ALgebra class as a majority of what i am teaching is brand new to them.
    • Kim Foley-Sharp
       
      I love this idea! I think there would be the initial learning curve of how to design a rubric, but a teacher could explain some of the main features/expectations of the projects and then let the students have some say in what excellent would look like etc.
    • carlarwall
       
      Building autonomy in our students and promoting learner agency! What a novel idea.
    • brarykat
       
      Great idea but realistically when would any teacher have time to gather input?  Could it be through exit tickets?  I could see Google Forms be used as a way to collect input. It still would mean dedicated time to review input.   
    • staudtt
       
      I have had mixed feelings with this. For those that have done it do students really help design to further learning? I have had conversations with educators that say in some cases students create simple rubrics to make the expectations easy to attain. Just wondering what experiences were.
    • Jen Van Fleet
       
      As far as the time committment, I don't think it would have to be student created all day every day. I think allowing them to contribute when possible AND pulling out previous rubrics which students contributed on in the past shows the students that the teacher listens to student voice on a regular basis. Not necessarily 24/7. :)
  • dehumanize the act of writing
  • At the beginning of the process, you could ask a student to select to select which aspect she values the most in her writing and weight that aspect when you assess her paper.
    • leighbellville
       
      The idea of asking a student to choose which aspect "she values most" to determine the piece that will be weighted more heavily is an interesting one. I think it lends itself to creating personalized goals with students. Similar to when we ask teachers if there is a specific area they would like to focus on to receive a rating and feedback during an AIW scoring, it could create opportunities for growth and discussion between the teacher and the student.
  • ...67 more annotations...
  • rubrics can help the student with self-assessment; what is most important here is not the final product the students produce, but the habits of mind practiced in the act of self-assessment.
    • bbraack
       
      Though the end product is important, I agree that it is important for the student to think about what or how they are going to go about constructing the end product.
    • jhazelton11
       
      True. If students could accurately self-assess, their end-products ultimately become stronger.
    • stephlindmark
       
      This is when the true spirit of education come through when there is self reflection and self assessment occurs.
    • carlarwall
       
      The best way to get students to use self-reflection and self assessment is for teachers to also model this same practice.
    • dassom
       
      I often forget about the benefit of students being able to self assess. It would not be as useful in probably a math class since it's usually a yes or a no. However in a writing assignment it could help the students see how much work they need to do to get to the next level.
    • blockerl
       
      I agree that it is important to encourage self-assessment. I also like to show students things I have written so they can grade me on the rubric. They enjoy critiquing their teacher. :)
  • produced less interesting essays when they followed the rules [as outlined in a rubric]
    • bbraack
       
      I can see where students would be too concerned with following the rubric in writing, instead of just writing for the fun of it or pleasure of adding things to their writing that they might not when using a rubric.
    • krcouch
       
      I love when they write for fun but they still need to know the basics of grammar and sentence structure etc. and even writing and then going back and doing a self evaluation would be helpful to see if they got all the required items.
    • staudtt
       
      My biggest fear in creating a rubric is just this. How do I write it to encourage going the extra mile and encourage not squash creativity?
  • The second step is deciding who your audience is going to be. If the rubric is primarily used for instruction and will be shared with your students, then it should be non-judgemental, free of educational jargon, and reflect the critical vocabulary that you use in your classroom
    • leighbellville
       
      Purpose and audience are two important considerations when developing a rubric. The point of including "critical vocabulary that you use in your classroom" and ensuring that it is "non-judgemental" are pieces that can be overlooked by educators.
    • stephlindmark
       
      I really like that this emphasizes that the rubric be free from educational jargon.
    • carlarwall
       
      Student friendly language is key if we want the student self reflection to happen.
    • Mike Radue
       
      I think it's helpful to consider / reflect on the notion of the students as our audience in terms of assessment and feedback. Remaining non-judgemental is important to remember in the assessment mode.
  • an analytical rubric, however, will yield more detailed information about student performance and, therefore, will provide the student with more specific feedback.
    • bbraack
       
      I like the idea of having two or more separate scales (analytical rubric). Some parts of an assignment or test might have the student do more and so it should have a different scale. Specific feedback for students is always important so they can understand how they did and what they might need to improve on.
  • Can different scorers consistently apply the rubric?
    • brarykat
       
      I hadn't considered this being an issue until our small group assignment this week.  I've only used rubrics in isolation.  Interesting thought for teachers in department (i.e. Social Studies) using same rubric.
    • leighbellville
       
      Inter-rater reliability is essential. The goal is promoting creativity and creating clear expectations. However, by including too many details, we run the risk of formulaic writing. It is important to ensure students understand the expectations, but also stretch themselves and do not do the minimum required to reach proficiency. On the other hand, when enough detail is not included, then we can run the risk of a rubric that becomes too subjective and then two scorers can review the same piece of writing and score it differently based on their own expectations.
  • stultifying and others see as empowering.
    • Heather Whitman
       
      First of all, I had not seen the word stultifying before! In order for a rubric or other type of assessments to be empowering, students must understand how to use them and have examples that help guide the conversation. Students need to know the expectations and what is considered and exceeds and just beginning. We must put more ownership on the kids' ends to self-assess well before the final due date. We want kids to improve it. I have come to love checklists to help guide this.
    • stephlindmark
       
      I just commented about how students need to see the rubric before hand so they know what is expected of them. I love the idea of using checklists more to help guide the learning.
    • Kim Foley-Sharp
       
      Agreed. What good is a rubric if we don't let the students see it ahead of time? Are we setting students up for failure?
    • emmeyer
       
      Sadly, it is so easy to get wrapped up in all that we have to do in the short amount of time and not show the students the rubric, even when we know that it is more meaningful to show the rubric ahead of time.
    • blockerl
       
      I feel both ways about rubrics. Rubrics certainly help the students and teachers know what is expected out of an assignment, but they can sometimes restrict a student's creativity. I feel like we saw that when we applied our rubric to some of the assignments this week.
    • trgriffin1
       
      I think this is a major problem for a lot of PLCs I work with. Some don't even want students to see exemplars for fear of limiting creativity.
  • post-secondary educators in all disciplines
    • Heather Whitman
       
      I have had quite a bit of training on assessment and rubrics and still feel it is almost impossible to write a good one. Are our post-secondary educators, many of whom don't necessarily have a teaching background, feel comfortable developing rubrics? Who is in charge of this huge task that can be career ending or career beginning for some?
    • nickol11
       
      I couldn't agree more with your thoughts here! And depending on who is assessing your rubric the feedback, grows and glows you receive will also be different. OR what one person is taught as never to include in a rubric another person is taught to always do that.
    • dykstras
       
      Heather, I am with you. Right now I am torn because I am supposed to be assessing my Algebra classes by standards with rubrics created for me at the district level, but everything I read indicates that these should be teacher created. i'm not sure who is more (or less) qualified to be doing this type of work, the individual teachers or the district level decision makers?
  • current goals of solving real problems and using statistical reasoning.
    • Heather Whitman
       
      This perplexes me...As Mike pointed out the need to focus more on the process, do we focus too much on the final product? Can't we have separate rubrics that assess along the way to help with this? It would improve learning but and help teachers truly give a grade with multiple indicators that assess work ethic, collaboration, final product, and the process. I am glad to hear that our focus isn't always on the right answer but creating students who can reason and problem solve.
    • lisamsuya
       
      That idea resonates with me. Rubrics to help students with the process makes sense. Maybe the learning progressions would be helpful for teachers to create rubrics for "along the way."
  • The issue of weighting may be another area in which you can enlist the help of students
    • Heather Whitman
       
      This perplexes me...As Mike pointed out the need to focus more on the process, do we focus too much on the final product? Can't we have separate rubrics that assess along the way to help with this? It would improve learning but and help teachers truly give a grade with multiple indicators that assess work ethic, collaboration, final product, and the process. I am glad to hear that our focus isn't always on the right answer but creating students who can reason and problem solve.
  • “Meaningfully” here means both consistently and accurately—accurately measuring the specific entity the instructor intends to measure consistently student after student.
    • jhazelton11
       
      As a psychology major, this was a big deal in making sure you had sound products you were using. I'm wondering how much we are testing ours today. I know some PLC's that practice scoring examples with rubrics, then discuss, to ensure they are on the same page.
    • brarykat
       
      I see how beneficial rubrics can be in "meaningful" assessment.  It provides clear expectations for both teachers and students, keeps the student focused, and hopefully created to meet standards or other meaningful benchmark.  
    • trgriffin1
       
      I think sometimes the rubric is a tool for the teacher to score and not as much a tool for feedback and encouraging learning (from earlier in the article). When teachers common score, are they using that discussion to shape their instruction and feedback to students? I don't mean to imply they aren't, I don't currently work with a PLC willing to common score. They simply use the same rubric.
  • (whether they are rubrics or more nebulous modes of evaluation) from students is not only unfair and makes self-assessment more difficult, it maintains the traditional gap between what the teacher knows and what the student knows
    • jhazelton11
       
      We are running into this right now with our LMS... the new assessment piece doesn't allow us to upload the rubric. So, kids will have to do tasks without seeing the rubric. This is not okay with teachers, so hoping the tech people will build the rubric options in....
    • stephlindmark
       
      Agreed that withholding assessment tools does a disservice to the education for the students and is can give some teachers a power trip. I am glad to hear the tech at your school are working on this piece and that the LMS has a feature to upload rubric into the system.
  • one rubric can be used to assess all of the different papers assigned in a freshman composition course.
    • jhazelton11
       
      We use a common rubric when assessing special education students with writing goals (although some students have modified or specific rubrics addressing the specifics of their goal).
    • krcouch
       
      I love the idea of common rubrics so that the goals are spelled out. especiallywhen one teacher likes it this way and another likes it this way can be so confusing.
    • emmeyer
       
      I agree, it is nice to have the common rubric that makes all expectations the same.
  • Does the rubric relate to the outcome(s) being measured?
    • jhazelton11
       
      In paper-writing, sometimes we get really caught up in measuring outcomes like mechanics (capitalization, punctuation), and not content. Often we get so caught up in assessing those things, we lose sight of the higher order thinking that we are really trying to measure.
  • non-judgmental:
    • jhazelton11
       
      rubrics are certainly less judgemental when they are used formatively along the way during the process... it's not an end-all "gotcha"
  • system designed to measure the key qualities
    • stephlindmark
       
      The system of a rubric can be very abstract and not concrete if being teacher made. This has pros and cons, one pro if the teacher lets the students see it ahead of time, is that the students know what is expected of their performance.
    • srankin11
       
      Agree! This can be challenging for a new teacher or one that is new to teaching that unit/class. The rubric also allows for standards to be measured in multiple assessments.
  • actually learned rather than what they have been taught
    • stephlindmark
       
      This reiterates to me the difference we are learning between assessing and grading. It is our job as teachers to make sure all students our learning and we aren't just going through the motions of going from chapter to chapter in a textbook.
    • dassom
       
      Teaching is a personal profession and when a student doesn't perform well on an exam it can be a shot to the teachers ego. If we can get teachers to think of rubrics as a way to see if the students have learned it yet instead of just a summative yes or not they got it, it might become less personal and we can start focusing on how to get the students to actually learn in.
  • help instructors in all disciplines
    • stephlindmark
       
      A beauty about Rubrics is they can be utilized in all content areas for all educators.
    • Kim Foley-Sharp
       
      and they can be tailored for the specific assignment or project. I love that rubrics are not content specific and can be designed for individualized, specific things.
  • traditional gap between what the teacher knows and what the student knows
    • stephlindmark
       
      This makes me emotional and the emotion I feel is anger. That there are teachers that are still out there that try to one up the student and have a power trip. As an educator and mother of three students myself I see this and have to play the politically nice card and try to listen instead of get mad during conversations with teachers. This class is giving me knowledge on the importance of assessments and different types.
  • Well-designed rubrics
    • stephlindmark
       
      As stated in one of the videos teachers are not taught in pre-teaching programs how to ask good questions, nor do I think we were taught how to prepare well written rubrics. If rubric are well designed they should not be "formulaic" in their outcomes.
  • But she did it without saying anything coherent
    • stephlindmark
       
      I would say this student was not given a well written rubric.
    • staudtt
       
      Agreed. The rubric apparently wasn't written so that it focused on an outcome the required something coherent.
    • Jen Van Fleet
       
      Leave it to kids to take your words literally in order to drive you figuratively insane. This just goes to show that a rubric shouldn't be driving students to one right answer but rather guiding them towards quality and learning.
    • Kim Foley-Sharp
       
      Absolutely. Kids will pick out one or two words and take them out of context. Is that what the intent of the rubric was? most likely no, but we need to teach the students that the rubric is a guide for expanding their learning with a few checks throughout the process.
  • mitagate both teacher bias and the perception of teacher bias
    • stephlindmark
       
      Anything to mitigate teacher bias is an improvement for many teacher assessments and evaluations of student learning.
    • emmeyer
       
      So true, removing teacher bias is difficult, and when we can do it, it is a good thing.
    • dassom
       
      I love the term real-life learning. Most professions don't have a good and bad type of employee. There are different levels of employees, and there's usually room for improvement.
    • brarykat
       
      In this respect, rubrics protect both the student and teacher. This document removes any possible bias perceived by students and/or parents.
    • blockerl
       
      The problem, which I don't know that it is really a problem, is that grading writing is biased. What I find creative or thoughtful might not be what another teacher thinks. The rubric can assess the prescriptive things like thesis, intro., conclusion, etc.
  • achiev[ing a] new vision of statistics education.
    • nickol11
       
      This is also true for the review systems for many companies. As I talk more and more with my friends outside of education, they talk of the rubrics that are used for their evaluation processes. I think that it is important as we teach students that they are able to relate their learning to rubrics as someday they will have to transfer that knowledge and understanding to their someday job/career.
  • a clear understanding of how rubrics operate
    • nickol11
       
      I really feel like many times when teachers are lost building rubrics they really need to zero in on the criteria needed to meet each indicator level. That said, they also need to model and communicate these items with their students.
    • emmeyer
       
      I agree with both of your points here. The indicator level makes the rubric clear and effective or not so much. Also, it is key for students to know what is expected of them. We, as adults, want to know what is expected of us, but we often think that students don't...which doesn't make sense.
  • wrote poorly when writing, as we might say, to the rubric
    • nickol11
       
      Have we considered to present the assignment to the students with the criteria THEN midway through the creative process bringing in the rubric so that students can assess their own work but still not lose their individuality?
  • Do the students find the rubric helpful?
    • nickol11
       
      I always find it helpful that in designing my rubrics (especially now when our school is building learning targets, assessment plans and more rubrics) that I test them out in my classrooms. They not only provide me feedback to student learning but I also have students provide me feedback as to how they are written, what I can change or add to make them work better for them. It also gives them even further buy-in to what you are doing in the class, as well and shows that you respect that there may be changes in learning but you are there for the student.
  • shared with students prior to the completion of any given assignment
    • hansenn
       
      I think rubrics should always shared with students when they start the assignment. so for me it is not an "IF:
    • dykstras
       
      I agree Noel! Mine are posted along side my standards and learning targets in my room, and constantly referred to.
    • krcouch
       
      I agree completely. I think the kids should know ahead of time what the expectation is.
  • reports that extensive use of rubrics can help minimize students’ educational disparities and bring fairness into assessment on numerous levels:
    • hansenn
       
      As long as the rubrics are well constructed and use I believe they do help lead to more equality and consistency in assessment. Teachers that give the same assessments, also need to review the rubrics together for consistency across schools and district.
  • students to simply make sure their essays have those features
    • hansenn
       
      Many students will just complete the assessment to meet the requirements in the rubric, but students are then meeting the expectations you wrote in the rubric. If you want them to do more change the rubric. What would happen if you did not share the rubric some might do more than expected and many would not because they have no idea what is expected.
  • Look at some actual examples of student work to see if you have omitted any important dimensions.
    • lisamsuya
       
      Looking at actual examples of student work ahead of time is a good idea. When we created the rubric for the Assess This assignment, we only had one example of student work. Then when we were given more pieces to assess, we quickly learned that the rubric would not work for all of the types of pieces that needed assessed.
    • hansenn
       
      Sometimes after using a new assessment an rubric, I reflect and notice the mistakes I made when creating the rubric and revise it. When you have students examples it makes it easier to evaluate your own rubric.
  • given their association with standardized assessment
    • dykstras
       
      Last I checked, the iowa Assessments were not scored by a rubric. This is something I continuously struggle with. if students, teachers, buildings, and districts are measured by standardized test scores, why do we push for standards based assessments and rubrics? This will be the first year I have never taught specific focus lessons geared to higher achievement on the iowa Assessments. My district wanted me to pilot standards based assessment so I am going all out! Can't wait to compare and contrast previous years' scores to this year. Stay tuned!
  • formulaic writing
    • dykstras
       
      Sounds more like a checklist approach. Who hasn't been guilty in their life of following a rubric like a checklist? Almost human nature.
  • “checksheets.”
    • dykstras
       
      There's my checklist comment! Should have kept reading :-) When I think of this in math though, I must admit it's a struggle to NOT say these skills are level 1, these are level 2, and so on.
    • Jen Van Fleet
       
      I do see the checklists especially in math as a benefit when collaborative teacher teams are discussing what exactly the foundational skills of a priority standard look like and what dots to connect if a student is far away from achieving proficiency. I don't think that kind of learning progression would translate for a student who would see it as a checklist.
    • trgriffin1
       
      I think the checklist and deep learning piece are not necessarily mutually exclusive. The checklist may require certain content (based on the unit of study or course topic) but the rest of the rubric can be skill focused and framed in a growth model.
  • there has been “notable increases in the use of open-response questions, creative/critical thinking questions, problem-solving activities, […] writing assignments, and inquiry/investigation.”
    • dykstras
       
      This ties in directly with a comment I made earlier, "How does this help increase student achievement scores of high stakes standardized assessments like the Iowa Assessments.
  • Focus, Support, Organization, Conventions.
    • dykstras
       
      Good for us Group 1! We pretty much came up with these same criteria for our rubric :-)
  • Weighting
    • dykstras
       
      I have to admit as a math teacher this peaks my interest the most. Would love to work with teachers who establish their own grading criteria for rubrics but want help 'converting' that into a conventional grade for reporting purposes i.e. report cards.
  • Modify accordingly
    • dykstras
       
      As should be the case with anything we do as professional educators.
    • jwalt15
       
      I agree with you Shawn. Professional educators are constantly modifying and adapting their instruction to the meet the needs of their students and the curriculum. Change means growth and learning are taking place for both the student and the teacher.
  • that rubrics provide students with clear and specific qualities to strive for in those assignments that “are open-ended, aligned more closely to real-life learning situations and the nature of learning”
    • krcouch
       
      I agree that it helps the students know what they need to strive for instead of just open ended questions and then you get back your grade and you did not do well because it wasn't what the teacher wanted. I struggled with this in my undergrad classes.
    • stephlindmark
       
      I agree with this too that it provides students with the clear and specific qualities of the academic piece of material they are working on to be assessed. I have never thought about it being related closely to real-life learning situations though which is an imperative connection that should be made.
  • ‘some rubrics are dumb.’” He recounts,
    • stephlindmark
       
      I would say to that, it was a poorly written rubric is it is "dumb".
  • Usually a numerical value is assigned to each point on a scale
    • stephlindmark
       
      This has been my experience with rubric to be very specific in the world of special ed. especially when using them for IEP goal writing.
  • vital to the process and/or product of a given assignment,
    • carlarwall
       
      When I see the word vital in this statement, it reminds me that we should only be assessing the qualities that are truly important. We need to be so careful when we are creating and assessing student work to not over assess or under assess our students.
    • staudtt
       
      I think this is true. Sometimes as teachers we feel the need to give a grade to everything. And while we are constantly assessing, we need to focus on the the things that are vital for the student to know.
    • jwalt15
       
      I agree with both of your statements. The word "vital" does remind the teacher to assess only what is truly important. It is very easy for teachers to loose focus on the important skills being taught and turn their attention to mundane details that are easier to define like writing mechanics or content presentation.
  • rubrics to both assess and encourage student learning.
    • carlarwall
       
      This statement stands out to me because we should use rubrics for many purposes. Many times teachers just want to use the rubric to grade. We need to think about the feedback that we give students on a rubric as a way to encourage them to continue to push themselves in their learning and set goals for themselves.
    • dassom
       
      I really like the word encourage here. I do not really show the kids the rubric I am grading them on (although I should). I don't know if my students are mentally there to "want" to move to the next progression. Currently I am doing a lot of forcing to learn. I think that encourage puts the wanting to learn on the students shoulders.
    • trgriffin1
       
      I like this concept - assess and encourage, not just evaluate and move on to the next assignment. In my opinion, this is where the learning on assessment and feedback is so important for teachers and students.
  • When instructors plan on grading student thinking and not just student knowledge, they should articulate the vital features that they are looking for and make these features known to the student.
    • carlarwall
       
      Students should not have to play a guessing game with instructors. We as teachers need to be transparent with our students about what they need to know and should be able to demonstrate.
  • rubrics should be used in conjunction with other strategies
    • carlarwall
       
      So important to remember that rubrics are not the only way to provide feedback to students.
    • srankin11
       
      True! I would hope by the time that the students complete a project to get graded on by a rubric, that they have received feedback from formative assessments along the way.
  • some educators see
    • dassom
       
      I think it's important to understand both sides of why teachers may or may not be in favor of rubic. In a math class it seemed unresonable and unnecessary to use a rubric until we started talking about standard based grading. It still a hard concept I am wrapping my head around but I am getting there. I have had WAY more instruction than other math teachers in building and district so I know it will be a huge struggle for them to see the value.
  • become wooden
    • dassom
       
      This reminds me of readings we did that talked about rubics killing the creativity of the writings. It is definately a con, but for some students might help them get started in the writing process.
  • With your colleagues
    • dassom
       
      This is important. If you are going to go into rubric style grading you want input from like content people. I teach 8th grade math, and would want input from 7th and 9th teachers when developing rubrics.
  • different levels of that “deep learning”
    • brarykat
       
      The examples of why rubrics haven't been appreciated mainly boil down to poor design.  I like this statement because it shows the flexibility of rubrics.  The creator can decide how in-depth the learning can go or encourage the student to expand beyond with skinny columns.
  • different
  • A rubric that tells students, as a typical example, that they will get an A for writing a 1000 word essay that “cites x number of sources and supports its thesis with at least three arguments” will lead students to perceive writing as a kind of “paint-by-number” endeavor (Mathews).
    • Mike Radue
       
      When I see a rubric performance descriptions include a certain number of something, I can't help but think about this.
    • srankin11
       
      In this case, a teacher could use a checklist instead of a rubric. Trying to reach a specific number seems like it would cut down on the quality of some student work and only produce quantity.
    • tifinif
       
      I understand this type of rubric but have also wondered what # of words/ correct words/spelling etc. constitutes an A/B/C...grade. What an A means to mean might not be the same to another person.
  • I once gave extra credit to a student who realized that without providing a shred of meaningful content she could meet all the requirements of a state writing rubric he posted in his classroom. As required she used the word “persuade” and two synonyms, composed a clear topic sentence and closing sentence, and made no spelling or grammatical errors.
    • Mike Radue
       
      Even a well-intentioned rubric can leave something to be desired. This sounds more like a checklist but begs the argument around having a criteria for coherence.
  • Similarly, Heidi Andrade, in her study, “The Effects of Rubrics on Learning to Write,” has found that, while rubrics increased her students’ knowledge of the grading criteria and helped most of her students (especially the young male students) do well on the state writing test, many of the young female students, who had been more expressive in previous writing assignments
    • Mike Radue
       
      I find this interesting. The formal, structured writing is favored and the in this particular task, the expressive abilities of a writer are not assessed and reported on and/or flexibility to consider creative structures is not in place. We should look at a student's overall writing abilities in a variety of settings.
  • problem-solving, inquiry-based, student-centered pedagogy replacing the traditional lecture-based, teacher-centered approach in tertiary education
    • staudtt
       
      This to me is important. I try to use rubrics to assess the more inquiry/student centered work I do. There is still a place for teacher centered as there are skills that must be conveyed to all students for foundational learning. Finding that balance between teacher and student based is what can be challenging.
    • srankin11
       
      I agree that there needs to be a balance and that balance can be challenging. I believe this is important as it helps to reach all learning styles.
  • weight dimensions differently
    • staudtt
       
      I need to figure out a way to do this within our standards based grading system.
  • increases the likelihood of a quality product
    • srankin11
       
      It can be challenging and time consuming to create a quality product. In my opinion, teachers that can work in teams to develop rubrics have a bonus. Several minds working together may help to produce a better rubric. A quality rubric is important so students do not have to guess what teachers want as they work on a project.
    • trgriffin1
       
      Also, I think the teachers having that discussion is powerful - it can help develop their ideas or challenge misconceptions. I know some teachers fear students looking at an exemplar or rubric and all students creating basically the same thing. I think that is an error of instruction/feedback/design and not a student error. I think teachers having that discussion can prevent that type of problem.
  • description of the work rather than judgments about the work.
    • lisamsuya
       
      Descriptive vs evaluative is another way to think about this. It is difficult to keep evaluate words from our feedback and from rubric descriptions but descriptive feedback is more beneficial than evaluative feedback for students learning.
  • we need a rubric to judge our performance—
  • However, for the student to successfully use a rubric this way, the criteria must be made clear to them and the jargon used must not only be understandable to the student but also be linked specifically to classroom instruction.
    • jwalt15
       
      This is a powerful statement because it doesn't do any good to share rubrics with students if they don't understand the expectations or the way the teacher is using the rubric. Older students should have a better understanding of rubrics because they should have more experience with them. I think that younger students would benefit from initial exposures to rubrics especially since more and more teachers and employers are using them.
  • “Perhaps the greatest potential value of classroom assessment is realized when we open the assessment process up and welcome students into that process as full partners”
    • tifinif
       
      I think that this would be interesting to see what students consider valuable in the assessment. What is it that they want to gain from their input?
    • tifinif
       
      Totally agree. This goes back to the days when you study for a test, take the test and then do poorly because nothing you studied for was included on the test. If students have input or are able to know the expectations the results will hopefully reflect actual student learning.
  • teacher
  • explicit performance criteria, along with supporting models of work, make it possible for students to use the attributes of exemplary work to monitor their own performance
  • The result is many students struggle blindly, especially non-traditional, unsuccessful, or under-prepared students, who tend to miss many of the implied expectations of a college instructor, expectations that better prepared, traditional students readily internaliz
    • tifinif
       
      I think that having students of all ages know the expectations or knowledge of what is required for grades is crucial. As an adult it is important that we are clear with what we are assessing. Time is valuable at any age but certainly as an adult learner I don't want to spend hours working on a project only to find out that what I present or do was not relevant.
  • Can students and parents understand the rubric?
    • jwalt15
       
      It is important that students and parents understand the rubric because usually the project grade is the product or reflection of the rubric. If the students or parents don't understand the components of the rubric, then they will question the validity of the grade that was given.
  • to assess our rubric
    • blockerl
       
      I agree. When we make these rubrics, we do need to discover its effectiveness.
  • “red” or “reddish,
    • trgriffin1
       
      Sometimes this looks like teachers' favorite parts - marking up the sheet in every possible way. I personally don't even have red pens! I think it sends the wrong message.
  • to a hit or miss endeavor
    • trgriffin1
       
      This is why students see school as a game and only want to talk about how to get more points.
  • static
    • trgriffin1
       
      I think the classic example of this is something like "3-5 spelling errors" as a criterion. Some rubrics are bad because they focus on delimiting every possible error instead of being growth or learning focused.
cjd203

The Quest for Quality - Educational Leadership - 11 views

  • In the past, few educators, policymakers, or parents would have considered questioning the accuracy of these tests.
    • Denise Krefting
       
      I was a teacher who didn't question cut scores. In fact they made life easier for me- but there really was no real learning beyond the assessment. This transition to continual learning makes so much more sense!
    • denise carlson
       
      This sentence is so true. I remember bringing home ITBS scores to my parents. As long as the scores were in the 90th percentile or better they were pleased. I don't remember them ever digging deeper to ask the teacher what I actually knew or did not know. To them it was an important test and whatever the results said must have been the truth. I'm glad we're not there anymore.
    • Cindy Blinkinsop
       
      Very true. We never questioned ITBS or ITED scores - we believed they were the one and only true assessment of a student's abilities. My how things are changing! There are so many factors to consider (region, vocabulary, did the student eat breakfast, did the student get enough rest, etc).
    • Natalie Smithhart
       
      I can remember as a child being very worried about my ITBS score, I was never a good test taker and I knew how "important" these tests were. I am glad that these days we use more authentic types of assessments also.
    • Lora Lehmkuhl
       
      I just reviewed ITED scores with our son. I recently read that ITED scores are closely related to scores one might expect for ACTs. This really worries me as a parent since we have a special needs child whose vision problems have greatly affected his performance in school. He plans to take the ACT test this spring and I know he's not prepared to accept a low score. Convincing him that he needs to take practice tests and study has been really difficult.
  • The assessor must begin with a clear picture of why he or she is conducting the assessment.
    • Denise Krefting
       
      Using this with the concept of backward design shows us how many options all fit together.
    • Joletta Yoder
       
      I too value the "Begin with the end in mind" method. I find it easier, after establishing learning goals, to determine how I'll assess them then let that direct my method of instruction.
    • Lora Lehmkuhl
       
      The "end product" might have different meaning to the student. For example, I teach a cooking class and the end product is often the food prepared. It can be difficult to convince the student that a standard muffin has specific characteristics. We review the characteristics before beginning the lab. In the eyes of the student, if it is edible it's just fine! You wouldn't believe how many times students have mixed up baking soda for baking powder and have been completely satisfied with a pancake that tastes like soap.
    • Marcia Jensen
       
      Strangely, after all the staff development, I think some teachers don't know why they are giving certain assessments. Part of this may be that they are philosophically opposed to so much testing but I think there is still a lack of understanding about the concepts being taught: the minutiae are more clear.
  • four categories of learning targets are
    • Julie Townsend
       
      These targets could define four different assessments given quarterly. Don't we give informal assessments that cover some of these targets?
    • Marcia Jensen
       
      I like checklist type information because it helps me to evaluate and plan my own instruction. I can use these criteria to make sure I plan for all these targets in my instruction.
  • ...58 more annotations...
    • Denise Krefting
       
      What is the Iowa Core calling these?
  • Do the results provide clear direction for what to do next?
    • Linda Hoobin
       
      What plan is provided for improvement with the Iowa Assessments?
    • Darin Johnson
       
      I would like to see an efficient, real-world model of such a system.
    • Joletta Yoder
       
      I would love to see our inservices allow for time to have such reflections on our assessments and allow us to redirect our planning. How much more would we see student growth if we not only reflected and redirected but also shared our observations with colleagues who also have the students (cross-curricular and at the next level) to have growth be specific and continual rather than a 9 month experiment that restarts from Ground Zero the following year!
    • parsonsbrandi
       
      Yes! There's so much research that values reflection, and yet it's something that one almost feels "guilty" doing on contract time.
  • Selecting an assessment method that is incapable of reflecting the intended learning will compromise the accuracy of the results.
    • Lori Pearson
       
      This shows how important it is to set your learning targets and then make sure your assessment gives you the information that you are seeking in regards to those targets.
    • jalfaro
       
      Without proper training, I'm sure this happens all too often. Teachers often teach and test based on their own experiences and not based on best-practices.
    • Linda Hoobin
       
      If you can't determine an assessment to match your learning target, could it be that your learning target needs revision?
    • Julie Townsend
       
      I couldn't agree with you more! Some teachers refuse to open up to the latest in best practice, assuming that '36' years of teaching for example, has given them enough info to have 'all' the answers. And if the assessment is too difficult to create to match the target, why yes, revise the target. It seems we need to think outside the box, and to remind ourselves to keep updated and in touch with the world.
    • Deb Versteeg
       
      I think many times, the catch here is the gradebook. Many stakeholders(parents, students, administrators, etc.) have very rigid expectations for grading and equate assessment and grading. Teachers don't know how to manage both effectively, and tend to default to the needs of the gradebook for survival.
    • Lori Pearson
       
      Ah.......the gradebook. I believe you have hit the nail on the head, Deb.
    • Denise Krefting
       
      I have found it useful for another person to look at the assessment. Especially someone in a different curriculum area.
    • Deborah Ausborn
       
      That sounds like a good idea. Why, specifically, do you use someone from a different curriculum area? I can think of some ideas, but I don't know if they are the ones you are considering.
  • After defining inference as "a conclusion drawn from the information available,"
    • Denise Krefting
       
      So.. if my rubric says " requires deep thought" and I define or give examples of deep thought would that be better. I am struggling with the use of those words in my rubric- my participants have had not difficulty with the words, I just feel it isn't as specific as maybe I should make it....
    • Julie Townsend
       
      What is the definition of 'deep'?
  • a student might assess how strong his or her thesis statement is by using phrases from a rubric,
    • Lori Pearson
       
      Connection to rubrics in my group during the first week-are the phrases strong and promote further progress in their learning?
    • Darin Johnson
       
      I like the phrase "using phrases from a rubric." I think I'll borrow this idea and phrasing!
  • If we don't begin with clear statements of the intended learning—clear and understandable to everyone, including students—we won't end up with sound assessments.
    • Peggy Christensen
       
      I remember once writing a test item that had a term in it that my sophomore biology students didn't understand. Some asked me what the word meant, but what about those who were too embarrassed to ask?
    • Linda Hoobin
       
      This helps solidify the Iowa Core characteristic of effective instruction--assessment for learning and why it is part of the Iowa Core.
    • parsonsbrandi
       
      I can relate this to my children and the way that my husband and I differ on how we give directions. For example, he may say, "Your job is to be good." To a three and a five year old, "be good" is a very vague term. I might say something along the lines of, "Your job is to listen without interupting me, use good manners like saying, 'please and thank you,' and to sit down while we're eating dinner."
  • Figure 2 (page 18) clarifies which assessment methods are most likely to produce accurate results for different learning targets.
    • Peggy Christensen
       
      I have seen this chart from Stiggins work before and have found it to be quite useful. This reminds me of why we need to take the written portion to get an Iowa Driver's license, as well as taking Driver's Ed. or taking the Driving portion (of the test) to get a Driver's License. We need to know both the factual "stuff" (like what a STOP sign means), as well as the skill of being able to actually drive a vehicle.
  • new levels of testing that include benchmark, interim, and common assessments.
    • jalfaro
       
      And I wonder how much Professional Development teachers (new and old) have been given to support them as they face the new assessment expectations. I think too much is taken for granted...teachers need training if all of this testing and data is to make a real difference for our students.
    • Cheryl Merical
       
      Totally agree!! Teachers need to know not only how and why they are collecting data.  But how to use the data to make instructional decisions.
  • the use of multiple measures does not, by itself, translate into high-quality evidence.
    • jalfaro
       
      Exactly! More is necessarily better.
  • and the students themselves
    • jalfaro
       
      I think that we often forget about this part of the equation! I remember all too often getting a computer generated page back with test results that I couldn't understand and I'm sure that this is still happening nationwide. We must not forget that our jargon must be translated to the student and the parent so that all stakeholders are on the same page.
  • test plan.
    • jalfaro
       
      And how often do we as teachers fly by the seat of our pants?
    • Linda Hoobin
       
      This takes me back to DWALA training from Heartland AEA years ago. Anyone else remember this?
    • Julie Townsend
       
      We do sometimes, especially when placed into a different level of programming at the end of the school year.
  • noise distractions
    • jalfaro
       
      I once had to ask that they stop mowing the grass just outside my classroom window while my students took the FCAT Reading test in Florida...minor details like this can make a HUGE difference for the kids testing! I couldn't believe that my administrators hadn't considered all of the details.
    • terri lamb
       
      This can be major for some students - I took a professional knnowledge test years ago in an auditorium and the monitors were talking softly at the front but it really carried - they had no idea and I didn't say anything but noise doesn't normally bother me so I know it bothered others.
  • assessment literate
    • jalfaro
       
      something else that I think is often taken for granted....
    • Cheryl Merical
       
      Agree. . .another reason for TA for teachers regarding how to not only gather data, but understand how to use it.
    • Marcia Jensen
       
      Here lies a bigger problem than we want to acknowledge.
  • Clear Learning Targets
    • Sandy Kluver
       
      When I first read Stiggins and Chappius' works, it was clear that targets need to be static... not moving! We can't expect students to hit a moving target.
    • Lori Pearson
       
      If you don't know where you're going, how can you get there?
  • function CheckKaLogin() { if (getQuerystring('kalogin') != "") { window.location.href = window.location.href.replace('?kalogin=1', ''); } } function getQuerystring(key, default_) { if (default_==null) default_=""; key = key.replace(/[\[]/,"\\\[").replace(/[\]]/,"\\\]"); var regex = new RegExp("[\\?&]"+key+"=([^&#]*)"); var qs = regex.exec(window.location.href); if(qs == null) return default_; else return qs[1]; } window.onload = function() { if (getQuerystring('kalogin') != "" ) { // window.location.href = window.location.href.replace('?kalogin=1', ''); //alert('kalogin'); } } .smallf { font-size:9px; } MEMBER SIGN IN Username / Customer ID / E-mail Password Forgot your Username or Password? JOIN ASCD &nbsp;|&nbsp;MEMBER BENEFITS Register for ASCD EDge &nbsp; var userNameField='dnn_ctr898_ViewLoginModule_txtUserName';var passwordField='dnn_ctr898_ViewLoginModule_txtPassword';var loginField='dnn_ctr898_ViewLoginModule_btnSignIn'; function printPage() { window.print(); } //function sendData() //{ // window.open('/dnn/desktopmodules/VCMPrintSendArticleModule/sendfriend.htm'); //} function sendData(data) { // Initialize packed or we get the word 'undefined' var packed = ""; for (i = 0; (i < data.length); i++) { if (i > 0) { packed += ","; } packed += escape(data[i]); } window.location = "/dnn/desktopmodules/VCMPrintSendArticleModule/SendFriend.htm?" + packed; } function openWindow(url) { window.open(url, 'mywindow', 'width=350,height=370,directories=no,location=no,menubar=no,scrollbars=no,status=no,toolbar=no,resizable=yes'); } Print This ArticleSend to a Friend OAS_AD('Right'); Online Store ASCD's Top 5 Books Classroom Instruction That Works Enhancing Professional Practice, 2nd Edition The Art and Science of Teaching http://shop.ascd.org/productdisplay
  • aim for the lowest possible reading leve
    • Sandy Kluver
       
      This really surprises me. I've never thought to write a test at the least possible reading level. With my ESL students, I always make sure the words aren't new to the students but hadn't thought about the level I was writing the test at.
  • Use a reading score from a state accountability test as a diagnostic instrument for reading group placement.
    • Sandy Kluver
       
      hmmm... we do this for Instructional Decision Making groups in Carroll. It's only one piece of the puzzle, but at the beginning of the year, we rely on the ITBS Reading Comp score to place students into groups.
    • Cheryl Merical
       
      Unfortunately, I think that is a common practice of many districts.
    • Deb Versteeg
       
      Sandy, I've always been bothered by this part of IDM, also.
    • Marcia Jensen
       
      I have done this myself at the high school level. No other data exists for my use in connection with students I don't know and time constraints.
  • Seven strategies of assessment for learning.
    • Linda Hoobin
       
      This is one of the most practical resources on assessment that I have read in a long time. I recommend it to all!
  • cultural insensitivity
    • Linda Hoobin
       
      I witnessed this first hand when the demographics in one district changed dramatically over the course of about two years. For younger students, pictures in an assessment were used. Several of the students had never seen a rose, but they knew it was a flower--but flower wasn't a choice.
    • Cindy Blinkinsop
       
      This is so true! One night my husband and I were watching COPS and they were in NYC. A little boy pointed to the very small grassy area in between four apartment buildings that made a square and said, "He just ran through that meadow." I looked at my husband and said, "That kid would flunk the ITBS because he doesn't know the true definition of a meadow...for him, the small grassy area is a meadow. But for our region, a meadow is described totally differently and looks totally different." Test writers do not consider regional vocabulary enough when putting together an assessment. It is still 'one size fits all.'
    • Marcia Jensen
       
      There are some obvious things when it comes to cultural sensitivity. There are also some things a person preparing a test just might not know since their culture is different.
  • access to the data they want when they need it,
    • Linda Hoobin
       
      This implies timely feedback.
  • students
  • learning continuum
    • Linda Hoobin
       
      Learning progressions that Margaret Heritage talks about in Assessment for Learning.
  • The classroom is also a practical location to give students multiple opportunities to demonstrate what they know and can do
    • Linda Hoobin
       
      Multiple is the key word here!
    • Cindy Blinkinsop
       
      I agree - multiple opportunities. We need to consider the various learning styles that we are teaching to each day and how each will best be able to show proficiency based on a product meaningful to the learner.
  • the reason for assessing is to document individual or group achievement or mastery of standards and measure achievement status at a point in time.
    • Julie Townsend
       
      Mastery is what we want as teachers, and using an accurate assessment done frequently should show us how far students have come in their achievement.
  • Choosing the Right Assessment
    • Julie Townsend
       
      I like this table--the categories and the description within.
    • Cheryl Merical
       
      Agree. Would be a good reference tool for all teachers.
    • Lisa Buss
       
      I think I will use this as a reference.
    • Deborah Ausborn
       
      I agree as well. This would be a good tool to share with my home school parents.
    • Joletta Yoder
       
      Great reminder for all of us, especially English teachers, that we can, and should, be using various forms of assessment. I'm hitting PRINT right now and posting this on my wall in and in my planning folders!
  • Specific, descriptive feedback linked to the targets of instruction and arising from the assessment items or rubrics communicates to students in ways that enable them to immediately take action, thereby promoting further learning.
    • Darin Johnson
       
      Whenever I read the word "specific," I can't help but to remember my third year of teaching when the English 9 teachers would share an old reel-to-reel converted to VHS instructional video with the class. Several minutes into the video, the narrator would tell the students: "Specific is terrific." This type of feedback is really the exception rather than the rule, isn't it?
    • Deborah Ausborn
       
      This is really good practice, but extremely time consuming. We need to include as much as possible, but it may not always be feasible or possible to do it all the time.
  • build balanced systems, with assessment-literate users
    • Cheryl Merical
       
      Wouldn't an RTI model with all its components (e.g., universal screening, progress monitoring, etc.) implemented with fidelity, meet this criteria??
  • Creating a plan like this for each assessment helps assessors sync what they taught with what they're assessing.
    • terri lamb
       
      .This is a great way to document each assessment.
  • In the case of summative tests, the reason for assessing is to document individual or group achievement or mastery of standards and measure achievement status at a point in time.
    • Darin Johnson
       
      The point where my assessment breaks down is that my formative assessments are almost always for individuals rather than for groups. Aside from ITEDs, no one beyond my classroom seems concerned with assessment data.
  • inform instructional improvement and identify struggling students and the areas in which they struggle
    • Cheryl Merical
       
      If we can identify students at-risk earlier through regular progress monitoring, we can move away from the "waiting to fail" model. 
  • Students learn best when they monitor and take responsibility for their own learning.
    • terri lamb
       
      When we begin a project in desktop publishing the students and I brainstorm the different skills and techniques they can demonstrate and use in the project which in turn becomes their checklist or rubric. They feel more ownership and may need to revisit a skills that other students - they often require more of themselves as well.
    • Lisa Buss
       
      I think this is very true and I also believe that the learning is at a higher level.
  • For each assessment, regardless of purpose, the assessor should organize the learning targets represented in the assessment into a written test plan that matches the learning targets represented in the curriculum
    • Lisa Buss
       
      In other words, we must test over wht we've taught?
    • Deb Versteeg
       
      Or....we need to be sure that students are learning what is going to be assessed. And what is going to be assessed is aligned with the intended learning target. I think too often in classrooms, the teaching is first, then the learning, then the alignment with the assessments or definied learning targets.
    • Natalie Smithhart
       
      So we need to decide what is going to be assessed first before we create the curriculum. I think often as teachers we do this the other way around. Seems like it should be simple, but sometimes I find myself creating my curriculum before I have decided what I might need to assess.
  • Teachers should design the assessment so students can use the results to self-assess and set goals.
    • Lisa Buss
       
      I need to do a better job of this!
  • Annual state and local district standardized tests serve annual accountability purposes, provide comparable data, and serve functions related to student placement and selection, guidance, progress monitoring, and program evaluation.
    • Lisa Buss
       
      But, in my opinion, what's being taught isn't necessarily what's being evaluated.
  • As a "big picture" beginning point in planning for the use of multiple measures, assessors need to consider each assessment level in light of four key questions, along with their formative and summative applications1
    • Lisa Buss
       
      This is brand new to me!
  • Summative applications refer to grades students receive (classroom level)
    • Lisa Buss
       
      I wish we could get away from grades and move to a benchmark checklist. When the student is proficient in one skill or concept they can move on to the next.
  • At the level of annual state/district standardized assessments, they involve where and how teachers can improve instruction—next year.
    • Deborah Ausborn
       
      It is great when this data is used to improve instruction. I was teaching in Texas whe Gov. Perry took over from George Bush (late 90s). The annual testing there was used to determined which schools received the most funds for the next year. High scoring schools received more money; low scoring schools received less money. Sadly, the low scoring schools generally needed the funds so much more than the high scoring schools. I had friends teaching in downtown Houston who told me how many of their students came to school with just a plain tortilla for lunch. They needed more funds, but since they received low scores received less funds. The students from the suburbs (such as Sugarland where at that time the mean income was $100,000/year, attending private tutoring (paid for by parents) several afternoons a week so their test scores would be higher. I literally saw students and teachers who had nervous breakdowns due to the pressure on the testing results. I agree we need assessments; I'm just concerned about how some of those assessments are used.
  • Feedback to students can use the language of the rubric:
  • Although it may seem as though having more assessments will mean we are more accurately estimating student achievement
    • Deb Versteeg
       
      This is definitely a common misconception.
    • Lori Pearson
       
      Although, there are times when we need to dig deeper to find out exactly what area needs strengthening. Take reading comprehension, for example, so they are low in that area, what does that mean-many, many components make up that area.
  • The assessor
    • Deb Versteeg
       
      This term, "the assessor", in and of itself has got me thinking. While the instructor might be the one "giving" the assessment, might the "assessor" at times not be the instructor? Could the state or the district be the assessor in some cases? Could the student be the assessor?
    • Amy Burns
       
      Devil's Advocate at work here....in a perfect world, our assessments would inspire students to WANT to improve, but in reality, can a rubric really do that in and of itself?
    • Marcia Jensen
       
      I have yet to see a student use a rubric to improve a project. I think the idea of it is good, but the self-motivation is not there, or I don't know how to motivate them myself.
  • Given the rise in testing, especially in light of a heightened focus on using multiple measures, it's increasingly important to address two essential components of reliable assessments: quality and balance.
    • Amy Burns
       
      Agreed. Now, if multiple measures are indeed so important, why are we still so mired in the standardized tests to judge success?
    • Kay Durfey
       
      I believe that this article "The Quest for Quality" really gets at the heart of the importance of having "focus lessons" daily and more long-term learning targets for both teachers and students. Being specific and purposeful about what and how we want students to learn (skills and academic (vocabulary) is essential to genuine learning and performances.
  • Knowledge targets,
  • Reasoning targets
  • Performance skill targets
  • Product targets
  • It also helps them assign the appropriate balance of points in relation to the importance of each target as well as the number of items for each assessed target.
    • Marcia Jensen
       
      Is anyone besides me starting to feel overwhelmed? I guess this could be done as a districtwide assessment project, but what this article is really starting to accentuate is how little time teachers have for pondering once a school year begins.
  • This key ensures that the assessor has translated the learning targets into assessments that will yield accurate results. It calls attention to the proper assessment method and to the importance of minimizing any bias that might distort estimates of student learning.
    • Marcia Jensen
       
      This is what I really want to learn how to do!
  • A mechanism should be in place for students to track their own progress on learning targets and communicate their status to others
    • Marcia Jensen
       
      My comment here concerns this whole paragraph. I think we need to provide time to students as well as teachers for analyzing the results of assessments, and for using the results to make their projects better. As it is, no one has time to revisit the object of the assessment. Time constraints have all educational participants roaring along at breakneck speeds
  • Who is the decision maker?
    • Marcia Jensen
       
      I think this question is crucial. If the decision-maker and the purpose of the test are punitive rather than informed, no wonder people don't want to be assessed! of course we need to consider this as people who are decisionmakers and quit using tests scores to punish students--we don't like being punished for results and neither do they.
  • applying data to decisions for which they aren't suited.
  • Assessment literacy
    • Marcia Jensen
       
      Surely a staff development need.
  • A detailed chart listing key issues and their formative and summative applications at each of the three assessment levels is available at www.ascd.org/ASCD/pdf/journals/ed_lead/el200911_chappius_table.pdf
    • Marcia Jensen
       
      Hoping to share this with our data teams this year.
  • cultural insensitivity
  • Are results communicated in time to inform the intended decisions?
  • to know what constitutes appropriate and inappropriate uses of assessment results—thereby reducing the risk of applying data to decisions for which they aren't suited.
  •  
    The point where my assessment breaks down is that my formative data is rarely shared with others. We don't look for trends or patterns or discuss needed changes in content or instructional delivery.
  •  
    I believe that this article "The Quest for Quality" really gets at the heart of the importance of having "focus lessons" daily and more long-term learning targets for both teachers and students. Being specific and purposeful about what and how we want students to learn (skills and academic (vocabulary) is essential to genuine learning and performances.
  •  
    Founded in 1943, ASCD (formerly the Association for Supervision and Curriculum Development) is an educational leadership organization dedicated to advancing best practices and policies for the success of each learner. Our 175,000 members in 119 countries are professional educators from all levels and subject areas--superintendents, supervisors, principals, teachers, professors of education, and school board members.
susanbrown87

ollie-afe-2020summer: Educational Leadership: The Quest for Quality--article - 4 views

  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores.
    • dsunderman
       
      As an elementary teacher, I spend. so much time with my learners that I feel I can pretty accurately predict the outcome of the assessment. So the loss of instructional time is very frustrating. I know that middle school and high school teachers do not get as much time with their learners, so maybe this is not as true for them.
    • erinlullmann
       
      This is a common concern for the majority of our elementary teachers as well. We have to have 5 data points (assessments) for every standard we are reporting out, in every subject area, per quarter. We feel like all we do is assess and we don't have enough time to actually teach what we need to be teaching in between assessments.
  • Creating a plan like this for each assessment helps assessors sync what they taught with what they're assessing.
    • dsunderman
       
      When do teachers have time to create a plan like this for each assessment? Our math series has something similar already laid out, but I won't lie I don't always have or take the time to look at it.
  • avoid providing clues or making the correct answer obvious, and highlight crucial words (for instance, most, least, except, not).
    • dsunderman
       
      I struggle when writing multiple choice with not making the write answer obvious. I had not thought to highlight key directional words. I talk to my class about reading carefully and how one little word can change the question but I like the idea of highlight those words.
  • ...15 more annotations...
  • Are results communicated in time to inform the intended decisions? Will the users of the results understand them and see the connection to learning? Do the results provide clear direction for what to do next?
    • dsunderman
       
      This was a struggle when we suddenly went online in the spring. My students were so use to face to face feedback that I really struggled getting them to look at the feedback through Schoology. I plan to teach that skill right away this fall.
  • Because classroom teachers can effectively use all available assessment methods, including the more labor-intensive methods of performance assessment and personal communication, they can provide information about student progress not typically available from student information systems or standardized test results
    • dsunderman
       
      So true and ofter forgotten or overlooked.
  • a
  • The four categories of learning targets
    • bushb13
       
      We are required to post content and language targets each day. I really like how this puts learning targets in four categories and provides examples. This information would make it helpful when determining and writing the targets for each class period.
    • erinlullmann
       
      I agree. In addition, I think it would be helpful to look at the standard from the Iowa Core that we are trying to instruct or assess. The wording of the standard should help indicate which type of learning target it should be and therefore we need to make sure to teach and assess it accordingly. Often times, teachers will slightly tweak the wording in a standard to change it from a performance skill to a knowledge target.
  • Specific, descriptive feedback linked to the targets of instruction and arising from the assessment items or rubrics communicates to students in ways that enable them to immediately take action, thereby promoting further learning.
    • bushb13
       
      I know how important specific and descriptive feedback is for students to understand their mistakes and move forward. I use various forms of formative assessment, but struggle to be timely when the feedback must be very specific. In face-to-face classes, this can be done quickly. How can I be efficient with providing constructive feedback in an online course?
  • Figure 2 clarifies which assessment methods are most likely to produce accurate results for different learning targets.
    • bushb13
       
      Figure 2 provides an efficient and helpful way to determine which type of assessment method is best for various types of learning targets. It would also be helpful for ensuring that you use various types of assessment methods on your classes.
    • erinlullmann
       
      I love this table. It clearly outlines the purpose for learning/type of learning target and aligns the assessment methods. I think this would be extremely beneficial to teachers who are in the process of writing assessments.
  • assessment-literate teachers would not Use a reading score from a state accountability test as a diagnostic instrument for reading group placement.
    • bushb13
       
      In my school district, a student's ELA score on the Iowa Statewide Assessment of Student Progress (ISASP) is used to determine if a student is placed in an LA Support class. In a previous section, the article states that standardized test scores can serve functions related to student placement and selection. Does this mean it is okay to use standardized test scores to determine placement or that it isn't appropriate?
    • erinlullmann
       
      I think you brought up a great point. We also use FAST and ISASP to determine placement in courses. However, when I read the bulleted statement that you highlighted, I interpreted it differently than course placement. In my mind, this was referring to a teacher using something like FAST CBM-Reading results (like a words per minute score) to determine placement in a small reading group during classtime. The FAST assessment is meant to screen students for possible reading difficulties. It is not meant to be used as a diagnostic assessment, which would be an assessment that could pinpoint specific gaps in the students knowledge. In reading this could be a decoding issue, a letter-sound correspondence issue, a phonemic awareness issue, etc. When making small reading groups, we would need to take into account much more information than simply words per minute from the FAST assessment to determine strengths and needs of a student.
  • assessment literate—to know what constitutes appropriate and inappropriate uses of assessment results
    • erinlullmann
       
      I believe that in my district, especially at the elementary level, we have the need to increase our assessment literacy. As an instruction coach, I am considering including this topic in professional development sessions in the future. Does anyone have suggestions for books, videos, speakers, or resources that would be beneficial for this task?
  • Students learn best when they monitor and take responsibility for their own learning.
    • erinlullmann
       
      John Hattie's meta-analysis found that students self-reported their grades had an effect size of 1.33. This means that by self-reporting grades a student can more than triple the amount of learning in one year's time. When students truly understand what is expected of them, what success looks like, and they have tools to help them determine where they are at in the learning progression, they are more motivated and engaged in learning and therefore will learn more and achieve at higher levels. Knowing that though (and I'm coming from an elementary background) - how can we build this into our classrooms? What does this look like for kindergartners?
  • teachers must provide the results in a way that helps students move forward.
  • Specific, descriptive feedback linked to the targets of instruction and arising from the assessment items or rubrics communicates to students in ways that enable them to immediately take action, thereby promoting further learning.
    • susanbrown87
       
      I think this step gets missed sometimes due to time constraints in the classroom when face to face. This is something I need to improve on, without it the assessment is essentially worthless. Online this spring I was able to give more specific feedback to all as they competed assignments.
  • We're betting that the instructional hours sacrificed to testing will return dividends in the form of better instructional decisions and improved high-stakes test scores.
    • susanbrown87
       
      A few years ago we found ourselves testing 4 times a year and in some subjects 7 times a year. It felt like all we did was test and teachers were not using the results to drive instruction so the time was wasted. Whenever assessments are given the results are only worth the time if incorporated into instruction. The more we tested we found the students putting forth less effort and we didn't feel like the assessments were accurate representations of ability.
  • Students learn best when they monitor and take responsibility for their own learning.
    • susanbrown87
       
      I agree with you, students learn more when they take responsibility for their learning. Any ideas on how to motivate them to do this? There are a few that jump up to the plate, its hard to get all to see the benefit.
  • assessment-literate teachers would not Use a reading score from a state accountability test as a diagnostic instrument for reading group placement.
    • susanbrown87
       
      In addition to the FAST score our district also looked at results from the NWEA test that was taken 3 times a year to plan interventions and group students.
  • Because classroom teachers can effectively use all available assessment methods, including the more labor-intensive methods of performance assessment and personal communication, they can provide information about student progress not typically available from student information systems or standardized test results
    • susanbrown87
       
      Often stakeholders do not see this. I wonder if going standards based would be beneficial to allow everyone to see the progress and success rather than just a number. This makes communication so important.
1 - 10 of 10
Showing 20 items per page