OLLIE Iowa

While this seems like a straightforward idea, in reality, making a learning purpose clear and understandable to everyone - students included - can be difficult. Especially in English, the skill were teaching is not clear cut. CCSS Reading Literature 11-12.6 asks students to "Analyze a case in which grasping a point of view requires distinguishing what is directly stated in a text from what is really meant." However, there's no "right" answer to this skill. Student analysis of "what is really meant" could encompass a huge range of ideas. Crafting an assessment and teaching/learning opportunities that clearly delineate "proficient" analysis from "poor" analysis can't always be put into clear and understandable language. How can you quantify the qualitative?

There is truth in the challenge. But I know I have been guilty of knowing what I was looking for but not clearly communicating it to students. Then they are left to guess...which means they are likely to guess in at least some ways incorrectly. I think the more modeling we do, the more "anchor papers" we provide, the better students achieve our expectations. Putting those expectations into words and examples is its own challenge, but a worthy one.

It is nice to hear from other high school English teachers about the difficulty of measuring such subjective skills. I always struggled. One strategy I did find helpful was assigning paragraph writing as an assessment and scoring them 1-5, with a 3 being adequate and a 5 outstanding Then we would do several together and discuss what constituted a 3 and the differences between 3-4-5. That did seem to help, and students personalized the challenge of getting at least a 3 to show competency and reaching for outstanding.

I really like this chart, it's easy to follow and easy to read.

This is where I know as an English teacher, I can get bogged down in the details. All of my writing assignments have an assessment category for "M.U.G.S." as we call them (mechanics, usage, grammar, spelling), but those aren't actively taught and retaught every unit. We just expect students to have a certain level of proficiency at this point. However, that isn't always the case. There are MANY students who have not internalized the "rules" of writing. Their mechanics (punctuation) seems haphazard, grammar atrocious, usage nonexistent, and spelling like they fell asleep on their keyboard. However, a complete lack of those skills might not prevent them from being able to distinguish "what is directly stated in a text from what is really meant." I have to be careful to not allow my internal bias against poor writing ability to distort an accurate estimate of a student's learning and demonstration of the skill.

When I read through this about minimizing bias it made me think of the old ITBS/ITED tests and a student we had that was new to this country. The student was very bright but he did not perform well on the test because of bias. One example I recall was he had no idea what a fir tree was as where he was from there was no such thing.

This is also where I struggle. Our department uses the online program Turnitin.com to give students feedback on written assessments and grade almost all work. This is partially to alleviate issues with plagiarism, but mostly because it gives students and teachers a one access point to communicate feedback. The program allows users to submit rubrics that students can see. We've started assessing rough draft using the final rubric so students can see where their work is in the rough draft stage so they know which paper criteria need work. They also can view my feedback on the paper that tells them how to fix what they need to fix. My frustration is when students aren't willing to go back and look at the feedback on the paper or rubric so they know what learning skills they still need to work on. How can we motivate them to look at the results, see the connections, and make the progress in learning?

That is a great point! How do we motivate kids to go back and look at the feedback and make changes. Many of our kids just want to know what do I need to know to pass the test or assignment and once they pass that's all that matters.

You have mentioned before that kids always want to know what they have to do in order to get an A or pass...but that's what I want to know when I take a course. I want/need to know what the expected outcomes are. I feel that kids have so many classes, tests, and assignments that if they don't ask those questions or think in that kind of a structured fashion that they will crash and burn. I get that we want them to LEARN and be passionate, but especially in required courses, the passion just isn't always there and the class literally is a box to check off.

This is another area where I personally struggle. The time and flexibility needed to be truly responsive is astronomical. I currently teach 4 of the 10 sections of English 10 at Indianola High School. As a class cohort, we try to be within a day or two of each other in content delivery. However, if my students don't get a concept, it's difficult to take a day to reteach since that throws off my alignment with the other teachers. It also means that I would have would have different periods at different places. I'm hoping the flipped and blended learning opportunities will help with the time and organization issues I currently have. If I can break groups up into smaller cohorts based on skill, then use flipped/blended methods for each group, I can (hopefully) accomplish more within the time frame. It makes organization more complicated, but allows more flexibility.

This is why common formative assessments can be so helpful. If some of your students aren't getting something, it's likely that others aren't either. If you look at the whole team's formative data, it could be that everyone needs to adjust rather than just you.

And if your class is doing more poorly than another class, you can have conversations about the different instructional practices being used. We all do our best but it's ok to not be the best. Together we can do what is best for our students.

We do need to make sure that our feedback is helpful. Telling students "fix this" or "revise this paragraph" doesn't help them learn, the feedback needs to be more specific and point to the learning target.

I totally agree with giving feedback about why they missed a question or problem. If you just count it wrong the student might now have any idea why they got the question wrong.

As teachers we do have to be careful of bias and making assumptions. When I read through this about minimizing bias it made me think of the old ITBS/ITED tests and a student we had that was new to this country. The student was very bright but he did not perform well on the test because of bias. One example I recall was he had no idea what a fir tree was as where he was from there was no such thing.

I completely understand this. Teaching writing and reading at the secondary level is so very difficult.

Shouldn't this be the goal of all assessments? If it serves other purposes great. If this does not become the focus of the assessment, then a student will start chasing points.

Ideally testing should serve the purpose of helping the teacher and student see areas where they need improvement...

I think this is a real problem with ISASP

I'm willing to let ISASP run its course though - I think it is vastly improved from the old ITBS. At least it does have open ended questions and require students to process and write instead of the good ole A, B, C, or D.

I think that these decisions are made too infrequently. One test may place a student in a group that is not in your zone of proximal development. They may be stuck there for quite some time.

From my experience, most of the high stakes testing explicitly states that the results should not be used on the individual student decision making level. Oh the irony....

This is tough to implement. Students don't know intuitively how to do this on their own. There has to be coaching a feedback provided. I know that I have not implemented this to any degree of fidelity, but I am amazed at what students come up with on their own. They need to know they have that freedom, and that comes with the knowledge of how to use it.

It is important for students to have the freedom to choose things that are meaningful to them. When that happens they buy into learning.

I agree that this is tough to implement but I think it is a critical component. The freedom of students getting to play a key role in their own learning is so fun to watch. I am amazed when I see even a small taste of this, the difference in the students' attitudes and motivations.

When students are given an actual choice, it does seem to make a world of difference in their efforts. It also seems like they are more excited for class, and sometimes even upset when the period ends.

I love this line! We have to help students do things for themselves. I don't know about you, but implementing this for the vast majority of students takes so much time in getting them comfortable with the desire to learn. I know, I know, I'm just trying to pass the buck onto someone that "should have taught them that". How do I do it? I need to only consider reality, it doesn't matter if they don't know how. They need to learn how, and that is where I need to focus my attention.

This is a powerful distinction. Teaching kids how to do things for themselves is something that I believe is important. The kids in my school lack the intrinsic motivation to do anything, except play Minecraft. As in many initiatives in education, I think that it is not necessarily that we should make a shift from one thing to another, but how can we blend the good from all? That is, how can we blend personalization and personal learning, not just follow one or the other.

Wow! This really jumped out at me. I don't think many people would acknowledge the difference between personalized and personal learning. When described like this... it really makes me think of the key distinctions that must be made. The important part is not just that we are altering our instruction to what our students like but encouraging the development of personal learning experiences and helping set our students up for successful experiences when this is done.

Who has the time for this? I say it sarcastically, but this is really a numbers game. 25 kids, 45 minutes, 90 class periods in a semester. That is 2.7 hours per student. That includes getting to know students, helping with personalization choices, decision making, monitoring learning, providing feedback, monitoring new learning, providing more feedback on dozens of standards. Our system isn't designed to foster personalized learning. We are trying to fit a square key in a round hole.

It's true, this is definetely a system-problem. It's one of the questions I'm hoping to answer through this course. Can these concepts be used in smaller ways and have a significant impact? They do ask a lot of us as educators.

I think of this as adaptive learning. it can be a valuable resource in personalization. Going back millenia, personalization began with the socratic method from Socrates himself. He was able to adapt learning through questioning, but he didn't rely on technology. He also had groups of 10 students for extended periods of time. So maybe technology allows teachers to have a larger effective reach than without it. In today's world, do you think technology aided learning is essential?

Standardized tests seem counterintuitive to innovative learning. How do we balance the two?

If the standardized tests are on concepts/objectives that we think all students show know/understand as they progress through school, they should be general enough that students can approach them from different ways/their own ways and still achieve the objectives.

Admin is always worried about test scores and rankings but if we want to give students the freedom to learn what they want the admin may be concerned about scores.

We definitely need to make sure we consider what needs to be taught first and then how can technology make it better.

Good point Kelley.

This is so true when people have the opportunity to collaborate with one another it elevates their learning and productivity. Ideas help beget other ideas and help stimulate thoughts and create questions.

I see the confusion stemming from a linguistic debate about whether "directions" refers to the task requirements (e.g. write a persuasive essay using 5 sources) or the assessment criteria (cites strong and thorough textual evidence). Many times students ask to see the "rubric" when they really just mean the specific task requirements.

I find this interesting that they are assessing "behavioral objectives." Much of what our discussions around grading versus assessing have focused on is the need to grade/assess the demonstrated learning and NOT the behavior which lead to the demonstrated learning.

I tried having students create their own rubrics for an independent learning project. They were all high achieving seniors near the end of their secondary academic career. And across the board, NONE of them said they enjoyed the process, calling it one of the hardest parts of the project as a whole. ALL said it was very eye opening. Ironically, these high-achieving, point grubbing seniors found it MORE difficult to define for themselves what a "perfect" project would be, then to just rise to standards already set by someone else (me). Having to set the bar themselves made them far more nervous about meeting it than if I had set a goal for them to meet. It does make sense, however. By setting their own standards, they would potentially be letting themselves down if they did not rise to their own challenges. Whereas, if they did not fully meet the criteria on a teacher generated rubric, it did not necessarily reflect badly on themselves.

Fascinating and insightful!

Wow. Good points!

See, these seem more like task requirements rather than assessable rubric criteria

Yes Wendy, I agree. This would be an assignment, but not in the rubric.

Yes, and if that's all you want to grade, you could just make it a checklist and save yourself a lot of prep time!

I think that a checklist instead of a rubric in that case is a great idea.

Is there anyone who DOESN'T do this?

Most of mine are the same but then I change the content part for the details of the assignment.

Interestingly, until the 2019-2020 school year, the College Board and AP programs have always used holistic rubrics to score the written essay portions of the exams (at least the English Language and Literature exams). These were used because, especially for the third free-response question, students could choose to respond to any aspect of the passage they chose. With the third free-response question, students had a choice about what text to use to respond to a very vague thematic prompt. Holistic rubrics were necessary to meet the needs of all these different approaches. Beginning next year, during the 2019-2020 school year, the College Board and AP program are replacing all holistic rubrics with analytic ones to "more specific feedback on your Instructional Planning Reports about your students' performance." Interestingly, this feedback is not to the students - students never see their rubrics - but to the teachers so the teachers can adjust their teaching. https://apcentral.collegeboard.org/courses/ap-english-literature-and-composition/course/updates-2019-20

That's interesting! The College Board switched to an analytical rubric for social studies a few years ago. It will be interesting to compare those.

In the case of social studies, it gives the student and teacher more specific guidance in what should be included rather than feedback.

I mentioned this above, but the College Board and the AP program are changing their use of rubrics from holistic to analytic to provide TEACHERS with a better understanding of student performance and comprehension. It's interesting that the audience for these new rubrics will not be the students who are being assessed, but the teachers who taught them. Who is really being assessed here?

Great point!

While this makes complete sense and would be a great use of PLCs, my instinctual response was "Oh Geez. Yet another thing..."