Skip to main content

Home/ Middle School Matters/ Group items tagged measuring

Rss Feed Group items tagged

17More

The Sabermetrics of Effort - Jonah Lehrer - 0 views

  • The fundamental premise of Moneyball is that the labor market of sports is inefficient, and that many teams systematically undervalue particular athletic skills that help them win. While these skills are often subtle – and the players that possess them tend to toil in obscurity - they can be identified using sophisticated statistical techniques, aka sabermetrics. Home runs are fun. On-base percentage is crucial.
  • The wisdom of the moneyball strategy is no longer controversial. It’s why the A’s almost always outperform their payroll,
  • However, the triumph of moneyball creates a paradox, since its success depends on the very market inefficiencies it exposes. The end result is a relentless search for new undervalued skills, those hidden talents that nobody else seems to appreciate. At least not yet.
  • ...14 more annotations...
  •  One study found that baseball players significantly improved their performance in the final year of their contracts, just before entering free-agency. (Another study found a similar trend among NBA players.) What explained this improvement? Effort. Hustle. Blood, sweat and tears. The players wanted a big contract, so they worked harder.
  • If a player runs too little during a game, it’s not because his body gives out – it’s because his head doesn’t want to.
  • despite the obvious impact of effort, it’s surprisingly hard to isolate as a variable of athletic performance. Weimer and Wicker set out to fix this oversight. Using data gathered from three seasons and 1514 games of the Bundesliga – the premier soccer league in Germany – the economists attempted to measure individual effort as a variable of player performance,
  • So did these differences in levels of effort matter? The answer is an emphatic yes: teams with players that run longer distances are more likely to win the game,
  • As the economists note, “teams where some players run a lot while others are relatively lazy have a higher winning probability.”
  • There is a larger lesson here, which is that our obsession with measuring talent has led us to neglect the measurement of effort. This is a blind spot that extends far beyond the realm of professional sports.
  • Maximum tests are high-stakes assessments that try to measure a person’s peak level of performance. Think here of the SAT, or the NFL Combine, or all those standardized tests we give to our kids. Because these tests are relatively short, we assume people are motivated enough to put in the effort while they’re being measured. As a result, maximum tests are good at quantifying individual talent, whether it’s scholastic aptitude or speed in the 40-yard dash.
  • Unfortunately, the brevity of maximum tests means they are not very good at predicting future levels of effort. Sackett has demonstrated this by comparing the results from maximum tests to field studies of typical performance, which is a measure of how people perform when they are not being tested.
  • As Sackett came to discover, the correlation between these two assessments is often surprisingly low: the same people identified as the best by a maximum test often unperformed according to the measure of typical performance, and vice versa.
  • What accounts for the mismatch between maximum tests and typical performance? One explanation is that, while maximum tests are good at measuring talent, typical performance is about talent plus effort.
  • In the real world, you can’t assume people are always motivated to try their hardest. You can’t assume they are always striving to do their best. Clocking someone in a sprint won’t tell you if he or she has the nerve to run a marathon, or even 12 kilometers in a soccer match.
  • With any luck, these sabermetric innovations will trickle down to education, which is still mired in maximum high-stakes tests that fail to directly measure or improve the levels of effort put forth by students.
  • After all, those teams with the hardest workers (and not just the most talented ones) significantly increase their odds of winning.
  • Old-fashioned effort just might be the next on-base percentage.
19More

Principal: Why our new educator evaluation system is unethical - 0 views

  • A few years ago, a student at my high school was having a terrible time passing one of the exams needed to earn a Regents Diploma.
  • Mary has a learning disability that truly impacts her retention and analytical thinking.
  • Because she was a special education student, at the time there was an easier exam available, the RCT, which she could take and then use to earn a local high school diploma instead of the Regents Diploma.
  • ...16 more annotations...
  • Regents Diploma serves as a motivator for our students while providing an objective (though imperfect) measure of accomplishment.
  • If they do not pass a test the first time, it is not awful if they take it again—we use it as a diagnostic, help them fill the learning gaps, and only the passing score goes on the transcript
  • in Mary’s case, to ask her to take that test yet once again would have been tantamount to child abuse.
  • Mary’s story, therefore, points to a key reason why evaluating teachers and principals by test scores is wrong.
  • It illustrates how the problems with value-added measures of performance go well beyond the technicalities of validity and reliability.
  • The basic rule is this: No measure of performance used for high-stakes purposes should put the best interests of students in conflict with the best interests of the adults who serve them.
  • I will just point out that under that system I may be penalized if future students like Mary do not achieve a 65 on the Regents exam.
  • Mary and I can still make the choice to say “enough”, but it may cost me a “point”, if a majority of students who had the same middle school scores on math and English tests that she did years before, pass the test.
  • But I can also be less concerned about the VAM-based evaluation system because it’s very likely to be biased in favor of those like me who lead schools that have only one or two students like Mary every year.
  • When we have an ELL (English language learner) student with interrupted education arrive at our school, we often consider a plan that includes an extra year of high school.
  • last few years “four year graduation rates” are of high importance
  • four-year graduation rate as a high-stakes measure has resulted in the proliferation of “credit recovery” programs of dubious quality, along with teacher complaints of being pressured to pass students with poor attendance and grades, especially in schools under threat of closure.
  • On the one hand, they had a clear incentive to “test prep” for the recent Common Core exams, but they also knew that test prep was not the instruction that their students needed and deserved.
  • in New York and in many other Race to the Top states, continue to favor “form over substance” and allow the unintended consequences of a rushed models to be put in place.
  • Creating bell curves of relative educator performance may look like progress and science, but these are measures without meaning, and they do not help schools improve.
  • We can raise every bar and continue to add high-stakes measures. Or we can acknowledge and respond to the reality that school improvement takes time, capacity building, professional development, and financial support at the district, state and national levels.
2More

Experts Say Measuring Non-Cognitive Skills Won't Work, But Districts Still Try | MindSh... - 0 views

  • Federal education law now requires one non-academic measure of school progress, which has led some districts to consider including students’ social and emotional growth as a performance measure.
  • She writes that even the researchers who popularized terms like “grit” think using it to measure school effectiveness is a bad idea:
1More

The differences between a geek and a nerd - 0 views

  •  
    Curious about how people use "geek" and "nerd" to describe themselves and if there was any difference between the two terms, Burr Settles analyzed words used in tweets that contained the two. Settles used pointwise mutual information (PMI), which essentially provided a measure of the geekness or nerdiness of a term.
7More

Hybrid Classes Outlearn Traditional Classes -- THE Journal - 0 views

  • Students in hybrid classrooms outperformed their peers in traditional classes in all grades and subjects, according to the newest study from two organizations that work with schools in establishing hybrid instruction.
  • The results come out of those classes where students either took the Pennsylvania System of School Assessment (PSSA) tests or Keystone Exams to measure academic achievement.
  • In one example, hybrid learning eighth grade math students at Hatboro-Horsham School District (PA) passed the PSSA tests and Keystone Exams at a rate10 percent higher than their non-hybrid peers in five schools.
  • ...4 more annotations...
  • In another example, third grade math students in the hybrid learning program at Pennsylvania's Indiana Area School District outperformed students in traditional classes by 10 percentage points on the PSSA exams.
  • scored proficient or advanced on PSSA tests at a rate 23 percent higher than the previous year with gains in all subjects: reading (up 20 percent), math (up 24 percent) and science (up 27 percent).
  • "We use a rigorous accountability system that helps us measure and report on hybrid classroom outcomes," said Dellicker President and CEO Kevin Dellicker.
  • The cost of implementing hybrid learning through the Institute's model could be considered modest. During the 2013-2014 school year, according to the report, the schools spent an average of $220 per student (not including computing devices) to transform their learning models.
9More

What poor children need in school - 0 views

  • Most educational policy elites, whether in government or in the nonprofit sector, mean well.
  • Yet policymakers tend to come from a relatively privileged slice of American society.  And they tend to possess a set of beliefs and assumptions distinct to their background. 
  • But in most cases, the fact that decision-makers inhabit a different world from students—and particularly, poor students—is a matter of great significance.
  • ...6 more annotations...
  • Poverty limits opportunity in all senses.  It restricts career paths, as policymakers recognize.  But it also denies young people equal time, resources, and exposure to discover their interests and foster their passions.  It constrains lives.
  • Schools, of course, did not create this problem.  But they do exacerbate it.  Over the past decade, well-intended policymakers concerned with closing the achievement gap have promoted policies and practices that reduce learning to something easily quantified.
  • Reformers need to understand that their narrow efforts to close the quantifiable “achievement gap” are creating another kind of educational inequity.  In other words, as they seek to close one gap they are opening up another.
  • Concerned only with the cultivation of ostensibly job-oriented knowledge and skills, they have neglected everything else that makes schools great. 
  • Our best schools are places where children gain confidence in themselves, build healthy relationships, and develop values congruent with their own self-interest.  They are places of play and laughter and discovery.
  • For contemporary education reformers, improving test scores is the only measure of school quality that matters.  And they have had some modest successes in this regard.  Yet they have merely reshuffled the deck. 
9More

Homework: An unnecessary evil? … Surprising findings from new research - The ... - 0 views

  •  A brand-new study on the academic effects of homework offers not only some intriguing results but also a lesson on how to read a study — and a reminder of the importance of doing just that:  reading studies (carefully) rather than relying on summaries by journalists or even by the researchers themselves.
  • First, no research has ever found a benefit to assigning homework (of any kind or in any amount) in elementary school.  In fact, there isn’t even a positive correlation between, on the one hand, having younger children do some homework (vs. none), or more (vs. less), and, on the other hand, any measure of achievement.  If we’re making 12-year-olds, much less five-year-olds, do homework, it’s either because we’re misinformed about what the evidence says or because we think kids ought to have to do homework despite what the evidence says.
  • Second, even at the high school level, the research supporting homework hasn’t been particularly persuasive.
  • ...6 more annotations...
  • It’s easy to miss one interesting result in this study that appears in a one-sentence aside.  When kids in these two similar datasets were asked how much time they spent on math homework each day, those in the NELS study said 37 minutes, whereas those in the ELS study said 60 minutes. 
  • it was statistically significant but “very modest”:  Even assuming the existence of a causal relationship, which is by no means clear, one or two hours’ worth of homework every day buys you two or three points on a test.
  • There was no relationship whatsoever between time spent on homework and course grade, and “no substantive difference in grades between students who complete homework and those who do not.”
  • The better the research, the less likely one is to find any benefits from homework.
  • you’ll find that there’s not much to prop up the belief that students must be made to work a second shift after they get home from school.  The assumption that teachers are just assigning homework badly, that we’d start to see meaningful results if only it were improved, is harder and harder to justify with each study that’s published.
  • many people will respond to these results by repeating platitudes about the importance of practice[8], or by complaining that anyone who doesn’t think kids need homework is coddling them and failing to prepare them for the “real world” (read:  the pointless tasks they’ll be forced to do after they leave school).
10More

Message to My Freshman Students | Keith M. Parsons - 1 views

  • Your teachers were not allowed to teach, but were required to focus on preparing you for those all-important standardized tests.
  • Your teachers were held responsible if you failed, and expected to show that they had tried hard to avoid that dreaded result.
  • First, I am your professor, not your teacher. There is a difference.
  • ...7 more annotations...
  • Teachers are evaluated on the basis of learning outcomes, generally as measured by standardized tests. If you don't learn, then your teacher is blamed.
  • We should not foolishly expect them to listen to us, but instead cater to their conditioned craving for constant stimulation.
  • Hogwash. You need to learn to listen.
  • Critical listening means that are not just hearing but thinking about what you are hearing. Critical listening questions and evaluates what is being said and seeks key concepts and unifying themes. Your high school curriculum would have served you better had it focused more on developing your listening skills rather than drilling you on test-taking.
  • For an academic, there is something sacred about a citation. The proper citation of a source is a small tribute to the hard work, diligence, intelligence and integrity of someone dedicated enough to make a contribution to knowledge.
  • For you, citations and bibliographies are pointless hoops to jump through and you often treat these requirements carelessly.
  • Your professor still harbors the traditional view that universities are about education. If your aim is to get a credential, then for you courses will be obstacles in your path. For your professor, a course is an opportunity for you to make your world richer and yourself stronger.
4More

How to Make a Quiz Work Harder for You | Cult of Pedagogy - 0 views

  • Assessments should give us loads of information about what our students understand, what they don’t understand, and how well we’ve taught them.
  • It took me years of teaching before I realized I was using my tests and quizzes to sort out, reward and punish my students, rather than measure and inform my teaching. I needed to make my assessments work harder for me.
  • I could identify specific misconceptions students had about the material and get better at addressing those the next time around. I also became a much better test maker.
  • ...1 more annotation...
  • The best part about this system is you only need a pencil, an answer key, and a few extra minutes.
14More

Curiosity Is a Unique Marker of Academic Success - The Atlantic - 0 views

  • Yet in actual schools, curiosity is drastically underappreciated.
  • The power of curiosity to contribute not only to high achievement, but also to a fulfilling existence, cannot be emphasized enough.
  • When Orville Wright, of the Wright brothers fame, was told by a friend that he and his brother would always be an example of how far someone can go in life with no special advantages, he emphatically responded, “to say we had no special advantages … the greatest thing in our favor was growing up in a family where there was always much encouragement to intellectual curiosity.”
  • ...11 more annotations...
  • They initiated their study in 1979, and have been assessing the participants based on a wide range of variables (e.g., school performance, IQ, leadership, happiness) across multiple contexts (laboratory and home) since.
  • Cognitive giftedness matters.
  • While intellectually gifted children were not different than the comparison group with respect to their temperament, behavioral, social, or emotional functioning, they did differ in regards to their advanced sensory and motor functioning starting at age 1.5, their ability to understand the meaning of words starting at age 1, and their ability to both understand and communicate information thereafter.
  • Parents of intellectually gifted children reported similar observations and were more likely than those of average children to say that their kids actively elicited stimulation by, for example, requesting intellectual extracurricular activities.
  • The researchers also measured what they described as academic intrinsic motivation and identified the top 19 percent of the 111 adolescent participants as “motivationally gifted,” displaying extreme enjoyment of school and of learning of challenging, difficult, and novel tasks and an orientation toward mastery, curiosity, and persistence.
  • Interestingly, they found very little correspondence between intellectual giftedness and motivational giftedness.
  • Students with gifted curiosity outperformed their peers on a wide range of educational outcomes, including math and reading, SAT scores, and college attainment. According to ratings from teachers, the motivationally gifted students worked harder and learned more.
  • suggest that gifted curiosity is a distinct characteristic that contributes uniquely to academic success.
  • “Motivation should not be considered simply a catalyst for the development of other forms of giftedness, but should be nurtured in its own right,”
  • All in all, the Fullerton study is proof that giftedness is not something an individual is either born with or without—giftedness is clearly a developmental process.
  • “giftedness is not a chance event … giftedness will blossom when children’s cognitive ability, motivation and enriched environments coexist and meld together to foster its growth.”
1 - 20 of 21 Next ›
Showing 20 items per page