After her training in using the VALUE rubrics, Mullaney gathered nine faculty members on her campus to be the core of the two-year college's project group. They were previously unfamiliar with the rubrics, she says, but together they "went through them with a fine-toothed comb" and agreed "that these rubrics do represent an accurate way to assess these skills." The professors brought in their own (and their colleagues') assignments to see how well (or poorly) they aligned with the rubrics, Mullaney said. "Sometimes their assignments were missing things, but they could easily add them in and make them better."
The last step of the process at the institutional level, she said, was gathering a representative sample of student work, so that it came from all of CCRI's four campuses and 18 different disciplines, and mirrored the gender, racial and ethnic demographics and age of the community college's student body. Similar efforts went on at the other 60-odd campuses.
Tom Woodward on 25 Jul 15": Hansen's study comes via a nontraditional publishing decision by its authors. The study will be published in Atmospheric Chemistry and Physics, an open-access "discussion" journal, and will not have formal peer review prior to its appearance online later this week. [Update, July 23: The paper is now available.] The complete discussion draft circulated to journalists was 66 pages long, and included more than 300 references. The peer review will take place in real time, with responses to the work by other scientists also published online. Hansen said this publishing timeline was necessary to make the work public as soon as possible before global negotiators meet in Paris later this year. Still, the lack of traditional peer review and the fact that this study's results go far beyond what's been previously published will likely bring increased scrutiny. On Twitter, Ruth Mottram, a climate scientist whose work focuses on Greenland and the Arctic, was skeptical of such enormous rates of near-term sea level rise, though she defended Hansen's decision to publish in a nontraditional way."
