Skip to main content

Home/ CTLT and Friends/ Group items tagged downes

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
14More

Evaluations That Make the Grade: 4 Ways to Improve Rating the Faculty - Teaching - The ... - 1 views

chronicle.com/...65226 evaluating teaching
shared by Gary Brown on 27 Apr 10 - Cached
  • For students, the act of filling out those forms is sometimes a fleeting, half-conscious moment. But for instructors whose careers can live and die by student evaluations, getting back the forms is an hour of high anxiety
  • "They have destroyed higher education." Mr. Crumbley believes the forms lead inexorably to grade inflation and the dumbing down of the curriculum.
  • Texas enacted a law that will require every public college to post each faculty member's student-evaluation scores on a public Web site.
  • ...10 more annotations...
  • The IDEA Center, an education research group based at Kansas State University, has been spreading its particular course-evaluation gospel since 1975. The central innovation of the IDEA system is that departments can tailor their evaluation forms to emphasize whichever learning objectives are most important in their discipline.
  • (Roughly 350 colleges use the IDEA Center's system, though in some cases only a single department or academic unit participates.)
  • The new North Texas instrument that came from these efforts tries to correct for biases that are beyond an instructor's control. The questionnaire asks students, for example, whether the classroom had an appropriate size and layout for the course. If students were unhappy with the classroom, and if it appears that their unhappiness inappropriately colored their evaluations of the instructor, the system can adjust the instructor's scores accordingly.
  • The survey instrument, known as SALG, for Student Assessment of their Learning Gains, is now used by instructors across the country. The project's Web site contains more than 900 templates, mostly for courses in the sciences.
  • "So the ability to do some quantitative analysis of these comments really allows you to take a more nuanced and effective look at what these students are really saying."
  • Mr. Frick and his colleagues found that his new course-evaluation form was strongly correlated with both students' and instructors' own measures of how well the students had mastered each course's learning goals.
  • Elaine Seymour, who was then director of ethnography and evaluation research at the University of Colorado at Boulder, was assisting with a National Science Foundation project to improve the quality of science instruction at the college level. She found that many instructors were reluctant to try new teaching techniques because they feared their course-evaluation ratings might decline.
  • "Students are the inventory," Mr. Crumbley says. "The real stakeholders in higher education are employers, society, the people who hire our graduates. But what we do is ask the inventory if a professor is good or bad. At General Motors," he says, "you don't ask the cars which factory workers are good at their jobs. You check the cars for defects, you ask the drivers, and that's how you know how the workers are doing."
  • William H. Pallett, president of the IDEA Center, says that when course rating surveys are well-designed and instructors make clear that they care about them, students will answer honestly and thoughtfully.
  • In Mr. Bain's view, student evaluations should be just one of several tools colleges use to assess teaching. Peers should regularly visit one another's classrooms, he argues. And professors should develop "teaching portfolios" that demonstrate their ability to do the kinds of instruction that are most important in their particular disciplines. "It's kind of ironic that we grab onto something that seems fixed and fast and absolute, rather than something that seems a little bit messy," he says. "Making decisions about the ability of someone to cultivate someone else's learning is inherently a messy process. It can't be reduced to a formula."
  • Gary Brown on 27 Apr 10
     
    Old friends at the Idea Center, and an old but persistent issue.
2More

From Social Media to Social Strategy - Umair Haque - Harvard Business Review - 0 views

blogs.hbr.org/..._media_to_social_strategy.html
shared by Nils Peterson on 10 May 10 - Cached
  • Choreography. Most organizations seek "high performance." Today, performance is no longer enough: excelling in yesterday's terms is excelling at the wrong things. This is downright self-destructive (just ask Wall Street). Today's radical innovators aren't merely mute performers, precisely executing the empty steps of a meaningless dance: they're more like choreographers. Choreographers define the steps of a better dance — they lay down better rules for interactions between supply and demand to take place.
    • Nils Peterson
      Nils Peterson on 10 May 10
       
      It strilkes me that this connects to OAI's Aof A work. We recognize learning outcomes can't forever improve, but through better assessment, we can hope the programs are ever more attentive and responsive to changing situations.
7More

In Hunt for Prestige, Colleges May Undermine Their Public Mission - Government - The Ch... - 1 views

chronicle.com/...65640 research future of educaiton
shared by Gary Brown on 21 May 10 - Cached
  • many large research universities are placing too much priority on activities that raise the profile and prestige of their institutions but do little to improve undergraduate education.
  • "In some of these places, undergraduate education has never been a top priority," says Jane V. Wellman, executive director of the Delta Project on Postsecondary Education Costs, Productivity, and Accountability.
  • While its grants and gifts have gone up, the percentage of money it spends on core teaching and student services has gone down. Many students, of course, benefit from the private support and research dollars, as the university has built better facilities and attracted world-class faculty members.
  • ...3 more annotations...
  • But the research aspirations of many large universities are in conflict with their founding principles, Ms. Wellman says, especially as undergraduate admissions has become more selective
  • another result of the chase for research dollars is that measures for faculty assessment and promotion rely too heavily on the research output and publication and too little on the quality of classroom teaching.
  • "I'm not pushing for banning research," he says, but there should be more flexibility and balance in the criteria."
  • Gary Brown on 21 May 10
     
    Nothing new, but affirmation of our perceptons.
2More

The Wired Campus - Duke Professor Uses 'Crowdsourcing' to Grade - The Chronicle of High... - 0 views

chronicle.com/...7538 grading crowd-sourcing peer review
shared by Gary Brown on 13 Aug 09 - Cached
  • Learning is more than earning an A says Cathy N. Davidson, the professor, who recently returned to teach English and interdisciplinary studies after eight years in administration. But students don't always see it that way. Vying for an A by trying to figure out what a professor wants or through the least amount of work has made the traditional grading scale superficial, she says."You've got this real mismatch between the kind of participatory learning that’s happening online and outside of the classroom, and the top-down, hierarchical learning and rigid assessment schemes that we’re using in the classroom from grades K through 12 and all the way up to graduate school," Ms. Davidson says. "In school systems today, we’re putting more and more emphasis on quantitative assessment in an era when, out of the classroom, students are learning through an entirely different way of collaboration, customizing, and interacting."
  • Theron DesRosier on 14 Aug 09
     
    We need to contact Cathy Davidson and work together on this.
3More

How Web-Savvy Edupunks Are Transforming American Higher Education | Fast Company - 0 views

www.fastcompany.com/...who-needs-harvard.html
shared by Nils Peterson on 04 Sep 09 - Cached
  • "Colleges have become outrageously expensive, yet there remains a general refusal to acknowledge the implications of new technologies," says Jim Groom, an "instructional technologist" at Virginia's University of Mary Washington and a prominent voice in the blogosphere for blowing up college as we know it. Groom, a chain-smoker with an ever-present five days' growth of beard, coined the term "edupunk" to describe the growing movement toward high-tech do-it-yourself education. "Edupunk," he tells me in the opening notes of his first email, "is about the utter irresponsibility and lethargy of educational institutions and the means by which they are financially cannibalizing their own mission."
    • Nils Peterson
      Nils Peterson on 24 Sep 09
       
      Several people to follow in this article. They are moving from open content up the ladder. I don't see them pointing to open assessment as Downes did a couple years back, but that may make a place for us to play with them
  • Joshua Yeidel on 04 Sep 09
     
    A good overview of how higher ed's core functions are being remixed online. As you might expect from the source, the emphasis is on the positive.
7More

Beth's Blog: How Nonprofits Can Use Social Media: Connected Futures: Connected futures:... - 0 views

beth.typepad.com/...r-communities-of-practice.html tagging social_Network
shared by Nils Peterson on 15 Apr 09 - Cached
  • opportunity to reflect with colleagues and peers on the challenges and learnings from leading a tagging community.
    • Nils Peterson
      Nils Peterson on 15 Apr 09
       
      'leading a tagging community' is an interesting pharse
  • Action Notebook which summarizes dozens of practical steps that you need work through if you are stewarding a community of practice
  • We know that successful social media strategy isn't as effective when it is siloed with one person in the organization - the intern in the corner or a part of a web staff person's job.  The organization has to own it.  I'm also looking at this role in the context of working wikily.   
    • Nils Peterson
      Nils Peterson on 15 Apr 09
       
      needs to be distributed in the organization
  • ...1 more annotation...
  • I am participating in this year's "Connected Futures: New Social Strategies adn Tools for Communities of Practice" a five week online workshop for community managers, designers and conveners to explore social strategies and tools to support their work.   The workshop begins on April 20th
  • Nils Peterson on 15 Apr 09
     
    lots to explore linked from this post that I found linked from Downes
2More

Marty Linsky and Alexander Grashow: Obama is Reset -- Are You? - 0 views

www.huffingtonpost.com/...-reset---are-you_b_181467.html
shared by Nils Peterson on 01 Apr 09 - Cached
  • Will you hunker down until the storm blows over and then try to restore? Or will you adapt and Reset now, and start from a new beginning?
    • Nils Peterson
      Nils Peterson on 01 Apr 09
       
      Josh made this same observation about the choice facing WSU and higher ed. He said relative to the Newspapers and Universities piece he Diigoed that he worries WSU 'sails under' in this process. Gary calls it never letting a good crisis go wasted
2More

Small classes have long-term benefit for all students, research says - 2 views

www.physorg.com/news174300427.html education
shared by Matthew Tedder on 10 Oct 09 - Cached
  • Matthew Tedder on 10 Oct 09
     
    Don't we start higher education with generally larger classes and work toward smaller ones? I am not sure, how much starting with smaller classes applies to higher ed.. but it's something to think differently about.
  • Gary Brown on 10 Oct 09
     
    Lots of research in higher ed tends to debunk the belief that smaller classes without additional kinds of mediation will have little impact. Many have argued turning the curriculum in higher ed upside down. Small classes in first years, then when students have internalized new learning strategies they are more likely to get more out of the large lecture class and have the schema to contextualize and therefore learn more from the bombardment of facts that are most often lectures.
9More

News: Turning Surveys Into Reforms - Inside Higher Ed - 0 views

www.insidehighered.com/...nsse assessment NSSE Closing the loop
shared by Gary Brown on 26 Oct 09 - Cached
  • Molly Corbett Broad, president of the American Council on Education, warned those gathered here that they would be foolish to think that accountability demands were a thing of the past.
  • She said that while she is “impressed” with the work of NSSE, she thinks higher education is “not moving fast enough” right now to have in place accountability systems that truly answer the questions being asked of higher education. The best bet for higher education, she said, is to more fully embrace various voluntary systems, and show that they are used to promote improvements.
  • One reason NSSE data are not used more, some here said, was the decentralized nature of American higher education. David Paris, executive director of the New Leadership Alliance for Student Learning and Accountability, said that “every faculty member is king or queen in his or her classroom.” As such, he said, “they can take the lessons of NSSE” about the kinds of activities that engage students, but they don’t have to. “There is no authority or dominant professional culture that could impel any faculty member to apply” what NSSE teaches about engaged learning, he said.
  • ...4 more annotations...
  • She stressed that NSSE averages may no longer reflect any single reality of one type of faculty member. She challenged Paris’s description of powerful faculty members by noting that many adjuncts have relatively little control over their pedagogy, and must follow syllabuses and rules set by others. So the power to execute NSSE ideas, she said, may not rest with those doing most of the teaching.
  • Research presented here, however, by the Wabash College National Study of Liberal Arts Education offered concrete evidence of direct correlations between NSSE attributes and specific skills, such as critical thinking skills. The Wabash study, which involves 49 colleges of all types, features cohorts of students being analyzed on various NSSE benchmarks (for academic challenge, for instance, or supportive campus environment or faculty-student interaction) and various measures of learning, such as tests to show critical thinking skills or cognitive skills or the development of leadership skills.
  • The irony of the Wabash work with NSSE data and other data, Blaich said, was that it demonstrates the failure of colleges to act on information they get -- unless someone (in this case Wabash) drives home the ideas.“In every case, after collecting loads of information, we have yet to find a single thing that institutions didn’t already know. Everyone at the institution didn’t know -- it may have been filed away,” he said, but someone had the data. “It just wasn’t followed. There wasn’t sufficient organizational energy to use that data to improve student learning.”
  • “I want to try to make the point that there is a distinction between participating in NSSE and using NSSE," he said. "In the end, what good is it if all you get is a report?"
  • Kimberly Green on 26 Oct 09
     
    An interesting discussion, exploring basic questions CTLT folks are familiar with, grappling with the question of how to use survey data and how to identify and address limitations. 10 years after launch of National Survey of Student Engagement, many worry that colleges have been speedier to embrace giving the questionnaire than using its results. And some experts want changes in what the survey measures. I note these limitations, near the end of the article: Adrianna Kezar, associate professor of higher education at the University of Southern California, noted that NSSE's questions were drafted based on the model of students attending a single residential college. Indeed many of the questions concern out-of-class experiences (both academic and otherwise) that suggest someone is living in a college community. Kezar noted that this is no longer a valid assumption for many undergraduates. Nor is the assumption that they have time to interact with peers and professors out of class when many are holding down jobs. Nor is the assumption -- when students are "swirling" from college to college, or taking courses at multiple colleges at the same time -- that any single institution is responsible for their engagement. Further, Kezar noted that there is an implicit assumption in NSSE of faculty being part of a stable college community. Questions about seeing faculty members outside of class, she said, don't necessarily work when adjunct faculty members may lack offices or the ability to interact with students from one semester to the next. Kezar said that she thinks full-time adjunct faculty members may actually encourage more engagement than tenured professors because the adjuncts are focused on teaching and generally not on research. And she emphasized that concerns about the impact of part-time adjuncts on student engagement arise not out of criticism of those individuals, but of the system that assigns them teaching duties without much support. S
  • Gary Brown on 02 Nov 09
     
    Repeat of highlighted resource, but merits revisiting.
5More

News: Assessing the Assessments - Inside Higher Ed - 2 views

www.insidehighered.com/...vsa assessment CLA VSA
shared by Gary Brown on 05 Nov 09 - Cached
  • The validity of a measure is based on evidence regarding the inferences and assumptions that are intended to be made and the uses to which the measure will be put. Showing that the three tests in question are comparable does not support Shulenburger's assertion regarding the value-added measure as a valid indicator of institutional effectiveness. The claim that public university groups have previously judged the value-added measure as appropriate does not tell us anything about the evidence upon which this judgment was based nor the conditions under which the judgment was reached. As someone familiar with the process, I would assert that there was no compelling evidence presented that these instruments and the value-added measure were validated for making this assertion (no such evidence was available at the time), which is the intended use in the VSA.
  • (however much the sellers of these tests tell you that those samples are "representative"), they provide an easy way out for academic administrators who want to avoid the time-and-effort consuming but incredibly valuable task of developing detailed major program learning outcome statements (even the specialized accrediting bodies don't get down to the level of discrete, operational statements that guide faculty toward appropriate assessment design)
  • f somebody really cared about "value added," they could look at each student's first essay in this course, and compare it with that same student's last essay in this course. This person could then evaluate each individual student's increased mastery of the subject-matter in the course (there's a lot) and also the increased writing skill, if any.
  • ...1 more annotation...
  • These skills cannot be separated out from student success in learning sophisticated subject-matter, because understanding anthropology, or history of science, or organic chemistry, or Japanese painting, is not a matter of absorbing individual facts, but learning facts and ways of thinking about them in a seamless, synthetic way. No assessment scheme that neglects these obvious facts about higher education is going to do anybody any good, and we'll be wasting valuable intellectual and financial resources if we try to design one.
  • Gary Brown on 05 Nov 09
     
    ongoing discussion of these tools. Note Longanecker's comment and ask me why.
« First ‹ Previous 41 - 50 of 50
Showing 20▼ items per page