Skip to main content

Home/ CTLT and Friends/ Group items tagged outsource

Rss Feed Group items tagged

Gary Brown

Ethics? Let's Outsource Them! - Brainstorm - The Chronicle of Higher Education - 4 views

  • Many students are already buying their papers from term-paper factories located in India and other third world countries. Now we are sending those papers back there to be graded. I wonder how many people are both writing and grading student work, and whether, serendipitously, any of those people ever get the chance to grade their own writing.”
  • The great learning loop of outcomes assessment is neatly “closed,” with education now a perfect, completed circle of meaningless words.
  • With outsourced grading, it’s clearer than ever that the world of rubrics behaves like that wicked southern plant called kudzu, smothering everything it touches. Certainly teaching and learning are being covered over by rubrics, which are evolving into a sort of quasi-religious educational theory controlled by priests whose heads are so stuck in playing with statistics that they forget to try to look openly at what makes students turn into real, viable, educated adults and what makes great, or even good, teachers.
  • ...2 more annotations...
  • Writing an essay is an art, not a science. As such, people, not instruments, must take its measure, and judge it. Students have the right to know who is doing the measuring. Instead of going for outsourced grading, Ms. Whisenant should cause a ruckus over the size of her course with the administration at Houston. After all, if she can’t take an ethical stand, how can she dare to teach ethics?
  • "People need to get past thinking that grading must be done by the people who are teaching.” Sorry, Mr. Rajam, but what you should be saying is this: Teachers, including those who teach large classes and require teaching assistants and readers, need to get past thinking that they can get around grading.
  •  
    the outsourcing loop becomes a diatribe against rubrics...
  •  
    It's hard to see how either outsourced assessment or harvested assessment can be accomplished convincingly without rubrics. How else can the standards of the teacher be enacted by the grader? From there we are driven to consider how, in the absence of a rubric, the standards of the teacher can be enacted by the student. Is it "ethical" to use the Potter Stewart standard: "I'll know it when I see it"?
  •  
    Yes, who is the "priest" in the preceding rendering--one who shares principles of quality (rubrics), or one who divines a grade a proclaims who is a "real, viable, educated adult"?
Joshua Yeidel

Above-Campus Services: Shaping the Promise of Cloud Computing for Higher Education (EDU... - 0 views

  • In the early 1990s, Mike Zucchini, formerly the CIO of Fleet/Norstar, saw four possible reasons for outsourcing information technology. He explained these reasons in his "4-S" model: Scale — the desire to access economies of scale and efficiency that an institution could not achieve alone; Specialty — the desire to access specialized expertise that is too expensive to staff; Sale — the desire to turn nonproductive assets of capital facilities and IT equipment into cash to improve a balance sheet and reduce headcount; and Surrender — the desire to simplify the IT agenda by essentially giving up and hoping that a contract for service yields the outcomes an executive desires.7 Zucchini argued that Scale and Specialty are functional reasons for outsourcing and that Sale and Surrender are ultimately dysfunctional. History supports his insights: the big Sale/Surrender outsourcing deals of Kodak, American Express, GM, and Xerox all proved transient as the complexities of managing by contract and service-level agreements led to the eventual re-creation of internal IT service capabilities
  •  
    Describes a "meta-versity" concept based on cloud computing shared by HE institutions. Although the article focuses on the institution level, many of the considerations also occur in department-level movement toward the cloud.
Gary Brown

Outsourced Grading, With Supporters and Critics, Comes to College - Teaching - The Chro... - 3 views

shared by Gary Brown on 06 Apr 10 - Cached
  • Lori Whisenant knows that one way to improve the writing skills of undergraduates is to make them write more. But as each student in her course in business law and ethics at the University of Houston began to crank out—often awkwardly—nearly 5,000 words a semester, it became clear to her that what would really help them was consistent, detailed feedback.
  • She outsourced assignment grading to a company whose employees are mostly in Asia.
  • The graders working for EduMetry, based in a Virginia suburb of Washington, are concentrated in India, Singapore, and Malaysia, along with some in the United States and elsewhere. They do their work online and communicate with professors via e-mail.
  • ...8 more annotations...
  • The company argues that professors freed from grading papers can spend more time teaching and doing research.
  • "This is what they do for a living," says Ms. Whisenant. "We're working with professionals." 
  • Assessors are trained in the use of rubrics, or systematic guidelines for evaluating student work, and before they are hired are given sample student assignments to see "how they perform on those," says Ravindra Singh Bangari, EduMetry's vice president of assessment services.
  • Professors give final grades to assignments, but the assessors score the papers based on the elements in the rubric and "help students understand where their strengths and weaknesses are," says Tara Sherman, vice president of client services at EduMetry. "Then the professors can give the students the help they need based on the feedback."
  • The assessors use technology that allows them to embed comments in each document; professors can review the results (and edit them if they choose) before passing assignments back to students.
  • But West Hills' investment, which it wouldn't disclose, has paid off in an unexpected way. The feedback from Virtual-TA seems to make the difference between a student's remaining in an online course and dropping out.
  • Because Virtual-TA provides detailed comments about grammar, organization, and other writing errors in the papers, students have a framework for improvement that some instructors may not be able to provide, she says.
  • "People need to get past thinking that grading must be done by the people who are teaching," says Mr. Rajam, who is director of assurance of learning at George Washington University's School of Business. "Sometimes people get so caught up in the mousetrap that they forget about the mouse."
Gary Brown

Let's Make Rankings That Matter - Commentary - The Chronicle of Higher Education - 3 views

  • By outsourcing evaluation of our doctoral programs to an external agency, we allow ourselves to play the double game of insulating ourselves from the criticisms they may raise by questioning their accuracy, while embracing the praise they bestow.
  • The solution to the problem is obvious: Universities should provide relevant information to potential students and faculty members themselves, instead of relying on an outside body to do it for them, years too late. How? By carrying out yearly audits of their doctoral programs.
  • The ubiquitous rise of social networking and open access to information via electronic media facilitate this approach to self-evaluation of academic departments. There is no need to depend on an obsolete system that irregularly publishes rankings when all of the necessary tools—e-mail, databases, Web sites—are available at all institutions of higher learning.
  • ...2 more annotations...
  • A great paradox of modern academe is that our institutions take pride in being on the cutting edge of new ideas and innovations, yet remain resistant and even hostile to the openness made possible by technology
  • We should not hide our departments' deficiencies in debatable rankings, but rather be honest about those limitations in order to aggressively pursue solutions that will strengthen doctoral programs and the institutions in which they play a vital role.
Gary Brown

Academic Grants Foster Waste and Antagonism - Commentary - The Chronicle of Higher Educ... - 1 views

  • We think that our work is primarily organized by institutions of higher education, or by departments, or by conferences, but in reality those have become but appendages to a huge system of distributing resources through grants.
  • It's time we looked at this system—and at its costs: unpaid, anxiety-filled hours upon hours for a single successful grant; scholarship shaped, or misshaped, according to the demands of marketlike forces and the interests of nonacademic private foundations. All to uphold a distributive system that fosters antagonistic competition and increasing inequality.
  • Every hour spent working on or worrying about grants is an hour that could be better spent on research (or family life, or civic engagement, or sleep). But every hour not spent on a grant gives a competitive edge to other applicants.
  • ...5 more annotations...
  • The grant is basically an outsourcing of assessment that could, in most situations, be carried out much better by paid professional staff members.
  • Meanwhile grant-receiving institutions, like universities, become increasingly dependent on grants, to the point that faculty members and other campus voices can scarcely be heard beneath the din of administrators exhorting them to get more and more grants.
  • Colleagues whose research may be equally valuable (based on traditional criteria of academic debate) could be denied resources and livelihoods because, instead of grant writing, they favor publishing, or public engagement, or teaching.
  • Grant applications normalize a mode of scholarly writing and thought that, whatever its merits, has not been chosen collectively by academe in the interests of good scholarship, but has been imposed from without, with the grant as its guide. And as application procedures grow more stringent, the quality of successful projects is likely to sink. Can we honestly expect good scholarship from scholars who must constantly concentrate on something other than their scholarship? Academic life is increasingly made up of a series of applications, while the applied-for work dwindles toward insignificance.
  • It's time, I think, to put an end to our rationalizations. My spine will not be straightened. The agony will not be wiped off my brain. My mind misshapen will not be pounded back, and I have to stop telling myself that everything will be OK. Months and years of my life have been taken away, and nothing short of systemic transformation will redeem them.
Gary Brown

News: The Specialists - Inside Higher Ed - 4 views

  • Choosing the academic program at a single university, they say, is a relic of a time before online education made it possible for a student in Oregon to take courses at a university in Florida
  • Much of the talk about this imminent unbundling has come from colleges that predict that students might want to transfer credits from other colleges that might have different missions. But the competition may also come from entities that do not even offer degrees.
  • The company outsources grading and other work to master’s degree-holders in India for much less than it would cost to employ similarly qualified teaching assistants in the United States.
  • ...1 more annotation...
  • the confluence of several economic factors — particularly rising tuition and the unwillingness of many students to take on exorbitant debt, especially as they see their degree-holding peers struggling to land jobs — may force institutions to consider turning to outside specialists if they want to continue offering certain courses.And if they don’t, Smith says, students will likely turn to the outside specialists themselves.
  •  
    Variations on a theme, but notable now in particular as we debate general education reform.
Theron DesRosier

Virtual-TA - 2 views

  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  •  
    I went to Virtual TA and Highlighted their language describing how it works.
Nils Peterson

Change Magazine - The New Guys in Assessment Town - 0 views

  • if one of the institution’s general education goals is critical thinking, the system makes it possible to call up all the courses and programs that assess student performance on that outcome.
  • bringing together student learning outcomes data at the level of the institution, program, course, and throughout student support services so that “the data flows between and among these levels”
  • Like its competitors, eLumen maps outcomes vertically across courses and programs, but its distinctiveness lies in its capacity to capture what goes on in the classroom. Student names are entered into the system, and faculty use a rubric-like template to record assessment results for every student on every goal. The result is a running record for each student available only to the course instructor (and in a some cases to the students themselves, who can go to the system to  get feedback on recent assessments).
    • Nils Peterson
       
      sounds like harvesting gradebook. assess student work and roll up
    • Joshua Yeidel
       
      This system has some potential for formative use at the per-student leve.
  • ...7 more annotations...
  • “I’m a little wary.  It seems as if, in addition to the assessment feedback we are already giving to students, we might soon be asked to add a data-entry step of filling in boxes in a centralized database for all the student learning outcomes. This is worrisome to those of us already struggling under the weight of all that commenting and essay grading.”
    • Nils Peterson
       
      its either double work, or not being understood that the grading and the assessment can be the same activity. i suspect the former -- grading is being done with different metrics
    • Joshua Yeidel
       
      I am in the unusual position of seeing many papers _after_ they have been graded by a wide variety of teachers. Many of these contain little "assessment feedback" -- many teachers focus on "correcting" the papers and finding some letter or number to assign as a value.
  • “This is where we see many institutions struggling,” Galvin says. “Faculty simply don’t have the time for a deeper involvement in the mechanics of assessment.” Many have never seen a rubric or worked with one, “so generating accurate, objective data for analysis is a challenge.”  
    • Nils Peterson
       
      Rather than faculty using the community to help with assessment, they are outsourcing to a paid assessor -- this is the result of undertaking this thinking while also remaining in the institution-centric end of the spectrum we developed
  • I asked about faculty pushback. “Not so much,” Galvin says, “not after faculty understand that the process is not intended to evaluate their work.”
    • Nils Peterson
       
      red flag
  • the annual reports required by this process were producing “heaps of paper” while failing to track trends and developments over time. “It’s like our departments were starting anew every year,” Chaplot says. “We wanted to find a way to house the data that gave us access to what was done in the past,” which meant moving from discrete paper reports to an electronic database.
    • Joshua Yeidel
       
      It's not clear whether the "database" is housing measurements, narratives and reflections, or all of the above.
  • Can eLumen represent student learning in language? No, but it can quantify the number of boxes checked against number of boxes not checked.”
  • developing a national repository of resources, rubrics, outcomes statements, and the like that can be reviewed and downloaded by users
    • Nils Peterson
       
      in building our repository we could well open-source these tools, no need to lock them up
  • “These solutions cement the idea that assessment is an administrative rather than an educational enterprise, focused largely on accountability. They increasingly remove assessment decision making from the everyday rhythm of teaching and learning and the realm of the faculty.
    • Nils Peterson
       
      Over the wall assessment, see Transformative Assessment rubric for more detail
1 - 8 of 8
Showing 20 items per page