Skip to main content

Home/ CTLT and Friends/ Group items tagged assessments

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Joshua Yeidel

Wired Campus: Student Beats Cheating Charges for Posting Work Online - Chroni... - 0 views

chronicle.com/...index.php

assessment higher_education

shared by Joshua Yeidel on 08 Jul 09 - No Cached
  • Joshua Yeidel on 08 Jul 09
     
    "A student majoring in computer science at San Jose State University said he fought against a professor who had tried to force him to remove his homework from the Internet, and won..." For computer science assignments where a working solution to a specific problem is the expected response, the implications are clear. But what are the implications for assessment (and for higher educaiton generally)?
Theron DesRosier

Pontydysgu - Bridge to Learning » Blog Archive » Learning in practice - a soc... - 0 views

www.pontydysgu.org/...%E2%80%93-a-social-perspective

etienne wenger CoP assessment

shared by Theron DesRosier on 08 Apr 09 - Cached
  • Theron DesRosier on 08 Apr 09
     
    Complex inter-relationship between: space, time, locality, practice, boundary crossings between different practices. For example trainee doctor in the hospital in one practice, translation of this experience into 'evidence for assessment purposes' needs to then be 'validated' by auditors in another community of practice.
Nils Peterson

E-Portfolios for Learning: Limitations of Portfolios - 1 views

electronicportfolios.org/...limitations-of-portfolios.html

shared by Nils Peterson on 27 Oct 09 - Cached
  • Today, Shavelson, Klein & Benjamin published an online article on Inside Higher Ed entitled, "The Limitations of Portfolios." The comments to that article are even more illuminating, and highlight the debate about electronic portfolios vs. accountability systems... assessment vs. evaluation. These arguments highlight what I think is a clash in philosophies of learning and assessment, between traditional, behaviorist models and more progressive, cognitive/constructivist models. How do we build assessment strategies that bridge these two approaches? Or is the divide too wide? Do these different perspectives support the need for multiple measures and triangulation?
    • Nils Peterson
      Nils Peterson on 27 Oct 09
       
      Helen responds to CLA proponents
Gary Brown

WSU Today Online - Current Article List - 0 views

www.wsutoday.wsu.edu/...Publications.asp

writing assessment

shared by Gary Brown on 02 Dec 09 - Cached
  • the goal of the program is for students to submit their portfolios at the start of their junior year, and only about 34 percent are managing to do that.
  • Writing Assessment Program received the 2009 “Writing Program Certificate of Excellence”
  • If students delay completing their portfolio until late in their junior year, or into their senior year, she said, “it undermines the instructional integrity of the assessment.”
  • ...1 more annotation...
  • 70 percent of students submitted a paper as part of their portfolio that had been completed in a non-WSU course
  • Gary Brown on 02 Dec 09
     
    I ponder these highlights
Theron DesRosier

Documenting and decoding the undergrad experience | University Affairs - 3 views

www.universityaffairs.ca/-the-undergrad-experience.aspx

credentialing documenting_learning non_curricular_learning

shared by Theron DesRosier on 20 Aug 10 - No Cached
  • Theron DesRosier on 20 Aug 10
     
    "An official transcript shows how well a student did in class, but universities have long recognized that a lot of learning takes place outside the classroom. Now a growing number of schools are developing ways of tracking, measuring and authenticating that learning. Some are giving official sanction to a student's involvement in campus activities - student council or campus clubs, for example - through what's called a co-curricular transcript. Others have developed web-based self-assessment tools that students can use to understand their own knowledge, values and strengths."
Gary Brown

The Quality Question - Special Reports - The Chronicle of Higher Education - 1 views

chronicle.com/...124185

shared by Gary Brown on 30 Aug 10 - Cached
  • Few reliable, comparable measures of student learning across colleges exist. Standardized assessments like the Collegiate Learning Assessment are not widely used—and many experts say those tests need refinement in any case.
    • Gary Brown
      Gary Brown on 30 Aug 10
       
      I am hoping the assumptions underlying this sentence do not frame the discussion. The extent to which it has in the past parallels the lack of progress. Standardized comparisons evince nothing but the wrong questions.
  • "We are the most moribund field that I know of," Mr. Zemsky said in an interview. "We're even more moribund than county government."
  • Robert Zemsky
Kimberly Green

Strategic National Arts Alumni Project (SNAAP) - 0 views

www.snaap.indiana.edu

national survey arts

shared by Kimberly Green on 09 Aug 10 - Cached
  • Kimberly Green on 09 Aug 10
     
    WSU is participating in this survey. Looks interesting, follow up on students who graduate with an arts degree. Could be useful in program assessment in a number of ways ( a model, sample questions, as well as ways to leverage nationally collected data.) Kimberly Welcome to the Strategic National Arts Alumni Project (SNAAP), an annual online survey, data management, and institutional improvement system designed to enhance the impact of arts-school education. SNAAP partners with arts high schools, art and design colleges, conservatories and arts programs within colleges and universities to administer the survey to their graduates. SNAAP is a project of the Indiana University Center for Postsecondary Research in collaboration with the Vanderbilt University Curb Center for Art, Enterprise, and Public Policy. Lead funding is provided by the Surdna Foundation, with major partnership support from the Houston Endowment, Barr Foundation, Cleveland Foundation, Educational Foundation of America and the National Endowment for the Arts. improvement system designed to enhance the impact of arts-school education. SNAAP partners with arts high schools, art and design colleges, conservatories and arts programs within colleges and universities to administer the survey to their graduates. SNAAP is a project of the Indiana University Center for Postsecondary Research in collaboration with the Vanderbilt University Curb Center for Art, Enterprise, and Public Policy. Lead funding is provided by the Surdna Foundation, with major partnership support from the Houston Endowment, Barr Foundation, Cleveland Foundation, Educational Foundation of America and the National Endowment for the Arts."
Gary Brown

Ranking Employees: Why Comparing Workers to Their Peers Can Often Backfire - Knowledge@... - 2 views

knowledge.wharton.upenn.edu/article.cfm

ratings feedback

shared by Gary Brown on 23 Aug 10 - Cached
  • We live in a world full of benchmarks and rankings. Consumers use them to compare the latest gadgets. Parents and policy makers rely on them to assess schools and other public institutions,
  • "Many managers think that giving workers feedback about their performance relative to their peers inspires them to become more competitive -- to work harder to catch up, or excel even more. But in fact, the opposite happens," says Barankay, whose previous research and teaching has focused on personnel and labor economics. "Workers can become complacent and de-motivated. People who rank highly think, 'I am already number one, so why try harder?' And people who are far behind can become depressed about their work and give up."
  • mong the companies that use Mechanical Turk are Google, Yahoo and Zappos.com, the online shoe and clothing purveyor.
  • ...12 more annotations...
  • Nothing is more compelling than data from actual workplace settings, but getting it is usually very hard."
  • Instead, the job without the feedback attracted more workers -- 254, compared with 76 for the job with feedback.
  • "This indicates that when people are great and they know it, they tend to slack off. But when they're at the bottom, and are told they're doing terribly, they are de-motivated," says Barankay.
  • In the second stage of the experiment
  • it seems that people would rather not know how they rank compared to others, even though when we surveyed these workers after the experiment, 74% said they wanted feedback about their rank."
  • Of the workers in the control group, 66% came back for more work, compared with 42% in the treatment group. The members of the treatment group who returned were also 22% less productive than the control group. This seems to dispel the notion that giving people feedback might encourage high-performing workers to work harder to excel, and inspire low-ranked workers to make more of an effort.
  • The aim was to determine whether giving people feedback affected their desire to do more work, as well as the quantity and quality of their work.
  • top performers move on to new challenges and low performers have no viable options elsewhere.
  • feedback about rank is detrimental to performance,"
  • it is well documented that tournaments, where rankings are tied to prizes, bonuses and promotions, do inspire higher productivity and performance.
  • "In workplaces where rankings and relative performance is very transparent, even without the intervention of management ... it may be better to attach financial incentives to rankings, as interpersonal comparisons without prizes may lead to lower effort," Barankay suggests. "In those office environments where people may not be able to assess and compare the performance of others, it may not be useful to just post a ranking without attaching prizes."
  • "The key is to devote more time to thinking about whether to give feedback, and how each individual will respond to it. If, as the employer, you think a worker will respond positively to a ranking and feel inspired to work harder, then by all means do it. But it's imperative to think about it on an individual level."
  • Gary Brown on 23 Aug 10
     
    the conflation of feedback with ranking confounds this. What is not done and needs to be done is to compare the motivational impact of providing constructive feedback. Presumably the study uses ranking in a strictly comparative context as well, and we do not see the influence of feedback relative to an absolute scale. Still, much in this piece to ponder....
Kimberly Green

Career Coach: The psychology of building a work team - 0 views

www.washingtonpost.com/...AR2010072304294.html

change management relationship

shared by Kimberly Green on 13 Aug 10 - Cached
  • Kimberly Green on 13 Aug 10
     
    this article has suggestions for protocols to address typical team dysfunctions. Might be useful to suggest to depts as part of strategies for successful assessment work.
Gary Brown

Higher Education: Assessment & Process Improvement Group News | LinkedIn - 3 views

www.linkedin.com/news

assessment accountability

shared by Gary Brown on 16 Sep 10 - No Cached
  • Gary Brown on 16 Sep 10
     
    as we ponder our own issues related to transparency....
Lorena O'English

Effective Assessment in a Digital Age: A guide to technology-enhanced assessment and fe... - 1 views

www.jisc.ac.uk/...digiassass_eada.pdf

shared by Lorena O'English on 07 Sep 10 - No Cached
  • Lorena O'English on 07 Sep 10
     
    from JISC (pdf)
Theron DesRosier

Learning from The Wisdom of Crowds | Carnegie Foundation for the Advancement of Teaching - 1 views

www.carnegiefoundation.org/...learning-the-wisdom-crowds

peerreview learning

shared by Theron DesRosier on 23 Sep 10 - No Cached
  • Theron DesRosier on 23 Sep 10
     
    In The New York Times article, "Scholars Test Web Alternative to Peer Review," Patricia Cohen writes that some humanities scholars are arguing "that in an era of digital media there is a better way to assess the quality of work. Instead of relying on a few experts selected by leading publications, they advocate using the Internet to expose scholarly thinking to the swift collective judgment of a much broader interested audience."
Gary Brown

The Future of Wannabe U. - The Chronicle Review - The Chronicle of Higher Education - 2 views

chronicle.com/...124917

outcomes numbers

shared by Gary Brown on 18 Oct 10 - No Cached
  • Alice didn't tell me about the topics of her research; instead she listed the number of articles she had written, where they had been submitted and accepted, the reputation of the journals, the data sets she was constructing, and how many articles she could milk from each data set.
  • colleges and universities have transformed themselves from participants in an audit culture to accomplices in an accountability regime.
  • higher education has inaugurated an accountability regime—a politics of surveillance, control, and market management that disguises itself as value-neutral and scientific administration.
  • ...7 more annotations...
  • annabe administrator noted that the recipient had published well more than 100 articles. He never said why those articles mattered.
  • And all we have are numbers about teaching. And we don't know what the difference is between a [summary measure of] 7.3 and a 7.7 or an 8.2 and an 8.5."
  • The problem is that such numbers have no meaning. They cannot indicate the quality of a student's education.
  • or can the many metrics that commonly appear in academic (strategic) plans, like student credit hours per full-time-equivalent faculty member, or the percentage of classes with more than 50 students. Those productivity measures (for they are indeed productivity measures) might as well apply to the assembly-line workers who fabricate the proverbial widget, for one cannot tell what the metrics have to do with the supposed purpose of institutions of higher education—to create and transmit knowledge. That includes leading students to the possibility of a fuller life and an appreciation of the world around them and expanding their horizons.
  • But, like the fitness club's expensive cardio machines, a significant increase in faculty research, in the quality of student experiences (including learning), in the institution's service to its state, or in its standing among its peers may cost more than a university can afford to invest or would even dream of paying.
  • Such metrics are a speedup of the academic assembly line, not an intensification or improvement of student learning. Indeed, sometimes a boost in some measures, like an increase in the number of first-year students participating in "living and learning communities," may even detract from what students learn. (Wan U.'s pre-pharmacy living-and-learning community is so competitive that students keep track of one another's grades more than they help one another study. Last year one student turned off her roommate's alarm clock so that she would miss an exam and thus no longer compete for admission to the School of Pharmacy.)
  • Even metrics intended to indicate what students may have learned seem to have more to do with controlling faculty members than with gauging education. Take student-outcomes assessments, meant to be evaluations of whether courses have achieved their goals. They search for fault where earlier researchers would not have dreamed to look. When parents in the 1950s asked why Johnny couldn't read, teachers may have responded that it was Johnny's fault; they had prepared detailed lesson plans. Today student-outcomes assessment does not even try to discover whether Johnny attended class; instead it produces metrics about outcomes without considering Johnny's input.
  • Gary Brown on 18 Oct 10
     
    A good one to wrestle with.  It may be worth formulating distinctions we hold, and steering accordingly.
Joshua Yeidel

Higher Education: Assessment & Process Improvement Group News | LinkedIn - 2 views

www.linkedin.com/news?viewArticle=&articleID=228514267&gid=1171287&type=news&item=228514267&articleURL=http%3A%2F%2Fnews%2Egoogle%2Ecom%2Fnews%2Furl%3Fsa%3Dt%26fd%3DR%26usg%3DAFQjCNFtGpxVvvSMHWFLYe7182CFKjFmIQ%26url%3Dhttp%3A%2F%2Fchronicle%2Ecom%2

Assessment accountability

shared by Joshua Yeidel on 18 Oct 10 - No Cached
  • Joshua Yeidel on 18 Oct 10
     
    "Colleges and universities have transformed themselves from participants in an audit culture to accomplices in an accountability regime."
  • Joshua Yeidel on 18 Oct 10
     
    A philosophical critique of a rapidly-approaching "metric future", with "comensuration" (assigning meaning to measurements) run amok. While the application of student learning outcomes given in the article is not ours, the critique of continuous quality improvement challenges some of our assumptions.
Judy Rumph

Blog U.: It Boils Down to... - Confessions of a Community College Dean - Inside Higher Ed - 4 views

www.insidehighered.com/...it_boils_down_to

Outcomes Assessment accountability

shared by Judy Rumph on 29 Sep 10 - No Cached
  • I had a conversation a few days ago with a professor who helped me understand some of the otherwise-puzzling opposition faculty have shown to actually using the general education outcomes they themselves voted into place.
  • Yet getting those outcomes from ‘adopted’ to ‘used’ has proved a long, hard slog.
  • The delicate balance is in respecting the ambitions of the various disciplines, while still maintaining -- correctly, in my view -- that you can’t just assume that the whole of a degree is equal to the sum of its parts. Even if each course works on its own terms, if the mix of courses is wrong, the students will finish with meaningful gaps. Catching those gaps can help you determine what’s missing, which is where assessment is supposed to come in. But there’s some local history to overcome first.
  • Judy Rumph on 29 Sep 10
     
    This is an interesting take on what we are doing and the comments interesting
Kimberly Green

Commodification of Academic Research (Inside HIgher Ed) - 0 views

www.insidehighered.com/...radder

education higher_education

shared by Kimberly Green on 25 Oct 10 - No Cached
  • Kimberly Green on 25 Oct 10
     
    This article provides an international view of the commodification of academic research, including this base line definition, from an email interview with Hans Radder, a professor of the philosophy of science and technology at Vrije Universiteit Amsterdam, Q: Academic research has always cost money to produce, and led to products that made money for others. How is the "commodification" of research different today than in past periods? A: Commodification means that all kinds of activities and their results are predominantly interpreted and assessed on the basis of economic criteria. In this sense, recent academic research is far more commodified than it was in the past. In general terms, one can say that the relation between "money" and specific academic activity has become much more direct. Consider the following examples: first, the amount of external funding acquired is often used as a measure of individual academic quality; second, specific assessments by individual scientists have a direct impact on departmental budgets; for instance, if I now pass this doctoral dissertation, my department receives a substantial sum of money; if not, it ends up with a budget deficit; third, the growing practice of patenting the results of academic research is explicitly aimed at acquiring commercial monopolies. Related to these financial issues are important and substantial changes of academic culture. Universities are increasingly being run as big corporations. They have a top-down command structure and an academic culture in which individual university scientists are forced to behave like mini-capitalists in order to survive, guided by an entrepreneurial ethos aimed at maximizing the capitalization of their knowledge.
Gary Brown

Views: Asking Too Much (and Too Little) of Accreditors - Inside Higher Ed - 1 views

www.insidehighered.com/...neal

accreditation

shared by Gary Brown on 12 Nov 10 - No Cached
  • Senators want to know why accreditors haven’t protected the public interest.
  • Congress shouldn’t blame accreditors: it should blame itself. The existing accreditation system has neither ensured quality nor ferreted out fraud. Why? Because Congress didn’t want it to. If Congress truly wants to protect the public interest, it needs to create a system that ensures real accountability.
  • But turning accreditors into gatekeepers changed the picture. In effect, accreditors now held a gun to the heads of colleges and universities since federal financial aid wouldn’t flow unless the institution received “accredited” status.
  • ...10 more annotations...
  • Congress listened to higher education lobbyists and designated accreditors -- teams made up largely of administrators and faculty -- to be “reliable authorities” on educational quality. Intending to protect institutional autonomy, Congress appropriated the existing voluntary system by which institutions differentiated themselves.
  • A gatekeeping system using peer review is like a penal system that uses inmates to evaluate eligibility for parole. The conflicts of interest are everywhere -- and, surprise, virtually everyone is eligible!
  • accreditation is “premised upon collegiality and assistance; rather than requirements that institutions meet certain standards (with public announcements when they don’t."
  • Meanwhile, there is ample evidence that many accredited colleges are adding little educational value. The 2006 National Assessment of Adult Literacy revealed that nearly a third of college graduates were unable to compare two newspaper editorials or compute the cost of office items, prompting the Spellings Commission and others to raise concerns about accreditors’ attention to productivity and quality.
  • But Congress wouldn’t let them. Rather than welcoming accreditors’ efforts to enhance their public oversight role, Congress told accreditors to back off and let nonprofit colleges and universities set their own standards for educational quality.
  • ccreditation is nothing more than an outdated industrial-era monopoly whose regulations prevent colleges from cultivating the skills, flexibility, and innovation that they need to ensure quality and accountability.
  • there is a much cheaper and better way: a self-certifying regimen of financial accountability, coupled with transparency about graduation rates and student success. (See some alternatives here and here.)
  • Such a system would prioritize student and parent assessment over the judgment of institutional peers or the educational bureaucracy. And it would protect students, parents, and taxpayers from fraud or mismanagement by permitting immediate complaints and investigations, with a notarized certification from the institution to serve as Exhibit A
  • The only way to protect the public interest is to end the current system of peer review patronage, and demand that colleges and universities put their reputation -- and their performance -- on the line.
  • Anne D. Neal is president of the American Council of Trustees and Alumni. The views stated herein do not represent the views of the National Advisory Committee on Institutional Quality and Integrity, of which she is a member.
  • Gary Brown on 12 Nov 10
     
    The ascending view of accreditation.
Gary Brown

Home - Journal of Assessment and Accountability Systems in Educator Preparation - 1 views

www.uni.edu/...current.html

Assessment accountability

shared by Gary Brown on 16 Nov 10 - No Cached
  • Gary Brown on 16 Nov 10
     
    a new journal to note
S Spaeth

Matthews et al: Selecting influential members of social networks - 0 views

baywood.metapress.com/...contribution.asp

iteams

shared by S Spaeth on 15 Feb 09 - Cached
  • S Spaeth on 15 Feb 09
     
    Opinion leaders are influential members of their social networks, strategically selected for their ability to sway community norms. The aims of the study were to assess: 1) whether it is feasible to identify student opinion leaders (SOLs) and their social networks among Grade 11 students at two high schools in Cape Town, South Africa; and 2) whether these opinion leaders would be willing to be involved in an HIV/AIDS prevention program in their school. The students (N = 412) completed a semi-structured, anonymous, self-administered questionnaire. ... Of these, all but two at each school were willing and available to participate in a HIV/AIDS prevention program. ---------- Focuses on HIV/AIDS prevention but can we use principles in other contexts and Facebook recommendation tools to support the process?
  • Theron DesRosier on 11 Mar 09
     
    I've been thinking about how to support the development and visibility of SOLs using technology, without creating a creepy treehouse. How do we make them more visible and accessible?
Nils Peterson

Education | Change.gov - 0 views

change.gov/education

obama service learning Learning2.0

shared by Nils Peterson on 07 Nov 08 - Cached
  • Nils Peterson on 07 Nov 08
     
    CTLT: We know how to do this integrated with the curriculum, authentically assessed by the community and credentialled by the University with Harvesting Grade Book. see ctltwsu.wordpress.com Obama "This universal and fully refundable credit will ensure that the first $4,000 of a college education is completely free for most Americans, and will cover two-thirds the cost of tuition at the average public college or university and make community college tuition completely free for most students. Recipients of the credit will be required to conduct 100 hours of community service."
« First ‹ Previous 81 - 100 of 223 Next › Last »
Showing 20▼ items per page