Skip to main content

Home/ CTLT and Friends/ Group items tagged department of education

Rss Feed Group items tagged

Nils Peterson

Change Magazine - The New Guys in Assessment Town - 0 views

  • if one of the institution’s general education goals is critical thinking, the system makes it possible to call up all the courses and programs that assess student performance on that outcome.
  • bringing together student learning outcomes data at the level of the institution, program, course, and throughout student support services so that “the data flows between and among these levels”
  • Like its competitors, eLumen maps outcomes vertically across courses and programs, but its distinctiveness lies in its capacity to capture what goes on in the classroom. Student names are entered into the system, and faculty use a rubric-like template to record assessment results for every student on every goal. The result is a running record for each student available only to the course instructor (and in a some cases to the students themselves, who can go to the system to  get feedback on recent assessments).
    • Nils Peterson
       
      sounds like harvesting gradebook. assess student work and roll up
    • Joshua Yeidel
       
      This system has some potential for formative use at the per-student leve.
  • ...7 more annotations...
  • “I’m a little wary.  It seems as if, in addition to the assessment feedback we are already giving to students, we might soon be asked to add a data-entry step of filling in boxes in a centralized database for all the student learning outcomes. This is worrisome to those of us already struggling under the weight of all that commenting and essay grading.”
    • Nils Peterson
       
      its either double work, or not being understood that the grading and the assessment can be the same activity. i suspect the former -- grading is being done with different metrics
    • Joshua Yeidel
       
      I am in the unusual position of seeing many papers _after_ they have been graded by a wide variety of teachers. Many of these contain little "assessment feedback" -- many teachers focus on "correcting" the papers and finding some letter or number to assign as a value.
  • “This is where we see many institutions struggling,” Galvin says. “Faculty simply don’t have the time for a deeper involvement in the mechanics of assessment.” Many have never seen a rubric or worked with one, “so generating accurate, objective data for analysis is a challenge.”  
    • Nils Peterson
       
      Rather than faculty using the community to help with assessment, they are outsourcing to a paid assessor -- this is the result of undertaking this thinking while also remaining in the institution-centric end of the spectrum we developed
  • I asked about faculty pushback. “Not so much,” Galvin says, “not after faculty understand that the process is not intended to evaluate their work.”
    • Nils Peterson
       
      red flag
  • the annual reports required by this process were producing “heaps of paper” while failing to track trends and developments over time. “It’s like our departments were starting anew every year,” Chaplot says. “We wanted to find a way to house the data that gave us access to what was done in the past,” which meant moving from discrete paper reports to an electronic database.
    • Joshua Yeidel
       
      It's not clear whether the "database" is housing measurements, narratives and reflections, or all of the above.
  • Can eLumen represent student learning in language? No, but it can quantify the number of boxes checked against number of boxes not checked.”
  • developing a national repository of resources, rubrics, outcomes statements, and the like that can be reviewed and downloaded by users
    • Nils Peterson
       
      in building our repository we could well open-source these tools, no need to lock them up
  • “These solutions cement the idea that assessment is an administrative rather than an educational enterprise, focused largely on accountability. They increasingly remove assessment decision making from the everyday rhythm of teaching and learning and the realm of the faculty.
    • Nils Peterson
       
      Over the wall assessment, see Transformative Assessment rubric for more detail
Ashley Ater Kranov

Course Reminds Budding Ph.D.'s of the Damage They Can Do - Teaching - The Chronicle of ... - 1 views

  •  
    I think most of us are aware of and agree with what this author is positing - the purpose in sharing this is related to our work with departments in re-thinking how they think about teaching and evaluate it. ""People often think that education works either to improve you or to leave you as you were," Mr. Cahn says. "But that's not right. An unsuccessful education can ruin you. It can kill your interest in a topic. It can make you a less-good thinker. It can leave you less open to rational argument. So we do good and bad as teachers-it's not just good or nothing.""
Gary Brown

Academic Grants Foster Waste and Antagonism - Commentary - The Chronicle of Higher Educ... - 1 views

  • We think that our work is primarily organized by institutions of higher education, or by departments, or by conferences, but in reality those have become but appendages to a huge system of distributing resources through grants.
  • It's time we looked at this system—and at its costs: unpaid, anxiety-filled hours upon hours for a single successful grant; scholarship shaped, or misshaped, according to the demands of marketlike forces and the interests of nonacademic private foundations. All to uphold a distributive system that fosters antagonistic competition and increasing inequality.
  • Every hour spent working on or worrying about grants is an hour that could be better spent on research (or family life, or civic engagement, or sleep). But every hour not spent on a grant gives a competitive edge to other applicants.
  • ...5 more annotations...
  • The grant is basically an outsourcing of assessment that could, in most situations, be carried out much better by paid professional staff members.
  • Meanwhile grant-receiving institutions, like universities, become increasingly dependent on grants, to the point that faculty members and other campus voices can scarcely be heard beneath the din of administrators exhorting them to get more and more grants.
  • Colleagues whose research may be equally valuable (based on traditional criteria of academic debate) could be denied resources and livelihoods because, instead of grant writing, they favor publishing, or public engagement, or teaching.
  • Grant applications normalize a mode of scholarly writing and thought that, whatever its merits, has not been chosen collectively by academe in the interests of good scholarship, but has been imposed from without, with the grant as its guide. And as application procedures grow more stringent, the quality of successful projects is likely to sink. Can we honestly expect good scholarship from scholars who must constantly concentrate on something other than their scholarship? Academic life is increasingly made up of a series of applications, while the applied-for work dwindles toward insignificance.
  • It's time, I think, to put an end to our rationalizations. My spine will not be straightened. The agony will not be wiped off my brain. My mind misshapen will not be pounded back, and I have to stop telling myself that everything will be OK. Months and years of my life have been taken away, and nothing short of systemic transformation will redeem them.
Gary Brown

A Final Word on the Presidents' Student-Learning Alliance - Measuring Stick - The Chron... - 1 views

  • I was very pleased to see the responses to the announcement of the Presidents’ Alliance as generally welcoming (“commendable,” “laudatory initiative,” “applaud”) the shared commitment of these 71 founding institutions to do more—and do it publicly and cooperatively—with regard to gathering, reporting, and using evidence of student learning.
  • establishing institutional indicators of educational progress that could be valuable in increasing transparency may not suggest what needs changing to improve results
  • As Adelman’s implied critique of the CLA indicates, we may end up with an indicator without connections to practice.
  • ...6 more annotations...
  • The Presidents’ Alliance’s focus on and encouragement of institutional efforts is important to making these connections and steps in a direct way supporting improvement.
  • Second, it is hard to disagree with the notion that ultimately evidence-based improvement will occur only if faculty members are appropriately trained and encouraged to improve their classroom work with undergraduates.
  • Certainly there has to be some connection between and among various levels of assessment—classroom, program, department, and institution—in order to have evidence that serves both to aid improvement and to provide transparency and accountability.
  • Presidents’ Alliance is setting forth a common framework of “critical dimensions” that institutions can use to evaluate and extend their own efforts, efforts that would include better reporting for transparency and accountability and greater involvement of faculty.
  • there is wide variation in where institutions are in their efforts, and we have a long way to go. But what is critical here is the public commitment of these institutions to work on their campuses and together to improve the gathering and reporting of evidence of student learning and, in turn, using evidence to improve outcomes.
  • The involvement of institutions of all types will make it possible to build a more coherent and cohesive professional community in which evidence-based improvement of student learning is tangible, visible, and ongoing.
Gary Brown

Let's Make Rankings That Matter - Commentary - The Chronicle of Higher Education - 3 views

  • By outsourcing evaluation of our doctoral programs to an external agency, we allow ourselves to play the double game of insulating ourselves from the criticisms they may raise by questioning their accuracy, while embracing the praise they bestow.
  • The solution to the problem is obvious: Universities should provide relevant information to potential students and faculty members themselves, instead of relying on an outside body to do it for them, years too late. How? By carrying out yearly audits of their doctoral programs.
  • The ubiquitous rise of social networking and open access to information via electronic media facilitate this approach to self-evaluation of academic departments. There is no need to depend on an obsolete system that irregularly publishes rankings when all of the necessary tools—e-mail, databases, Web sites—are available at all institutions of higher learning.
  • ...2 more annotations...
  • A great paradox of modern academe is that our institutions take pride in being on the cutting edge of new ideas and innovations, yet remain resistant and even hostile to the openness made possible by technology
  • We should not hide our departments' deficiencies in debatable rankings, but rather be honest about those limitations in order to aggressively pursue solutions that will strengthen doctoral programs and the institutions in which they play a vital role.
Gary Brown

The Ticker - Education Dept. Criticizes Accreditor Over Credit-Hour Standards - The Chr... - 2 views

  • The Southern Association of Colleges and Schools cannot consistently ensure the quality of academic programs it reviews without clearly defining what constitutes a credit hour, according to a report issued on Tuesday by the U.S. Department of Education's inspector general. The accrediting organization, which assesses colleges in 11 states, responded that the variety of experiential, online, and distance courses that institutions now offer makes it impossible to define a single, common standard for credit hours. "The traditionally accepted definitions of semester credit hours and quarter credit hours based almost exclusively on seat time can no longer be applied to half of the credits now being awarded by our higher-education institutions," the association wrote in answer to the report.
  •  
    Outcomes are mentioned as an alternative in the comments, but in a disconcerting way. As is the alternative approach to study time....
Gary Brown

Professors Who Focus on Honing Their Teaching Are a Distinct Breed - Research - The Chr... - 1 views

  • Professors who are heavily focused on learning how to improve their teaching stand apart as a very distinct subset of college faculties, according to a new study examining how members of the professoriate spend their time.
  • those who are focused on tackling societal problems stand apart as their own breed. Other faculty members, it suggests, are pretty much mutts, according to its classification scheme.
  • 1,000 full-time faculty members at four-year colleges and universities gathered as part of the Faculty Professional Performance Survey administered by Mr. Braxton and two Vanderbilt doctoral students in 1999. That survey had asked the faculty members how often they engaged in each of nearly 70 distinct scholarly activities, such as experimenting with a new teaching method, publishing a critical book review in a journal, or being interviewed on a local television station. All of the faculty members examined in the new analysis were either tenured or tenure-track and fell into one of four academic disciplines: biology, chemistry, history, or sociology.
  • ...7 more annotations...
  • cluster analysis,
  • nearly two-thirds of those surveyed were involved in the full range of scholarly activity they examined
  • Just over a third, however, stood out as focused almost solely on one of two types of scholarship: on teaching practices, or on using knowledge from their discipline to identify or solve societal problems.
  • pedagogy-focused scholars were found mainly at liberal-arts colleges and, compared with the general population surveyed, tended to be younger, heavily represented in history departments, and more likely to be female and untenured
  • Those focused on problem-solving were located mainly at research and doctoral institutions, and were evenly dispersed across disciplines and more likely than others surveyed to be male and tenured.
  • how faculty members rate those priorities are fairly consistent across academic disciplines,
  • The study was conducted by B. Jan Middendorf, acting director of Kansas State University's office of educational innovation and evaluation; Russell J. Webster, a doctoral student in psychology at Kansas State; and Steve Benton, a senior research officer at the IDEA Center
  •  
    Another study that documents the challenge and suggests confirmation of the 50% figure of faculty who are not focused on either research or teaching.
Joshua Yeidel

Above-Campus Services: Shaping the Promise of Cloud Computing for Higher Education (EDU... - 0 views

  • In the early 1990s, Mike Zucchini, formerly the CIO of Fleet/Norstar, saw four possible reasons for outsourcing information technology. He explained these reasons in his "4-S" model: Scale — the desire to access economies of scale and efficiency that an institution could not achieve alone; Specialty — the desire to access specialized expertise that is too expensive to staff; Sale — the desire to turn nonproductive assets of capital facilities and IT equipment into cash to improve a balance sheet and reduce headcount; and Surrender — the desire to simplify the IT agenda by essentially giving up and hoping that a contract for service yields the outcomes an executive desires.7 Zucchini argued that Scale and Specialty are functional reasons for outsourcing and that Sale and Surrender are ultimately dysfunctional. History supports his insights: the big Sale/Surrender outsourcing deals of Kodak, American Express, GM, and Xerox all proved transient as the complexities of managing by contract and service-level agreements led to the eventual re-creation of internal IT service capabilities
  •  
    Describes a "meta-versity" concept based on cloud computing shared by HE institutions. Although the article focuses on the institution level, many of the considerations also occur in department-level movement toward the cloud.
Gary Brown

The Rules of Faculty Club - Manage Your Career - The Chronicle of Higher Education - 0 views

  • The third rule of Faculty Club: You must be a teacher to enter the club. Your adviser will not tell you that; your fellow graduate students won't understand that. So enjoy the research nirvana that is graduate school but know that you will be descending back into the cave if and when you are hired by a university. You may have difficulty accepting this rule. If you can't, stop reading this immediately and go back to work on your dissertation. Cease and desist. Only precede to Rule No. 4 once you have fully accepted and understood Rule No. 3. Once you do, then you must not expect to be given any actual guidance from your department on how to be a teacher. You will only be able to obtain those skills through your own efforts.
  • The fourth rule of Faculty Club: Your students will only know you as their teacher and do not care about your research unless you require them to know about your research. If you require them to know about your research, they will figure out your argument without understanding the complex road that you took to get there. That leads students to believe that the point of education is to tell a professor what he or she wants to hear rather than to think through the material for themselves.
  • You must be able to convey on a syllabus the course objective and the road map that you will be employing to get students there
  • ...4 more annotations...
  • Nobody will ever tell you this, but your career will, in part, rest on having a well-thought-out philosophy of education
  • Teaching is a science. Be as methodical about developing teaching strategies and a teaching philosophy as you are in your research.
  • You must have enough teaching experience to handle Rules No. 5 and No. 6.
  • Stay focused on your research while being cognizant that you are preparing for a career as a teacher.
  •  
    another for those collecting the secret reality of teaching
Kimberly Green

Commodification of Academic Research (Inside HIgher Ed) - 0 views

  •  
    This article provides an international view of the commodification of academic research, including this base line definition, from an email interview with Hans Radder, a professor of the philosophy of science and technology at Vrije Universiteit Amsterdam, Q: Academic research has always cost money to produce, and led to products that made money for others. How is the "commodification" of research different today than in past periods? A: Commodification means that all kinds of activities and their results are predominantly interpreted and assessed on the basis of economic criteria. In this sense, recent academic research is far more commodified than it was in the past. In general terms, one can say that the relation between "money" and specific academic activity has become much more direct. Consider the following examples: first, the amount of external funding acquired is often used as a measure of individual academic quality; second, specific assessments by individual scientists have a direct impact on departmental budgets; for instance, if I now pass this doctoral dissertation, my department receives a substantial sum of money; if not, it ends up with a budget deficit; third, the growing practice of patenting the results of academic research is explicitly aimed at acquiring commercial monopolies. Related to these financial issues are important and substantial changes of academic culture. Universities are increasingly being run as big corporations. They have a top-down command structure and an academic culture in which individual university scientists are forced to behave like mini-capitalists in order to survive, guided by an entrepreneurial ethos aimed at maximizing the capitalization of their knowledge.
Gary Brown

Making College Degrees Easier to Interpret - Measuring Stick - The Chronicle of Higher ... - 1 views

  • Over the past few decades, the central purpose of undergraduate education in the United States has steadily evolved away from elite studies in the liberal arts and toward course work that prepares students for successful careers in their chosen fields. 
  • how do employers determine the values of the college degrees held by young job applicants? 
  • There is essentially no method to determine which of the three graduates have the knowledge and skills that match the advertised position. Grades and academic standards often vary so much by institution, department, and instructor that transcripts are written off as arbitrary and meaningless by those making hiring decisions. Outside fields with licensure exams like accounting and nursing, employers often hire workers based on connections, intuition, and the sometimes-misleading reputations of applicants’ alma maters. 
  • ...3 more annotations...
  • This system doesn’t allow labor markets to function efficiently.
  • To rectify this broken hiring system, academia and industry should form stronger partnerships to better determine which skills and knowledge students in various fields need to master
  • The traditional college transcript is simply too impenetrable for anyone outside—or inside—academia to comprehend.
  •  
    The purposes are problematic, but the solution points to one of our approaches.  Where is John Dewey when we need him?
Gary Brown

An Expert Surveys the Assessment Landscape - Student Affairs - The Chronicle of Higher ... - 1 views

shared by Gary Brown on 29 Oct 09 - Cached
    • Gary Brown
       
      Illustration of a vision of assessment that separates assessment from teaching and learning.
  • If assessment is going to be required by accrediting bodies and top administrators, then we need administrative support and oversight of assessment on campus, rather than once again offloading more work onto faculty members squeezed by teaching & research inflation.
  • Outcomes assessment does not have to be in the form of standardized tests, nor does including assessment in faculty review have to translate into percentages achieving a particular score on such a test. What it does mean is that when the annual review comes along, one should be prepared to answer the question, "How do you know that what you're doing results in student learning?" We've all had the experience of realizing at times that students took in something very different from what we intended (if we were paying attention at all). So it's reasonable to be asked about how you do look at that question and how you decide when your current practice is successful or when it needs to be modified. That's simply being a reflective practitioner in the classroom which is the bare minimum students should expect from us. And that's all assessment is - answering that question, reflecting on what you find, and taking next steps to keep doing what works well and find better solutions for the things that aren't working well.
  • ...2 more annotations...
  • We need to really show HOW we use the results of assessment in the revamping of our curriculum, with real case studies. Each department should insist and be ready to demonstrate real case studies of this type of use of Assessment.
  • Socrates said "A life that is not examined is not worth living". Wonderful as this may be as a metaphor we should add to it - "and once examined - do something to improve it".
Gary Brown

Accreditation Council Sets Stricter Standards for Recognizing Accreditors - Government ... - 1 views

  • As Congress and the Education Department turn up the heat on accrediting agencies to be more stringent in monitoring colleges and universities,. a nongovernmental group is also raising its requirements for recognizing accreditors.
  • requiring accreditors to disclose the specific reasons for denying or withdrawing their approval of a college.
  •  
    I guess just saying because we say so no longer suffices.
Gary Brown

Texas Law Requires Professors to Post Details of Their Teaching Online - Faculty - The ... - 1 views

  • Faculty members and administrators in Texas are speaking out about a recent state law that requires them to post specific, detailed information about their classroom assignments, curricula vitae, department budgets, and the results of student evaluations.
  • Beginning this fall, universities will have to post online a syllabus for every undergraduate course, including major assignments and examinations, reading lists, and course descriptions.
  • All of the information must be no more than three clicks away from the college's home page.
  • ...2 more annotations...
  • "the worst example of government meddling at a huge cost to the public and for zero public good that I have ever seen."
  • "You get the feeling that the government sees us as slackers," she says. By requiring professors to list every assignment, she says the law interferes with her ability to respond to students' interests and current events and shift to different topics during the semester.
  •  
    another to watch--the politization of the, well, everything
Gary Brown

Has Accreditation Produced an Ethical Business Climate? - Letters to the Editor - The C... - 0 views

  • Institutions that choose to seek program accreditation must, in the finite world of budgets, shift funds away from many struggling departments and toward the chosen few to ensure that all criteria, from faculty credentials and salaries to high-tech classrooms and generous support staff, are not only met but exceeded.
  • Last year's economic crisis, fueled largely by the graduates of elite, accredited M.B.A. programs who flocked into banking and Wall Street, suggests a startling ethical blindness, social irresponsibility, and historical ignorance.
  • What good are accrediting agencies that take no responsibility for the behavior of those they accredit?
  •  
    We might choose to help our accreditors by forwarding a response to this letter in our Rain King write up.
‹ Previous 21 - 35 of 35
Showing 20 items per page