Skip to main content

Home/ CTLT and Friends/ Contents contributed and discussions participated by Gary Brown

Contents contributed and discussions participated by Gary Brown

Gary Brown

Views: The White Noise of Accountability - Inside Higher Ed - 2 views

  • We don’t really know what we are saying
  • “In education, accountability usually means holding colleges accountable for the learning outcomes produced.” One hopes Burck Smith, whose paper containing this sentence was delivered at an American Enterprise Institute conference last November, held a firm tongue-in-cheek with the core phrase.
  • Our adventure through these questions is designed as a prodding to all who use the term to tell us what they are talking about before they otherwise simply echo the white noise.
  • ...20 more annotations...
  • when our students attend three or four schools, the subject of these sentences is considerably weakened in terms of what happens to those students.
  • Who or what is one accountable to?
  • For what?
  • Why that particular “what” -- and not another “what”?
  • To what extent is the relationship reciprocal? Are there rewards and/or sanctions inherent in the relationship? How continuous is the relationship?
  • In the Socratic moral universe, one is simultaneously witness and judge. The Greek syneidesis (“conscience” and “consciousness”) means to know something with, so to know oneself with oneself becomes an obligation of institutions and systems -- to themselves.
  • Obligation becomes self-reflexive.
  • There are no external authorities here. We offer, we accept, we provide evidence, we judge. There is nothing wrong with this: it is indispensable, reflective self-knowledge. And provided we judge without excuses, we hold to this Socratic moral framework. As Peter Ewell has noted, the information produced under this rubric, particularly in the matter of student learning, is “part of our accountability to ourselves.”
  • But is this “accountability” as the rhetoric of higher education uses the white noise -- or something else?
  • in response to shrill calls for “accountability,” U.S. higher education has placed all its eggs in the Socratic basket, but in a way that leaves the basket half-empty. It functions as the witness, providing enormous amounts of information, but does not judge that information.
  • Every single “best practice” cited by Aldeman and Carey is subject to measurement: labor market histories of graduates, ratios of resource commitment to various student outcomes, proportion of students in learning communities or taking capstone courses, publicly-posted NSSE results, undergraduate research participation, space utilization rates, licensing income, faculty patents, volume of non-institutional visitors to art exhibits, etc. etc. There’s nothing wrong with any of these, but they all wind up as measurements, each at a different concentric circle of putatively engaged acceptees of a unilateral contract to provide evidence. By the time one plows through Aldeman and Carey’s banquet, one is measuring everything that moves -- and even some things that don’t.
  • Sorry, but basic capacity facts mean that consumers cannot vote with their feet in higher education.
  • If we glossed the Socratic notion on provision-of-information, the purpose is self-improvement, not comparison. The market approach to accountability implicitly seeks to beat Socrates by holding that I cannot serve as both witness and judge of my own actions unless the behavior of others is also on the table. The self shrinks: others define the reference points. “Accountability” is about comparison and competition, and an institution’s obligations are only to collect and make public those metrics that allow comparison and competition. As for who judges the competition, we have a range of amorphous publics and imagined authorities.
  • There are no formal agreements here: this is not a contract, it is not a warranty, it is not a regulatory relationship. It isn’t even an issue of becoming a Socratic self-witness and judge. It is, instead, a case in which one set of parties, concentrated in places of power, asks another set of parties, diffuse and diverse, “to disclose more and more about academic results,” with the second set of parties responding in their own terms and formulations. The environment itself determines behavior.
  • Ewell is right about the rules of the information game in this environment: when the provider is the institution, it will shape information “to look as good as possible, regardless of the underlying performance.”
  • U.S. News & World Report’s rankings
  • The messengers become self-appointed arbiters of performance, establishing themselves as the second party to which institutions and aggregates of institutions become “accountable.” Can we honestly say that the implicit obligation of feeding these arbiters constitutes “accountability”?
  • But if the issue is student learning, there is nothing wrong with -- and a good deal to be said for -- posting public examples of comprehensive examinations, summative projects, capstone course papers, etc. within the information environment, and doing so irrespective of anyone requesting such evidence of the distribution of knowledge and skills. Yes, institutions will pick what makes them look good, but if the public products resemble AAC&U’s “Our Students’ Best Work” project, they set off peer pressure for self-improvement and very concrete disclosure. The other prominent media messengers simply don’t engage in constructive communication of this type.
  • Ironically, a “market” in the loudest voices, the flashiest media productions, and the weightiest panels of glitterati has emerged to declare judgment on institutional performance in an age when student behavior has diluted the very notion of an “institution” of higher education. The best we can say is that this environment casts nothing but fog over the specific relationships, responsibilities, and obligations that should be inherent in something we call “accountability.” Perhaps it is about time that we defined these components and their interactions with persuasive clarity. I hope that this essay will invite readers to do so.
  • Clifford Adelman is senior associate at the Institute for Higher Education Policy. The analysis and opinions expressed in this essay are those of the author, and do not necessarily represent the positions or opinions of the institute, nor should any such representation be inferred.
  •  
    Perhaps the most important piece I've read recently. Yes must be our answer to Adelman's last challenge: It is time for us to disseminate what and why we do what we do.
Gary Brown

Declining Study Time Signals Falling Standards, Report Says - The Ticker - The Chronicl... - 0 views

shared by Gary Brown on 06 Aug 10 - Cached
  • The amount of time spent studying has fallen drastically among full-time students in all demographic groups, whether they work or not, at all types of four-year colleges, according to a report released on Thursday by the American Enterprise Institute.
  • they cater to students' preferences for leisure, the report says, a shift that may slow economic growth.
  •  
    Perhaps a partial explanation for resistance to innovations that promote authentic and group work?
Gary Brown

Lawmakers Focus Ire on Accreditors for Abuses at For-Profit Colleges - Government - The... - 1 views

  • Six weeks after vowing to cull the bad apples from the for-profit higher-education sector, some Senate Democrats are asking whether the whole barrel is spoiled, and largely blaming accreditors for the rot.
  • Pressed by lawmakers, Mr. Kutz faulted the Education Department, saying it has failed in its oversight of the sector.
  • "Consistent oversight is going to be necessary," he said.
  • ...6 more annotations...
  • Senate Democrats focused most of their ire on accreditors, grilling the head of one national agency about the standards it uses to judge institutions.
  • "Do you think maybe your rigorous standards aren't rigorous enough?" asked Senator Franken, of Minnesota.
  • it was "apparent to me that we need a hearing on accreditation."
  • "But your on-site evaluations didn't detect it," Senator Harkin said. "It seems like you accept the schools' word on what they're doing."
  • Mr. Harkin said he planned to "look into" the financing structure of the accrediting system, saying it "seems to be a situation that is rife with conflict."
  • That should please committee Republicans, who called for a broader investigation into higher education. Sen. Michael B. Enzi of Wyoming, the top Republican on the education panel, said he would ask the GAO to expand its investigation to nonprofit colleges as well.
  •  
    Though the focus is on recruiting and finance of the for-profits, it is hard not to see more emphasis on verification coming down the pike....
Gary Brown

Op-Ed: 'Higher Education' Is A Waste Of Money : NPR - 4 views

shared by Gary Brown on 02 Aug 10 - Cached
  • Professor Andrew Hacker says that higher education in the U.S. is broken. He argues that too many undergraduate courses are taught by graduate assistants or professors who have no interest in teaching.
  •  
    Forwarded from a colleague.
Gary Brown

Teacher unions fighting accountability - Leonard Pitts Jr. - MiamiHerald.com - 2 views

  • Teacher unions fighting accountability
  • Enough. It is time teachers embraced accountability. Time parents, students and government did, too
  • this is an argument about the future -- and whether this country will have one
  • ...1 more annotation...
  • Lead, follow, or get out of the way.
  •  
    Another call for accountability...again from the side of the political spectrum that I think we should consider allies...
Gary Brown

How to analyze anything. - 5 views

  •  
    shared before, sharing again as it struck me anew
Gary Brown

Teacher-Education Programs Are Unaccountable and Undemanding, Report Says - Government ... - 2 views

  • Most states are doing little or nothing to hold teacher-education programs accountable for the quality of their graduates, according to a new report that also criticizes colleges for setting low standards for education majors.
  • Colleges, by contrast, are largely not selective enough in accepting students for education programs, lack a rigorous curriculum, and don't give teaching candidates enough classroom training.
  • the American Association of Colleges for Teacher Education, said that the report was timely and that her association was working to unify its members on the theme of accountability.
  •  
    Apparently NCATE is not sufficient according to some.
Gary Brown

For Accreditation, a Narrow Window of Opportunity - Commentary - The Chronicle of Highe... - 4 views

  • After two years as president of the American Council on Education, I feel compelled to send a wake-up call to campus executives: If federal policy makers are now willing to bail out the nation's leading banks and buy equity stakes in auto makers because those companies are "too big to fail," they will probably have few reservations about regulating an education system that they now understand is "too important to fail."
  • Regardless of party, policy makers are clearly aware of the importance of education and are demanding improved performance and more information, from preschool to graduate school. In this environment, we should expect college accreditation to come under significant scrutiny.
  • It has also clearly signaled its interest in using data to measure institutional performance and student outcomes, and it has invested in state efforts to create student-data systems from pre-kindergarten through graduate school.
  • ...8 more annotations...
  • Higher education has so far navigated its way through the environment of increased regulatory interest without substantial changes to our system of quality assurance or federally mandated outcomes assessment. But that has only bought us time. As we look ahead, we must keep three facts in mind: Interest in accountability is bipartisan, and the pendulum has swung toward more regulation in virtually all sectors. The economic crisis is likely to spur increased calls from policy makers to control college prices and demonstrate that students are getting value for the dollar. The size of the federal budget deficit will force everyone who receives federal support to produce more and better evidence that an investment of federal funds will pay dividends for individuals and society.
  • If we do not seize the opportunity to strengthen voluntary peer accreditation as a rigorous test of institutional quality, grounded in appropriate measures of student learning, we place at risk a precious bulwark against excessive government intervention, a bulwark that has allowed American higher education to flourish. When it comes to safeguarding the quality, diversity, and independence of American higher education, accreditors hold the keys to the kingdom.
  • all accreditors now require colleges and universities to put more emphasis on measuring student-learning outcomes. They should be equally vigilant about ensuring that those data are used to achieve improvements in outcomes
  • share plain-language results of accreditation reviews with the public.
  • It takes very little close reading to see through the self-serving statements here: namely that higher education institutions must do a better PR job pretending they are interested in meaningful reform so as to head off any real reform that migh come from the federal authorities.
  • THEREFORE, let me voice a wakeup call for those who are really interested in reform--not that there are many.1.There will never be any meaningful reform unless we have a centralized and nationalized higher educational system. Leaving higher education in the hands of individual institutions is no longer effective and is in fact what has led to the present state we find ourselves in. Year after countless year we have been promised changes in higher education and year after year nothing changes. IF CHANGE IS TO COME IT MUST BE FORCED ONTO HIGHER EDUCATION FROM THE OUTSIDE.
  • Higher education in America can no longer afford to be organized around the useless market capitalism that forces too many financially marginalized institutions to compete for less and less.
  • Keeping Quiet by Pablo NerudaIf we were not so singled-mindedabout keeping our lives moving,and for once could do nothing,perhaps a huge silencemight interrupt this sadnessof never understanding ourselvesand of threatening ourselves with death.
  •  
    It is heating up again
Gary Brown

Op-Ed Contributor - Mind Over Mass Media - NYTimes.com - 5 views

  •  
    Pinker sets the record straight, and we encounter these concerns regularly in our work. A good resource.
Gary Brown

The Chimera of College Brands - Commentary - The Chronicle of Higher Education - 1 views

  • What you get from a college, by contrast, varies wildly from department to department, professor to professor, and course to course. The idea implicit in college brands—that every course reflects certain institutional values and standards—is mostly a fraud. In reality, there are both great and terrible courses at the most esteemed and at the most denigrated institutions.
  • With a grant from the nonprofit Lumina Foundation for Education, physics and history professors from a range of Utah two- and four-year institutions are applying the "tuning" methods developed as part of the sweeping Bologna Process reforms in Europe.
  • The group also created "employability maps" by surveying employers of recent physics graduates—including General Electric, Simco Electronics, and the Air Force—to find out what knowledge and skills are needed for successful science careers.
  • ...3 more annotations...
  • If a student finishes and can't do what's advertised, they'll say, 'I've been shortchanged.'
  • Kathryn MacKay, an associate professor of history at Weber State University, drew on recent work from the American Historical Association to define learning goals in historical knowledge, thinking, and skills.
  • In the immediate future, as the higher-education market continues to globalize and the allure of prestige continues to grow, the value of university brands is likely to rise. But at some point, the countervailing forces of empiricism will begin to take hold. The openness inherent to tuning and other, similar processes will make plain that college courses do not vary in quality in anything like the way that archaic, prestige- and money-driven brands imply. Once you've defined the goals, you can prove what everyone knows but few want to admit: From an educational standpoint, institutional brands are largely an illusion for which students routinely overpay.
  •  
    The argumet for external stakeholders is underscored, among other implications.
Gary Brown

Quick Takes: May 13, 2010 - Inside Higher Ed - 2 views

  • A proposed change in the Council for Higher Education Accreditation's policies for recognizing accrediting agencies is drawing criticism from the National Association of Independent Colleges and Universities. Under the proposed change, which is part of a larger revision of the council's procedures for reviewing the work of accreditors, would require agencies to show that they "inform the public of decisions on [individual colleges' or programs'] accreditation status and the reasons for these decisions."
  • CHEA language is ambiguous about the purpose of the new requirement." CHEA is seeking comment on the new standards.
  •  
    changing pressures influencing changes in accreditation, and a link to weigh in....
Gary Brown

Education ambivalence : Nature : Nature Publishing Group - 1 views

  • Academic scientists value teaching as much as research — but universities apparently don't
  • Nature Education, last year conducted a survey of 450 university-level science faculty members from more than 30 countries. The first report from that survey, freely available at http://go.nature.com/5wEKij, focuses on 'postsecondary' university- and college-level education. It finds that more than half of the respondents in Europe, Asia and North America feel that the quality of undergraduate science education in their country is mediocre, poor or very poor.
  • 77% of respondents indicated that they considered their teaching responsibilities to be just as important as their research — and 16% said teaching was more important.
  • ...6 more annotations...
  • But the biggest barrier to improvement is the pervasive perception that academic institutions — and the prevailing rewards structure of science — value research far more than teaching
  • despite their beliefs that teaching was at least as important as research, many respondents said that they would choose to appoint a researcher rather than a teacher to an open tenured position.
  • To correct this misalignment of values, two things are required. The first is to establish a standardized system of teaching evaluation. This would give universities and professors alike the feedback they need to improve.
  • The second requirement is to improve the support and rewards for university-level teaching.
  • systematic training in how to teach well
  • But by showering so many rewards on research instead of on teaching, universities and funding agencies risk undermining the educational quality that is required for research to flourish in the long term.
  •  
    Attention to this issue from this resource--Nature--is a breakthrough in its own right. Note the focus on "flourish in the long term...".
Gary Brown

Scholar Raises Doubts About the Value of a Test of Student Learning - Research - The Ch... - 3 views

  • Beginning in 2011, the 331 universities that participate in the Voluntary System of Accountability will be expected to publicly report their students' performance on one of three national tests of college-level learning.
  • But at least one of those three tests—the Collegiate Learning Assessment, or CLA—isn't quite ready to be used as a tool of public accountability, a scholar suggested here on Tuesday during the annual meeting of the Association for Institutional Research.
  • Students' performance on the test was strongly correlated with how long they spent taking it.
  • ...6 more annotations...
  • Besides the CLA, which is sponsored by the Council for Aid to Education, other tests that participants in the voluntary system may use are the Collegiate Assessment of Academic Proficiency, from ACT Inc., and the Measure of Academic Proficiency and Progress, offered by the Educational Testing Service.
  • The test has sometimes been criticized for relying on a cross-sectional system rather than a longitudinal model, in which the same students would be tested in their first and fourth years of college.
  • there have long been concerns about just how motivated students are to perform well on the CLA.
  • Mr. Hosch suggested that small groups of similar colleges should create consortia for measuring student learning. For example, five liberal-arts colleges might create a common pool of faculty members that would evaluate senior theses from all five colleges. "That wouldn't be a national measure," Mr. Hosch said, "but it would be much more authentic."
  • Mr. Shavelson said. "The challenge confronting higher education is for institutions to address the recruitment and motivation issues if they are to get useful data. From my perspective, we need to integrate assessment into teaching and learning as part of students' programs of study, thereby raising the stakes a bit while enhancing motivation of both students and faculty
  • "I do agree with his central point that it would not be prudent to move to an accountability system based on cross-sectional assessments of freshmen and seniors at an institution," said Mr. Arum, who is an author, with Josipa Roksa, of Academically Adrift: Limited Learning on College Campuses, forthcoming from the University of Chicago Press
  •  
    CLA debunking, but the best item may be the forthcoming book on "limited learning on College Campuses."
Gary Brown

Analysis Paralysis--Why do they rhyme? - 3 views

  • To an analyst such as myself, it is rather unfortunate that the words rhyme.
  • When we analyze data or systems we certainly do want the patterns to reveal themselves – to come loose – to emerge despite the forces that are holding fast breakthrough realizations and insights needed in order to facilitate progress, positive change and growth.
  • organizations which embrace self-analysis are the most successful organizations. The lesson: You need not break it in order to fix it.
  •  
    This is a fun one to look at and makes a few good points.
Gary Brown

A New Digital Repository for Sociology Instructors - Wired Campus - The Chronicle of Hi... - 1 views

shared by Gary Brown on 27 May 10 - Cached
  • the leaders of the American Sociological Association—believe that it also helps if instructors bring to their lecture halls a well-designed syllabus and a decent idea of how to engage students with the material.
  • Materials will be assessed by peer-review committees for their fidelity to a set of principles of high-quality teaching that have been identified by the association.
  • Our goal for the peer-review process is not only to sort out which materials belong in the repository, but also to promote a conversation within the discipline about effective teaching and learning
  • ...2 more annotations...
  • include them in their tenure-and promotion portfolios.
  • As Ernest Boyer said, faculty reward systems will need to be revised in order for faculty members to truly be rewarded on the basis of their scholarship of teaching."
  •  
    Here's a repository in the making, and argument we have been making.
Gary Brown

Validity and Reliability in Higher Education Assessment - 2 views

  • Validity and Reliability in Higher Education Assessment
  • However, validity and reliability are not inherent features of assessments or assessment systems and must be monitored continuously throughout the design and implementation of an assessment system. Research studies of a theoretical or empirical nature addressing methodology for ensuring and testing validity and reliability in the higher education assessment process, results of validity and reliability studies, and novel approaches to the concepts of validity and reliability in higher education assessment are all welcome. To be most helpful in this academic exchange, empirical studies should be clear and explicit about their methodology so that others can replicate or advance their research.
  •  
    We should take this opportunity seriously and write up our work. Let me know if you want to join me.
Gary Brown

Classroom Creativity : The Frontal Cortex - 1 views

  • Classroom Creativity
  • Eric Barker recently referred me to this interesting study, which looked at how elementary school teachers perceived creativity in their students. While the teachers said they wanted creative kids in their classroom, they actually didn't. I
  • The point is that the classroom isn't designed for impulsive expression - that's called talking out of turn.
  • ...3 more annotations...
  • The danger, however, is that we're teaching our kids a very narrow and stultifying model of cognition, in which conscientiousness is privileged above all.
  • In recent years, however, it's become clear that daydreaming is actually an important element of the creative process, allowing the brain to remix ideas, explore counterfactuals and turn the spotlight of attention inwards.
  • The solution, I suppose, is rather banal: we really do need arts education in our schools,
  •  
    The Teaching Academy has refined critical and creative thinking with a draft definition that presumes they are two different thought processes. In my exploration of the purported diision, I encountered the writings of this neuroscientist.
Gary Brown

In Hunt for Prestige, Colleges May Undermine Their Public Mission - Government - The Ch... - 1 views

  • many large research universities are placing too much priority on activities that raise the profile and prestige of their institutions but do little to improve undergraduate education.
  • "In some of these places, undergraduate education has never been a top priority," says Jane V. Wellman, executive director of the Delta Project on Postsecondary Education Costs, Productivity, and Accountability.
  • While its grants and gifts have gone up, the percentage of money it spends on core teaching and student services has gone down. Many students, of course, benefit from the private support and research dollars, as the university has built better facilities and attracted world-class faculty members.
  • ...3 more annotations...
  • But the research aspirations of many large universities are in conflict with their founding principles, Ms. Wellman says, especially as undergraduate admissions has become more selective
  • another result of the chase for research dollars is that measures for faculty assessment and promotion rely too heavily on the research output and publication and too little on the quality of classroom teaching.
  • "I'm not pushing for banning research," he says, but there should be more flexibility and balance in the criteria."
  •  
    Nothing new, but affirmation of our perceptons.
Gary Brown

(the teeming void): This is Data? Arguing with Data Baby - 3 views

  • Making that call - defining what data is - is a powerful cultural gesture right now, because as I've argued before data as an idea or a figure is both highly charged and strangely abstract.
  • In other words data here is not gathered, measured, stored or transmitted - or not that we can see. It just is, and it seems to be inherent in the objects it refers to; Data Baby is "generating" data as easily as breathing.
  • This vision of material data is also frustrating because it has all the ingredients of a far more interesting idea: data is material, or at least it depends on material substrates, but the relationship between data and matter is just that, a relationship, not an identity. Data depends on stuff; always in it, and moving transmaterially through it, but it is precisely not stuff in itself.
  • ...3 more annotations...
  • Data does not just happen; it is created in specific and deliberate ways. It is generated by sensors, not babies; and those sensors are designed to measure specific parameters for specific reasons, at certain rates, with certain resolutions. Or more correctly: it is gathered by people, for specific reasons, with a certain view of the world in mind, a certain concept of what the problem or the subject is. The people use the sensors, to gather the data, to measure a certain chosen aspect of the world.
  • If we come to accept that data just is, it's too easy to forget that it reflects a specific set of contexts, contingencies and choices, and that crucially, these could be (and maybe should be) different. Accepting data shaped by someone else's choices is a tacit acceptance of their view of the world, their notion of what is interesting or important or valid. Data is not inherent or intrinsic in anything: it is constructed, and if we are going to work intelligently with data we must remember that it can always be constructed some other way.
  • We need real, broad-based, practical and critical data skills and literacies, an understanding of how to make data and do things with it.
  •  
    A discussion that coincides with reports this morning that again homeland security had the data; they just failed to understand the meaning of the data.
Gary Brown

A concept cluster quiz ~ Stephen's Web ~ by Stephen Downes - 1 views

shared by Gary Brown on 19 May 10 - Cached
  • Not everybody is happy when I say words have different meanings for each person that uses them. But it's hard to escape that conclusion when you actually look at language.
  • Geoffrey K. Pullum writes, "The people who think clarity involves lack of ambiguity, so we have to strive to eliminate all multiple meanings and should never let a word develop a new sense... they simply don't get it about how language works, do they?" A good lesson for the Semantic Web people, no?
  •  
    As we continue to refine the rubric, this short post is a useful reminder of the challenge....and the limits. We struggle in part because the formal assessment experience of many of our partners is not wide or deep, which in turns increases the language challenges.
« First ‹ Previous 81 - 100 of 244 Next › Last »
Showing 20 items per page