Skip to main content

Home/ CTLT and Friends/ Contents contributed and discussions participated by Gary Brown

Contents contributed and discussions participated by Gary Brown

Gary Brown

A Real-Life Lesson in Why Accountability Matters - Administration - The Chronicle of Hi... - 1 views

  • "Change is in the wind,"
  • "All we have is this campus," says Raven Curling, a biology and pre-dental student who is also president of the student government. "It feels like we're a university without university standards." Policy wonks and education reformers talk often about the importance of accountability and about the responsibilities of trustees to set and enforce standards. All that jargon moves from abstraction to reality when you see the price students pay for inattention.
  •  
    more focus on provostial numbers, but the import is still the same--"accountability is in the wind."
Gary Brown

Audio: Community Colleges Create a Measuring Stick - Community Colleges - The Chronicle... - 0 views

  • Joe D. May: Community Colleges Create a Measuring Stick
  •  
    nothing new here beyond the headline, but another to save for our collection. "Transparency comes with risk," says Joe.
Gary Brown

Has Accreditation Produced an Ethical Business Climate? - Letters to the Editor - The C... - 0 views

  • Institutions that choose to seek program accreditation must, in the finite world of budgets, shift funds away from many struggling departments and toward the chosen few to ensure that all criteria, from faculty credentials and salaries to high-tech classrooms and generous support staff, are not only met but exceeded.
  • Last year's economic crisis, fueled largely by the graduates of elite, accredited M.B.A. programs who flocked into banking and Wall Street, suggests a startling ethical blindness, social irresponsibility, and historical ignorance.
  • What good are accrediting agencies that take no responsibility for the behavior of those they accredit?
  •  
    We might choose to help our accreditors by forwarding a response to this letter in our Rain King write up.
Gary Brown

Renewed Debate Over the 3-Year B.A. - The Chronicle Review - The Chronicle of Higher Ed... - 0 views

  • Zemsky, chairman of the Learning Alliance for Higher Education, wrote in The Chronicle in August. Shifting to a three-year baccalaureate, Zemsky added, would force universities to "judge whether their shorter degree programs were achieving the same learning outcomes as their four-year programs had promised; they would find themselves in need of the performance measures they had hitherto eschewed." The idea has stirred some support, as well as considerable opposition.
  • the reality is that the question of whether or not this makes sense may have already been made for us by the Bologna Process, which has been moving toward mainstreaming and standardizing three-year degrees across the European Union and beyond (46 countries are participating) for some time now.
  • This idea treats an academic credit as a purchasable commodity, and a college experience as quantifiable, subject to rules of efficiency rather than humane values. In reality, so-called "credits" have no standard meaning or value. Furthermore, the idea on its own is superficial. Why not two years? One? Five?
  • ...3 more annotations...
  • For those who see college as a place to learn marketable skills, the less time and money it takes, the better. For others who see college as a place to learn to think and to learn about the world and others as broadly as possible, and to grow into one's own, why rush? (The Choice, NYTimes.com)
  • they might want to rethink not just what time of year and how long students are in the classroom, but how student accomplishment is measured.
  • The high schools are not going to suddenly become more rigorous because the colleges reduce their expectations.
  •  
    Today's rip-tide toward measures, this time from Alexander and Zemsky (and others), and the implications of standardized measures.
Gary Brown

The Ticker - Governors' Association Urges More Accountability in Academic Performance -... - 1 views

  • Governors' Association Urges More Accountability in Academic Performance
  • An issue brief, released today by the bipartisan group, which represents the nation's chief state executives, calls on states to go beyond federal reporting requirements for graduation rates, for instance, and include degree attainment by part-time students and those who transfer among community colleges.
  •  
    The call for accountability du jour. Note dissatisfaction with provostial measures while suggesting we need more...provostial measures.
Gary Brown

Schmidt - 3 views

  • There are a number of assessment methods by which learning can be evaluated (exam, practicum, etc.) for the purpose of recognition and accreditation, and there are a number of different purposes for the accreditation itself (i.e., job, social recognition, membership in a group, etc). As our world moves from an industrial to a knowledge society, new skills are needed. Social web technologies offer opportunities for learning, which build these skills and allow new ways to assess them.
  • This paper makes the case for a peer-based method of assessment and recognition as a feasible option for accreditation purposes. The peer-based method would leverage online communities and tools, for example digital portfolios, digital trails, and aggregations of individual opinions and ratings into a reliable assessment of quality. Recognition by peers can have a similar function as formal accreditation, and pathways to turn peer recognition into formal credits are outlined. The authors conclude by presenting an open education assessment and accreditation scenario, which draws upon the attributes of open source software communities: trust, relevance, scalability, and transparency.
  •  
    Kinship here, and familiar friends.
Gary Brown

News: Assessing the Assessments - Inside Higher Ed - 2 views

  • The validity of a measure is based on evidence regarding the inferences and assumptions that are intended to be made and the uses to which the measure will be put. Showing that the three tests in question are comparable does not support Shulenburger's assertion regarding the value-added measure as a valid indicator of institutional effectiveness. The claim that public university groups have previously judged the value-added measure as appropriate does not tell us anything about the evidence upon which this judgment was based nor the conditions under which the judgment was reached. As someone familiar with the process, I would assert that there was no compelling evidence presented that these instruments and the value-added measure were validated for making this assertion (no such evidence was available at the time), which is the intended use in the VSA.
  • (however much the sellers of these tests tell you that those samples are "representative"), they provide an easy way out for academic administrators who want to avoid the time-and-effort consuming but incredibly valuable task of developing detailed major program learning outcome statements (even the specialized accrediting bodies don't get down to the level of discrete, operational statements that guide faculty toward appropriate assessment design)
  • f somebody really cared about "value added," they could look at each student's first essay in this course, and compare it with that same student's last essay in this course. This person could then evaluate each individual student's increased mastery of the subject-matter in the course (there's a lot) and also the increased writing skill, if any.
  • ...1 more annotation...
  • These skills cannot be separated out from student success in learning sophisticated subject-matter, because understanding anthropology, or history of science, or organic chemistry, or Japanese painting, is not a matter of absorbing individual facts, but learning facts and ways of thinking about them in a seamless, synthetic way. No assessment scheme that neglects these obvious facts about higher education is going to do anybody any good, and we'll be wasting valuable intellectual and financial resources if we try to design one.
  •  
    ongoing discussion of these tools. Note Longanecker's comment and ask me why.
Gary Brown

News: Assessing the Assessments - Inside Higher Ed - 0 views

  • In other words, a college that ranked in the 95th percentile for critical thinking using one of the tests would rank in roughly the same place using the critical thinking component of one of the other two tests, and vice versa.
    • Gary Brown
       
      A stellar example of critical thinking, this sentence.
  • diversity in measurement" to satisfy faculty
Gary Brown

The Rules of Faculty Club - Manage Your Career - The Chronicle of Higher Education - 0 views

  • The third rule of Faculty Club: You must be a teacher to enter the club. Your adviser will not tell you that; your fellow graduate students won't understand that. So enjoy the research nirvana that is graduate school but know that you will be descending back into the cave if and when you are hired by a university. You may have difficulty accepting this rule. If you can't, stop reading this immediately and go back to work on your dissertation. Cease and desist. Only precede to Rule No. 4 once you have fully accepted and understood Rule No. 3. Once you do, then you must not expect to be given any actual guidance from your department on how to be a teacher. You will only be able to obtain those skills through your own efforts.
  • The fourth rule of Faculty Club: Your students will only know you as their teacher and do not care about your research unless you require them to know about your research. If you require them to know about your research, they will figure out your argument without understanding the complex road that you took to get there. That leads students to believe that the point of education is to tell a professor what he or she wants to hear rather than to think through the material for themselves.
  • You must be able to convey on a syllabus the course objective and the road map that you will be employing to get students there
  • ...4 more annotations...
  • Nobody will ever tell you this, but your career will, in part, rest on having a well-thought-out philosophy of education
  • Teaching is a science. Be as methodical about developing teaching strategies and a teaching philosophy as you are in your research.
  • You must have enough teaching experience to handle Rules No. 5 and No. 6.
  • Stay focused on your research while being cognizant that you are preparing for a career as a teacher.
  •  
    another for those collecting the secret reality of teaching
Gary Brown

Why Liberal Arts Need Career Services - Commentary - The Chronicle of Higher Education - 1 views

shared by Gary Brown on 04 Nov 09 - Cached
  • I have consulted with deans who say they really want to improve their career-services programs—but no, they can't offer career courses for credit, their professors aren't interested in supervising internships, and they must tread lightly around anything that might be seen by the faculty as encroaching vocationalism.
  • I've also heard from numerous professors, "Our good students go to graduate school. We don't need to focus on those who are looking for jobs."
  • I have also been told, "The professors are too busy teaching to worry about how the students will use their knowledge. It's not their job." And I've had more than one faculty member confess to me that they really aren't sure how what they teach applies in the nonacademic world.
  • ...6 more annotations...
  • There's no way to predict which moments of a liberal-arts education will be directly relevant in the workplace, but it's imperative that students know such moments occur frequently, and that the skills and knowledge they're learning are far from obscure and irrelevant.
  • We use visual-thinking techniques to help students connect the dots between their academic experience and the workplace.
  • But the opportunity to teach a career course that directly draws from a liberal-arts curriculum is not offered at many institutions. Instead, if courses are offered at all, they typically focus on basic job-finding skills like résumé writing and networking, serving to reinforce professors' worst beliefs about career advising: that it distracts and detracts from the educational process.
  • Professors, academic deans, and career-center staff members must work together. Learn what is happening in each other's shops. And don't have just a superficial conversation about services—instead, engage in a conversation about what is truly distinct about the curriculum, what students are learning, and how to make employers care.
  • Career-center personnel should find out what employers are seeking and what they say about your students.
  • If more liberal-arts faculties and career experts get together, watch out—the results could be amazing.
  •  
    As we work with CLA, perhaps inviting Careers Services to join as independent reviewers will help the effort
Gary Brown

News: Turning Surveys Into Reforms - Inside Higher Ed - 0 views

  • Molly Corbett Broad, president of the American Council on Education, warned those gathered here that they would be foolish to think that accountability demands were a thing of the past.
  • She said that while she is “impressed” with the work of NSSE, she thinks higher education is “not moving fast enough” right now to have in place accountability systems that truly answer the questions being asked of higher education. The best bet for higher education, she said, is to more fully embrace various voluntary systems, and show that they are used to promote improvements.
  • One reason NSSE data are not used more, some here said, was the decentralized nature of American higher education. David Paris, executive director of the New Leadership Alliance for Student Learning and Accountability, said that “every faculty member is king or queen in his or her classroom.” As such, he said, “they can take the lessons of NSSE” about the kinds of activities that engage students, but they don’t have to. “There is no authority or dominant professional culture that could impel any faculty member to apply” what NSSE teaches about engaged learning, he said.
  • ...4 more annotations...
  • She stressed that NSSE averages may no longer reflect any single reality of one type of faculty member. She challenged Paris’s description of powerful faculty members by noting that many adjuncts have relatively little control over their pedagogy, and must follow syllabuses and rules set by others. So the power to execute NSSE ideas, she said, may not rest with those doing most of the teaching.
  • Research presented here, however, by the Wabash College National Study of Liberal Arts Education offered concrete evidence of direct correlations between NSSE attributes and specific skills, such as critical thinking skills. The Wabash study, which involves 49 colleges of all types, features cohorts of students being analyzed on various NSSE benchmarks (for academic challenge, for instance, or supportive campus environment or faculty-student interaction) and various measures of learning, such as tests to show critical thinking skills or cognitive skills or the development of leadership skills.
  • The irony of the Wabash work with NSSE data and other data, Blaich said, was that it demonstrates the failure of colleges to act on information they get -- unless someone (in this case Wabash) drives home the ideas.“In every case, after collecting loads of information, we have yet to find a single thing that institutions didn’t already know. Everyone at the institution didn’t know -- it may have been filed away,” he said, but someone had the data. “It just wasn’t followed. There wasn’t sufficient organizational energy to use that data to improve student learning.”
  • “I want to try to make the point that there is a distinction between participating in NSSE and using NSSE," he said. "In the end, what good is it if all you get is a report?"
  •  
    Repeat of highlighted resource, but merits revisiting.
Gary Brown

An Expert Surveys the Assessment Landscape - Student Affairs - The Chronicle of Higher ... - 1 views

shared by Gary Brown on 29 Oct 09 - Cached
    • Gary Brown
       
      Illustration of a vision of assessment that separates assessment from teaching and learning.
  • If assessment is going to be required by accrediting bodies and top administrators, then we need administrative support and oversight of assessment on campus, rather than once again offloading more work onto faculty members squeezed by teaching & research inflation.
  • Outcomes assessment does not have to be in the form of standardized tests, nor does including assessment in faculty review have to translate into percentages achieving a particular score on such a test. What it does mean is that when the annual review comes along, one should be prepared to answer the question, "How do you know that what you're doing results in student learning?" We've all had the experience of realizing at times that students took in something very different from what we intended (if we were paying attention at all). So it's reasonable to be asked about how you do look at that question and how you decide when your current practice is successful or when it needs to be modified. That's simply being a reflective practitioner in the classroom which is the bare minimum students should expect from us. And that's all assessment is - answering that question, reflecting on what you find, and taking next steps to keep doing what works well and find better solutions for the things that aren't working well.
  • ...2 more annotations...
  • We need to really show HOW we use the results of assessment in the revamping of our curriculum, with real case studies. Each department should insist and be ready to demonstrate real case studies of this type of use of Assessment.
  • Socrates said "A life that is not examined is not worth living". Wonderful as this may be as a metaphor we should add to it - "and once examined - do something to improve it".
Gary Brown

Might Companies, Not Colleges, Deserve the Blame for a Shortage of Engineers? - Faculty... - 2 views

  • But in fact the number of talented college graduates in the sciences is "quite in excess of the demand," said Harold Salzman, a professor of public policy at Rutgers University. In a new paper, he and a colleague argue that the real problem is at the employment end of the pipeline.
  • It may not be so easy to convince companies, however, that they're the main problem. Susan L. Traiman, director of public policy at Business Roundtable, an association of chief executives of the largest American companies, said the analysis by Mr. Salzman and Mr. Lowell has some potential shortcomings that may explain why its findings contradict the experience of many engineering companies.
  • The fundamental suggestion by Mr. Salzman and Mr. Lowell—that science and engineering companies perhaps should be doing more to grab science and engineering students—may even have trouble winning support on university campuses, where engineering deans increasingly take pride in graduating students with a diverse set of talents, who are able to take on a range of professional challenges, rather than simply follow traditional engineering paths.
  • ...1 more annotation...
  • And Ms. Traiman, despite questioning some of the specifics in the report, said she understands the need for American companies—including those in engineering—to compete harder on both salary and lifestyle issues to attract graduates like Ms. Anderegg.
  •  
    A new twist on what Dewey worried about: the forfeit of the shaping roleof higher ed.
Gary Brown

News: Assessment vs. Action - Inside Higher Ed - 0 views

  • The assessment movement has firmly taken hold in American higher education, if you judge it by how many colleges are engaged in measuring what undergraduates learn. But if you judge by how many of them use that information to do something, the picture is different.
  • The most common approach used for institutional assessment is a nationally normed survey of students.
  • ut the survey found more attention to learning outcomes at the program level, especially by community colleges.)
  • ...3 more annotations...
  • Much smaller percentages of colleges report that assessment is based on external evaluations of student work (9 percent), student portfolios (8 percent) and employer interviews (8 percent).
  • “Some faculty and staff at prestigious, highly selective campuses wonder why documenting something already understood to be superior is warranted. They have little to gain and perhaps a lot to lose,” the report says. “On the other hand, many colleagues at lower-status campuses often feel pressed to demonstrate their worth; some worry that they may not fare well in comparison with their better-resourced, more selective counterparts. Here too, anxiety may morph into a perceived threat if the results disappoint.”
  • The provosts in the survey said what they most needed to more effectively use assessment was more faculty involvement, with 66 percent citing this need. The percentage was even greater (80 percent) at doctoral institutions.George Kuh, director of the institute, said that he viewed the results as "cause for cautious optimism," and that the reality of so much assessment activity makes it possible to work on making better use of it.
  •  
    another report on survey with interesting implications
Gary Brown

Scholars Assess Their Progress on Improving Student Learning - Research - The Chronicle... - 0 views

  • International Society for the Scholarship of Teaching and Learning, which drew 650 people. The scholars who gathered here were cautiously hopeful about colleges' commitment to the study of student learning, even as the Carnegie Foundation winds down its own project. (Mr. Shulman stepped down as president last year, and the foundation's scholarship-of-teaching-and-learning program formally came to an end last week.) "It's still a fragile thing," said Pat Hutchings, the Carnegie Foundation's vice president, in an interview here. "But I think there's a huge amount of momentum." She cited recent growth in faculty teaching centers,
  • Mary Taylor Huber, director of the foundation's Integrative Learning Project, said that pressure from accrediting organizations, policy makers, and the public has encouraged colleges to pour new resources into this work.
  • The scholars here believe that it is much more useful to try to measure and improve student learning at the level of individual courses. Institutionwide tests like the Collegiate Learning Assessment have limited utility at best, they said.
  • ...6 more annotations...
  • Mr. Bass and Toru Iiyoshi, a senior strategist at the Massachusetts Institute of Technology's office of educational innovation and technology, pointed to an emerging crop of online multimedia projects where college instructors can share findings about their teaching. Those sites include Merlot and the Digital Storytelling Multimedia Archive.
  • "We need to create 'middle spaces' for the scholarship of teaching and learning," said Randall Bass, assistant provost for teaching and learning initiatives at Georgetown University, during a conference session on Friday.
  • "If you use a more generic instrument, you can give the accreditors all the data in the world, but that's not really helpful to faculty at the department level," said the society's president, Jennifer Meta Robinson, in an interview. (Ms. Robinson is also a senior lecturer in communication and culture at Indiana University at Bloomington.)
  • It is vital, Ms. Peseta said, for scholars' articles about teaching and learning to be engaging and human. But at the same time, she urged scholars not to dumb down their statistical analyses or the theoretical foundations of their studies. She even put in a rare good word for jargon.
  • No one had a ready answer. Ms. Huber, of the Carnegie Foundation, noted that a vast number of intervening variables make it difficult to assess the effectiveness of any educational project.
  • "Well, I guess we have a couple of thousand years' worth of evidence that people don't listen to each other, and that we don't build knowledge," Mr. Bass quipped. "So we're building on that momentum."
  •  
    Note our friends Randy Bass (AAEEBL) and Mary Huber are prominent.
Gary Brown

The Ticker - Most Colleges Try to Assess Student Learning, Survey Finds - The Chronicle... - 0 views

  • October 26, 2009, 02:53 PM ET Most Colleges Try to Assess Student Learning, Survey Finds A large majority of American colleges make at least some formal effort to assess their students' learning, but most have few or no staff members dedicated to doing so. Those are among the findings of a survey report released Monday by the National Institute for Learning Outcomes Assessment, a year-old project based at Indiana University and the University of Illinois. Of more than 1,500 provosts' offices that responded to the survey, nearly two-thirds said their institutions had two or fewer employees assigned to student assessment. Among large research universities, almost 80 percent cited a lack of faculty engagement as the most serious barrier to student-assessment projects.
  •  
    no news here, but it does suggest the commitment our unit represents.
Gary Brown

Innovate to Cease Publication ~ Stephen's Web ~ by Stephen Downes - 1 views

  • To say that this publication - Technology Source, and then Innovate - and the work of editor James Morrison was an important influence on my work and my career would be an understatement. I benefited at all levels from my involvement with it, from help with my writing, to exposure to innovative ideas, to the creation of an audience for my work, to Jim's encouragement and support, which was unwavering. My thanks to Jim and to everyone else involved.
  •  
    nothing to add here. I will miss this affiliation.
Gary Brown

Will a Culture of Entitlement Bankrupt Higher Education? - Commentary - The Chronicle o... - 2 views

  • The economy has suffered changes so deep and fundamental that institutions cannot just hunker down to weather the storm. The time has come for creative reconstruction. We must summon the courage and will to re-engineer education in ways founded on shared responsibility, demanding hard work and a willingness on the part of everyone involved to let go of "the way it's always been."
  • We need to break down expectations based on entitlement and focus on educational productivity and outcomes. Institutions should review redundancies, rethink staffing models, and streamline business practices. Productivity measures should be applied in all areas. In the same way that secondary schools are being challenged to consider longer school days and an extended academic year, we in higher education need to revisit basic assumptions about how we deliver higher education to students. We should not be tied to any one model or structure.
  • For example, we should re-evaluate the notion that large classes are inherently pedagogically unsound. What both students and faculty members tend to prefer—small classes—is not the only educationally effective approach. Although no one would advocate for large classes in every discipline or instance, we should review what we do in light of new financial contingencies, while keeping an eye on what students learn.
  • ...2 more annotations...
  • the growing demand for a better-prepared work force, we need to revisit undergraduate education as a whole. We should re-examine the teacher/scholar model, for instance. Is it appropriate for every institution? Does that model really produce what it is supposed to: thinkers and makers, learned and professionally skilled graduates?
  • We should separate legitimate aspirations and a drive toward excellence from the costly and often fruitless pursuit of higher status—which may feed egos but is beyond the reasonable prospects of many institutions.
Gary Brown

Higher Education: Assessment & Process Improvement Group News | LinkedIn - 1 views

  •  
    lots about program effectiveness implied here, notably having good teachers in succession.
Gary Brown

It's the Learning, Stupid - Lumina Foundation: Helping People Achieve Their Potential - 3 views

  • My thesis is this. We live in a world where much is changing, quickly. Economic crises, technology, ideological division, and a host of other factors have all had a profound influence on who we are and what we do in higher education. But when all is said and done, it is imperative that we not lose sight of what matters most. To paraphrase the oft-used maxim of the famous political consultant James Carville, it's the learning, stupid.
  • We believe that, to significantly increase higher education attainment rates, three intermediate outcomes must first occur: Higher education must use proven strategies to move students to completion. Quality data must be used to improve student performance and inform policy and decision-making at all levels. The outcomes of student learning must be defined, measured, and aligned with workforce needs. To achieve these outcomes (and thus improve success rates), Lumina has decided to pursue several specific strategies. I'll cite just a few of these many different strategies: We will advocate for the redesign, rebranding and improvement of developmental education. We will explore the development of alternative pathways to degrees and credentials. We will push for smoother systems of transferring credit so students can move more easily between institutions, including from community colleges to bachelor's degree programs.
  • "Lumina defines high-quality credentials as degrees and certificates that have well-defined and transparent learning outcomes which provide clear pathways to further education and employment."
  • ...4 more annotations...
  • And—as Footnote One softly but incessantly reminds us—quality, at its core, must be a measure of what students actually learn and are able to do with the knowledge and skills they gain.
  • and yet we seem reluctant or unable to discuss higher education's true purpose: equipping students for success in life.
  • Research has already shown that higher education institutions vary significantly in the value they add to students in terms of what those students actually learn. Various tools and instruments tell us that some institutions add much more value than others, even when looking at students with similar backgrounds and abilities.
  • The idea with tuning is to take various programs within a specific discipline—chemistry, history, psychology, whatever—and agree on a set of learning outcomes that a degree in the field represents. The goal is not for the various programs to teach exactly the same thing in the same way or even for all of the programs to offer the same courses. Rather, programs can employ whatever techniques they prefer, so long as their students can demonstrate mastery of an agreed-upon body of knowledge and set of skills. To use the musical terminology, the various programs are not expected to play the same notes, but to be "tuned" to the same key.
« First ‹ Previous 181 - 200 of 244 Next › Last »
Showing 20 items per page