Skip to main content

Home/ CTLT and Friends/ Group items tagged educational research

Rss Feed Group items tagged

Nils Peterson

2009 Annual Meeting | Conference Program - 0 views

  • This session explores the notion that assessment for transformational learning is best utilized as a learning tool. By providing timely, transparent, and appropriate feedback, both to students and to the institution itself, learning is enhanced – a far different motive for assessment than is external accountability.
    • Nils Peterson
       
      need to get to these guys with our harvesting gradebook ideas...
    • Nils Peterson
       
      decided to attend another session. Hersh was OK before lunch, but the talk by Pan looks more promising
  • Academic and corporate communities agree on the urgent need for contemporary, research-based pedagogies of engagement in STEM fields. Participants will learn how leaders from academic departments and institutions have collaborated with leaders from the corporate and business community in regional networks to ensure that graduates meet the expectations of prospective employers and the public.
    • Nils Peterson
       
      here is another session with links to CTLT work, both harvesting gradebook and the ABET work
  • Professor Pan will discuss the reflective teaching methods used to prepare students to recognize and mobilize community assets as they design, implement, and evaluate projects to improve public health.
    • Nils Peterson
       
      Students tasked to learn about a community, ride the bus, make a Doc appt. Then tasked to do a non-clinical health project in that community (they do plenty of clinical stuff elsewhere in the program). Project must build capacity in the community to survive after the student leaves. Example. Work with hispanic parents in Sacramento about parenting issue, ex getting kids to sleep on time. Student had identified problem in the community, but first project idea was show a video, which was not capacity building. Rather than showing the video, used the video as a template and made a new video. Families were actors. Result was spanish DVD that the community could own. Pan thinks this is increased capacity in the community.
  • ...17 more annotations...
  • Freshman Survey annually examines the academic habits of mind of entering first-year students.  Along with academic involvement, the survey examines diversity, civic engagement, college admissions and expectations of college. 
  • The project aims to promote faculty and student assessment of undergraduate research products in relation to outcomes associated with basic research skills and general undergraduate learning principles (communication and quantitative reasoning, critical thinking, and integration and application of knowledge).
  • They focus educators on the magnitude of the challenge to prepare an ever-increasingly diverse, globally-connected student body with the knowledge, ability, processes, and confidence to adapt to diverse environments and respond creatively to the enormous issues facing humankind.
  • One challenge of civic engagement in the co-curriculum is the merging of cost and outcome: creating meaningful experiences for students and the community with small staffs, on small budgets, while still having significant, purposeful impact. 
  • a)claims that faculty are the sole arbiters of what constitutes a liberal education and b) counter claims that student life professionals also possess the knowledge and expertise critical to defining students’ total learning experiences.  
    • Nils Peterson
       
      also, how many angels can dance on the head of a pin?
  • This session introduces a three-year national effort to document how colleges and universities are using assessment data to improve teaching and learning and to facilitate the dissemination and adoption of best practices in the assessment of college learning outcomes.
  • Exciting pedagogies of engagement abound, including undergraduate research, community-engaged learning, interdisciplinary exploration, and international study.  However, such experiences are typically optional and non-credit-bearing for students, and/or “on top of” the workload for faculty. This session explores strategies for integrating engaged learning into the institutional fabric (curriculum, student role, faculty role) and increasing access to these transformative experiences.
  • hands-on experiential learning, especially in collaboration with other students, is a superior pedagogy but how can this be provided in increasingly larger introductory classes? 
  • As educators seek innovative ways to manage knowledge and expand interdisciplinary attention to pressing global issues, as students and parents look for assurances that their tuition investment will pay professional dividends, and as alumni look for meaningful ways to give back to the institutions that nurtured and prepared them, colleges and universities can integrate these disparate goals through the Guilds, intergenerational membership networks that draw strength from the contributions of all of their members.
    • Nils Peterson
       
      see Theron's ideas for COMM.
  • Civic engagement learning derives its power from the engagement of students with real communities—local, national, and global. This panel explores the relationship between student learning and the contexts in which that learning unfolds by examining programs that place students in diverse contexts close to campus and far afield.
  • For institutional assessment to make a difference for student learning its results must result in changes in classroom practice. This session explores ways in which the institutional assessment of student learning, such as the Wabash National Study of Liberal Arts Education and the Collegiate Learning Assessment, can be connected to our classrooms.
  • Interdisciplinary Teaching and Object-Based Learning in Campus Museums
  • To address pressing needs of their communities, government and non-profit agencies are requesting higher education to provide education in an array of human and social services. To serve these needs effectively, higher educationneeds to broaden and deepen its consultation with practitioners in designing new curricula. Colleges and universities would do well to consider a curriculum development model that requires consultation not only with potential employers, but also with practitioners and supervisors of practitioners.
  • Should Academics be Active? Campuses and Cutting Edge Civic Engagement
  • If transformational liberal education requires engaging the whole student across the educational experience, how can colleges and universities renew strategy and allocate resources effectively to support it?  How can assessment be used to improve student learning and strengthen a transformational learning environment? 
    • Nils Peterson
       
      Purpose of university is not to grant degrees, it has something to do with learning. Keeling's perspective is that the learning should be transformative; changing perspective. Liberating and emancipatory Learning is a complex interaction among student and others, new knowledge and experience, event, own aspirations. learners construct meaning from these elements. "we change our minds" altering the brain at the micro-level Brain imaging research demonstrates that analogical learning (abstract) demands more from more areas of the brain than semantic (concrete) learning. Mind is not an abstraction, it is based in the brain, a working physical organ .Learner and the environment matter to the learning. Seeds magazine, current issue on brain imaging and learning. Segway from brain research to need for university to educate the whole student. Uses the term 'transformative learning' meaning to transform the learning (re-wire the brain) but does not use transformative assessment (see wikipedia).
  • But as public debates roil, higher education has been more reactive than proactive on the question of how best to ensure that today’s students are fully prepared for a fast-paced future.
    • Nils Peterson
       
      Bologna process being adopted (slowly) in EU, the idea is to make academic degrees more interchangeable and understandable across the EU three elements * Qualification Frameworks (transnational, national, disciplinary). Frameworks are graduated, with increasing expertise and autonomy required for the upper levels. They sound like broad skills that we might recognize in the WSU CITR. Not clear how they are assessed * Tuning (benchmarking) process * Diploma Supplements (licensure, thesis, other capstone activities) these extend the information in the transcript. US equivalent might be the Kuali Students system for extending the transcript. Emerging dialog on American capability This dialog is coming from 2 directions * on campus * employers Connect to the Greater Exceptions (2000-2005) iniative. Concluded that American HE has islands of innovation. Lead to LEAP (Liberal Education and America's Promise) Initiative (2005-2015). The dialog is converging because of several forces * Changes in the balance of economic and political power. "The rise of the rest (of the world)" * Global economy in which innovation is key to growth and prosperity LEAP attempts to frame the dialog (look for LEAP in AACU website). Miami-Dade CC has announced a LEAP-derived covenant, the goals must span all aspects of their programs. Define liberal education Knowledge of human cultures and the physical and natural world intellectual and practical skills responsibility integrative skills Marker of success is (here is where the Transformative Gradebook fits in): evidence that students can apply the essential learning outcomes to complex, unscripted problems and real-world settings Current failure -- have not tracked our progress, or have found that we are not doing well. See AACU employer survey 5-10% percent of current graduates taking courses that would meet the global competencies (transcript analysis) See NSSE on Personal and social responsibility gains, less tha
  • Dr. Pan will also talk about strategies for breaking down cultural barriers.
    • Nils Peterson
       
      Pan. found a non-profit agency to be a conduit and coordinator to level the power between univ and grass roots orgs. helped with cultural gaps.
Gary Brown

Book review: Taking Stock: Research on Teaching and Learning in Higher Educat... - 2 views

  • Christensen Hughes, J. and Mighty, J. (eds.) (2010) Taking Stock: Research on Teaching and Learning in Higher Education Montreal QC and Kingston ON: McGill-Queen’s University Press, 350 pp, C$/US$39.95
  • ‘The impetus for this event was the recognition that researchers have discovered much about teaching and learning in higher education, but that dissemination and uptake of this information have been limited. As such, the impact of educational research on faculty-teaching practice and student-learning experience has been negligible.’
  • Julia Christensen Hughes
  • ...10 more annotations...
  • Chapter 7: Faculty research and teaching approaches Michael Prosser
  • What faculty know about student learning Maryellen Weimer
  • ractices of Convenience: Teaching and Learning in Higher Education
  • Chapter 8: Student engagement and learning: Jillian Kinzie
  • (p. 4)
  • ‘much of our current approach to teaching in higher education might best be described as practices of convenience, to the extent that traditional pedagogical approaches continue to predominate. Such practices are convenient insofar as large numbers of students can be efficiently processed through the system. As far as learning effectiveness is concerned, however, such practices are decidedly inconvenient, as they fall far short of what is needed in terms of fostering self-directed learning, transformative learning, or learning that lasts.’
  • p. 10:
  • …research suggests that there is an association between how faculty teach and how students learn, and how students learn and the learning outcomes achieved. Further, research suggests that many faculty members teach in ways that are not particularly helpful to deep learning. Much of this research has been known for decades, yet we continue to teach in ways that are contrary to these findings.’
  • ‘There is increasing empirical evidence from a variety of international settings that prevailing teaching practices in higher education do not encourage the sort of learning that contemporary society demands….Teaching remains largely didactic, assessment of student work is often trivial, and curricula are more likely to emphasize content coverage than acquisition of lifelong and life-wide skills.’
  • What other profession would go about its business in such an amateurish and unprofessional way as university teaching? Despite the excellent suggestions in this book from those ‘within the tent’, I don’t see change coming from within. We have government and self-imposed industry regulation to prevent financial advisers, medical practitioners, real estate agents, engineers, construction workers and many other professions from operating without proper training. How long are we prepared to put up with this unregulated situation in university and college teaching?
Theron DesRosier

Education Data Model (National Forum on Education Statistics). Strategies for building ... - 0 views

  •  
    "The National Education Data Model is a conceptual but detailed representation of the education information domain focused at the student, instructor and course/class levels. It delineates the relationships and interdependencies between the data elements necessary to document, operate, track, evaluate, and improve key aspects of an education system. The NEDM strives to be a shared understanding among all education stakeholders as to what information needs to be collected and managed at the local level in order to enable effective instruction of students and superior leadership of schools. It is a comprehensive, non-proprietary inventory and a map of education information that can be used by schools, LEAs, states, vendors, and researchers to identify the information required for teaching, learning, administrative systems, and evaluation of education programs and approaches. "
Gary Brown

Education ambivalence : Nature : Nature Publishing Group - 1 views

  • Academic scientists value teaching as much as research — but universities apparently don't
  • Nature Education, last year conducted a survey of 450 university-level science faculty members from more than 30 countries. The first report from that survey, freely available at http://go.nature.com/5wEKij, focuses on 'postsecondary' university- and college-level education. It finds that more than half of the respondents in Europe, Asia and North America feel that the quality of undergraduate science education in their country is mediocre, poor or very poor.
  • 77% of respondents indicated that they considered their teaching responsibilities to be just as important as their research — and 16% said teaching was more important.
  • ...6 more annotations...
  • But the biggest barrier to improvement is the pervasive perception that academic institutions — and the prevailing rewards structure of science — value research far more than teaching
  • despite their beliefs that teaching was at least as important as research, many respondents said that they would choose to appoint a researcher rather than a teacher to an open tenured position.
  • To correct this misalignment of values, two things are required. The first is to establish a standardized system of teaching evaluation. This would give universities and professors alike the feedback they need to improve.
  • The second requirement is to improve the support and rewards for university-level teaching.
  • systematic training in how to teach well
  • But by showering so many rewards on research instead of on teaching, universities and funding agencies risk undermining the educational quality that is required for research to flourish in the long term.
  •  
    Attention to this issue from this resource--Nature--is a breakthrough in its own right. Note the focus on "flourish in the long term...".
Kimberly Green

Strategic National Arts Alumni Project (SNAAP) - 0 views

  •  
    WSU is participating in this survey. Looks interesting, follow up on students who graduate with an arts degree. Could be useful in program assessment in a number of ways ( a model, sample questions, as well as ways to leverage nationally collected data.) Kimberly Welcome to the Strategic National Arts Alumni Project (SNAAP), an annual online survey, data management, and institutional improvement system designed to enhance the impact of arts-school education. SNAAP partners with arts high schools, art and design colleges, conservatories and arts programs within colleges and universities to administer the survey to their graduates. SNAAP is a project of the Indiana University Center for Postsecondary Research in collaboration with the Vanderbilt University Curb Center for Art, Enterprise, and Public Policy. Lead funding is provided by the Surdna Foundation, with major partnership support from the Houston Endowment, Barr Foundation, Cleveland Foundation, Educational Foundation of America and the National Endowment for the Arts. improvement system designed to enhance the impact of arts-school education. SNAAP partners with arts high schools, art and design colleges, conservatories and arts programs within colleges and universities to administer the survey to their graduates. SNAAP is a project of the Indiana University Center for Postsecondary Research in collaboration with the Vanderbilt University Curb Center for Art, Enterprise, and Public Policy. Lead funding is provided by the Surdna Foundation, with major partnership support from the Houston Endowment, Barr Foundation, Cleveland Foundation, Educational Foundation of America and the National Endowment for the Arts."
Gary Brown

In Hunt for Prestige, Colleges May Undermine Their Public Mission - Government - The Ch... - 1 views

  • many large research universities are placing too much priority on activities that raise the profile and prestige of their institutions but do little to improve undergraduate education.
  • "In some of these places, undergraduate education has never been a top priority," says Jane V. Wellman, executive director of the Delta Project on Postsecondary Education Costs, Productivity, and Accountability.
  • While its grants and gifts have gone up, the percentage of money it spends on core teaching and student services has gone down. Many students, of course, benefit from the private support and research dollars, as the university has built better facilities and attracted world-class faculty members.
  • ...3 more annotations...
  • But the research aspirations of many large universities are in conflict with their founding principles, Ms. Wellman says, especially as undergraduate admissions has become more selective
  • another result of the chase for research dollars is that measures for faculty assessment and promotion rely too heavily on the research output and publication and too little on the quality of classroom teaching.
  • "I'm not pushing for banning research," he says, but there should be more flexibility and balance in the criteria."
  •  
    Nothing new, but affirmation of our perceptons.
Gary Brown

What's Wrong With the American University System - Culture - The Atlantic - 3 views

  • But when the young superstar sat down with the department chair, he seemed to have only one goal: to land a tenure-track position that involved as many sabbaticals and as little teaching as possible
  • Hacker and his coauthor, New York Times writer Claudia Dreifus, use this cautionary tale to launch their new book, a fierce critique of modern academia called Higher Education? "The question mark in our title," they write, "is the key to this book." To their minds, little of what takes place on college campuses today can be considered either "higher" or "education."
  • They blame a system that favors research over teaching and vocational training over liberal arts.
  • ...10 more annotations...
  • Tenure, they argue, does anything but protect intellectual freedom
  • Schools get status by bringing on professors who are star researchers, star scholars. That's all we really know about Caltech or MIT or Stanford. We don't really know about the quality of undergraduate teaching at any of these places. And it's the students who suffer.
  • Claudia and I were up at Harvard talking to students, and they said they get nothing from their classes, but that doesn't matter. They're smart already—they can breeze through college. The point is that they're going to be Harvard people when they come out.
  • So tenure is, in fact, the enemy of spontaneity, the enemy of intellectual freedom.
  • Good teaching can't be quantified at the college level.
  • or instance, Evergreen College, a sweet little state school in Olympia, Washington. We spent three days there and it was fantastic. They don't give grades, and they don't have academic departments. There are no faculty rankings. Almost all the classes we saw were taught by two professors—say, one from philosophy and one from psychology, teaching jointly on Henry and William James. Even though they don't give grades, the professors write out long evaluations for students. And the students have no problem getting into graduate schools.
  • I like Missouri Western State. It's a third-tier university, but the faculty realize they're going to stay there, they're not going to get hired away by other colleges, so they pitch in and take teaching seriously. At a school like that, you have a decent chance of finding a mentor who will write you a strong recommendation, better than you would at Harvard.
  • We believe the current criteria for admissions—particularly the SAT—are just so out of whack. It's like No Child Left Behind. It really is. It's one of the biggest crimes that's ever been perpetrated.
  • Professor X. He argued that some students just aren't ready for college. What's your view on that? Our view is that the primary obligation belongs to the teacher. Good teaching is not just imparting knowledge, like pouring milk into a jug. It's the job of the teacher to get students interested and turned on no matter what the subject is. Every student can be turned on if teachers really engage in this way. We saw it at Evergreen and other places that have this emphasis.
  • This is the hand I was dealt this semester. This is my job." Some people say to me, "Your students at Queens, are they any good?" I say, "I make them good." Every student is capable of college. I know some people have had difficult high school educations. But if you have good teachers who really care, it's remarkable how you can make up the difference.
  •  
    In case you haven't already seen this.  While don't deny higher education needs attention, I personal wish there'd be far more attention paid to lower education and regressive education (my own term for, redressing and improving the education of all U.S. citizens).  We are in the process of destroying our country and our world.  Education as at the very heart of any solution.
  •  
    More of the discussion in the news--the Atlantic
Gary Brown

Colleges May Be Missing a Chance for Change - International - The Chronicle of Higher E... - 1 views

    • Gary Brown
       
      And what are people for, after all?
  • Peter P. Smith, senior vice president for academic strategies and development at Kaplan Higher Education, said that if traditional universities did not adjust, new institutions would evolve to meet student needs. Those new institutions, said Mr. Smith, whose company is a for-profit education provider, would be more student-centric, would deliver instruction with greater flexibility, and would offer educational services at a lower cost.
  • both education and research must become more relevant and responsive to society.
  • ...5 more annotations...
  • The gathering drew about 500 government officials, institutional leaders, and researchers
  • Speakers at an international conference here delivered a scathing assessment of higher education: Universities, they said, are slow to change, uncomfortable in dealing with real-world problems, and culturally resistant to substantive internationalization.
  • many faculty members may be "uncomfortable" with having deeper links to industry because they don't understand that world. Students, however, are highly practical, Mr. Fadel said, and are specifically seeking education that will get them a job or give them an advantage in the workplace.
  • "I'm sorry, as a student, you do not go to university to learn. You go to get a credential," he said.
    • Gary Brown
       
      And if you graduate more appreciative of the credential than what and how you have learned, then the education.
  • That does not mean colleges simply ought to turn out more graduates for in-demand professions like science and engineering, Mr. Fadel added. Colleges need to infuse other disciplines with science and engineering skills.
Nils Peterson

Innovating the 21st-Century University: It's Time! (EDUCAUSE Review) | EDUCAUSE - 4 views

  • change is required in two vast and interwoven domains that permeate the deep structures and operating model of the university: (1) the value created for the main customers of the university (the students); and (2) the model of production for how that value is created. First we need to toss out the old industrial model of pedagogy (how learning is accomplished) and replace it with a new model called collaborative learning. Second we need an entirely new modus operandi for how the subject matter, course materials, texts, written and spoken word, and other media (the content of higher education) are created.
  • Research shows that mutual exploration, group problem solving, and collective meaning-making produce better learning outcomes and understanding overall. Brown and Adler cite a study by Richard J. Light, of the Harvard Graduate School of Education: "Light discovered that one of the strongest determinants of students' success in higher education . . . was their ability to form or participate in small study groups. Students who studied in groups, even only once a week, were more engaged in their studies, were better prepared for class, and learned significantly more than students who worked on their own."
  • Second, the web enables students to collaborate with others independent of time and geography. Finally, the web represents a new mode of production for knowledge, and that changes just about everything regarding how the "content" of college and university courses are created.
  • ...7 more annotations...
  • As Seymour Papert, one of the world's foremost experts on how technology can provide new ways to learn, put it: "The scandal of education is that every time you teach something, you deprive a [student] of the pleasure and benefit of discovery."14 Students need to integrate new information with the information they already have — to "construct" new knowledge structures and meaning.
  • Universities need an entirely new modus operandi for how the content of higher education is created. The university needs to open up, embrace collaborative knowledge production, and break down the walls that exist among institutions of higher education and between those institutions and the rest of the world.To do so, universities require deep structural changes — and soon. More than three years ago, Charles M. Vest published "Open Content and the Emerging Global Meta-University" in EDUCAUSE Review. In his concluding paragraph, Vest offered a tantalizing vision: "My view is that in the open-access movement, we are seeing the early emergence of a meta-university — a transcendent, accessible, empowering, dynamic, communally constructed framework of open materials and platforms on which much of higher education worldwide can be constructed or enhanced. The Internet and the Web will provide the communication infrastructure, and the open-access movement and its derivatives will provide much of the knowledge and information infrastructure." Vest wrote that the meta-university "will speed the propagation of high-quality education and scholarship. . . . The emerging meta-university, built on the power and ubiquity of the Web and launched by the open courseware movement, will give teachers and learners everywhere the ability to access and share teaching materials, scholarly publications, scientific works in progress, teleoperation of experiments, and worldwide collaborations, thereby achieving economic efficiencies and raising the quality of education through a noble and global endeavor."17
  • Used properly, wikis are tremendously powerful tools to collaborate and co-innovate new content. Tapscott wrote the foreword for a book called We Are Smarter Than Me (2008). The book, a best-seller, was written by Barry Libert, Jon Spector, and more than 4,000 people who contributed to the book's wiki. If a global collaboration can write a book, surely one could be used to create a university course. A professor could operate a wiki with other teachers. Or a professor could use a wiki with his or her students, thereby co-innovating course content with the students themselves. Rather than simply being the recipients of the professor's knowledge, the students co-create the knowledge on their own, which has been shown to be one of the most effective methods of learning.
  • The student might enroll in the primary college in Oregon and register to take a behavioral psychology course from Stanford University and a medieval history course from Cambridge. For these students, the collective syllabi of the world form their menu for higher education. Yet the opportunity goes beyond simply mixing and matching courses. Next-generation faculty will create a context whereby students from around the world can participate in online discussions, forums, and wikis to discover, learn, and produce knowledge as networked individuals and collectively.
  • But what about credentials? As long as the universities can grant degrees, their supremacy will never be challenged." This is myopic thinking. The value of a credential and even the prestige of a university are rooted in its effectiveness as a learning institution. If these institutions are shown to be inferior to alternative learning environments, their capacity to credential will surely diminish. How much longer will, say, a Harvard undergraduate degree, taught mostly through lectures by teaching assistants in large classes, be able to compete in status with the small class size of liberal arts colleges or the superior delivery systems that harness the new models of learning?
  • As part of this, the academic journal should be disintermediated and the textbook industry eliminated. In fact, the word textbook is an oxymoron today. Content should be multimedia — not just text. Content should be networked and hyperlinked bits — not atoms. Moreover, interactive courseware — not separate "books" — should be used to present this content to students, constituting a platform for every subject, across disciplines, among institutions, and around the world. The textbook industry will never reinvent itself, however, since legacy cultures and business models die hard. It will be up to scholars and students to do this collectively.
  • Ultimately, we will need more objective measures centered on students' learning performance.
Gary Brown

Educators Mull How to Motivate Professors to Improve Teaching - Curriculum - The Chroni... - 4 views

  • "Without an unrelenting focus on quality—on defining and measuring and ensuring the learning outcomes of students—any effort to increase college-completion rates would be a hollow effort indeed."
  • If colleges are going to provide high-quality educations to millions of additional students, they said, the institutions will need to develop measures of student learning than can assure parents, employers, and taxpayers that no one's time and money are being wasted.
  • "Effective assessment is critical to ensure that our colleges and universities are delivering the kinds of educational experiences that we believe we actually provide for students," said Ronald A. Crutcher, president of Wheaton College, in Massachusetts, during the opening plenary. "That data is also vital to addressing the skepticism that society has about the value of a liberal education."
  • ...13 more annotations...
  • But many speakers insisted that colleges should go ahead and take drastic steps to improve the quality of their instruction, without using rigid faculty-incentive structures or the fiscal crisis as excuses for inaction.
  • Handing out "teacher of the year" awards may not do much for a college
  • W.E. Deming argued, quality has to be designed into the entire system and supported by top management (that is, every decision made by CEOs and Presidents, and support systems as well as operations) rather than being made the responsibility solely of those delivering 'at the coal face'.
  • I see as a certain cluelessness among those who think one can create substantial change based on volunteerism
  • Current approaches to broaden the instructional repertoires of faculty members include faculty workshops, summer leave, and individual consultations, but these approaches work only for those relatively few faculty members who seek out opportunities to broaden their instructional methods.
  • The approach that makes sense to me is to engage faculty members at the departmental level in a discussion of the future and the implications of the future for their field, their college, their students, and themselves. You are invited to join an ongoing discussion of this issue at http://innovate-ideagora.ning.com/forum/topics/addressing-the-problem-of
  • Putting pressure on professors to improve teaching will not result in better education. The primary reason is that they do not know how to make real improvements. The problem is that in many fields of education there is either not enough research, or they do not have good ways of evaluationg the results of their teaching.
  • Then there needs to be a research based assessment that can be used by individual professors, NOT by the administration.
  • Humanities educatiors either have to learn enough statistics and cognitive science so they can make valid scientific comparisons of different strategies, or they have to work with cognitive scientists and statisticians
  • good teaching takes time
  • On the measurement side, about half of the assessments constructed by faculty fail to meet reasonable minimum standards for validity. (Interestingly, these failures leave the door open to a class action lawsuit. Physicians are successfully sued for failing to apply scientific findings correctly; commerce is replete with lawsuits based on measurement errors.)
  • The elephant in the corner of the room --still-- is that we refuse to measure learning outcomes and impact, especially proficiencies generalized to one's life outside the classroom.
  • until universities stop playing games to make themselves look better because they want to maintain their comfortable positions and actually look at what they can do to improve nothing is going to change.
  •  
    our work, our friends (Ken and Jim), and more context that shapes our strategy.
  •  
    How about using examples of highly motivational lecture and teaching techniques like the Richard Dawkins video I presented on this forum, recently. Even if teacher's do not consciously try to adopt good working techniques, there is at least a strong subconscious human tendency to mimic behaviors. I think that if teachers see more effective techniques, they will automatically begin to adopt adopt them.
Gary Brown

Education Sector: Research and Reports: Ready to Assemble: Grading State Higher Educati... - 0 views

  •  
    I note Washington gets a check mark for learning outcomes.
  •  
    States need strong higher education systems, now more than ever. In the tumultuous, highly competitive 21st century economy, citizens and workers need knowledge, skills, and credentials in order to prosper. Yet many colleges and universities are falling short. To give all students the best possible postsecondary education, states must create smart, effective higher education accountability systems, modeled from the best practices of their peers, and set bold, concrete goals for achievement
Gary Brown

The Rules of Faculty Club - Manage Your Career - The Chronicle of Higher Education - 0 views

  • The third rule of Faculty Club: You must be a teacher to enter the club. Your adviser will not tell you that; your fellow graduate students won't understand that. So enjoy the research nirvana that is graduate school but know that you will be descending back into the cave if and when you are hired by a university. You may have difficulty accepting this rule. If you can't, stop reading this immediately and go back to work on your dissertation. Cease and desist. Only precede to Rule No. 4 once you have fully accepted and understood Rule No. 3. Once you do, then you must not expect to be given any actual guidance from your department on how to be a teacher. You will only be able to obtain those skills through your own efforts.
  • The fourth rule of Faculty Club: Your students will only know you as their teacher and do not care about your research unless you require them to know about your research. If you require them to know about your research, they will figure out your argument without understanding the complex road that you took to get there. That leads students to believe that the point of education is to tell a professor what he or she wants to hear rather than to think through the material for themselves.
  • You must be able to convey on a syllabus the course objective and the road map that you will be employing to get students there
  • ...4 more annotations...
  • Nobody will ever tell you this, but your career will, in part, rest on having a well-thought-out philosophy of education
  • Teaching is a science. Be as methodical about developing teaching strategies and a teaching philosophy as you are in your research.
  • You must have enough teaching experience to handle Rules No. 5 and No. 6.
  • Stay focused on your research while being cognizant that you are preparing for a career as a teacher.
  •  
    another for those collecting the secret reality of teaching
Gary Brown

News: Turning Surveys Into Reforms - Inside Higher Ed - 0 views

  • Molly Corbett Broad, president of the American Council on Education, warned those gathered here that they would be foolish to think that accountability demands were a thing of the past.
  • She said that while she is “impressed” with the work of NSSE, she thinks higher education is “not moving fast enough” right now to have in place accountability systems that truly answer the questions being asked of higher education. The best bet for higher education, she said, is to more fully embrace various voluntary systems, and show that they are used to promote improvements.
  • One reason NSSE data are not used more, some here said, was the decentralized nature of American higher education. David Paris, executive director of the New Leadership Alliance for Student Learning and Accountability, said that “every faculty member is king or queen in his or her classroom.” As such, he said, “they can take the lessons of NSSE” about the kinds of activities that engage students, but they don’t have to. “There is no authority or dominant professional culture that could impel any faculty member to apply” what NSSE teaches about engaged learning, he said.
  • ...4 more annotations...
  • She stressed that NSSE averages may no longer reflect any single reality of one type of faculty member. She challenged Paris’s description of powerful faculty members by noting that many adjuncts have relatively little control over their pedagogy, and must follow syllabuses and rules set by others. So the power to execute NSSE ideas, she said, may not rest with those doing most of the teaching.
  • Research presented here, however, by the Wabash College National Study of Liberal Arts Education offered concrete evidence of direct correlations between NSSE attributes and specific skills, such as critical thinking skills. The Wabash study, which involves 49 colleges of all types, features cohorts of students being analyzed on various NSSE benchmarks (for academic challenge, for instance, or supportive campus environment or faculty-student interaction) and various measures of learning, such as tests to show critical thinking skills or cognitive skills or the development of leadership skills.
  • The irony of the Wabash work with NSSE data and other data, Blaich said, was that it demonstrates the failure of colleges to act on information they get -- unless someone (in this case Wabash) drives home the ideas.“In every case, after collecting loads of information, we have yet to find a single thing that institutions didn’t already know. Everyone at the institution didn’t know -- it may have been filed away,” he said, but someone had the data. “It just wasn’t followed. There wasn’t sufficient organizational energy to use that data to improve student learning.”
  • “I want to try to make the point that there is a distinction between participating in NSSE and using NSSE," he said. "In the end, what good is it if all you get is a report?"
  •  
    An interesting discussion, exploring basic questions CTLT folks are familiar with, grappling with the question of how to use survey data and how to identify and address limitations. 10 years after launch of National Survey of Student Engagement, many worry that colleges have been speedier to embrace giving the questionnaire than using its results. And some experts want changes in what the survey measures. I note these limitations, near the end of the article: Adrianna Kezar, associate professor of higher education at the University of Southern California, noted that NSSE's questions were drafted based on the model of students attending a single residential college. Indeed many of the questions concern out-of-class experiences (both academic and otherwise) that suggest someone is living in a college community. Kezar noted that this is no longer a valid assumption for many undergraduates. Nor is the assumption that they have time to interact with peers and professors out of class when many are holding down jobs. Nor is the assumption -- when students are "swirling" from college to college, or taking courses at multiple colleges at the same time -- that any single institution is responsible for their engagement. Further, Kezar noted that there is an implicit assumption in NSSE of faculty being part of a stable college community. Questions about seeing faculty members outside of class, she said, don't necessarily work when adjunct faculty members may lack offices or the ability to interact with students from one semester to the next. Kezar said that she thinks full-time adjunct faculty members may actually encourage more engagement than tenured professors because the adjuncts are focused on teaching and generally not on research. And she emphasized that concerns about the impact of part-time adjuncts on student engagement arise not out of criticism of those individuals, but of the system that assigns them teaching duties without much support. S
  •  
    Repeat of highlighted resource, but merits revisiting.
Gary Brown

The Future of Wannabe U. - The Chronicle Review - The Chronicle of Higher Education - 2 views

  • Alice didn't tell me about the topics of her research; instead she listed the number of articles she had written, where they had been submitted and accepted, the reputation of the journals, the data sets she was constructing, and how many articles she could milk from each data set.
  • colleges and universities have transformed themselves from participants in an audit culture to accomplices in an accountability regime.
  • higher education has inaugurated an accountability regime—a politics of surveillance, control, and market management that disguises itself as value-neutral and scientific administration.
  • ...7 more annotations...
  • annabe administrator noted that the recipient had published well more than 100 articles. He never said why those articles mattered.
  • And all we have are numbers about teaching. And we don't know what the difference is between a [summary measure of] 7.3 and a 7.7 or an 8.2 and an 8.5."
  • The problem is that such numbers have no meaning. They cannot indicate the quality of a student's education.
  • or can the many metrics that commonly appear in academic (strategic) plans, like student credit hours per full-time-equivalent faculty member, or the percentage of classes with more than 50 students. Those productivity measures (for they are indeed productivity measures) might as well apply to the assembly-line workers who fabricate the proverbial widget, for one cannot tell what the metrics have to do with the supposed purpose of institutions of higher education—to create and transmit knowledge. That includes leading students to the possibility of a fuller life and an appreciation of the world around them and expanding their horizons.
  • But, like the fitness club's expensive cardio machines, a significant increase in faculty research, in the quality of student experiences (including learning), in the institution's service to its state, or in its standing among its peers may cost more than a university can afford to invest or would even dream of paying.
  • Such metrics are a speedup of the academic assembly line, not an intensification or improvement of student learning. Indeed, sometimes a boost in some measures, like an increase in the number of first-year students participating in "living and learning communities," may even detract from what students learn. (Wan U.'s pre-pharmacy living-and-learning community is so competitive that students keep track of one another's grades more than they help one another study. Last year one student turned off her roommate's alarm clock so that she would miss an exam and thus no longer compete for admission to the School of Pharmacy.)
  • Even metrics intended to indicate what students may have learned seem to have more to do with controlling faculty members than with gauging education. Take student-outcomes assessments, meant to be evaluations of whether courses have achieved their goals. They search for fault where earlier researchers would not have dreamed to look. When parents in the 1950s asked why Johnny couldn't read, teachers may have responded that it was Johnny's fault; they had prepared detailed lesson plans. Today student-outcomes assessment does not even try to discover whether Johnny attended class; instead it produces metrics about outcomes without considering Johnny's input.
  •  
    A good one to wrestle with.  It may be worth formulating distinctions we hold, and steering accordingly.
Judy Rumph

Views: Why Are We Assessing? - Inside Higher Ed - 1 views

  • Amid all this progress, however, we seem to have lost our way. Too many of us have focused on the route we’re traveling: whether assessment should be value-added; the improvement versus accountability debate; entering assessment data into a database; pulling together a report for an accreditor. We’ve been so focused on the details of our route that we’ve lost sight of our destinatio
  • Our destination, which is what we should be focusing on, is the purpose of assessment. Over the last decades, we've consistently talked about two purposes of assessment: improvement and accountability. The thinking has been that improvement means using assessment to identify problems — things that need improvement — while accountability means using assessment to show that we're already doing a great job and need no improvement. A great deal has been written about the need to reconcile these two seemingly disparate purposes.
  • The most important purpose of assessment should be not improvement or accountability but their common aim: everyone wants students to get the best possible education
  • ...7 more annotations...
  • Our second common purpose of assessment should be making sure not only that students learn what’s important, but that their learning is of appropriate scope, depth, and rigo
  • Third, we need to accept how good we already are, so we can recognize success when we see i
  • And we haven’t figured out a way to tell the story of our effectiveness in 25 words or less, which is what busy people want and nee
  • Because we're not telling the stories of our successful outcomes in simple, understandable terms, the public continues to define quality using the outdated concept of inputs like faculty credentials, student aptitude, and institutional wealth — things that by themselves don’t say a whole lot about student learning.
  • And people like to invest in success. Because the public doesn't know how good we are at helping students learn, it doesn't yet give us all the support we need in our quest to give our students the best possible education.
  • But while virtually every college and university has had to make draconian budget cuts in the last couple of years, with more to come, I wonder how many are using solid, systematic evidence — including assessment evidence — to inform those decisions.
  • Now is the time to move our focus from the road we are traveling to our destination: a point at which we all are prudent, informed stewards of our resources… a point at which we each have clear, appropriate, justifiable, and externally-informed standards for student learning. Most importantly, now is the time to move our focus from assessment to learning, and to keeping our promises. Only then can we make higher education as great as it needs to be.
  •  
    Yes, this article resonnated with me too. Especially connecting assessment to teaching and learning. The most important purpose of assessment should be not improvement or accountability but their common aim: everyone wants students to get the best possible education.... today we seem to be devoting more time, money, thought, and effort to assessment than to helping faculty help students learn as effectively as possible. When our colleagues have disappointing assessment results, and they don't know what to do to improve them, I wonder how many have been made aware that, in some respects, we are living in a golden age of higher education, coming off a quarter-century of solid research on practices that promote deep, lasting learning. I wonder how many are pointed to the many excellent resources we now have on good teaching practices, including books, journals, conferences and, increasingly, teaching-learning centers right on campus. I wonder how many of the graduate programs they attended include the study and practice of contemporary research on effective higher education pedagogies. No wonder so many of us are struggling to make sense of our assessment results! Too many of us are separating work on assessment from work on improving teaching and learning, when they should be two sides of the same coin. We need to bring our work on teaching, learning, and assessment together.
Theron DesRosier

The Learning in Informal and Formal Environments (LIFE) Center » Blog Archive... - 0 views

  •  
    In 2004, the LIFE Center and the Center for Multicultural Education at the University of Washington established the LIFE Diversity Panel. The Panel's goal was to summarize important principles that educational practitioners, policy makers, and researchers can use to build upon the learning that occurs in the homes and community cultures of students from diverse groups. We are pleased to announce the culmination of this two year consensus process. On May 11th, 2007, the centers released the consensus report produced by the LIFE Diversity Panel called Learning In and Out of School in Diverse Environments: Life-Long, Life-Wide, and Life-Deep. A major assumption of this report is that if educators make use of the informal learning that occurs in the homes and communities of students, the achievement gap between marginalized students and mainstream students can be reduced.
Gary Brown

2 Efforts to Provide Data on Colleges to Consumers Fall Short, Report Says - Administra... - 2 views

  • Higher education will have to be more accountable for its performance and more open to consumers about the actual cost of attending a college, and help people make easier comparisons among institutions, in order to succeed as the nation's economic engine, says a new report from two nonprofit think tanks here.
  • too little information to make informed choices about where they will get the most from their tuition dollars, say researchers at the two organizations, the libertarian-leaning American Enterprise Institute, and Education Sector, which is a proponent of reforming higher education
  • And without a more thorough and open form of accountability, institutions will not have any incentive to make the changes that will improve students' success,
  • ...7 more annotations...
  • "If existing flaws are not resolved, the nation runs the risk of ending up in the worst of all worlds: the appearance of higher education accountability without the reality," the authors say.
  • The two voluntary systems criticized in the study are the University and College Accountability Network, begun in September 2007 by the National Association of Independent Colleges and Universities to provide information about private colleges, and the Voluntary System of Accountability,
  • it does not obligate institutions to gather or reveal any data that are not already available elsewhere,"
  • associations are beginning to offer workshops and other opportunities for system participants to learn how to use the data they're collecting to improve the college experience for students, she said
  • VSA has the testing lobby written all over it
  • We may all appreciate the cultural context inhibiting public accountability but it is also important to understand that this same accountability is lacking internally where it effectively thwarts attempts to manage the institution rationally; i.e., informed with a continuous flow of mission-critical performance information. With the scant objective information at their command, college presidents and their associates must perform as shamans, reading the tea leaves of opinion and passion among stakeholders.
  • On balance, America's institutions of higher education function in a managerial vacuum.
  •  
    More of the same and the discussion is familiar--our challenge is to bring this topic to the attention of our points.
Kimberly Green

Commodification of Academic Research (Inside HIgher Ed) - 0 views

  •  
    This article provides an international view of the commodification of academic research, including this base line definition, from an email interview with Hans Radder, a professor of the philosophy of science and technology at Vrije Universiteit Amsterdam, Q: Academic research has always cost money to produce, and led to products that made money for others. How is the "commodification" of research different today than in past periods? A: Commodification means that all kinds of activities and their results are predominantly interpreted and assessed on the basis of economic criteria. In this sense, recent academic research is far more commodified than it was in the past. In general terms, one can say that the relation between "money" and specific academic activity has become much more direct. Consider the following examples: first, the amount of external funding acquired is often used as a measure of individual academic quality; second, specific assessments by individual scientists have a direct impact on departmental budgets; for instance, if I now pass this doctoral dissertation, my department receives a substantial sum of money; if not, it ends up with a budget deficit; third, the growing practice of patenting the results of academic research is explicitly aimed at acquiring commercial monopolies. Related to these financial issues are important and substantial changes of academic culture. Universities are increasingly being run as big corporations. They have a top-down command structure and an academic culture in which individual university scientists are forced to behave like mini-capitalists in order to survive, guided by an entrepreneurial ethos aimed at maximizing the capitalization of their knowledge.
Gary Brown

Texas A&M's Faculty Ratings: Right and Wrong - Commentary - The Chronicle of Higher Edu... - 0 views

  • "Academia is highly specialized. We don't mean to be exclusive. We are a public-serving group of people. But at the same time, that public isn't well-enough aware of what we do and who we are to evaluate us."
  • But the think tank is correct that taxpayers deserve to know how their money is being spent. Public-university operating costs in Texas have gone up more than 60 percent in the last two decades, even after adjusting for inflation, and professors are among the state's highest-paid public employees. The state needs accountability measures, and they must be enforced by a party other than the faculty, who, it could easily be charged, have a conflict of interest. That's what Texas A&M got right.
  • Moosally is right about one thing: The public isn't well aware of what she and many of her colleagues do. But they should be. That is not to say that the public will be able to understand what goes on in all of the chemistry laboratories in Texas. But Moosally teaches English at a college that is not exactly tasked with performing cutting-edge research. Houston-Downtown's mission is to provide "educational opportunities and access to students from a variety of backgrounds including many first-generation college students."
  • ...7 more annotations...
  • No doubt there is useful research coming out of the university system. But plenty could be omitted without a great deal of detriment to students' education. For instance, Hugill's most recent contributions have included a chapter on "Transitions in Hegemony: A Theory Based on State Type and Technology" and the article "German Great-Power Relations in the Pages of Simplicissimus, 1896-1914." Moosally's master's thesis was titled "Resumptive Pronouns in Modern Standard Arabic: A Head-Driven Phrase Structure Grammar Account," and her current research interests include "interactions between grammar knowledge and writing abilities/interest [and] cross-linguistic patterns of agreement."
  • Only 35 percent of respondents felt it was very important for colleges to "provide useful information to the public on issues affecting their daily lives."
  • According to a 2004 survey by The Chronicle, 71 percent of Americans thought it was very important for colleges to prepare undergraduates for careers, while only 56 percent thought it was very important for colleges to "discover more about the world through research."
  • What Texas A&M officials have also missed is that faculty members must be held accountable for what they teach.
  • Professors receive more credit for teaching higher-level students. But again, that is backward. The idea should be to give senior faculty members more credit for teaching introductory classes.
  • Moreover, the metric entirely ignores teaching quality. Who cares how many "student hours" professors put in if they are not particularly good teachers anyway?
  • Ultimately there needs to be a systemic solution to the problem of teacher quality. Someone—a grown-up, preferably—needs to get into the classroom and watch what is being done there.
  •  
    Another one in which the comments say more than I might--but the range of these accountability pieces underscore the work to do....
Gary Brown

The Public Be Damned - Innovations - The Chronicle of Higher Education - 0 views

  • A new generation comes along, and a new bunch of books critical of academia are starting to appear. Two recently out include Andrew Hacker and Claudia Dreifus' Higher Education? and Mark Taylor's Crisis on Campus. We are told colleges have lost their way, have lost sight of what is important, namely shaping young minds and turning immature adolescents into responsible young adults. The last round of muckraking had a decidedly conservative cast to it, while this one is more conventionally left wing or apolitical.
  • But until there is mass indignation about the behavior of colleges--their obscene costs, their bloated bureaucracies, the scandalously low teaching loads, the tons trivial academic research, the corruption of intercollegiate sports
  • Reform requires threats of reduced funding from the financiers of higher education.
  • ...2 more annotations...
  • the Academic Class has radically different perceptions that the public that funds higher education.
  • The public believes state universities have as their top mission the intellectual and leadership development of undergraduate students, while the Academic Class believes that research and graduate education is truly more important.
  •  
    for the collection
1 - 20 of 85 Next › Last »
Showing 20 items per page