Skip to main content

Home/ Groups/ CTLT and Friends
Gary Brown

Assess this! - 5 views

  • Assess this! is a gathering place for information and resources about new and better ways to promote learning in higher education, with a special focus on high-impact educational practices, student engagement, general or liberal education, and assessment of learning.
  • If you'd like to help make Assess this! more useful, there are some things you can do. You can comment on a post by clicking on the comments link following the post.
  • Of the various ways to assess student learning outcomes, many faculty members prefer what are called “authentic” approaches that document student performance during or at the end of a course or program of study. In this paper, assessment experts Trudy Banta, Merilee Griffin, Teresa Flateby, and Susan Kahn describe the development of several promising authentic assessment approaches.
  • ...5 more annotations...
  • Going PublicDouglas C. Bennett, President of Earlham College, suggests each institution having a public learning audit document and gives the example of what this means for Earlham College as a way for public accountability.
  • More TransparencyMartha Kanter, from the US Education Department, calls for more transparency in the way higher education does accreditation.
  • Despite the uptick in activity, "I still feel like there's no there there" when it comes to colleges' efforts to measure student learning, Kevin Carey, policy director at Education Sector, said in a speech at the Council for Higher Education Accreditation meeting Tuesday.
  • Most of the assessment activity on campuses can be found in nooks and crannies of the institutions - by individual professors, or in one department - and it is often not tied to goals set broadly at the institutional level.
  • Nine Principles of Good Practice for Assessing Student Learning
  •  
    A very interesting useful site where we might help ourselves by getting involved.
Gary Brown

Improving Teaching Will Require Strategic Thinking - Letters to the Editor - The Chroni... - 1 views

  • a rather large gap between knowledge about effective teaching practices in higher education and the use of these practices in higher education.
  • the greatest gains in STEM education are likely to come from the development of strategies to encourage faculty and administrators to implement proven instructional strategies."
  • The issue is not just one of finding better ways to motivate professors. Most professors already take their teaching responsibilities seriously and are motivated to do a good job. Improving instruction will require strategic and systematic work at all levels of the educational system.
  •  
    note the focus on systems
  •  
    This piece raises a related issue we have been discussing at OAI -- "First, and perhaps most important, there is very little research conducted on how to promote change in instructional practices used in higher education. " How does leadership promote change? How do leaders -- such as dept chairs -- promote and manage change? How do they get, or invest in, those skills?
Gary Brown

Struggling Students Can Improve by Studying Themselves, Research Shows - Teaching - The... - 3 views

  • "We're trying to document the role of processes that are different from standard student-outcome measures and standard ability measures,
  • We're interested in various types of studying, setting goals for oneself, monitoring one's progress as one goes through learning a particular topic."
  • Mr. Zimmerman has spent most of his career examining what can go wrong when people try to learn new facts and skills. His work centers on two common follies: First, students are often overconfident about their knowledge, assuming that they understand material just because they sat through a few lectures or read a few chapters. Second, students tend to attribute their failures to outside forces ("the teacher didn't like me," "the textbook wasn't clear enough") rather than taking a hard look at their own study habits.
  • ...14 more annotations...
  • That might sound like a recipe for banal lectures about study skills. But training students to monitor their learning involves much more than simple nagging, Mr. Zimmerman says. For one thing, it means providing constant feedback, so that students can see their own strengths and weaknesses.
  • or one thing, it means providing constant feedback, so that students can see their own strengths and weaknesses.
  • "The first one is, Give students fast, accurate feedback about how they're doing. And the second rule, which is less familiar to most people, is, Now make them demonstrate that they actually understand the feedback that has been given."
  • "I did a survey in December," he says. "Only one instructor said they were no longer using the technique. Twelve people said they were using the technique 'somewhat,' and eight said 'a lot.' So we were pleased that they didn't forget about us after the program ended."
  • "Only one instructor said they were no longer using the technique. Twelve people said they were using the technique 'somewhat,' and eight said 'a lot.' So we were pleased that they didn't forget about us after the program ended."
  • And over time, we've realized that these methods have a much greater effect if they're embedded within the course content.
  • "Once we focus on noticing and correcting errors in whatever writing strategy we're working on, the students just become junkies for feedback,"
  • "Errors are part of the process of learning, and not a sign of personal imperfection," Mr. Zimmerman says. "We're trying to help instructors and students see errors not as an endpoint, but as a beginning point for understanding what they know and what they don't know, and how they can approach problems in a more effective way."
  • Errors are part of the process of learning, and not a sign of personal imperfection,"
  • Self-efficacy" was coined by Albert Bandura in the 1970's
  • "Self-efficacy" was coined by Albert Bandura in the 1970's,
  • The 1990 paper from _Educational Psychologist_ 25 (1), pp. 3-17) which is linked above DOES include three citations to Bandura's work.
  • The 1990 paper from _Educational Psychologist_ 25 (1), pp. 3-17) which is linked above DOES include three citations to Bandura's work.
  • What I am particularly amazed by is that the idea of feedback, reflection and explicitly demonstrated understanding (essentially a Socratic approach of teaching), is considered an innovation.
  •  
    selected for the focus on feedback. The adoption by half or fewer, depending, is also interesting as the research is of the type we would presume to be compelling.
Theron DesRosier

While Supplies Last ... Get Yours Today! ~ Stephen's Web ~ by Stephen Downes - 1 views

  • The Chronicle ridicules the idea of corporations granting degrees, but universities should take note. When their funding falls through the floorboards, corporations will be quick to jump into the credentialing game. They won't, though, think of professors as high-paid talent. Teaching staff, like hamburger-flippers, will be disposable, because the real power is in the degree-granting monopoly, not the hoarding (or delivery) of knowledge.
Theron DesRosier

The Problem with the Data-Information-Knowledge-Wisdom Hierarchy - The Conversation - H... - 3 views

  •  
    "But knowledge is not a result merely of filtering or algorithms. It results from a far more complex process that is social, goal-driven, contextual, and culturally-bound. We get to knowledge - especially "actionable" knowledge - by having desires and curiosity, through plotting and play, by being wrong more often than right, by talking with others and forming social bonds, by applying methods and then backing away from them, by calculation and serendipity, by rationality and intuition, by institutional processes and social roles."
  •  
    An interresting take on assumptions about knowledge.
  •  
    Really interesting quote, Theron. I wonder if it's a chunk that could be used as a prompt for a faculty discussion, to open up the dialogue about what is learning. And then how does a program design a curriculum and syllabi / assignments to teach and assess, towards a much broader understanding of knowledge (and skills)?
Nils Peterson

Innovating the 21st-Century University: It's Time! (EDUCAUSE Review) | EDUCAUSE - 4 views

  • change is required in two vast and interwoven domains that permeate the deep structures and operating model of the university: (1) the value created for the main customers of the university (the students); and (2) the model of production for how that value is created. First we need to toss out the old industrial model of pedagogy (how learning is accomplished) and replace it with a new model called collaborative learning. Second we need an entirely new modus operandi for how the subject matter, course materials, texts, written and spoken word, and other media (the content of higher education) are created.
  • Research shows that mutual exploration, group problem solving, and collective meaning-making produce better learning outcomes and understanding overall. Brown and Adler cite a study by Richard J. Light, of the Harvard Graduate School of Education: "Light discovered that one of the strongest determinants of students' success in higher education . . . was their ability to form or participate in small study groups. Students who studied in groups, even only once a week, were more engaged in their studies, were better prepared for class, and learned significantly more than students who worked on their own."
  • Second, the web enables students to collaborate with others independent of time and geography. Finally, the web represents a new mode of production for knowledge, and that changes just about everything regarding how the "content" of college and university courses are created.
  • ...7 more annotations...
  • As Seymour Papert, one of the world's foremost experts on how technology can provide new ways to learn, put it: "The scandal of education is that every time you teach something, you deprive a [student] of the pleasure and benefit of discovery."14 Students need to integrate new information with the information they already have — to "construct" new knowledge structures and meaning.
  • Universities need an entirely new modus operandi for how the content of higher education is created. The university needs to open up, embrace collaborative knowledge production, and break down the walls that exist among institutions of higher education and between those institutions and the rest of the world.To do so, universities require deep structural changes — and soon. More than three years ago, Charles M. Vest published "Open Content and the Emerging Global Meta-University" in EDUCAUSE Review. In his concluding paragraph, Vest offered a tantalizing vision: "My view is that in the open-access movement, we are seeing the early emergence of a meta-university — a transcendent, accessible, empowering, dynamic, communally constructed framework of open materials and platforms on which much of higher education worldwide can be constructed or enhanced. The Internet and the Web will provide the communication infrastructure, and the open-access movement and its derivatives will provide much of the knowledge and information infrastructure." Vest wrote that the meta-university "will speed the propagation of high-quality education and scholarship. . . . The emerging meta-university, built on the power and ubiquity of the Web and launched by the open courseware movement, will give teachers and learners everywhere the ability to access and share teaching materials, scholarly publications, scientific works in progress, teleoperation of experiments, and worldwide collaborations, thereby achieving economic efficiencies and raising the quality of education through a noble and global endeavor."17
  • Used properly, wikis are tremendously powerful tools to collaborate and co-innovate new content. Tapscott wrote the foreword for a book called We Are Smarter Than Me (2008). The book, a best-seller, was written by Barry Libert, Jon Spector, and more than 4,000 people who contributed to the book's wiki. If a global collaboration can write a book, surely one could be used to create a university course. A professor could operate a wiki with other teachers. Or a professor could use a wiki with his or her students, thereby co-innovating course content with the students themselves. Rather than simply being the recipients of the professor's knowledge, the students co-create the knowledge on their own, which has been shown to be one of the most effective methods of learning.
  • The student might enroll in the primary college in Oregon and register to take a behavioral psychology course from Stanford University and a medieval history course from Cambridge. For these students, the collective syllabi of the world form their menu for higher education. Yet the opportunity goes beyond simply mixing and matching courses. Next-generation faculty will create a context whereby students from around the world can participate in online discussions, forums, and wikis to discover, learn, and produce knowledge as networked individuals and collectively.
  • But what about credentials? As long as the universities can grant degrees, their supremacy will never be challenged." This is myopic thinking. The value of a credential and even the prestige of a university are rooted in its effectiveness as a learning institution. If these institutions are shown to be inferior to alternative learning environments, their capacity to credential will surely diminish. How much longer will, say, a Harvard undergraduate degree, taught mostly through lectures by teaching assistants in large classes, be able to compete in status with the small class size of liberal arts colleges or the superior delivery systems that harness the new models of learning?
  • As part of this, the academic journal should be disintermediated and the textbook industry eliminated. In fact, the word textbook is an oxymoron today. Content should be multimedia — not just text. Content should be networked and hyperlinked bits — not atoms. Moreover, interactive courseware — not separate "books" — should be used to present this content to students, constituting a platform for every subject, across disciplines, among institutions, and around the world. The textbook industry will never reinvent itself, however, since legacy cultures and business models die hard. It will be up to scholars and students to do this collectively.
  • Ultimately, we will need more objective measures centered on students' learning performance.
Joshua Yeidel

Caring for the Whole Student, Wholeheartedly - The Chronicle Review - The Chronicle of ... - 1 views

  •  
    "Robby... came in search of understanding and affirmation as well as tea and fried eggs." A beautiful, wise, and humorous reflection on caring for the development of students as whole people.
Matthew Tedder

Students failing because of Twitter, texting - Canada - Canoe.ca - 0 views

  •  
    Is this a bad thing? After all, we let English evolve and how can this evolution continue if we demand uniformity with the past? Personally, I'd love to see a well-informed engineering of architectural aspects of English--even the engineering of an "International English" for business that is simplified for all the world's people to learn.
Matthew Tedder

New studies highlight needs of boys in K-12, higher education - 1 views

  •  
    I've long suspected as much. We hear so much about how women's issue need addressing (and that's true) but let's not also neglect male issues... as much as us males don't like to even think they exist.
Gary Brown

OECD Project Seeks International Measures for Assessing Educational Quality - Internati... - 0 views

  • The first phase of an ambitious international study that intends to assess and compare learning outcomes in higher-education systems around the world was announced here on Wednesday at the conference of the Council for Higher Education Accreditation.
  • Richard Yelland, of the OECD's Education Directorate, is leading the project, which he said expects to eventually offer faculty members, students, and governments "a more balanced assessment of higher-education quality" across the organization's 31 member countries.
  • learning outcomes are becoming a central focus worldwide
  • ...7 more annotations...
  • the feasibility study is adapting the Collegiate Learning Assessment, an instrument developed by the Council for Aid to Education in the United States, to an international context.
  • At least six nations are participating in the feasibility study.
  • 14 countries are expected to participate in the full project, with an average of 10 institutions per country and about 200 students per institution,
  • The project's target population will be students nearing the end of three-year or four-year degrees, and will eventually measure student knowledge in economics and engineering.
  • While the goal of the project is not to produce another global ranking of universities, the growing preoccupation with such lists has crystallized what Mr. Yelland described as the urgency of pinning down what exactly it is that most of the world's universities are teaching and how well they are doing
  • Judith S. Eaton, president of the Council for Higher Education Accreditation, said she was also skeptical about whether the project would eventually yield common international assessment mechanisms.
  • Ms. Eaton noted, the same sets of issues recur across borders and systems, about how best to enhance student learning and strengthen economic development and international competitiveness.
  •  
    Another day, another press, again thinking comparisons
Nils Peterson

News: Assessment Disconnect - Inside Higher Ed - 7 views

  •  
    Theron left an interesting comment to this, the whole piece is a timely read and connects to OAI's staff workshop 1/28/10
Joshua Yeidel

Taking the sting out of the honeybee controversy - environmentalresearchweb - 1 views

  •  
    Researchers use "harvesting feedback" and a uncertainty scale to illuminate how stakeholders use evidence to explain honeybee declines in France.
Joshua Yeidel

Firebug Lite : Firebug - 0 views

  •  
    "Firebug Lite Firebug is an extension for Firefox, but what happens when you need to test your pages in Internet Explorer, Opera, and Safari? The solution is Firebug Lite, a JavaScript file you can insert into your pages to simulate some Firebug features in browsers that are not named "Firefox"."
  •  
    A valuable aid for web designers and developers, now available "for browsers that are not named Firefox"
Joshua Yeidel

News: 'You Can't Measure What We Teach' - Inside Higher Ed - 0 views

  •  
    "Despite those diverging starting points, the discussion revealed quite a bit more common ground than any of the panelists probably would have predicted. Let's be clear: Where they ended up was hardly a breakthrough on the scale of solving the Middle East puzzle. But there was general agreement among them that: * Any effort to try to measure learning in the humanities through what McCulloch-Lovell deemed "[Margaret] Spellings-type assessment" -- defined as tests or other types of measures that could be easily compared across colleges and neatly sum up many of the learning outcomes one would seek in humanities students -- was doomed to fail, and should. * It might be possible, and could be valuable, for humanists to reach broad agreement on the skills, abilities, and knowledge they might seek to instill in their students, and that agreement on those goals might be a starting point for identifying effective ways to measure how well students have mastered those outcomes. * It is incumbent on humanities professors and academics generally to decide for themselves how to assess whether their students are learning, less to satisfy external calls for accountability than because it is the right thing for academics, as professionals who care about their students, to do. "
  •  
    Assessment meeting at the accreditors -- driven by expectations of a demand for accountability, with not one mention of improvement.
Joshua Yeidel

Views: Reconsider the Credit Hour - Inside Higher Ed - 0 views

  •  
    "The Office of the Inspector General (of the Department of Education) prefers auditable measures for performance. It reads the Higher Education Act with its multiple references to credit hours to demand such measures."
  •  
    How far is accountability from accounting...
Matthew Tedder

Female teachers transmit math anxiety to female students - 0 views

  •  
    Math anxiety is contagious.. a surprisingly lot of behaviors and beliefs tend to be..
Matthew Tedder

Richard Dawkins: Growing up in the universe | Video on TED.com - 4 views

  •  
    How many teachers are this enthusiastic, well-prepared, or facilitated? What principles are responsible for the inspirational power of this presentation? Should inspiration be part of education?
  •  
    but it is still a lecture, and only a few of us, about 2%, learn well from even great lectures. The trick is to design activities that help learners discover this. But the fact that 2% do learn to mimic the lecture, as you note, with more or less success, is precisely why lecture is so difficult to supplant. That 2% represents the faculty and those who lead the institutions they work in......
Gary Brown

Education Department Official Calls for More Transparency in Accreditation - Government... - 0 views

  • Martha J. Kanter, the No. 2 official in the U.S. Education Department, took higher-education accrediting organizations to task on Tuesday for being too secretive about how they assess colleges and for using outmoded standards that don't give enough weight to measuring student learning.
  • "Accreditation isn't transparent enough, it just isn't," Ms. Kanter said
  • The organizations that are responsible for assuring quality in higher education must consider whether their processes are really helping institutions improve and whether they are focusing too much on "inputs," such as the amount of time that students spend in class, and too little on what they have learned.
  • ...2 more annotations...
  • Accreditors and institutions also should be more willing to open up the accrediting process, by making self-studies easily accessible to the public and to other colleges that want to learn best practices, by announcing the teams of peer reviewers that make campus visits for accreditation purposes, and by opening accrediting commission meetings to the public.
  • Making the entire process open could have the unintended consequence of giving an institution a bad reputation even as they are working diligently to correct problems, said Ms. Wheelan.
  •  
    Their debate is our debate--and challenge
Gary Brown

Wise Men Gone: Stephen Toulmin and John E. Smith - The Chronicle Review - The Chronicle... - 0 views

  • Toulmin, born in London in 1922, earned his undergraduate degree in 1942 from King's College, Cambridge, in mathematics and physics. After participating in radar research and intelligence work during World War II in England and at Allied headquarters in Germany, he returned to Cambridge, where he studied with Ludwig Wittgenstein, the greatest influence on his thought, earning his Ph.D. in moral philosophy in 1948.
  • Toulmin moved to the United States, where he taught at Brandeis, Michigan State, and Northwestern Universities and the University of Chicago before landing in 1993 at the University of Southern California.
  • Toulmin's first, most enduring contribution to keeping philosophy sensible came in his 1958 book, The Uses of Argument (Cambridge University Press). Deceptively formalistic on its surface because it posited a general model of argument, Toulmin's view, in fact, was better described as taxonomic, yet flexible. He believed that formal systems of logic misrepresent the complex way that humans reason in most fields requiring what philosophers call "practical reason," and he offered, accordingly, a theory of knowledge as warranted belief.
  • ...4 more annotations...
  • Toulmin rejected the abstract syllogistic logic, meant to produce absolute standards for proving propositions true, that had become fashionable in analytic philosophy. Instead he argued (in the spirit of Wittgenstein) that philosophers must monitor how people actually argue if the philosophers' observations about persuasion are to make any sense. Toulmin took jurisprudential reasoning as his chief example in The Uses of Argument, but he believed that some aspects of a good argument depend on the field in which they're presented, while others are "field invariant."
  • Toulmin's "central thesis is that every sort of argumentation can in principle claim rationality and that the criteria to be applied when determining the soundness of the argumentation depend on the nature of the problems to which the argumentation relates."
  • But Toulmin, trained in the hard sciences and mathematics himself, saw through the science worship of less-credentialed sorts. He didn't relent, announcing "our need to reappropriate the wisdom of the 16th-century humanists, and develop a point of view that combines the abstract rigor and exactitude of the 17th-century 'new philosophy' with a practical concern for human life in its concrete detail."
  • Toulmin declared its upshot: "From now on, permanent validity must be set aside as illusory, and our idea of rationality related to specific functions of ... human reason. ... For me personally, the outcome of 40 years of philosophical critique was thus a new vision of—so to speak—the rhetoric of philosophy."
  •  
    FYI, Toulmin was the primary influence on the first WSU Critical Thinking Rubric. (Carella was the other philosopher.)
Gary Brown

Educators Mull How to Motivate Professors to Improve Teaching - Curriculum - The Chroni... - 4 views

  • "Without an unrelenting focus on quality—on defining and measuring and ensuring the learning outcomes of students—any effort to increase college-completion rates would be a hollow effort indeed."
  • If colleges are going to provide high-quality educations to millions of additional students, they said, the institutions will need to develop measures of student learning than can assure parents, employers, and taxpayers that no one's time and money are being wasted.
  • "Effective assessment is critical to ensure that our colleges and universities are delivering the kinds of educational experiences that we believe we actually provide for students," said Ronald A. Crutcher, president of Wheaton College, in Massachusetts, during the opening plenary. "That data is also vital to addressing the skepticism that society has about the value of a liberal education."
  • ...13 more annotations...
  • But many speakers insisted that colleges should go ahead and take drastic steps to improve the quality of their instruction, without using rigid faculty-incentive structures or the fiscal crisis as excuses for inaction.
  • Handing out "teacher of the year" awards may not do much for a college
  • W.E. Deming argued, quality has to be designed into the entire system and supported by top management (that is, every decision made by CEOs and Presidents, and support systems as well as operations) rather than being made the responsibility solely of those delivering 'at the coal face'.
  • I see as a certain cluelessness among those who think one can create substantial change based on volunteerism
  • Current approaches to broaden the instructional repertoires of faculty members include faculty workshops, summer leave, and individual consultations, but these approaches work only for those relatively few faculty members who seek out opportunities to broaden their instructional methods.
  • The approach that makes sense to me is to engage faculty members at the departmental level in a discussion of the future and the implications of the future for their field, their college, their students, and themselves. You are invited to join an ongoing discussion of this issue at http://innovate-ideagora.ning.com/forum/topics/addressing-the-problem-of
  • Putting pressure on professors to improve teaching will not result in better education. The primary reason is that they do not know how to make real improvements. The problem is that in many fields of education there is either not enough research, or they do not have good ways of evaluationg the results of their teaching.
  • Then there needs to be a research based assessment that can be used by individual professors, NOT by the administration.
  • Humanities educatiors either have to learn enough statistics and cognitive science so they can make valid scientific comparisons of different strategies, or they have to work with cognitive scientists and statisticians
  • good teaching takes time
  • On the measurement side, about half of the assessments constructed by faculty fail to meet reasonable minimum standards for validity. (Interestingly, these failures leave the door open to a class action lawsuit. Physicians are successfully sued for failing to apply scientific findings correctly; commerce is replete with lawsuits based on measurement errors.)
  • The elephant in the corner of the room --still-- is that we refuse to measure learning outcomes and impact, especially proficiencies generalized to one's life outside the classroom.
  • until universities stop playing games to make themselves look better because they want to maintain their comfortable positions and actually look at what they can do to improve nothing is going to change.
  •  
    our work, our friends (Ken and Jim), and more context that shapes our strategy.
  •  
    How about using examples of highly motivational lecture and teaching techniques like the Richard Dawkins video I presented on this forum, recently. Even if teacher's do not consciously try to adopt good working techniques, there is at least a strong subconscious human tendency to mimic behaviors. I think that if teachers see more effective techniques, they will automatically begin to adopt adopt them.
« First ‹ Previous 341 - 360 of 889 Next › Last »
Showing 20 items per page