Skip to main content

Home/ CTLT and Friends/ Group items tagged critical thinking

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Gary Brown

Disciplines Follow Their Own Paths to Quality - Faculty - The Chronicle of Higher Educa... - 2 views

chronicle.com/...125055

assessment accreditation critical thinking

shared by Gary Brown on 29 Oct 10 - No Cached
  • But when it comes to the fundamentals of measuring and improving student learning, engineering professors naturally have more to talk about with their counterparts at, say, Georgia Tech than with the humanities professors at Villanova
    • Gary Brown
      Gary Brown on 29 Oct 10
       
      Perhaps this is too bad....
  • But there is no nationally normed way to measure the particular kind of critical thinking that students of classics acquire
  • er colleagues have created discipline-specific critical-reasoning tests for classics and political science
  • ...5 more annotations...
  • Political science cultivates skills that are substantially different from those in classics, and in each case those skills can't be measured with a general-education test.
  • he wants to use tests of reasoning that are appropriate for each discipline
  • I believe Richard Paul has spent a lifetime articulating the characteristics of discipline based critical thinking. But anyway, I think it is interesting that an attempt is being made to develop (perhaps) a "national standard" for critical thinking in classics. In order to assess anything effectively we need a standard. Without a standard there are no criteria and therefore no basis from which to assess. But standards do not necessarily have to be established at the national level. This raises the issue of scale. What is the appropriate scale from which to measure the quality and effectiveness of an educational experience? Any valid approach to quality assurance has to be multi-scaled and requires multiple measures over time. But to be honest the issues of standards and scale are really just the tip of the outcomes iceberg.
    • Gary Brown
      Gary Brown on 29 Oct 10
       
      Missing the notion that the variance is in the activity more than the criteria.  We hear little of embedding nationally normed and weighted assignments and then assessing the implementation and facilitation variables.... mirror, not lens.
  • the UW Study of Undergraduate Learning (UW SOUL). Results from the UW SOUL show that learning in college is disciplinary; therefore, real assessment of learning must occur (with central support and resources)in the academic departments. Generic approaches to assessing thinking, writing, research, quantitative reasoning, and other areas of learning may be measuring something, but they cannot measure learning in college.
  • It turns out there is a six week, or 210+ hour serious reading exposure to two or more domains outside ones own, that "turns on" cross domain mapping as a robust capability. Some people just happen to have accumulated, usually by unseen and unsensed happenstance involvements (rooming with an engineer, son of a dad changing domains/careers, etc.) this minimum level of basics that allows robust metaphor based mapping.
Gary Brown

(How) Would You Use This Critical Thinking Video? at Beyond School - 3 views

beyond-school.org/...e-this-critical-thinking-video

critical thinking

shared by Gary Brown on 28 Dec 09 - Cached
  • This “Critical Thinking” video is worth a watch.
  • Gary Brown on 28 Dec 09
     
    it is worth a watch, and as a resource
  • Ashley Ater Kranov on 30 Dec 09
     
    This is well done - many potential applications - a self check, for one, and for use in the myriad of teaching situations we find ourselves in both in work and outside of work.
Gary Brown

News: Turning Surveys Into Reforms - Inside Higher Ed - 0 views

www.insidehighered.com/...nsse

assessment NSSE Closing the loop

shared by Gary Brown on 26 Oct 09 - Cached
  • Molly Corbett Broad, president of the American Council on Education, warned those gathered here that they would be foolish to think that accountability demands were a thing of the past.
  • She said that while she is “impressed” with the work of NSSE, she thinks higher education is “not moving fast enough” right now to have in place accountability systems that truly answer the questions being asked of higher education. The best bet for higher education, she said, is to more fully embrace various voluntary systems, and show that they are used to promote improvements.
  • One reason NSSE data are not used more, some here said, was the decentralized nature of American higher education. David Paris, executive director of the New Leadership Alliance for Student Learning and Accountability, said that “every faculty member is king or queen in his or her classroom.” As such, he said, “they can take the lessons of NSSE” about the kinds of activities that engage students, but they don’t have to. “There is no authority or dominant professional culture that could impel any faculty member to apply” what NSSE teaches about engaged learning, he said.
  • ...4 more annotations...
  • She stressed that NSSE averages may no longer reflect any single reality of one type of faculty member. She challenged Paris’s description of powerful faculty members by noting that many adjuncts have relatively little control over their pedagogy, and must follow syllabuses and rules set by others. So the power to execute NSSE ideas, she said, may not rest with those doing most of the teaching.
  • Research presented here, however, by the Wabash College National Study of Liberal Arts Education offered concrete evidence of direct correlations between NSSE attributes and specific skills, such as critical thinking skills. The Wabash study, which involves 49 colleges of all types, features cohorts of students being analyzed on various NSSE benchmarks (for academic challenge, for instance, or supportive campus environment or faculty-student interaction) and various measures of learning, such as tests to show critical thinking skills or cognitive skills or the development of leadership skills.
  • The irony of the Wabash work with NSSE data and other data, Blaich said, was that it demonstrates the failure of colleges to act on information they get -- unless someone (in this case Wabash) drives home the ideas.“In every case, after collecting loads of information, we have yet to find a single thing that institutions didn’t already know. Everyone at the institution didn’t know -- it may have been filed away,” he said, but someone had the data. “It just wasn’t followed. There wasn’t sufficient organizational energy to use that data to improve student learning.”
  • “I want to try to make the point that there is a distinction between participating in NSSE and using NSSE," he said. "In the end, what good is it if all you get is a report?"
  • Kimberly Green on 26 Oct 09
     
    An interesting discussion, exploring basic questions CTLT folks are familiar with, grappling with the question of how to use survey data and how to identify and address limitations. 10 years after launch of National Survey of Student Engagement, many worry that colleges have been speedier to embrace giving the questionnaire than using its results. And some experts want changes in what the survey measures. I note these limitations, near the end of the article: Adrianna Kezar, associate professor of higher education at the University of Southern California, noted that NSSE's questions were drafted based on the model of students attending a single residential college. Indeed many of the questions concern out-of-class experiences (both academic and otherwise) that suggest someone is living in a college community. Kezar noted that this is no longer a valid assumption for many undergraduates. Nor is the assumption that they have time to interact with peers and professors out of class when many are holding down jobs. Nor is the assumption -- when students are "swirling" from college to college, or taking courses at multiple colleges at the same time -- that any single institution is responsible for their engagement. Further, Kezar noted that there is an implicit assumption in NSSE of faculty being part of a stable college community. Questions about seeing faculty members outside of class, she said, don't necessarily work when adjunct faculty members may lack offices or the ability to interact with students from one semester to the next. Kezar said that she thinks full-time adjunct faculty members may actually encourage more engagement than tenured professors because the adjuncts are focused on teaching and generally not on research. And she emphasized that concerns about the impact of part-time adjuncts on student engagement arise not out of criticism of those individuals, but of the system that assigns them teaching duties without much support. S
  • Gary Brown on 02 Nov 09
     
    Repeat of highlighted resource, but merits revisiting.
Gary Brown

New test measures students' digital literacy | eCampus News - 0 views

www.ecampusnews.com/...ures-students-digital-literacy

tests information literacy critical thinking

shared by Gary Brown on 13 Apr 10 - Cached
  • Employers are looking for candidates who can navigate, critically evaluate, and make sense of the wealth of information available through digital media—and now educators have a new way to determine a student’s baseline digital literacy with a certification exam that measures the test-taker’s ability to assess information, think critically, and perform a range of real-world tasks.
  • iCritical Thinking Certification, created by the Educational Testing Service and Certiport, reveals whether or not a person is able to combine technical skills with experiences and knowledge.
  • Monica Brooks, Marshall University’s assistant vice president for Information Technology: Online Learning and Libraries, said her school plans to use iCritical Thinking beginning in the fall.
  • Gary Brown on 13 Apr 10
     
    the alternate universe, a small step away...
Gary Brown

Would You Protect Your Computer's Feelings? Clifford Nass Says Yes. - ProfHacker - The ... - 2 views

chronicle.com/...27081

critiques

shared by Gary Brown on 23 Sep 10 - No Cached
  • why peer review processes often avoid, rather than facilitate, sound judgment
  • humans do not differentiate between computers and people in their social interactions.
  • no matter what "everyone knows," people act as if the computer secretly cares
  • ...4 more annotations...
  • users given completely random praise by a computer program liked it more than the same program without praise, even though they knew in advance the praise was meaningless.
  • Nass demonstrates, however, that people internalize praise and criticism differently—while we welcome the former, we really dwell on and obsess over the latter. In the criticism sandwich, then, "the criticism blasts the first list of positive achievements out of listeners' memory. They then think hard about the criticism (which will make them remember it better) and are on the alert to think even harder about what happens next. What do they then get? Positive remarks that are too general to be remembered"
  • And because we focus so much on the negative, having a similar number of positive and negative comments "feels negative overall"
  • The best strategy, he suggests, is "to briefly present a few negative remarks and then provide a long list of positive remarks...You should also provide as much detail as possible within the positive comments, even more than feels natural, because positive feedback is less memorable" (33).
  • Gary Brown on 23 Sep 10
     
    The implications for feedback issues are pretty clear.
Gary Brown

Best Colleges: The Real Rankings - CBS MoneyWatch.com - 2 views

moneywatch.bnet.com/...345754

ranking colleges PLE

shared by Gary Brown on 28 Sep 09 - Cached
  • Ultimately, though, the usefulness of any college ranking will depend on what criteria matters most to you and your teen. The best strategy: Use a few of the rankings to amass quantifiable and
  • Gary Brown on 28 Sep 09
     
    key advice for prospective college students--and a way to think about providing models that engage authentic learning opportunities as critical benchmark.
  • Gary Brown on 28 Sep 09
     
    key advice for prospective college students--and a way to think about providing models that engage authentic learning opportunities as critical benchmark.
Theron DesRosier

Assessing Learning Outcomes at the University of Cincinnati: Comparing Rubric Assessmen... - 2 views

www.aacu.org/...feature.cfm

CLA assessment accountability

shared by Theron DesRosier on 15 Oct 10 - No Cached
  • Theron DesRosier on 15 Oct 10
     
    "When the CLA results arrived eight months later, the UC team compared the outcomes of the two assessments. "We found no statistically significant correlation between the CLA scores and the portfolio scores," Escoe says. "In some ways, it's a disappointing finding. If we'd found a correlation, we could tell faculty that the CLA, as an instrument, is measuring the same things that we value and that the CLA can be embedded in a course. But that didn't happen." There were many factors that may have contributed to the lack of correlation, she says, including the fact that the CLA is timed, while the rubric assignments are not; and that the rubric scores were diagnostic and included specific feedback, while the CLA awarded points "in a black box": if a student referred to a specific piece of evidence in a critical-thinking question, he or she simply received one point. In addition, she says, faculty members may have had exceptionally high expectations of their honors students and assessed the e-portfolios with those high expectations in mind-leading to results that would not correlate to a computer-scored test. In the end, Escoe says, the two assessments are both useful, but for different things. The CLA can provide broad institutional data that satisfies VSA requirements, while rubric-based assessment provides better information to facilitate continuous program improvement. "
  • Theron DesRosier on 15 Oct 10
     
    Another institution trying to make sense of the CLA. This study compared student's CLA scores with criteria-based scores of their eportfolios. The study used a modified version of the VALUE rubrics developed by the AACU. Our own Gary Brown was on the team that developed the critical thinking rubric for the VALUE project.
  • Joshua Yeidel on 19 Oct 10
     
    "The CLA can provide broad institutional data that satisfies VSA requirements, while rubric-based assessment provides better information to facilitate continuous program improvement. " This begs some questions: what meaning can we attach to these two non-correlated measures? What VSA requirements can rubric-based assessment NOT satisfy? Are those "requirements" really useful?
Nils Peterson

AAC&U News | April 2010 | Feature - 1 views

www.aacu.org/...feature.cfm

shared by Nils Peterson on 01 Apr 10 - Cached
  • Comparing Rubric Assessments to Standardized Tests
  • First, the university, a public institution of about 40,000 students in Ohio, needed to comply with the Voluntary System of Accountability (VSA), which requires that state institutions provide data about graduation rates, tuition, student characteristics, and student learning outcomes, among other measures, in the consistent format developed by its two sponsoring organizations, the Association of Public and Land-grant Universities (APLU), and the Association of State Colleges and Universities (AASCU).
  • And finally, UC was accepted in 2008 as a member of the fifth cohort of the Inter/National Coalition for Electronic Portfolio Research, a collaborative body with the goal of advancing knowledge about the effect of electronic portfolio use on student learning outcomes.  
  • ...13 more annotations...
  • outcomes required of all UC students—including critical thinking, knowledge integration, social responsibility, and effective communication
  • “The wonderful thing about this approach is that full-time faculty across the university  are gathering data about how their  students are doing, and since they’ll be teaching their courses in the future, they’re really invested in rubric assessment—they really care,” Escoe says. In one case, the capstone survey data revealed that students weren’t doing as well as expected in writing, and faculty from that program adjusted their pedagogy to include more writing assignments and writing assessments throughout the program, not just at the capstone level. As the university prepares to switch from a quarter system to semester system in two years, faculty members are using the capstone survey data to assist their course redesigns, Escoe says.
  • the university planned a “dual pilot” study examining the applicability of electronic portfolio assessment of writing and critical thinking alongside the Collegiate Learning Assessment,
  • The rubrics the UC team used were slightly modified versions of those developed by AAC&U’s Valid Assessment of Learning in Undergraduate Education (VALUE) project. 
  • In the critical thinking rubric assessment, for example, faculty evaluated student proposals for experiential honors projects that they could potentially complete in upcoming years.  The faculty assessors were trained and their rubric assessments “normed” to ensure that interrater reliability was suitably high.
  • “It’s not some nitpicky, onerous administrative add-on. It’s what we do as we teach our courses, and it really helps close that assessment loop.”
  • There were many factors that may have contributed to the lack of correlation, she says, including the fact that the CLA is timed, while the rubric assignments are not; and that the rubric scores were diagnostic and included specific feedback, while the CLA awarded points “in a black box”:
  • faculty members may have had exceptionally high expectations of their honors students and assessed the e-portfolios with those high expectations in mind—leading to results that would not correlate to a computer-scored test. 
  • “The CLA provides scores at the institutional level. It doesn’t give me a picture of how I can affect those specific students’ learning. So that’s where rubric assessment comes in—you can use it to look at data that’s compiled over time.”
  • Their portfolios are now more like real learning portfolios, not just a few artifacts, and we want to look at them as they go into their third and fourth years to see what they can tell us about students’ whole program of study.”  Hall and Robles are also looking into the possibility of forming relationships with other schools from NCEPR to exchange student e-portfolios and do a larger study on the value of rubric assessment of student learning.
  • “We’re really trying to stress that assessment is pedagogy,”
  • “We found no statistically significant correlation between the CLA scores and the portfolio scores,”
  • In the end, Escoe says, the two assessments are both useful, but for different things. The CLA can provide broad institutional data that satisfies VSA requirements, while rubric-based assessment provides better information to facilitate continuous program improvement.
    • Nils Peterson
      Nils Peterson on 01 Apr 10
       
      CLA did not provide information for continuous program improvement -- we've heard this argument before
  • Gary Brown on 01 Apr 10
     
    The lack of correlation might be rephrased--there appears to be no corrlation between what is useful for faculty who teach and what is useful for the VSA. A corollary question: Of what use is the VSA?
Gary Brown

News: Assessing the Assessments - Inside Higher Ed - 0 views

www.insidehighered.com/...vsa

shared by Gary Brown on 05 Nov 09 - Cached
  • In other words, a college that ranked in the 95th percentile for critical thinking using one of the tests would rank in roughly the same place using the critical thinking component of one of the other two tests, and vice versa.
    • Gary Brown
      Gary Brown on 05 Nov 09
       
      A stellar example of critical thinking, this sentence.
  • diversity in measurement" to satisfy faculty
Theron DesRosier

The scientist and blogging - 1 views

www.sylvienoel.ca/blog

scientist blogging learning network

shared by Theron DesRosier on 31 Mar 10 - Cached
  • Theron DesRosier on 31 Mar 10
     
    Some suggestions fort Scientists about blogging. "So what should you put in your blog? (1) Talk about your research. What have you done in the past? What are you working on at the moment? There is some controversy as to how transparent you should be when talking about your research (OMG, someone is going to steal my idea if I write it down! No wait, if everyone knows I said it first, then they can't steal it!), so it's up to you to decide how comfortable you are about sharing your research ideas. I'm old-fashioned enough that I tend towards the side that thinks we should be discreet about the details of what we're working on, but I also understand the side that wants everything to be out there. (2) Talk about other people's research. Do you agree with their results? Do you think that they missed something important? You may feel unqualified to criticize somebody else's work, but science does not advance through groupthink. Remember, part of your job as a scientist will be to review other people's papers. Now is as good a time as any to start practicing. (3) Talk about issues related to your research. Are you working on smartphones? Talk about how they're being integrated into museum visits. Working on accessibility issues? Talk about some of the problems that the handicapped encounter during their daily routine. Just make sure you choose to talk about something that interests you so that you feel motivated to write to your blog. "
Joshua Yeidel

Scholar Raises Doubts About the Value of a Test of Student Learning - Research - The Ch... - 3 views

chronicle.com/...65741

assessment accountability

shared by Joshua Yeidel on 02 Jun 10 - Cached
  • Beginning in 2011, the 331 universities that participate in the Voluntary System of Accountability will be expected to publicly report their students' performance on one of three national tests of college-level learning.
  • But at least one of those three tests—the Collegiate Learning Assessment, or CLA—isn't quite ready to be used as a tool of public accountability, a scholar suggested here on Tuesday during the annual meeting of the Association for Institutional Research.
  • Students' performance on the test was strongly correlated with how long they spent taking it.
  • ...6 more annotations...
  • Besides the CLA, which is sponsored by the Council for Aid to Education, other tests that participants in the voluntary system may use are the Collegiate Assessment of Academic Proficiency, from ACT Inc., and the Measure of Academic Proficiency and Progress, offered by the Educational Testing Service.
  • The test has sometimes been criticized for relying on a cross-sectional system rather than a longitudinal model, in which the same students would be tested in their first and fourth years of college.
  • there have long been concerns about just how motivated students are to perform well on the CLA.
  • Mr. Hosch suggested that small groups of similar colleges should create consortia for measuring student learning. For example, five liberal-arts colleges might create a common pool of faculty members that would evaluate senior theses from all five colleges. "That wouldn't be a national measure," Mr. Hosch said, "but it would be much more authentic."
  • Mr. Shavelson said. "The challenge confronting higher education is for institutions to address the recruitment and motivation issues if they are to get useful data. From my perspective, we need to integrate assessment into teaching and learning as part of students' programs of study, thereby raising the stakes a bit while enhancing motivation of both students and faculty
  • "I do agree with his central point that it would not be prudent to move to an accountability system based on cross-sectional assessments of freshmen and seniors at an institution," said Mr. Arum, who is an author, with Josipa Roksa, of Academically Adrift: Limited Learning on College Campuses, forthcoming from the University of Chicago Press
  • Gary Brown on 02 Jun 10
     
    CLA debunking, but the best item may be the forthcoming book on "limited learning on College Campuses."
  • Joshua Yeidel on 25 Jun 10
     
    "Micheal Scriven and I spent more than a few years trying to apply his multiple-ranking item tool (a very robust and creative tool, I recommend it to others when the alternative is multiple-choice items) to the assessment of critical thinking in health care professionals. The result might be deemed partially successful, at best. I eventually abandoned the test after about 10,000 administrations because the scoring was so complex we could not place it in non-technical hands."
  • Joshua Yeidel on 25 Jun 10
     
    In comments on an article about CLA, Scriven's name comes up...
Nils Peterson

Views: Changing the Equation - Inside Higher Ed - 1 views

www.insidehighered.com/...bassis

shared by Nils Peterson on 25 Mar 10 - Cached
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resources
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resource
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resources
  • ...19 more annotations...
  • year we strug
  • year we strug
  • those who control influential rating systems of the sort published by U.S. News & World Report -- define academic quality as small classes taught by distinguished faculty, grand campuses with impressive libraries and laboratories, and bright students heavily recruited. Since all of these indicators of quality are costly, my college’s pursuit of quality, like that of so many others, led us to seek more revenue to spend on quality improvements. And the strategy worked.
  • Based on those concerns, and informed by the literature on the “teaching to learning” paradigm shift, we began to change our focus from what we were teaching to what and how our students were learning.
  • No one wants to cut costs if their reputation for quality will suffer, yet no one wants to fall off the cliff.
  • When quality is defined by those things that require substantial resources, efforts to reduce costs are doomed to failure
  • some of the best thinkers in higher education have urged us to define the quality in terms of student outcomes.
  • Faculty said they wanted to move away from giving lectures and then having students parrot the information back to them on tests. They said they were tired of complaining that students couldn’t write well or think critically, but not having the time to address those problems because there was so much material to cover. And they were concerned when they read that employers had reported in national surveys that, while graduates knew a lot about the subjects they studied, they didn’t know how to apply what they had learned to practical problems or work in teams or with people from different racial and ethnic backgrounds.
  • Our applications have doubled over the last decade and now, for the first time in our 134-year history, we receive the majority of our applications from out-of-state students.
  • We established what we call college-wide learning goals that focus on "essential" skills and attributes that are critical for success in our increasingly complex world. These include critical and analytical thinking, creativity, writing and other communication skills, leadership, collaboration and teamwork, and global consciousness, social responsibility and ethical awareness.
  • despite claims to the contrary, many of the factors that drive up costs add little value. Research conducted by Dennis Jones and Jane Wellman found that “there is no consistent relationship between spending and performance, whether that is measured by spending against degree production, measures of student engagement, evidence of high impact practices, students’ satisfaction with their education, or future earnings.” Indeed, they concluded that “the absolute level of resources is less important than the way those resources are used.”
  • After more than a year, the group had developed what we now describe as a low-residency, project- and competency-based program. Here students don’t take courses or earn grades. The requirements for the degree are for students to complete a series of projects, captured in an electronic portfolio,
  • students must acquire and apply specific competencies
  • Faculty spend their time coaching students, providing them with feedback on their projects and running two-day residencies that bring students to campus periodically to learn through intensive face-to-face interaction
  • At the very least, finding innovative ways to lower costs without compromising student learning is wise competitive positioning for an uncertain future
  • As the campus learns more about the demonstration project, other faculty are expressing interest in applying its design principles to courses and degree programs in their fields. They created a Learning Coalition as a forum to explore different ways to capitalize on the potential of the learning paradigm.
  • a problem-based general education curriculum
  • After a year and a half, the evidence suggests that students are learning as much as, if not more than, those enrolled in our traditional business program
  • the focus of student evaluations has changed noticeably. Instead of focusing almost 100% on the instructor and whether he/she was good, bad, or indifferent, our students' evaluations are now focusing on the students themselves - as to what they learned, how much they have learned, and how much fun they had learning.
    • Nils Peterson
      Nils Peterson on 25 Mar 10
       
      gary diigoed this article. this comment shines another light -- the focus of the course eval shifted from faculty member to course & student learning when the focus shifted from teaching to learning
  • Gary Brown on 25 Mar 10
     
    A must read spotted by Jane Sherman--I've highlighed, as usual, much of it.
Joshua Yeidel

A Measure of Learning Is Put to the Test - Faculty - The Chronicle of Higher Education - 1 views

chronicle.com/...124519

assessment higher_education

shared by Joshua Yeidel on 20 Sep 10 - No Cached
  • "The CLA is really an authentic assessment process,"
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      What is the meaning of "authentic" in this statement? It certainly isn't "situated in the real world" or "of intrinsic value".
  • add CLA-style assignments to their liberal-arts courses.
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      Maybe the best way to prepare for the test, but the best way to develop analytical ability, et. al.?
  • the CLA typically reports scores on a "value added" basis, controlling for the scores that students earned on the SAT or ACT while in high school.
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      If SAT and ACT are measuring the same things as CLA, then why not just use them? If they are measuring different things, why "control for" their scores?
  • ...5 more annotations...
  • improved models of instruction.
  • it measures analytical ability, problem-solving ability, critical thinking, and communication.
  • "If a college pays attention to learning and helps students develop their skills—whether they do that by participating in our programs or by doing things on their own—they probably should do better on the CLA,"
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      Just in case anyone missed the message: pay attention to learning, and you'll _probably_ do better on the CLA. Get students to practice CLA tasks, and you _will_ do better on the CLA.
  • "Standardized tests of generic skills—I'm not talking about testing in the major—are so much a measure of what students bring to college with them that there is very little variance left out of which we might tease the effects of college," says Ms. Banta, who is a longtime critic of the CLA. "There's just not enough variance there to make comparative judgments about the comparative quality of institutions."
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      It's not clear what "standardized tests" means in this comment. Does the "lack of variance" apply to all assessments (including, e.g., e-portfolios)?
  • Can the CLA fill both of those roles?
  • Joshua Yeidel on 20 Sep 10
     
    A summary of the current state of "thinking" with regard to CLA. Many fallacies and contradictions are (unintentionally) exposed. At least CLA appears to be more about skills than content (though the question of how it is graded isn't even raised), but the "performance task" approach is the smallest possible step in that direction.
Gary Brown

Classroom Creativity : The Frontal Cortex - 1 views

scienceblogs.com/...classroom_creativity.php

creative thinking critical thinking

shared by Gary Brown on 26 May 10 - Cached
  • Classroom Creativity
  • Eric Barker recently referred me to this interesting study, which looked at how elementary school teachers perceived creativity in their students. While the teachers said they wanted creative kids in their classroom, they actually didn't. I
  • The point is that the classroom isn't designed for impulsive expression - that's called talking out of turn.
  • ...3 more annotations...
  • In recent years, however, it's become clear that daydreaming is actually an important element of the creative process, allowing the brain to remix ideas, explore counterfactuals and turn the spotlight of attention inwards.
  • The danger, however, is that we're teaching our kids a very narrow and stultifying model of cognition, in which conscientiousness is privileged above all.
  • The solution, I suppose, is rather banal: we really do need arts education in our schools,
  • Gary Brown on 26 May 10
     
    The Teaching Academy has refined critical and creative thinking with a draft definition that presumes they are two different thought processes. In my exploration of the purported diision, I encountered the writings of this neuroscientist.
Nils Peterson

2009 Annual Meeting | Conference Program - 0 views

www.aacu.org/...program.cfm

shared by Nils Peterson on 22 Jan 09 - Cached
  • This session explores the notion that assessment for transformational learning is best utilized as a learning tool. By providing timely, transparent, and appropriate feedback, both to students and to the institution itself, learning is enhanced – a far different motive for assessment than is external accountability.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      need to get to these guys with our harvesting gradebook ideas...
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      decided to attend another session. Hersh was OK before lunch, but the talk by Pan looks more promising
  • Academic and corporate communities agree on the urgent need for contemporary, research-based pedagogies of engagement in STEM fields. Participants will learn how leaders from academic departments and institutions have collaborated with leaders from the corporate and business community in regional networks to ensure that graduates meet the expectations of prospective employers and the public.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      here is another session with links to CTLT work, both harvesting gradebook and the ABET work
  • Professor Pan will discuss the reflective teaching methods used to prepare students to recognize and mobilize community assets as they design, implement, and evaluate projects to improve public health.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Students tasked to learn about a community, ride the bus, make a Doc appt. Then tasked to do a non-clinical health project in that community (they do plenty of clinical stuff elsewhere in the program). Project must build capacity in the community to survive after the student leaves. Example. Work with hispanic parents in Sacramento about parenting issue, ex getting kids to sleep on time. Student had identified problem in the community, but first project idea was show a video, which was not capacity building. Rather than showing the video, used the video as a template and made a new video. Families were actors. Result was spanish DVD that the community could own. Pan thinks this is increased capacity in the community.
  • ...17 more annotations...
  • Freshman Survey annually examines the academic habits of mind of entering first-year students.  Along with academic involvement, the survey examines diversity, civic engagement, college admissions and expectations of college. 
  • The project aims to promote faculty and student assessment of undergraduate research products in relation to outcomes associated with basic research skills and general undergraduate learning principles (communication and quantitative reasoning, critical thinking, and integration and application of knowledge).
  • They focus educators on the magnitude of the challenge to prepare an ever-increasingly diverse, globally-connected student body with the knowledge, ability, processes, and confidence to adapt to diverse environments and respond creatively to the enormous issues facing humankind.
  • One challenge of civic engagement in the co-curriculum is the merging of cost and outcome: creating meaningful experiences for students and the community with small staffs, on small budgets, while still having significant, purposeful impact. 
  • a)claims that faculty are the sole arbiters of what constitutes a liberal education and b) counter claims that student life professionals also possess the knowledge and expertise critical to defining students’ total learning experiences.  
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      also, how many angels can dance on the head of a pin?
  • This session introduces a three-year national effort to document how colleges and universities are using assessment data to improve teaching and learning and to facilitate the dissemination and adoption of best practices in the assessment of college learning outcomes.
  • Exciting pedagogies of engagement abound, including undergraduate research, community-engaged learning, interdisciplinary exploration, and international study.  However, such experiences are typically optional and non-credit-bearing for students, and/or “on top of” the workload for faculty. This session explores strategies for integrating engaged learning into the institutional fabric (curriculum, student role, faculty role) and increasing access to these transformative experiences.
  • hands-on experiential learning, especially in collaboration with other students, is a superior pedagogy but how can this be provided in increasingly larger introductory classes? 
  • As educators seek innovative ways to manage knowledge and expand interdisciplinary attention to pressing global issues, as students and parents look for assurances that their tuition investment will pay professional dividends, and as alumni look for meaningful ways to give back to the institutions that nurtured and prepared them, colleges and universities can integrate these disparate goals through the Guilds, intergenerational membership networks that draw strength from the contributions of all of their members.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      see Theron's ideas for COMM.
  • Civic engagement learning derives its power from the engagement of students with real communities—local, national, and global. This panel explores the relationship between student learning and the contexts in which that learning unfolds by examining programs that place students in diverse contexts close to campus and far afield.
  • For institutional assessment to make a difference for student learning its results must result in changes in classroom practice. This session explores ways in which the institutional assessment of student learning, such as the Wabash National Study of Liberal Arts Education and the Collegiate Learning Assessment, can be connected to our classrooms.
  • Interdisciplinary Teaching and Object-Based Learning in Campus Museums
  • To address pressing needs of their communities, government and non-profit agencies are requesting higher education to provide education in an array of human and social services. To serve these needs effectively, higher educationneeds to broaden and deepen its consultation with practitioners in designing new curricula. Colleges and universities would do well to consider a curriculum development model that requires consultation not only with potential employers, but also with practitioners and supervisors of practitioners.
  • Should Academics be Active? Campuses and Cutting Edge Civic Engagement
  • If transformational liberal education requires engaging the whole student across the educational experience, how can colleges and universities renew strategy and allocate resources effectively to support it?  How can assessment be used to improve student learning and strengthen a transformational learning environment? 
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Purpose of university is not to grant degrees, it has something to do with learning. Keeling's perspective is that the learning should be transformative; changing perspective. Liberating and emancipatory Learning is a complex interaction among student and others, new knowledge and experience, event, own aspirations. learners construct meaning from these elements. "we change our minds" altering the brain at the micro-level Brain imaging research demonstrates that analogical learning (abstract) demands more from more areas of the brain than semantic (concrete) learning. Mind is not an abstraction, it is based in the brain, a working physical organ .Learner and the environment matter to the learning. Seeds magazine, current issue on brain imaging and learning. Segway from brain research to need for university to educate the whole student. Uses the term 'transformative learning' meaning to transform the learning (re-wire the brain) but does not use transformative assessment (see wikipedia).
  • But as public debates roil, higher education has been more reactive than proactive on the question of how best to ensure that today’s students are fully prepared for a fast-paced future.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Bologna process being adopted (slowly) in EU, the idea is to make academic degrees more interchangeable and understandable across the EU three elements * Qualification Frameworks (transnational, national, disciplinary). Frameworks are graduated, with increasing expertise and autonomy required for the upper levels. They sound like broad skills that we might recognize in the WSU CITR. Not clear how they are assessed * Tuning (benchmarking) process * Diploma Supplements (licensure, thesis, other capstone activities) these extend the information in the transcript. US equivalent might be the Kuali Students system for extending the transcript. Emerging dialog on American capability This dialog is coming from 2 directions * on campus * employers Connect to the Greater Exceptions (2000-2005) iniative. Concluded that American HE has islands of innovation. Lead to LEAP (Liberal Education and America's Promise) Initiative (2005-2015). The dialog is converging because of several forces * Changes in the balance of economic and political power. "The rise of the rest (of the world)" * Global economy in which innovation is key to growth and prosperity LEAP attempts to frame the dialog (look for LEAP in AACU website). Miami-Dade CC has announced a LEAP-derived covenant, the goals must span all aspects of their programs. Define liberal education Knowledge of human cultures and the physical and natural world intellectual and practical skills responsibility integrative skills Marker of success is (here is where the Transformative Gradebook fits in): evidence that students can apply the essential learning outcomes to complex, unscripted problems and real-world settings Current failure -- have not tracked our progress, or have found that we are not doing well. See AACU employer survey 5-10% percent of current graduates taking courses that would meet the global competencies (transcript analysis) See NSSE on Personal and social responsibility gains, less tha
  • Dr. Pan will also talk about strategies for breaking down cultural barriers.
    • Nils Peterson
      Nils Peterson on 24 Jan 09
       
      Pan. found a non-profit agency to be a conduit and coordinator to level the power between univ and grass roots orgs. helped with cultural gaps.
Joshua Yeidel

TLChallenges09 | EDUCAUSE CONNECT - 0 views

connect.educause.edu/...TLChallenges09

web_2.0 educause higher education

shared by Joshua Yeidel on 09 Jan 09 - Cached
  • Joshua Yeidel on 09 Jan 09
     
    After four months of spirited discussion, the EDUCAUSE teaching and learning community has voted on the, "Top Teaching and Learning Challenges, 2009." The final list for 2009, ranked by popularity, includes (click on individual Challenges to visit their wiki page): 1. Creating learning environments that promote active learning, critical thinking, collaborative learning, and knowledge creation. 2. Developing 21st-century literacies among students and faculty (information, digital, and visual). 3. Reaching and engaging today's learner. 4. Encouraging faculty adoption and innovation in teaching and learning with IT. 5. Advancing innovation in teaching and learning (with technology) in an era of budget cuts.
Gary Brown

Wise Men Gone: Stephen Toulmin and John E. Smith - The Chronicle Review - The Chronicle... - 0 views

chronicle.com/...63649

critical thinking

shared by Gary Brown on 26 Jan 10 - Cached
  • Toulmin, born in London in 1922, earned his undergraduate degree in 1942 from King's College, Cambridge, in mathematics and physics. After participating in radar research and intelligence work during World War II in England and at Allied headquarters in Germany, he returned to Cambridge, where he studied with Ludwig Wittgenstein, the greatest influence on his thought, earning his Ph.D. in moral philosophy in 1948.
  • Toulmin moved to the United States, where he taught at Brandeis, Michigan State, and Northwestern Universities and the University of Chicago before landing in 1993 at the University of Southern California.
  • Toulmin's first, most enduring contribution to keeping philosophy sensible came in his 1958 book, The Uses of Argument (Cambridge University Press). Deceptively formalistic on its surface because it posited a general model of argument, Toulmin's view, in fact, was better described as taxonomic, yet flexible. He believed that formal systems of logic misrepresent the complex way that humans reason in most fields requiring what philosophers call "practical reason," and he offered, accordingly, a theory of knowledge as warranted belief.
  • ...4 more annotations...
  • Toulmin rejected the abstract syllogistic logic, meant to produce absolute standards for proving propositions true, that had become fashionable in analytic philosophy. Instead he argued (in the spirit of Wittgenstein) that philosophers must monitor how people actually argue if the philosophers' observations about persuasion are to make any sense. Toulmin took jurisprudential reasoning as his chief example in The Uses of Argument, but he believed that some aspects of a good argument depend on the field in which they're presented, while others are "field invariant."
  • Toulmin's "central thesis is that every sort of argumentation can in principle claim rationality and that the criteria to be applied when determining the soundness of the argumentation depend on the nature of the problems to which the argumentation relates."
  • But Toulmin, trained in the hard sciences and mathematics himself, saw through the science worship of less-credentialed sorts. He didn't relent, announcing "our need to reappropriate the wisdom of the 16th-century humanists, and develop a point of view that combines the abstract rigor and exactitude of the 17th-century 'new philosophy' with a practical concern for human life in its concrete detail."
  • Toulmin declared its upshot: "From now on, permanent validity must be set aside as illusory, and our idea of rationality related to specific functions of ... human reason. ... For me personally, the outcome of 40 years of philosophical critique was thus a new vision of—so to speak—the rhetoric of philosophy."
  • Gary Brown on 26 Jan 10
     
    FYI, Toulmin was the primary influence on the first WSU Critical Thinking Rubric. (Carella was the other philosopher.)
Gary Brown

News: Room for Improvement - Inside Higher Ed - 1 views

www.insidehighered.com/...employers

employers critical thinking

shared by Gary Brown on 21 Jan 10 - Cached
  • 302 private sector and non-profit employers who, by and large, say their employees need a broader set of skills and higher levels of knowledge than they ever have before. But, most surveyed said, colleges and universities have room for improvement in preparing students to be workers.
  • It is time for us to match our ambitious goals for college attainment with an equally ambitious – and well-informed – understanding of what it means to be well-prepared,” said Carol Geary Schneider, the association’s president. “Quality has to become the centerpiece of this nation’s postsecondary education.”
  • Nearly across the board, employers said they expect more of their employees than they did in the past
  • ...4 more annotations...
  • Employers were largely pessimistic in their views of whether higher education is successful in preparing students for what was characterized as “today’s global economy.”
  • “All of us must focus more on what students are actually doing in college.”
  • Employers said colleges should place more emphasis on preparing students "to effectively communicate orally and in writing" (89 percent), to use "critical thinking and analytical reasoning skills" (81 percent) and to have "the ability to apply knowledge and skills to real-world settings through internships or other hands on-experiences" (79 percent). Fewer than half -- 45 percent and 40 percent, respectively -- though colleges should do more to emphasize proficiency in a foreign language and knowledge of democratic institutions and values.
  • Eighty-four percent said that completion of "a significant project before graduation" like a capstone course or senior thesis would help a lot or a fair amount to prepare students for success, with 62 percent saying it would help "a lot." Expecting that students complete an internship or community-based field project was something that 66 percent of employers surveyed said would help a lot.
  • Gary Brown on 21 Jan 10
     
    Updating what we've heard.
Theron DesRosier

Critical Thinking as a Distributed Course - 2 views

ple.elg.ca/...view.php

education web_2.0

shared by Theron DesRosier on 22 Apr 10 - Cached
  • Drawing from two years of experience offering the 'Connectivism and Connective Knowledge' course in a distributed online environment, the National Research Council's Personal Learning Environment (PLE) project is expanding the model to courses outside the discipline of education. Specifically, Stephen Downes and Rita Kop - who have both offered Critical Thinking courses through more traditional online and offline means, are adapting this material to the distributed model. The purpose of this course is two-fold. First, the design of the course is based on an understanding of the skills and capacities required to effectively learn using a PLE. Second, the offering of the course is intended to test whether learners can employ a PLE environment in order to develop those capacities. Thus, combined, the objectives of the course are intended to demonstrate whether learning may be self-directed with a PLE, or whether an additional pedagogy is required prior to the use of a PLE. Research will form an integral component of the course.
  • Theron DesRosier on 22 Apr 10
     
    "This course attempts to teach the literacies I believe are needed to flourish in a connectivist environment." --Downes
Gary Brown

2 Efforts to Provide Data on Colleges to Consumers Fall Short, Report Says - Administra... - 2 views

chronicle.com/...64433

accountability

shared by Gary Brown on 02 Mar 10 - Cached
  • Higher education will have to be more accountable for its performance and more open to consumers about the actual cost of attending a college, and help people make easier comparisons among institutions, in order to succeed as the nation's economic engine, says a new report from two nonprofit think tanks here.
  • too little information to make informed choices about where they will get the most from their tuition dollars, say researchers at the two organizations, the libertarian-leaning American Enterprise Institute, and Education Sector, which is a proponent of reforming higher education
  • And without a more thorough and open form of accountability, institutions will not have any incentive to make the changes that will improve students' success,
  • ...7 more annotations...
  • "If existing flaws are not resolved, the nation runs the risk of ending up in the worst of all worlds: the appearance of higher education accountability without the reality," the authors say.
  • The two voluntary systems criticized in the study are the University and College Accountability Network, begun in September 2007 by the National Association of Independent Colleges and Universities to provide information about private colleges, and the Voluntary System of Accountability,
  • it does not obligate institutions to gather or reveal any data that are not already available elsewhere,"
  • associations are beginning to offer workshops and other opportunities for system participants to learn how to use the data they're collecting to improve the college experience for students, she said
  • VSA has the testing lobby written all over it
  • We may all appreciate the cultural context inhibiting public accountability but it is also important to understand that this same accountability is lacking internally where it effectively thwarts attempts to manage the institution rationally; i.e., informed with a continuous flow of mission-critical performance information. With the scant objective information at their command, college presidents and their associates must perform as shamans, reading the tea leaves of opinion and passion among stakeholders.
  • On balance, America's institutions of higher education function in a managerial vacuum.
  • Gary Brown on 02 Mar 10
     
    More of the same and the discussion is familiar--our challenge is to bring this topic to the attention of our points.
1 - 20 of 37 Next ›
Showing 20▼ items per page