Skip to main content

Home/ CTLT and Friends/ Group items tagged standards

Rss Feed Group items tagged

Joshua Yeidel

A Measure of Learning Is Put to the Test - Faculty - The Chronicle of Higher Education - 1 views

  • "The CLA is really an authentic assessment process,"
    • Joshua Yeidel
       
      What is the meaning of "authentic" in this statement? It certainly isn't "situated in the real world" or "of intrinsic value".
  • add CLA-style assignments to their liberal-arts courses.
    • Joshua Yeidel
       
      Maybe the best way to prepare for the test, but the best way to develop analytical ability, et. al.?
  • the CLA typically reports scores on a "value added" basis, controlling for the scores that students earned on the SAT or ACT while in high school.
    • Joshua Yeidel
       
      If SAT and ACT are measuring the same things as CLA, then why not just use them? If they are measuring different things, why "control for" their scores?
  • ...5 more annotations...
  • improved models of instruction.
  • it measures analytical ability, problem-solving ability, critical thinking, and communication.
  • "If a college pays attention to learning and helps students develop their skills—whether they do that by participating in our programs or by doing things on their own—they probably should do better on the CLA,"
    • Joshua Yeidel
       
      Just in case anyone missed the message: pay attention to learning, and you'll _probably_ do better on the CLA. Get students to practice CLA tasks, and you _will_ do better on the CLA.
  • "Standardized tests of generic skills—I'm not talking about testing in the major—are so much a measure of what students bring to college with them that there is very little variance left out of which we might tease the effects of college," says Ms. Banta, who is a longtime critic of the CLA. "There's just not enough variance there to make comparative judgments about the comparative quality of institutions."
    • Joshua Yeidel
       
      It's not clear what "standardized tests" means in this comment. Does the "lack of variance" apply to all assessments (including, e.g., e-portfolios)?
  • Can the CLA fill both of those roles?
  •  
    A summary of the current state of "thinking" with regard to CLA. Many fallacies and contradictions are (unintentionally) exposed. At least CLA appears to be more about skills than content (though the question of how it is graded isn't even raised), but the "performance task" approach is the smallest possible step in that direction.
Gary Brown

GAO - Generally Accepted Government Auditing Standards - 1 views

  • Our evaluator colleagues who work at GAO, and many others working in agencies and organizations that are responsible for oversight of, and focus on accountability for, government programs, often refer to the Yellow Book Standards. These agencies or organizations emphasize the importance of their independence from program officials and enjoy significant protections for their independence through statutory provisions, organizational location apart from program offices, direct reporting channels to the highest level official in their agency and governing legislative bodies, heightened tenure protections, and traditions emphasizing their independence.
  •  
    Good to have on the radar as DOE challenges the efficacy of accreditation, and not incidentally underpinning a principle of good evaluation.
Gary Brown

Views: Asking Too Much (and Too Little) of Accreditors - Inside Higher Ed - 1 views

  • Senators want to know why accreditors haven’t protected the public interest.
  • Congress shouldn’t blame accreditors: it should blame itself. The existing accreditation system has neither ensured quality nor ferreted out fraud. Why? Because Congress didn’t want it to. If Congress truly wants to protect the public interest, it needs to create a system that ensures real accountability.
  • But turning accreditors into gatekeepers changed the picture. In effect, accreditors now held a gun to the heads of colleges and universities since federal financial aid wouldn’t flow unless the institution received “accredited” status.
  • ...10 more annotations...
  • Congress listened to higher education lobbyists and designated accreditors -- teams made up largely of administrators and faculty -- to be “reliable authorities” on educational quality. Intending to protect institutional autonomy, Congress appropriated the existing voluntary system by which institutions differentiated themselves.
  • A gatekeeping system using peer review is like a penal system that uses inmates to evaluate eligibility for parole. The conflicts of interest are everywhere -- and, surprise, virtually everyone is eligible!
  • accreditation is “premised upon collegiality and assistance; rather than requirements that institutions meet certain standards (with public announcements when they don’t."
  • Meanwhile, there is ample evidence that many accredited colleges are adding little educational value. The 2006 National Assessment of Adult Literacy revealed that nearly a third of college graduates were unable to compare two newspaper editorials or compute the cost of office items, prompting the Spellings Commission and others to raise concerns about accreditors’ attention to productivity and quality.
  • But Congress wouldn’t let them. Rather than welcoming accreditors’ efforts to enhance their public oversight role, Congress told accreditors to back off and let nonprofit colleges and universities set their own standards for educational quality.
  • ccreditation is nothing more than an outdated industrial-era monopoly whose regulations prevent colleges from cultivating the skills, flexibility, and innovation that they need to ensure quality and accountability.
  • there is a much cheaper and better way: a self-certifying regimen of financial accountability, coupled with transparency about graduation rates and student success. (See some alternatives here and here.)
  • Such a system would prioritize student and parent assessment over the judgment of institutional peers or the educational bureaucracy. And it would protect students, parents, and taxpayers from fraud or mismanagement by permitting immediate complaints and investigations, with a notarized certification from the institution to serve as Exhibit A
  • The only way to protect the public interest is to end the current system of peer review patronage, and demand that colleges and universities put their reputation -- and their performance -- on the line.
  • Anne D. Neal is president of the American Council of Trustees and Alumni. The views stated herein do not represent the views of the National Advisory Committee on Institutional Quality and Integrity, of which she is a member.
  •  
    The ascending view of accreditation.
Joshua Yeidel

Shaping Strategy in a World of Constant Disruption | BNET - 0 views

  •  
    Hammered by relentless technological change, many companies take a reactive stance: They focus solely on keeping up, protecting their existing markets, and improving their performance. But a few companies take a proactive stance by executing shaping strategies: They use technology changes to create new business ecosystems that benefit themselves and other participants. Take Google's AdSense: It has reinvented the advertising business by enabling advertisers, content providers, and potential customers to connect with one another quickly, easily, and cheaply. To succeed, a shaping strategy needs a critical mass of participants, say Hagel, Brown, and Davison. Shapers can attract them by: * Convincingly articulating opportunities available to participants * Defining standards and practices that make participation easy and affordable * Demonstrating they have the conviction and resources for success and won't compete against participants Well-executed shaping strategies mobilize masses of players to learn from and share risk with one another - creating a profitable future for all.
Theron DesRosier

In Honor of the Standardized Testing Season… « Let's Play Math! - 0 views

  • — Jonathan Kozol at Westfield State College’s 157th Commencement
  •  
    If you could lead through testing, the U.S. would lead the world in all education categories. When are people going to understand you don't fatten your lambs by weighing them? - Jonathan Kozol at Westfield State College's 157th Commencement
Theron DesRosier

The Cape and Islands NPR Station - Positive Effect - 0 views

  •  
    (Listen to an audio version of this essay). I recently heard the author Jonathan Kozol speak about the over-use of standardized tests in schools today. "We're very busy weighing our lambs. That's not the same as fattening them," he said. That made me think of Nelson.
Gary Brown

Struggling Students Can Improve by Studying Themselves, Research Shows - Teaching - The... - 3 views

  • "We're trying to document the role of processes that are different from standard student-outcome measures and standard ability measures,
  • We're interested in various types of studying, setting goals for oneself, monitoring one's progress as one goes through learning a particular topic."
  • Mr. Zimmerman has spent most of his career examining what can go wrong when people try to learn new facts and skills. His work centers on two common follies: First, students are often overconfident about their knowledge, assuming that they understand material just because they sat through a few lectures or read a few chapters. Second, students tend to attribute their failures to outside forces ("the teacher didn't like me," "the textbook wasn't clear enough") rather than taking a hard look at their own study habits.
  • ...14 more annotations...
  • That might sound like a recipe for banal lectures about study skills. But training students to monitor their learning involves much more than simple nagging, Mr. Zimmerman says. For one thing, it means providing constant feedback, so that students can see their own strengths and weaknesses.
  • or one thing, it means providing constant feedback, so that students can see their own strengths and weaknesses.
  • "The first one is, Give students fast, accurate feedback about how they're doing. And the second rule, which is less familiar to most people, is, Now make them demonstrate that they actually understand the feedback that has been given."
  • "I did a survey in December," he says. "Only one instructor said they were no longer using the technique. Twelve people said they were using the technique 'somewhat,' and eight said 'a lot.' So we were pleased that they didn't forget about us after the program ended."
  • "Only one instructor said they were no longer using the technique. Twelve people said they were using the technique 'somewhat,' and eight said 'a lot.' So we were pleased that they didn't forget about us after the program ended."
  • And over time, we've realized that these methods have a much greater effect if they're embedded within the course content.
  • "Once we focus on noticing and correcting errors in whatever writing strategy we're working on, the students just become junkies for feedback,"
  • "Errors are part of the process of learning, and not a sign of personal imperfection," Mr. Zimmerman says. "We're trying to help instructors and students see errors not as an endpoint, but as a beginning point for understanding what they know and what they don't know, and how they can approach problems in a more effective way."
  • Errors are part of the process of learning, and not a sign of personal imperfection,"
  • Self-efficacy" was coined by Albert Bandura in the 1970's
  • "Self-efficacy" was coined by Albert Bandura in the 1970's,
  • The 1990 paper from _Educational Psychologist_ 25 (1), pp. 3-17) which is linked above DOES include three citations to Bandura's work.
  • The 1990 paper from _Educational Psychologist_ 25 (1), pp. 3-17) which is linked above DOES include three citations to Bandura's work.
  • What I am particularly amazed by is that the idea of feedback, reflection and explicitly demonstrated understanding (essentially a Socratic approach of teaching), is considered an innovation.
  •  
    selected for the focus on feedback. The adoption by half or fewer, depending, is also interesting as the research is of the type we would presume to be compelling.
Gary Brown

Change Management 101: A Primer - 1 views

shared by Gary Brown on 13 Jan 10 - Cached
  • To recapitulate, there are at least four basic definitions of change management:  1.      The task of managing change (from a reactive or a proactive posture) 2.      An area of professional practice (with considerable variation in competency and skill levels among practitioners) 3.      A body of knowledge (consisting of models, methods, techniques, and other tools) 4.      A control mechanism (consisting of requirements, standards, processes and procedures).
  • the problems found in organizations, especially the change problems, have both a content and a process dimension.
  • The process of change has been characterized as having three basic stages: unfreezing, changing, and re-freezing. This view draws heavily on Kurt Lewin’s adoption of the systems concept of homeostasis or dynamic stability.
  • ...10 more annotations...
  • The Change Process as Problem Solving and Problem Finding
  • What is not useful about this framework is that it does not allow for change efforts that begin with the organization in extremis
  • this framework is that it gives rise to thinking about a staged approach to changing things.
  • Change as a “How” Problem
  • Change as a “What” Problem
  • Change as a “Why” Problem
  • The Approach taken to Change Management Mirrors Management's Mindset
  • People in core units, buffered as they are from environmental turbulence and with a history of relying on adherence to standardized procedures, typically focus on “how” questions.
  • To summarize: Problems may be formulated in terms of “how,” “what” and “why” questions. Which formulation is used depends on where in the organization the person posing the question or formulating the problem is situated, and where the organization is situated in its own life cycle. “How” questions tend to cluster in core units. “What” questions tend to cluster in buffer units. People in perimeter units tend to ask “what” and “how” questions. “Why” questions are typically the responsibility of top management.
  • One More Time: How do you manage change? The honest answer is that you manage it pretty much the same way you’d manage anything else of a turbulent, messy, chaotic nature, that is, you don’t really manage it, you grapple with it. It’s more a matter of leadership ability than management skill. The first thing to do is jump in. You can’t do anything about it from the outside. A clear sense of mission or purpose is essential. The simpler the mission statement the better. “Kick ass in the marketplace” is a whole lot more meaningful than “Respond to market needs with a range of products and services that have been carefully designed and developed to compare so favorably in our customers’ eyes with the products and services offered by our competitors that the majority of buying decisions will be made in our favor.” Build a team. “Lone wolves” have their uses, but managing change isn’t one of them. On the other hand, the right kind of lone wolf makes an excellent temporary team leader. Maintain a flat organizational team structure and rely on minimal and informal reporting requirements. Pick people with relevant skills and high energy levels. You’ll need both. Toss out the rulebook. Change, by definition, calls for a configured response, not adherence to prefigured routines. Shift to an action-feedback model. Plan and act in short intervals. Do your analysis on the fly. No lengthy up-front studies, please. Remember the hare and the tortoise. Set flexible priorities. You must have the ability to drop what you’re doing and tend to something more important. Treat everything as a temporary measure. Don’t “lock in” until the last minute, and then insist on the right to change your mind. Ask for volunteers. You’ll be surprised at who shows up. You’ll be pleasantly surprised by what they can do. Find a good “straw boss” or team leader and stay out of his or her way. Give the team members whatever they ask for — except authority. They’ll generally ask only for what they really need in the way of resources. If they start asking for authority, that’s a signal they’re headed toward some kind of power-based confrontation and that spells trouble. Nip it in the bud! Concentrate dispersed knowledge. Start and maintain an issues logbook. Let anyone go anywhere and talk to anyone about anything. Keep the communications barriers low, widely spaced, and easily hurdled. Initially, if things look chaotic, relax — they are. Remember, the task of change management is to bring order to a messy situation, not pretend that it’s already well organized and disciplined.
  •  
    Note the "why" challenge and the role of leadership
Gary Brown

Law Schools Resist Proposal to Assess Them Based on What Students Learn - Curriculum - ... - 1 views

  • Law schools would be required to identify key skills and competencies and develop ways to test how well their graduates are learning them under controversial revisions to accreditation standards being proposed by the American Bar Association.
  • Several law deans said they have enough to worry about with budget cuts, a tough job market for their graduates, and the soaring cost of legal education without adding a potentially expensive assessment overhaul.
  • The proposed standards, which are still being developed, call on law schools to define learning outcomes that are consistent with their missions and to offer curricula that will achieve those outcomes. Different versions being considered offer varying degrees of specificity about what those skills should include.
  • ...2 more annotations...
  • "It is worth pausing to ask how the proponents of outcome measures can be so very confident that the actual performance of tasks deemed essential for the practice of law can be identified, measured, and evaluated," said Robert C. Post, dean of Yale Law School.
  • Phillip A. Bradley, senior vice president and general counsel for Duane Reade, a large drugstore chain, likened law schools to car companies that are "manufacturing something that nobody wants." Mr. Bradley said many law firms are developing core competencies they expect of their lawyers, but many law schools aren't delivering graduates who come close to meeting them.
  •  
    The homeopathic fallacy again, and as goes law school, so goes law....
Gary Brown

The Ticker - Education Dept. Criticizes Accreditor Over Credit-Hour Standards - The Chr... - 2 views

  • The Southern Association of Colleges and Schools cannot consistently ensure the quality of academic programs it reviews without clearly defining what constitutes a credit hour, according to a report issued on Tuesday by the U.S. Department of Education's inspector general. The accrediting organization, which assesses colleges in 11 states, responded that the variety of experiential, online, and distance courses that institutions now offer makes it impossible to define a single, common standard for credit hours. "The traditionally accepted definitions of semester credit hours and quarter credit hours based almost exclusively on seat time can no longer be applied to half of the credits now being awarded by our higher-education institutions," the association wrote in answer to the report.
  •  
    Outcomes are mentioned as an alternative in the comments, but in a disconcerting way. As is the alternative approach to study time....
Corinna Lo

IJ-SoTL - A Method for Collaboratively Developing and Validating a Rubric - 1 views

  •  
    "Assessing student learning outcomes relative to a valid and reliable standard that is academically-sound and employer-relevant presents a challenge to the scholarship of teaching and learning. In this paper, readers are guided through a method for collaboratively developing and validating a rubric that integrates baseline data collected from academics and professionals. The method addresses two additional goals: (1) to formulate and test a rubric as a teaching and learning protocol for a multi-section course taught by various instructors; and (2) to assure that students' learning outcomes are consistently assessed against the rubric regardless of teacher or section. Steps in the process include formulating the rubric, collecting data, and sequentially analyzing the techniques used to validate the rubric and to insure precision in grading papers in multiple sections of a course."
Joshua Yeidel

Digication e-Portfolios: Highered - Assessment - 0 views

  •  
    "Our web-based assessment solution for tracking, comparing, and reporting on student progress and performance gives faculty and administrators the tools they need to assess a class, department, or institution based on your standards, goals, or objectives. The Digication AMS integrates tightly with our award winning e-Portfolio system, enabling students to record and showcase learning outcomes within customizable, media friendly templates."
  •  
    Could this start out as with program portfolios, and bgrow to include student work?
Joshua Yeidel

Op-Ed Contributor - Why Charter Schools Fail the Test - NYTimes.com - 1 views

  •  
    Charles Murray of the Amertican Enterprise Institute waves a conservative flag for _abandoning_ standardized tests in education-- from a consumer's (parent's) standpoint
Kimberly Green

Would You Like Credit With That Internship? - Students - The Chronicle of Higher Education - 0 views

  •  
    Students pay tuition to work for free ... unpaid internships are growing in this down economy, favoring the wealthy who can afford them. But internships are generally valuable for students, administrators say. The complementary courses involve journals, essays, oral presentations, or work portfolios. Independent studies lean toward academics. Companies often see academic credit as substitute compensation that qualifies interns as legally unpaid trainees and keeps them on their colleges' liability insurance. Advertisements specify: "Candidates must be able to receive academic credit." That makes some campus officials bristle. "What they're saying is holding the institution hostage," says Kathy L. Sims, director of career services at the University of California at Los Angeles. Employers don't know colleges' academic standards, she says. "It's really not their call whether their experience is creditworthy." Colleges have dealt with that quandary in various ways. Some, especially those with traditions of experiential learning, vet and monitor internships, enrolling students in courses designed to complement their real-world work. Others let professors sponsor independent studies based on internships. More and more have devised some form of noncredit recognition to try to satisfy employers without altering academic philosophies or making students pay tuition to work free. At Bates College, the game is up. "We're quite adamant about our refusal to play along," says James W. Hughes, a professor of economics. As chairman of the department eight years ago, he got dozens of calls from students, parents, and employers asking for credit for unpaid internships, mainly in the financial industry. "Why is it that we have to evaluate this experience," he says, "just so some multibillion-dollar bank can avoid paying $7.50 an hour?" But the law is vague, and arguably antiquated. In the for-profit sector, guidelines for legally unpaid internships come from a 1947 U
Joshua Yeidel

iPad Usability: First Findings From User Testing (Jakob Nielsen's Alertbox) - 0 views

  •  
    Preliminary usability studies of the iPad show some UI problems in the first generation of apps. Overadoption of the iPhone UI raises one set of issues; avoidance of some standard Web concepts raises others. Many content providers are hoping that their iPad apps will capture users more than Web sites do; that will remain to be seen.
Joshua Yeidel

Higher Education: Assessment & Process Improvement Group News | LinkedIn - 0 views

  •  
    High School Principal George Wood eloquently contrasts standardized NCLB-style testing and his school's term-end performance testing.
Corinna Lo

News: The Challenge of Comparability - Inside Higher Ed - 0 views

  •  
    But when it came to defining sets of common learning outcomes for specific degree programs -- Transparency by Design's most distinguishing characteristic -- commonality was hard to come by. Questions to apply to any institution could be: 1) For any given program, what specific student learning outcomes are graduates expected to demonstrate? 2) By what standards and measurements are students being evaluated? 3) How well have graduating students done relative to these expectations? Comparability of results (the 3rd question) depends on transparency of goals and expectations (the 1st question) and transparency of measures (the 2nd question).
Judy Rumph

Wired Campus: Opinion: Demanding Educational Software Standards that Work - C... - 0 views

  •  
    Here is an article discussing the problems we face.
Nils Peterson

Views: The Limitations of Portfolios - Inside Higher Ed - 1 views

  • Gathering valid data about student performance levels and performance improvement requires making comparisons relative to fixed benchmarks and that can only be done when the assessments are standardized. Consequently, we urge the higher education community to embrace authentic, standardized performance-assessment approaches so as to gather valid data that can be used to improve teaching and learning as well as meet its obligations to external audiences to account for its actions and outcomes regarding student learning.
    • Nils Peterson
       
      Diigoed because this is the counter-argument to our work.
Gary Brown

A Real-Life Lesson in Why Accountability Matters - Administration - The Chronicle of Hi... - 1 views

  • "Change is in the wind,"
  • "All we have is this campus," says Raven Curling, a biology and pre-dental student who is also president of the student government. "It feels like we're a university without university standards." Policy wonks and education reformers talk often about the importance of accountability and about the responsibilities of trustees to set and enforce standards. All that jargon moves from abstraction to reality when you see the price students pay for inattention.
  •  
    more focus on provostial numbers, but the import is still the same--"accountability is in the wind."
‹ Previous 21 - 40 of 81 Next › Last »
Showing 20 items per page