Skip to main content

Home/ CTLT and Friends/ Group items tagged program assessment

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Judy Rumph

about | outcomes_assessment | planning | NYIT - 1 views

www.nyit.edu/...about

shared by Judy Rumph on 17 Aug 10 - Cached
  • The Assessment Committee of NYIT's Academic Senate is the institutional unit that brings together all program assessment activities at the university - for programs with and without professional accreditation, for programs at all locations, for programs given through all delivery mechanisms. The committee members come from all academic schools and numerous support departments. Its meetings are open and minutes are posted on the web site of the Academic Senate.
  • Judy Rumph on 17 Aug 10
     
    This page made me think about the public face of our own assessment process and how that can influence perceptions about our process.
Gary Brown

Details | LinkedIn - 0 views

www.linkedin.com/groupItem

accountability

shared by Gary Brown on 11 Sep 10 - No Cached
  • Although different members of the academic hierarchy take on different roles regarding student learning, student learning is everyone’s concern in an academic setting. As I specified in my article comments, universities would do well to use their academic support units, which often have evaluation teams (or a designated evaluator) to assist in providing boards the information they need for decision making. Perhaps boards are not aware of those serving in evaluation roles at the university or how those staff members can assist boards in their endeavors.
  • Gary Brown • We have been using the Internet to post program assessment plans and reports (the programs that support this initiative at least), our criteria (rubric) for reviewing them, and then inviting external stakeholders to join in the review process.
Gary Brown

WSU Today Online - Current Article List - 0 views

www.wsutoday.wsu.edu/...Publications.asp

writing assessment

shared by Gary Brown on 02 Dec 09 - Cached
  • the goal of the program is for students to submit their portfolios at the start of their junior year, and only about 34 percent are managing to do that.
  • Writing Assessment Program received the 2009 “Writing Program Certificate of Excellence”
  • If students delay completing their portfolio until late in their junior year, or into their senior year, she said, “it undermines the instructional integrity of the assessment.”
  • ...1 more annotation...
  • 70 percent of students submitted a paper as part of their portfolio that had been completed in a non-WSU course
  • Gary Brown on 02 Dec 09
     
    I ponder these highlights
Gary Brown

Many College Boards Are at Sea in Assessing Student Learning, Survey Finds - Leadership... - 0 views

chronicle.com/...124349

accountability assessment

shared by Gary Brown on 09 Sep 10 - No Cached
  • While oversight of educational quality is a critical responsibility of college boards of trustees, a majority of trustees and chief academic officers say boards do not spend enough time discussing student-learning outcomes, and more than a third say boards do not understand how student learning is assessed, says a report issued on Thursday by the Association of Governing Boards of Universities and Colleges.
  • While boards should not get involved in the details of teaching or ways to improve student-learning outcomes, they must hold the administration accountable for identifying needs in the academic programs and then meeting them, the report says. Boards should also make decisions on where to allocate resources based on what works or what should improve.
  • The most commonly received information by boards was college-ranking data
  • ...1 more annotation...
  • Boards should expect to receive useful high-level information on learning outcomes, the report says, and should make comparisons over time and to other institutions. Training in how to understand academic and learning assessments should also be part of orientation for new board members.
  • Gary Brown on 09 Sep 10
     
    This piece coupled with the usual commentary reveal again the profound identity crisis shaking education in this country.
Joshua Yeidel

Digication :: NCCC Art Department Program Evaluation :: Purpose of Evaluation - 0 views

nwcc.digication.com/...Home

portfolio assessment program

shared by Joshua Yeidel on 27 Apr 10 - Cached
  • Joshua Yeidel on 27 Apr 10
     
    An eportfolio for program evaluation by the Northwest Connecticut Community College Art Department. Slick, well-organized, and pretty using Digication as a platform and host. A fine portfolio, which could well be a model for our programs, except that there is not a single direct measure of student learning outcomes.
S Spaeth

Matthews et al: Selecting influential members of social networks - 0 views

baywood.metapress.com/...contribution.asp

iteams

shared by S Spaeth on 15 Feb 09 - Cached
  • S Spaeth on 15 Feb 09
     
    Opinion leaders are influential members of their social networks, strategically selected for their ability to sway community norms. The aims of the study were to assess: 1) whether it is feasible to identify student opinion leaders (SOLs) and their social networks among Grade 11 students at two high schools in Cape Town, South Africa; and 2) whether these opinion leaders would be willing to be involved in an HIV/AIDS prevention program in their school. The students (N = 412) completed a semi-structured, anonymous, self-administered questionnaire. ... Of these, all but two at each school were willing and available to participate in a HIV/AIDS prevention program. ---------- Focuses on HIV/AIDS prevention but can we use principles in other contexts and Facebook recommendation tools to support the process?
  • Theron DesRosier on 11 Mar 09
     
    I've been thinking about how to support the development and visibility of SOLs using technology, without creating a creepy treehouse. How do we make them more visible and accessible?
Nils Peterson

Office of the President: Perspectives Home - 1 views

president.wsu.edu/perspectives

shared by Nils Peterson on 22 Nov 09 - Cached
  • Clearly, a world-class research university cannot long stand on such a shaky IT foundation. In fact, in the  generally glowing accreditation report filed by the Northwest Commission on Colleges and Universities about our university this summer, one recommendation read: “The Committee recommends that Washington State University provide contemporary information management systems that will address the needs of the future for its student, academic and management support requirements.”
    • Nils Peterson
      Nils Peterson on 22 Nov 09
       
      Perhaps the President recalls the Spring preliminary accreditation report more clearly than the final report sent to him in the summer and linked at accreditation.wsu.edu which does not have the "glowing" comments but does say "...the Commission finds that Recommendations 1,2, and 3 of the Spring 2009 Comprehensive Evaluation Report are areas where Washington State University is substantially in compliance with Commission criteria for accreditation, but in need of improvement. The two additional Recommendations follow below. Recommendation 2 states that the implementation of the educational assessment plan remains inconsistent across the University despite promising starts and a number of exemplary successes in selected programs. The Commission therefore recommends that the Universìty continue to enhance and strengthen its assessment process. This process needs to be extended to all of the University's educational programs, including graduate programs, and programs offered at the branch campuses (Standard 2.8).
Joshua Yeidel

Blog U.: The Challenge of Value-Added - Digital Tweed - Inside Higher Ed - 0 views

www.insidehighered.com/...the_challenge_of_value_added

assessment higher_education accountability

shared by Joshua Yeidel on 25 Aug 10 - Cached
  • Joshua Yeidel on 25 Aug 10
     
    Quoting a 1984 study, "higher education should ensure that the mounds of data already collected on students are converted into useful information and fed back [to campus officials and faculty] in ways that enhance student learning and lead to improvement in programs, teaching practices, and the environment in which teaching and learning take place." The example given is an analysis of test scores in the Los Angeles Unified School District by the LA Times.
  • Joshua Yeidel on 25 Aug 10
     
    It's going to take some assessment (and political) smarts to deflect the notion that existing data can be re-purposed easily to assess "value-added".
S Spaeth

Google Gadget Ventures - 1 views

www.google.com/gadgetventures

assessment

shared by S Spaeth on 05 Dec 09 - Cached
  • S Spaeth on 05 Dec 09
     
    Google Gadget Ventures is a new Google pilot program dedicated to helping developers create richer, more useful gadgets. Inspired by the success of iGoogle, which has been driven by the creation by 3rd-party developers of a broad range of gadgets, Gadget Ventures provides two types of funding: Grants of $5,000 to those who've built gadgets we'd like to see developed further. You're eligible to apply for a grant if you've developed a gadget that's in our gadgets directory and gets at least 250,000 weekly page views. To apply, you must submit a one-page proposal detailing how you'd use the grant to improve your gadget. Seed investments of $100,000 to developers who'd like to build a business around the gadgets platform. Only Google Gadget Venture grant recipients are eligible for this type of funding. Submitting a business plan detailing how you plan to build a viable business around the gadgets platform is a required part of the seed investment application process. It's our hope that Google Gadget Ventures will give developers the opportunity to create a new generation of gadgets to benefit users. ---------- Consider this form of authentic assessment and the metrics they apply.
Joshua Yeidel

Outcomes and Distributions in Program Evaluation - 2 views

www.usablellc.net/ibutions-in-prorgam-evaluation

assessment outcomes

shared by Joshua Yeidel on 19 Aug 10 - Cached
  • Joshua Yeidel on 19 Aug 10
     
    "The key here is to understand that looking only at the total outcome of a program limits your ability to use evaluation data for program improvement."
  • Joshua Yeidel on 19 Aug 10
     
    Eric Graig discusses the need to slice and dice the data.
Nils Peterson

CITE Journal -- Volume 2, Issue 4 - 0 views

www.citejournal.org/...article3.cfm

shared by Nils Peterson on 13 Aug 10 - Cached
  • The ability to aggregate data for assessment is counted as a plus for CS and a minus for GT
    • Nils Peterson
      Nils Peterson on 13 Aug 10
       
      This analysis preceeds the Harvesting concept.
  • The map includes the portfolio's ability to aid learners in planning, setting goals, and navigating the artifacts learners create and collect.
    • Nils Peterson
      Nils Peterson on 13 Aug 10
       
      Recently, when I have been thinking about program assessment I've been thinking how students might assess courses (before adding the couse to their transcript (aka portfolio) in terms of the student's learning needs for developing proficiency in the 6 WSU goals. Students might also do a course evaluation relative to the 6 goals to give instrutors and fellow students guideposts. SO, the notion here, portfolio as map, would be that the portfolio had a way for the learner to track/map progress toward a goal. Perhaps a series of radar charts associated with a series of artifacts. Learner reflection would lead to conclusion about what aspect of the rubric needed more practice in the creation of the next artifacts going into the portfolio.
Joshua Yeidel

A Measure of Learning Is Put to the Test - Faculty - The Chronicle of Higher Education - 1 views

chronicle.com/...124519

assessment higher_education

shared by Joshua Yeidel on 20 Sep 10 - No Cached
  • "The CLA is really an authentic assessment process,"
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      What is the meaning of "authentic" in this statement? It certainly isn't "situated in the real world" or "of intrinsic value".
  • add CLA-style assignments to their liberal-arts courses.
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      Maybe the best way to prepare for the test, but the best way to develop analytical ability, et. al.?
  • the CLA typically reports scores on a "value added" basis, controlling for the scores that students earned on the SAT or ACT while in high school.
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      If SAT and ACT are measuring the same things as CLA, then why not just use them? If they are measuring different things, why "control for" their scores?
  • ...5 more annotations...
  • improved models of instruction.
  • it measures analytical ability, problem-solving ability, critical thinking, and communication.
  • "If a college pays attention to learning and helps students develop their skills—whether they do that by participating in our programs or by doing things on their own—they probably should do better on the CLA,"
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      Just in case anyone missed the message: pay attention to learning, and you'll _probably_ do better on the CLA. Get students to practice CLA tasks, and you _will_ do better on the CLA.
  • "Standardized tests of generic skills—I'm not talking about testing in the major—are so much a measure of what students bring to college with them that there is very little variance left out of which we might tease the effects of college," says Ms. Banta, who is a longtime critic of the CLA. "There's just not enough variance there to make comparative judgments about the comparative quality of institutions."
    • Joshua Yeidel
      Joshua Yeidel on 20 Sep 10
       
      It's not clear what "standardized tests" means in this comment. Does the "lack of variance" apply to all assessments (including, e.g., e-portfolios)?
  • Can the CLA fill both of those roles?
  • Joshua Yeidel on 20 Sep 10
     
    A summary of the current state of "thinking" with regard to CLA. Many fallacies and contradictions are (unintentionally) exposed. At least CLA appears to be more about skills than content (though the question of how it is graded isn't even raised), but the "performance task" approach is the smallest possible step in that direction.
Gary Brown

More thinking about the alignment project « The Weblog of (a) David Jones - 0 views

davidtjones.wordpress.com/...ng-about-the-alignment-project

alignment

shared by Gary Brown on 14 May 10 - Cached
  • he dominant teaching experience for academics is teaching an existing course, generally one the academic has taught previously. In such a setting, academics spend most of their time fine tuning a course or making minor modifications to material or content (Stark, 2000)
  • many academic staff continue to employ inappropriate, teacher-centered, content focused strategies”. If the systems and processes of university teaching and learning practice do not encourage and enable everyday consideration of alignment, is it surprising that many academics don’t consider alignment?
  • student learning outcomes are significantly higher when there are strong links between those learning outcomes, assessment tasks, and instructional activities and materials.
  • ...11 more annotations...
  • Cohen (1987) argues that limitations in learning are not mainly caused by ineffective teaching, but are instead mostly the result of a misalignment between what teachers teach, what they intend to teach, and what they assess as having been taught.
  • Make explicit the quality model.
  • Build in support for quality enhancement.
  • Institute a process for quality feasibility.
  • Levander and Mikkola (2009) describe the full complexity of managing alignment at the degree level which makes it difficult for the individual teacher and the program coordinator to keep connections between courses in mind.
  • Raban (2007) observes that the quality management systems of most universities employ procedures that are retrospective and weakly integrated with long term strategic planning. He continues to argue that the conventional quality management systems used by higher education are self-defeating as they undermine the commitment and motivation of academic staff through an apparent lack of trust, and divert resources away from the core activities of teaching and research (Raban, 2007, p. 78).
  • Ensure participation of formal institutional leadership and integration with institutional priorities.
  • Action research perspective, flexible responsive.
  • Having a scholarly, not bureaucratic focus.
  • Modifying an institutional information system.
  • A fundamental enabler of this project is the presence of an information system that is embedded into the everyday practice of teaching and learning (for both students and staff) that encourages and enables consideration of alignment.
  • Gary Brown on 14 May 10
     
    a long blog, but underlying principles align with the Guide to Effective Assessment on many levels.
Nils Peterson

Education Department Proposes To End Federal Funding To For-Profit Colleges Whose Stude... - 2 views

www.huffingtonpost.com/...nding-jobs-loans_n_657821.html

assessment stakeholder financial aid higher_education accountability

shared by Nils Peterson on 24 Jul 10 - Cached
  • The Education Department proposed much-anticipated regulations Friday that would cut off federal aid to for-profit college programs if too many of their students default on loans or don't earn enough after graduation to repay them.
  • To qualify for federal student aid programs, career college programs must prepare students for "gainful employment."
  • But shares were mixed among companies such as ITT Educational Services Inc., Corinthian Colleges Inc., Education Management Corp. and Career Education Corp. Those companies operate career colleges focusing more on two-year programs or lower-income students and may need to make big changes
Gary Brown

A Critic Sees Deep Problems in the Doctoral Rankings - Faculty - The Chronicle of Highe... - 1 views

chronicle.com/...124725

ranking colleges

shared by Gary Brown on 01 Oct 10 - No Cached
  • This week he posted a public critique of the NRC study on his university's Web site.
  • "Little credence should be given" to the NRC's ranges of rankings.
  • There's not very much real information about quality in the simple measures they've got."
  • ...4 more annotations...
  • The NRC project's directors say that those small samples are not a problem, because the reputational scores were not converted directly into program assessments. Instead, the scores were used to develop a profile of the kinds of traits that faculty members value in doctoral programs in their field.
  • For one thing, Mr. Stigler says, the relationships between programs' reputations and the various program traits are probably not simple and linear.
  • if these correlations between reputation and citations were plotted on a graph, the most accurate representation would be a curved line, not a straight line. (The curve would occur at the tipping point where high citation levels make reputations go sky-high.)
  • Mr. Stigler says that it was a mistake for the NRC to so thoroughly abandon the reputational measures it used in its previous doctoral studies, in 1982 and 1995. Reputational surveys are widely criticized, he says, but they do provide a check on certain kinds of qualitative measures.
  • Gary Brown on 01 Oct 10
     
    What is not challenged is the validity and utility of the construct itself--reputation rankings.
Nils Peterson

Foreign Policy: The Next Big Thing: Personalized Education - 0 views

www.foreignpolicy.com/...cms.php

shared by Nils Peterson on 20 Apr 09 - Cached
  • According to the analysis of business expert Clayton Christensen, personalized education is likely to begin outside formal school through a combination of entrepreneurial vendors on the one hand and ambitious students and parents on the other. Once far more efficient and effective education has been modeled in homes and clubs, those schools, communities, and/or societies that have the ambition, the means, and the willingness to take risks will follow suit.
  • Many more individuals will be well-educated because they will have learned in ways that suit them best. Even more importantly, these individuals will want to keep learning as they grow older because they have tasted success and are motivated to continue.
  • According to the analysis of business expert Clayton Christensen, personalized education is likely to begin outside formal school through a combination of entrepreneurial vendors on the one hand and ambitious students and parents on the other.
    • Nils Peterson
      Nils Peterson on 21 Apr 09
       
      That does seem right -- the system is unable to adapt and innovate and Christensen's Innovator's Dilemma seems to apply. But the previous paragraph, 'well programmed computers' seems to miss the collaborative, interpersonal, Web 2.0 potential for 1-1 tutoring.
  • S Spaeth on 20 Apr 09
     
    most of history, only the wealthy have been able to afford an education geared to the individual learner. For the rest of us, education has remained a mass affair, with standard curricula, pedagogy, and assessments. The financial crisis will likely change this state of affairs. With the global quest for long-term competitiveness assuming new urgency, education is on everyone's front burner. Societies are looking for ways to make quantum leaps in the speed and efficiency of learning. So long as we insist on teaching all students the same subjects in the same way, progress will be incremental. But now for the first time it is possible to individualize education-to teach each person what he or she needs and wants to know in ways that are most comfortable and most efficient, producing a qualitative spurt in educational effectiveness. In fact, we already have the technology to do so. Well-programmed computers-whether in the form of personal computers or hand-held devices-are becoming the vehicles of choice. They will offer many ways to master materials. Students (or their teachers, parents, or coaches) will choose the optimal ways of presenting the materials. Appropriate tools for assessment will be implemented.
Theron DesRosier

Virtual-TA - 2 views

www.virtual-ta.com/how-we-do-it.php

virtual ta outsource assessment

shared by Theron DesRosier on 07 Apr 10 - Cached
  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  • Theron DesRosier on 07 Apr 10
     
    I went to Virtual TA and Highlighted their language describing how it works.
Gary Brown

On Hiring - Redefining Faculty Roles - The Chronicle of Higher Education - 0 views

chronicle.com/...8016

faculty roles assessment change

shared by Gary Brown on 15 Sep 09 - Cached
  • aculty duties and expectations have diversified and become more complex, but there clearly has not been a concomitant change in the traditional expectations for faculty performance.To take one example: at many institutions, assessment programs have added substantial burdens to faculty members, who must both plan and execute them. I suspect, though I do not know, that such additional burdens are heavier at teaching-oriented colleges and universities that also have higher standard teaching loads than more research-oriented institutions. There's also increased pressure on faculty members to involve undergraduate students in research, an initiative that takes various forms at various institutions but that is prevalent across institutional types.
  • Gary Brown on 15 Sep 09
     
    lamenting the increased burden involved in changing faculty roles, but misses the implications of SoTL and synergies. It is not more work but different, but communicating that vantage is our challenge.
Nils Peterson

Accreditor for Teaching Programs Puts New Emphasis on Research and Real Life - Chronicl... - 0 views

chronicle.com/...20630n.htm

shared by Nils Peterson on 24 Jun 09 - Cached
  • “Learning these aspects of teaching in a contrived setting just isn’t doing the job.” Future teachers should be receiving this instruction and guidance from mentors who are working
    • Nils Peterson
      Nils Peterson on 24 Jun 09
       
      A call for learning in community -- what is missing is any discussion of how to harvest feedback. Be a classic case for posting a lesson plan and its assessment, and its products and asking teachers, peers, parents to assess and comment
Joshua Yeidel

New Web Site Compares Student Outcomes at Online Colleges - Technology - The Chronicle ... - 0 views

chronicle.com/...47924

assessment accountability

shared by Joshua Yeidel on 06 Aug 09 - Cached
  • Joshua Yeidel on 06 Aug 09
     
    "College Choices for Adults [website] provides adults with specific information about what students are supposed to learn in the colleges' mostly career-oriented programs and measurements of whether they did." That's the billing in the Chronicle, but when I wen to the site, I found mostly self-reports of engagement and satisfaction.
‹ Previous 21 - 40 of 52 Next ›
Showing 20▼ items per page