Skip to main content

Home/ CTLT and Friends/ Group items tagged design

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Nils Peterson

2009 Annual Meeting | Conference Program - 0 views

www.aacu.org/...program.cfm

shared by Nils Peterson on 22 Jan 09 - Cached
  • This session explores the notion that assessment for transformational learning is best utilized as a learning tool. By providing timely, transparent, and appropriate feedback, both to students and to the institution itself, learning is enhanced – a far different motive for assessment than is external accountability.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      need to get to these guys with our harvesting gradebook ideas...
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      decided to attend another session. Hersh was OK before lunch, but the talk by Pan looks more promising
  • Academic and corporate communities agree on the urgent need for contemporary, research-based pedagogies of engagement in STEM fields. Participants will learn how leaders from academic departments and institutions have collaborated with leaders from the corporate and business community in regional networks to ensure that graduates meet the expectations of prospective employers and the public.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      here is another session with links to CTLT work, both harvesting gradebook and the ABET work
  • Professor Pan will discuss the reflective teaching methods used to prepare students to recognize and mobilize community assets as they design, implement, and evaluate projects to improve public health.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Students tasked to learn about a community, ride the bus, make a Doc appt. Then tasked to do a non-clinical health project in that community (they do plenty of clinical stuff elsewhere in the program). Project must build capacity in the community to survive after the student leaves. Example. Work with hispanic parents in Sacramento about parenting issue, ex getting kids to sleep on time. Student had identified problem in the community, but first project idea was show a video, which was not capacity building. Rather than showing the video, used the video as a template and made a new video. Families were actors. Result was spanish DVD that the community could own. Pan thinks this is increased capacity in the community.
  • ...17 more annotations...
  • Freshman Survey annually examines the academic habits of mind of entering first-year students.  Along with academic involvement, the survey examines diversity, civic engagement, college admissions and expectations of college. 
  • The project aims to promote faculty and student assessment of undergraduate research products in relation to outcomes associated with basic research skills and general undergraduate learning principles (communication and quantitative reasoning, critical thinking, and integration and application of knowledge).
  • They focus educators on the magnitude of the challenge to prepare an ever-increasingly diverse, globally-connected student body with the knowledge, ability, processes, and confidence to adapt to diverse environments and respond creatively to the enormous issues facing humankind.
  • One challenge of civic engagement in the co-curriculum is the merging of cost and outcome: creating meaningful experiences for students and the community with small staffs, on small budgets, while still having significant, purposeful impact. 
  • a)claims that faculty are the sole arbiters of what constitutes a liberal education and b) counter claims that student life professionals also possess the knowledge and expertise critical to defining students’ total learning experiences.  
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      also, how many angels can dance on the head of a pin?
  • This session introduces a three-year national effort to document how colleges and universities are using assessment data to improve teaching and learning and to facilitate the dissemination and adoption of best practices in the assessment of college learning outcomes.
  • Exciting pedagogies of engagement abound, including undergraduate research, community-engaged learning, interdisciplinary exploration, and international study.  However, such experiences are typically optional and non-credit-bearing for students, and/or “on top of” the workload for faculty. This session explores strategies for integrating engaged learning into the institutional fabric (curriculum, student role, faculty role) and increasing access to these transformative experiences.
  • hands-on experiential learning, especially in collaboration with other students, is a superior pedagogy but how can this be provided in increasingly larger introductory classes? 
  • As educators seek innovative ways to manage knowledge and expand interdisciplinary attention to pressing global issues, as students and parents look for assurances that their tuition investment will pay professional dividends, and as alumni look for meaningful ways to give back to the institutions that nurtured and prepared them, colleges and universities can integrate these disparate goals through the Guilds, intergenerational membership networks that draw strength from the contributions of all of their members.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      see Theron's ideas for COMM.
  • Civic engagement learning derives its power from the engagement of students with real communities—local, national, and global. This panel explores the relationship between student learning and the contexts in which that learning unfolds by examining programs that place students in diverse contexts close to campus and far afield.
  • For institutional assessment to make a difference for student learning its results must result in changes in classroom practice. This session explores ways in which the institutional assessment of student learning, such as the Wabash National Study of Liberal Arts Education and the Collegiate Learning Assessment, can be connected to our classrooms.
  • Interdisciplinary Teaching and Object-Based Learning in Campus Museums
  • To address pressing needs of their communities, government and non-profit agencies are requesting higher education to provide education in an array of human and social services. To serve these needs effectively, higher educationneeds to broaden and deepen its consultation with practitioners in designing new curricula. Colleges and universities would do well to consider a curriculum development model that requires consultation not only with potential employers, but also with practitioners and supervisors of practitioners.
  • Should Academics be Active? Campuses and Cutting Edge Civic Engagement
  • If transformational liberal education requires engaging the whole student across the educational experience, how can colleges and universities renew strategy and allocate resources effectively to support it?  How can assessment be used to improve student learning and strengthen a transformational learning environment? 
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Purpose of university is not to grant degrees, it has something to do with learning. Keeling's perspective is that the learning should be transformative; changing perspective. Liberating and emancipatory Learning is a complex interaction among student and others, new knowledge and experience, event, own aspirations. learners construct meaning from these elements. "we change our minds" altering the brain at the micro-level Brain imaging research demonstrates that analogical learning (abstract) demands more from more areas of the brain than semantic (concrete) learning. Mind is not an abstraction, it is based in the brain, a working physical organ .Learner and the environment matter to the learning. Seeds magazine, current issue on brain imaging and learning. Segway from brain research to need for university to educate the whole student. Uses the term 'transformative learning' meaning to transform the learning (re-wire the brain) but does not use transformative assessment (see wikipedia).
  • But as public debates roil, higher education has been more reactive than proactive on the question of how best to ensure that today’s students are fully prepared for a fast-paced future.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Bologna process being adopted (slowly) in EU, the idea is to make academic degrees more interchangeable and understandable across the EU three elements * Qualification Frameworks (transnational, national, disciplinary). Frameworks are graduated, with increasing expertise and autonomy required for the upper levels. They sound like broad skills that we might recognize in the WSU CITR. Not clear how they are assessed * Tuning (benchmarking) process * Diploma Supplements (licensure, thesis, other capstone activities) these extend the information in the transcript. US equivalent might be the Kuali Students system for extending the transcript. Emerging dialog on American capability This dialog is coming from 2 directions * on campus * employers Connect to the Greater Exceptions (2000-2005) iniative. Concluded that American HE has islands of innovation. Lead to LEAP (Liberal Education and America's Promise) Initiative (2005-2015). The dialog is converging because of several forces * Changes in the balance of economic and political power. "The rise of the rest (of the world)" * Global economy in which innovation is key to growth and prosperity LEAP attempts to frame the dialog (look for LEAP in AACU website). Miami-Dade CC has announced a LEAP-derived covenant, the goals must span all aspects of their programs. Define liberal education Knowledge of human cultures and the physical and natural world intellectual and practical skills responsibility integrative skills Marker of success is (here is where the Transformative Gradebook fits in): evidence that students can apply the essential learning outcomes to complex, unscripted problems and real-world settings Current failure -- have not tracked our progress, or have found that we are not doing well. See AACU employer survey 5-10% percent of current graduates taking courses that would meet the global competencies (transcript analysis) See NSSE on Personal and social responsibility gains, less tha
  • Dr. Pan will also talk about strategies for breaking down cultural barriers.
    • Nils Peterson
      Nils Peterson on 24 Jan 09
       
      Pan. found a non-profit agency to be a conduit and coordinator to level the power between univ and grass roots orgs. helped with cultural gaps.
Theron DesRosier

School of Environmental Studies: Taking Class Outdoors | Edutopia - 0 views

www.edutopia.org/ses-video

theme based school environment

shared by Theron DesRosier on 14 Nov 08 - Cached
  • Theron DesRosier on 14 Nov 08
     
    School of Environmental Studies: Taking Class Outdoors At this Minnesota school focused on problem solving, the academic program and the architecture were designed to promote interdisciplinary project-based learning. More to this story.
Matthew Tedder

Turning Work into Play with Online Games | h+ Magazine - 0 views

hplusmagazine.com/...turning-work-play-online-games

education

shared by Matthew Tedder on 16 Jan 10 - Cached
  • Matthew Tedder on 16 Jan 10
     
    This is about games to improve employee work.
  • Matthew Tedder on 16 Jan 10
     
    This is about using online games to engage employees in work. This is very much the core of what I was talking about, except for education. For those more knowledgeable about software design: my thoughts so far were on using Google's V8 Javascript engine and a 3D engine, such as Ogre3D, perhaps wrapped by QT or SDL. The worlds would be managed on the server but code for each object type shipped to the clients and run, sychronized there. Everything would be an "object"--even a world itself (a container object). Each object would comprise of four code modules plus its media files (3D models, sounds, etc.): Affector -- this receives sensory input then filters and translates that to the object's internal properties. Intrinsor -- this is the object's behavioral programming. For example, it can be the functions of an espresso machine object or the AI and/or user-interface connector of an animate object, etc. Mitigator -- this is the code that controls the internal environment of any objects contained within this object. It mitigates the effects of contained objects to the affects of others. For example, a world object, a boat, a house, or a bag. The physics, weather, and such will depend on what they are contained within. The mitigator may also initiate effects to contained objects. Effector -- this provides the API for action attempts to the Intrinsor. It then filters and translates the action attempts to the objects actual action attempts that are read by this object's containor. (Yes--I mispelled some words above intentionally) This design provides a framework for a persistent world of decent individual performance. The V8 engine compiles to fast machine code (and caches). Only very minimal data need be communicated over the network. Objects can run in parallel precisely the same, so if a client fails the system continues. Updates of virtually any kind can be made on-the-fly without stopping the game. New object types will be relatively easy to b
Joshua Yeidel

Learn More about Pivot | Live Labs Pivot - 1 views

www.getpivot.com

visualization microsoft pivot

shared by Joshua Yeidel on 21 Apr 10 - Cached
  • Joshua Yeidel on 21 Apr 10
     
    "Pivot makes it easier to interact with massive amounts of data in ways that are powerful, informative, and fun. We tried to step back and design an interaction model that accommodates the complexity and scale of information rather than the traditional structure of the Web."
Theron DesRosier

Virtual-TA - 2 views

www.virtual-ta.com/how-we-do-it.php

virtual ta outsource assessment

shared by Theron DesRosier on 07 Apr 10 - Cached
  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  • Theron DesRosier on 07 Apr 10
     
    I went to Virtual TA and Highlighted their language describing how it works.
Kimberly Green

Would You Like Credit With That Internship? - Students - The Chronicle of Higher Education - 0 views

chronicle.com/...65434

learning

shared by Kimberly Green on 10 May 10 - Cached
  • Kimberly Green on 10 May 10
     
    Students pay tuition to work for free ... unpaid internships are growing in this down economy, favoring the wealthy who can afford them. But internships are generally valuable for students, administrators say. The complementary courses involve journals, essays, oral presentations, or work portfolios. Independent studies lean toward academics. Companies often see academic credit as substitute compensation that qualifies interns as legally unpaid trainees and keeps them on their colleges' liability insurance. Advertisements specify: "Candidates must be able to receive academic credit." That makes some campus officials bristle. "What they're saying is holding the institution hostage," says Kathy L. Sims, director of career services at the University of California at Los Angeles. Employers don't know colleges' academic standards, she says. "It's really not their call whether their experience is creditworthy." Colleges have dealt with that quandary in various ways. Some, especially those with traditions of experiential learning, vet and monitor internships, enrolling students in courses designed to complement their real-world work. Others let professors sponsor independent studies based on internships. More and more have devised some form of noncredit recognition to try to satisfy employers without altering academic philosophies or making students pay tuition to work free. At Bates College, the game is up. "We're quite adamant about our refusal to play along," says James W. Hughes, a professor of economics. As chairman of the department eight years ago, he got dozens of calls from students, parents, and employers asking for credit for unpaid internships, mainly in the financial industry. "Why is it that we have to evaluate this experience," he says, "just so some multibillion-dollar bank can avoid paying $7.50 an hour?" But the law is vague, and arguably antiquated. In the for-profit sector, guidelines for legally unpaid internships come from a 1947 U
Matthew Tedder

New York Launches Public School Curriculum Based on Playing Games | Popular Science - 0 views

www.popsci.com/...hool-based-games-set-nyc-debut

education

shared by Matthew Tedder on 17 Sep 09 - Cached
  • Matthew Tedder on 17 Sep 09
     
    hmm...
  • Matthew Tedder on 17 Sep 09
     
    This just reminds me that finding a way to make addictive games also educational is a holy grail of software design.
Gary Brown

Designing Effective Assessments: Q&A with Trudy Banta - 0 views

www.facultyfocus.com/...ssessments-qa-with-trudy-banta

institutional assessment program assessment assessment models

shared by Gary Brown on 16 Sep 09 - Cached
  • One-hundred forty-six assessment examples were sent to us, and we used all of those in one way or another in the book. I think it’s a pretty fair sample of what’s going on in higher education assessment. Yet most of the programs that we looked at had only been underway for two, three, or four years. When we asked what the long-term impact of doing assessment and using the findings to improve programs had been, in only six percent of the cases were the authors able to say that student learning had been improved.
  • Gary Brown on 16 Sep 09
     
    Though and advertisement for a workshop, Trudy Banta confirms our own suspicions. The blurb here further confirms that we need not look far for models--our energy will be better spent making our work at WSU a model.
Joshua Yeidel

Court fails Toronto professor's grading on a budget - 0 views

www.nationalpost.com/...story.html

higher_education pedagogy

shared by Joshua Yeidel on 30 Jun 09 - No Cached
  • Joshua Yeidel on 30 Jun 09
     
    "A University of Toronto professor who got students to grade their peers' work has seen the practice blocked by the Ontario Superior Court of Justice. The union that represents teaching assistants and sessional instructors at the university filed a grievance against the university when it discovered that psychology professor Steve Joordens was using specially designed software to have students grade and comment on one another's written work."
Nils Peterson

Google for Government? Broad Representations of Large N DataSets | Computational Legal ... - 0 views

computationallegalstudies.com/...tions-of-large-amounts-of-data

shared by Nils Peterson on 11 Apr 09 - Cached
  • We are just two graduate students working on a shoestring budget.
  • S Spaeth on 11 Apr 09
     
    We agree with both President Obama and Senator Coburn that universal accessibility of such information is worthwhile goal. However, we believe this is only a first step. In a deep sense, our prior post is designed to serve as a demonstration project. We are just two graduate students working on a shoestring budget. With the resources of the federal government, however, it would certainly be possible to create a series of simple interfaces designed to broadly represent of large amounts of information. While these interfaces should rely upon the best available analytical methods, such methods could probably be built-in behind the scenes. At a minimum, government agencies should follow the suggestion of David G. Robinson and his co-authors who argue the federal government "should require that federal websites themselves use the same open systems for accessing the underlying data as they make available to the public at large."
  • Nils Peterson on 12 Apr 09
     
    an interesting example of work with large data sets, but also, a research group that is working "off-shore" from their campus and in a blog in ways that seem to parallel WSUCTLT
Theron DesRosier

www.courseportflio.org - an international repository for documenting student learning - 0 views

www.courseportfolio.org/...index.jsp

shared by Theron DesRosier on 21 Sep 09 - Cached
  • Theron DesRosier on 21 Sep 09
     
    Home page: "The Peer Review of Teaching Project (PRTP) provides faculty with a structured and practical model that combines inquiry into the intellectual work of a course, careful investigation of student understanding and performance, and faculty reflection on teaching effectiveness. Begun in 1994, the PRTP has engaged hundreds of faculty members from numerous universities. In 2005, the project was awarded a TIAA-CREF Theodore M. Hesburgh Award Certificate of Excellence in recognition of it being an exceptional faculty development program designed to enhance undergraduate student achievement. "
Nils Peterson

Amazon.com: Data Flow: Visualising Information in Graphic Design: R. Klanten, N. Bourqu... - 0 views

www.amazon.com/...ref=cm_cr_pr_product_top

data design problem-representation

shared by Nils Peterson on 29 Mar 09 - No Cached
  • Nils Peterson on 29 Mar 09
     
    Found this via a review in PBK which says "haut couture" of info graphics
  • Corinna Lo on 07 Apr 09
     
    Here you can preview some of the pages in the book. http://www.gestalten.com/books/detail?id=ceaea7651adf9ba0011b78b89b9d0295
Gary Brown

News: Assessing the Assessments - Inside Higher Ed - 2 views

www.insidehighered.com/...vsa

assessment CLA VSA

shared by Gary Brown on 05 Nov 09 - Cached
  • The validity of a measure is based on evidence regarding the inferences and assumptions that are intended to be made and the uses to which the measure will be put. Showing that the three tests in question are comparable does not support Shulenburger's assertion regarding the value-added measure as a valid indicator of institutional effectiveness. The claim that public university groups have previously judged the value-added measure as appropriate does not tell us anything about the evidence upon which this judgment was based nor the conditions under which the judgment was reached. As someone familiar with the process, I would assert that there was no compelling evidence presented that these instruments and the value-added measure were validated for making this assertion (no such evidence was available at the time), which is the intended use in the VSA.
  • (however much the sellers of these tests tell you that those samples are "representative"), they provide an easy way out for academic administrators who want to avoid the time-and-effort consuming but incredibly valuable task of developing detailed major program learning outcome statements (even the specialized accrediting bodies don't get down to the level of discrete, operational statements that guide faculty toward appropriate assessment design)
  • f somebody really cared about "value added," they could look at each student's first essay in this course, and compare it with that same student's last essay in this course. This person could then evaluate each individual student's increased mastery of the subject-matter in the course (there's a lot) and also the increased writing skill, if any.
  • ...1 more annotation...
  • These skills cannot be separated out from student success in learning sophisticated subject-matter, because understanding anthropology, or history of science, or organic chemistry, or Japanese painting, is not a matter of absorbing individual facts, but learning facts and ways of thinking about them in a seamless, synthetic way. No assessment scheme that neglects these obvious facts about higher education is going to do anybody any good, and we'll be wasting valuable intellectual and financial resources if we try to design one.
  • Gary Brown on 05 Nov 09
     
    ongoing discussion of these tools. Note Longanecker's comment and ask me why.
Corinna Lo

Official Google Blog: Transparency, choice and control - now complete with a Dashboard! - 2 views

googleblog.blogspot.com/...cy-choice-and-control-now.html

google

shared by Corinna Lo on 06 Nov 09 - Cached
  • Corinna Lo on 06 Nov 09
     
    "In an effort to provide you with greater transparency and control over their own data, we've built the Google Dashboard. Designed to be simple and useful, the Dashboard summarizes data for each product that you use (when signed in to your account) and provides you direct links to control your personal settings. "
Joshua Yeidel

Skim | Home - 2 views

skim-app.sourceforge.net

pdf software mac opensource freeware

shared by Joshua Yeidel on 11 Nov 09 - Cached
  • Joshua Yeidel on 11 Nov 09
     
    "Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Stop printing and start skimming."
Bernad Carl

Functions - alloneword - Brisbane venue / bar / nightclub - 0 views

www.alloneword.com.au/brisbane-venue

Function Venues Brisbane

shared by Bernad Carl on 28 Aug 12 - No Cached
  • Bernad Carl on 28 Aug 12
     
    Situated in the upper end of Brunswick Street in Fortitude Valley (Brisbane), Alloneword offers an unrivalled function venue experience with two areas to choose from. With its open-air, or indoor booths designed for your privacy and comfort, Alloneword is the perfect destination for you to relax, unwind and appreciate the intimacy of this Brisbane bar.
Gary Brown

A New Digital Repository for Sociology Instructors - Wired Campus - The Chronicle of Hi... - 1 views

chronicle.com/...24313

SoTL

shared by Gary Brown on 27 May 10 - Cached
  • the leaders of the American Sociological Association—believe that it also helps if instructors bring to their lecture halls a well-designed syllabus and a decent idea of how to engage students with the material.
  • Materials will be assessed by peer-review committees for their fidelity to a set of principles of high-quality teaching that have been identified by the association.
  • Our goal for the peer-review process is not only to sort out which materials belong in the repository, but also to promote a conversation within the discipline about effective teaching and learning
  • ...2 more annotations...
  • include them in their tenure-and promotion portfolios.
  • As Ernest Boyer said, faculty reward systems will need to be revised in order for faculty members to truly be rewarded on the basis of their scholarship of teaching."
  • Gary Brown on 27 May 10
     
    Here's a repository in the making, and argument we have been making.
Gary Brown

Views: The White Noise of Accountability - Inside Higher Ed - 2 views

www.insidehighered.com/...adelman

accountability

shared by Gary Brown on 06 Aug 10 - Cached
  • We don’t really know what we are saying
  • “In education, accountability usually means holding colleges accountable for the learning outcomes produced.” One hopes Burck Smith, whose paper containing this sentence was delivered at an American Enterprise Institute conference last November, held a firm tongue-in-cheek with the core phrase.
  • Our adventure through these questions is designed as a prodding to all who use the term to tell us what they are talking about before they otherwise simply echo the white noise.
  • ...20 more annotations...
  • when our students attend three or four schools, the subject of these sentences is considerably weakened in terms of what happens to those students.
  • Who or what is one accountable to?
  • For what?
  • Why that particular “what” -- and not another “what”?
  • To what extent is the relationship reciprocal? Are there rewards and/or sanctions inherent in the relationship? How continuous is the relationship?
  • In the Socratic moral universe, one is simultaneously witness and judge. The Greek syneidesis (“conscience” and “consciousness”) means to know something with, so to know oneself with oneself becomes an obligation of institutions and systems -- to themselves.
  • Obligation becomes self-reflexive.
  • There are no external authorities here. We offer, we accept, we provide evidence, we judge. There is nothing wrong with this: it is indispensable, reflective self-knowledge. And provided we judge without excuses, we hold to this Socratic moral framework. As Peter Ewell has noted, the information produced under this rubric, particularly in the matter of student learning, is “part of our accountability to ourselves.”
  • But is this “accountability” as the rhetoric of higher education uses the white noise -- or something else?
  • in response to shrill calls for “accountability,” U.S. higher education has placed all its eggs in the Socratic basket, but in a way that leaves the basket half-empty. It functions as the witness, providing enormous amounts of information, but does not judge that information.
  • Every single “best practice” cited by Aldeman and Carey is subject to measurement: labor market histories of graduates, ratios of resource commitment to various student outcomes, proportion of students in learning communities or taking capstone courses, publicly-posted NSSE results, undergraduate research participation, space utilization rates, licensing income, faculty patents, volume of non-institutional visitors to art exhibits, etc. etc. There’s nothing wrong with any of these, but they all wind up as measurements, each at a different concentric circle of putatively engaged acceptees of a unilateral contract to provide evidence. By the time one plows through Aldeman and Carey’s banquet, one is measuring everything that moves -- and even some things that don’t.
  • Sorry, but basic capacity facts mean that consumers cannot vote with their feet in higher education.
  • If we glossed the Socratic notion on provision-of-information, the purpose is self-improvement, not comparison. The market approach to accountability implicitly seeks to beat Socrates by holding that I cannot serve as both witness and judge of my own actions unless the behavior of others is also on the table. The self shrinks: others define the reference points. “Accountability” is about comparison and competition, and an institution’s obligations are only to collect and make public those metrics that allow comparison and competition. As for who judges the competition, we have a range of amorphous publics and imagined authorities.
  • There are no formal agreements here: this is not a contract, it is not a warranty, it is not a regulatory relationship. It isn’t even an issue of becoming a Socratic self-witness and judge. It is, instead, a case in which one set of parties, concentrated in places of power, asks another set of parties, diffuse and diverse, “to disclose more and more about academic results,” with the second set of parties responding in their own terms and formulations. The environment itself determines behavior.
  • Ewell is right about the rules of the information game in this environment: when the provider is the institution, it will shape information “to look as good as possible, regardless of the underlying performance.”
  • U.S. News & World Report’s rankings
  • The messengers become self-appointed arbiters of performance, establishing themselves as the second party to which institutions and aggregates of institutions become “accountable.” Can we honestly say that the implicit obligation of feeding these arbiters constitutes “accountability”?
  • But if the issue is student learning, there is nothing wrong with -- and a good deal to be said for -- posting public examples of comprehensive examinations, summative projects, capstone course papers, etc. within the information environment, and doing so irrespective of anyone requesting such evidence of the distribution of knowledge and skills. Yes, institutions will pick what makes them look good, but if the public products resemble AAC&U’s “Our Students’ Best Work” project, they set off peer pressure for self-improvement and very concrete disclosure. The other prominent media messengers simply don’t engage in constructive communication of this type.
  • Ironically, a “market” in the loudest voices, the flashiest media productions, and the weightiest panels of glitterati has emerged to declare judgment on institutional performance in an age when student behavior has diluted the very notion of an “institution” of higher education. The best we can say is that this environment casts nothing but fog over the specific relationships, responsibilities, and obligations that should be inherent in something we call “accountability.” Perhaps it is about time that we defined these components and their interactions with persuasive clarity. I hope that this essay will invite readers to do so.
  • Clifford Adelman is senior associate at the Institute for Higher Education Policy. The analysis and opinions expressed in this essay are those of the author, and do not necessarily represent the positions or opinions of the institute, nor should any such representation be inferred.
  • Gary Brown on 06 Aug 10
     
    Perhaps the most important piece I've read recently. Yes must be our answer to Adelman's last challenge: It is time for us to disseminate what and why we do what we do.
Gary Brown

Details | LinkedIn - 0 views

www.linkedin.com/groupItem

accountability

shared by Gary Brown on 11 Sep 10 - No Cached
  • Although different members of the academic hierarchy take on different roles regarding student learning, student learning is everyone’s concern in an academic setting. As I specified in my article comments, universities would do well to use their academic support units, which often have evaluation teams (or a designated evaluator) to assist in providing boards the information they need for decision making. Perhaps boards are not aware of those serving in evaluation roles at the university or how those staff members can assist boards in their endeavors.
  • Gary Brown • We have been using the Internet to post program assessment plans and reports (the programs that support this initiative at least), our criteria (rubric) for reviewing them, and then inviting external stakeholders to join in the review process.
Nils Peterson

Half an Hour: Open Source Assessment - 0 views

halfanhour.blogspot.com/...open-source-assessment.html

Downes learning2.0 outcomes_assessment learning_community end_of_LMS

shared by Nils Peterson on 13 Sep 10 - Cached
  • When posed the question in Winnipeg regarding what I thought the ideal open online course would look like, my eventual response was that it would not look like a course at all, just the assessment.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      I remembered this Downes post on the way back from HASTAC. It is some of the roots of our Spectrum I think.
  • The reasoning was this: were students given the opportunity to attempt the assessment, without the requirement that they sit through lectures or otherwise proprietary forms of learning, then they would create their own learning resources.
  • In Holland I encountered a person from an organization that does nothing but test students. This is the sort of thing I long ago predicted (in my 1998 Future of Online Learning) so I wasn't that surprised. But when I pressed the discussion the gulf between different models of assessment became apparent.Designers of learning resources, for example, have only the vaguest of indication of what will be on the test. They have a general idea of the subject area and recommendations for reading resources. Why not list the exact questions, I asked? Because they would just memorize the answers, I was told. I was unsure how this varied from the current system, except for the amount of stuff that must be memorized.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      assumes a test as the form of assessment, rather than something more open ended.
  • ...8 more annotations...
  • As I think about it, I realize that what we have in assessment is now an exact analogy to what we have in software or learning content. We have proprietary tests or examinations, the content of which is held to be secret by the publishers. You cannot share the contents of these tests (at least, not openly). Only specially licensed institutions can offer the tests. The tests cost money.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      See our Where are you on the spectrum, Assessment is locked vs open
  • Without a public examination of the questions, how can we be sure they are reliable? We are forced to rely on 'peer reviews' or similar closed and expert-based evaluation mechanisms.
  • there is the question of who is doing the assessing. Again, the people (or machines) that grade the assessments work in secret. It is expert-based, which creates a resource bottleneck. The criteria they use are not always apparent (and there is no shortage of literature pointing to the randomness of the grading). There is an analogy here with peer-review processes (as compared to recommender system processes)
  • What constitutes achievement in a field? What constitutes, for example, 'being a physicist'?
  • This is a reductive theory of assessment. It is the theory that the assessment of a big thing can be reduced to the assessment of a set of (necessary and sufficient) little things. It is a standards-based theory of assessment. It suggests that we can measure accomplishment by testing for accomplishment of a predefined set of learning objectives.Left to its own devices, though, an open system of assessment is more likely to become non-reductive and non-standards based. Even if we consider the mastery of a subject or field of study to consist of the accomplishment of smaller components, there will be no widespread agreement on what those components are, much less how to measure them or how to test for them.Consequently, instead of very specific forms of evaluation, intended to measure particular competences, a wide variety of assessment methods will be devised. Assessment in such an environment might not even be subject-related. We won't think of, say, a person who has mastered 'physics'. Rather, we might say that they 'know how to use a scanning electron microscope' or 'developed a foundational idea'.
  • We are certainly familiar with the use of recognition, rather than measurement, as a means of evaluating achievement. Ludwig Wittgenstein is 'recognized' as a great philosopher, for example. He didn't pass a series of tests to prove this. Mahatma Gandhi is 'recognized' as a great leader.
  • The concept of the portfolio is drawn from the artistic community and will typically be applied in cases where the accomplishments are creative and content-based. In other disciplines, where the accomplishments resemble more the development of skills rather than of creations, accomplishments will resemble more the completion of tasks, like 'quests' or 'levels' in online games, say.Eventually, over time, a person will accumulate a 'profile' (much as described in 'Resource Profiles').
  • In other cases, the evaluation of achievement will resemble more a reputation system. Through some combination of inputs, from a more or less define community, a person may achieve a composite score called a 'reputation'. This will vary from community to community.
  • Nils Peterson on 13 Sep 10
     
    Fine piece, transformative. "were students given the opportunity to attempt the assessment, without the requirement that they sit through lectures or otherwise proprietary forms of learning, then they would create their own learning resources."
‹ Previous 21 - 40 of 71 Next › Last »
Showing 20▼ items per page