Skip to main content

Home/ CTLT and Friends/ Group items tagged learning design

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Nils Peterson

2009 Annual Meeting | Conference Program - 0 views

www.aacu.org/...program.cfm

shared by Nils Peterson on 22 Jan 09 - Cached
  • This session explores the notion that assessment for transformational learning is best utilized as a learning tool. By providing timely, transparent, and appropriate feedback, both to students and to the institution itself, learning is enhanced – a far different motive for assessment than is external accountability.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      need to get to these guys with our harvesting gradebook ideas...
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      decided to attend another session. Hersh was OK before lunch, but the talk by Pan looks more promising
  • Academic and corporate communities agree on the urgent need for contemporary, research-based pedagogies of engagement in STEM fields. Participants will learn how leaders from academic departments and institutions have collaborated with leaders from the corporate and business community in regional networks to ensure that graduates meet the expectations of prospective employers and the public.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      here is another session with links to CTLT work, both harvesting gradebook and the ABET work
  • Professor Pan will discuss the reflective teaching methods used to prepare students to recognize and mobilize community assets as they design, implement, and evaluate projects to improve public health.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Students tasked to learn about a community, ride the bus, make a Doc appt. Then tasked to do a non-clinical health project in that community (they do plenty of clinical stuff elsewhere in the program). Project must build capacity in the community to survive after the student leaves. Example. Work with hispanic parents in Sacramento about parenting issue, ex getting kids to sleep on time. Student had identified problem in the community, but first project idea was show a video, which was not capacity building. Rather than showing the video, used the video as a template and made a new video. Families were actors. Result was spanish DVD that the community could own. Pan thinks this is increased capacity in the community.
  • ...17 more annotations...
  • Freshman Survey annually examines the academic habits of mind of entering first-year students.  Along with academic involvement, the survey examines diversity, civic engagement, college admissions and expectations of college. 
  • The project aims to promote faculty and student assessment of undergraduate research products in relation to outcomes associated with basic research skills and general undergraduate learning principles (communication and quantitative reasoning, critical thinking, and integration and application of knowledge).
  • They focus educators on the magnitude of the challenge to prepare an ever-increasingly diverse, globally-connected student body with the knowledge, ability, processes, and confidence to adapt to diverse environments and respond creatively to the enormous issues facing humankind.
  • One challenge of civic engagement in the co-curriculum is the merging of cost and outcome: creating meaningful experiences for students and the community with small staffs, on small budgets, while still having significant, purposeful impact. 
  • a)claims that faculty are the sole arbiters of what constitutes a liberal education and b) counter claims that student life professionals also possess the knowledge and expertise critical to defining students’ total learning experiences.  
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      also, how many angels can dance on the head of a pin?
  • This session introduces a three-year national effort to document how colleges and universities are using assessment data to improve teaching and learning and to facilitate the dissemination and adoption of best practices in the assessment of college learning outcomes.
  • Exciting pedagogies of engagement abound, including undergraduate research, community-engaged learning, interdisciplinary exploration, and international study.  However, such experiences are typically optional and non-credit-bearing for students, and/or “on top of” the workload for faculty. This session explores strategies for integrating engaged learning into the institutional fabric (curriculum, student role, faculty role) and increasing access to these transformative experiences.
  • hands-on experiential learning, especially in collaboration with other students, is a superior pedagogy but how can this be provided in increasingly larger introductory classes? 
  • As educators seek innovative ways to manage knowledge and expand interdisciplinary attention to pressing global issues, as students and parents look for assurances that their tuition investment will pay professional dividends, and as alumni look for meaningful ways to give back to the institutions that nurtured and prepared them, colleges and universities can integrate these disparate goals through the Guilds, intergenerational membership networks that draw strength from the contributions of all of their members.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      see Theron's ideas for COMM.
  • Civic engagement learning derives its power from the engagement of students with real communities—local, national, and global. This panel explores the relationship between student learning and the contexts in which that learning unfolds by examining programs that place students in diverse contexts close to campus and far afield.
  • For institutional assessment to make a difference for student learning its results must result in changes in classroom practice. This session explores ways in which the institutional assessment of student learning, such as the Wabash National Study of Liberal Arts Education and the Collegiate Learning Assessment, can be connected to our classrooms.
  • Interdisciplinary Teaching and Object-Based Learning in Campus Museums
  • To address pressing needs of their communities, government and non-profit agencies are requesting higher education to provide education in an array of human and social services. To serve these needs effectively, higher educationneeds to broaden and deepen its consultation with practitioners in designing new curricula. Colleges and universities would do well to consider a curriculum development model that requires consultation not only with potential employers, but also with practitioners and supervisors of practitioners.
  • Should Academics be Active? Campuses and Cutting Edge Civic Engagement
  • If transformational liberal education requires engaging the whole student across the educational experience, how can colleges and universities renew strategy and allocate resources effectively to support it?  How can assessment be used to improve student learning and strengthen a transformational learning environment? 
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Purpose of university is not to grant degrees, it has something to do with learning. Keeling's perspective is that the learning should be transformative; changing perspective. Liberating and emancipatory Learning is a complex interaction among student and others, new knowledge and experience, event, own aspirations. learners construct meaning from these elements. "we change our minds" altering the brain at the micro-level Brain imaging research demonstrates that analogical learning (abstract) demands more from more areas of the brain than semantic (concrete) learning. Mind is not an abstraction, it is based in the brain, a working physical organ .Learner and the environment matter to the learning. Seeds magazine, current issue on brain imaging and learning. Segway from brain research to need for university to educate the whole student. Uses the term 'transformative learning' meaning to transform the learning (re-wire the brain) but does not use transformative assessment (see wikipedia).
  • But as public debates roil, higher education has been more reactive than proactive on the question of how best to ensure that today’s students are fully prepared for a fast-paced future.
    • Nils Peterson
      Nils Peterson on 22 Jan 09
       
      Bologna process being adopted (slowly) in EU, the idea is to make academic degrees more interchangeable and understandable across the EU three elements * Qualification Frameworks (transnational, national, disciplinary). Frameworks are graduated, with increasing expertise and autonomy required for the upper levels. They sound like broad skills that we might recognize in the WSU CITR. Not clear how they are assessed * Tuning (benchmarking) process * Diploma Supplements (licensure, thesis, other capstone activities) these extend the information in the transcript. US equivalent might be the Kuali Students system for extending the transcript. Emerging dialog on American capability This dialog is coming from 2 directions * on campus * employers Connect to the Greater Exceptions (2000-2005) iniative. Concluded that American HE has islands of innovation. Lead to LEAP (Liberal Education and America's Promise) Initiative (2005-2015). The dialog is converging because of several forces * Changes in the balance of economic and political power. "The rise of the rest (of the world)" * Global economy in which innovation is key to growth and prosperity LEAP attempts to frame the dialog (look for LEAP in AACU website). Miami-Dade CC has announced a LEAP-derived covenant, the goals must span all aspects of their programs. Define liberal education Knowledge of human cultures and the physical and natural world intellectual and practical skills responsibility integrative skills Marker of success is (here is where the Transformative Gradebook fits in): evidence that students can apply the essential learning outcomes to complex, unscripted problems and real-world settings Current failure -- have not tracked our progress, or have found that we are not doing well. See AACU employer survey 5-10% percent of current graduates taking courses that would meet the global competencies (transcript analysis) See NSSE on Personal and social responsibility gains, less tha
  • Dr. Pan will also talk about strategies for breaking down cultural barriers.
    • Nils Peterson
      Nils Peterson on 24 Jan 09
       
      Pan. found a non-profit agency to be a conduit and coordinator to level the power between univ and grass roots orgs. helped with cultural gaps.
Theron DesRosier

performance.learning.productivity: ID - Instructional Design or Interactivity Design in... - 1 views

charles-jennings.blogspot.com/...d-instructional-design-or.html

learning design

shared by Theron DesRosier on 01 Jun 10 - Cached
  • The vast majority of structured learning is content-rich and interaction-poor. That’s understandable in the context of a 20th century mindset and how learning professionals have been taught to develop ‘learning’ events. But it simply isn’t appropriate for today’s world.
  • Dr Ebbinghaus’ experiment revealed we suffer an exponential ‘forgetting curve’ and that about 50% of context-free information is lost in the first hour after acquisition if there is no opportunity to reinforce it with practice.
  • The need to become Interactivity Designers. That’s what they need to do.
  • ...1 more annotation...
  • We need designers who understand that learning comes from experience, practice, conversations and reflection, and are prepared to move away from massaging content into what they see as good instructional design. Designers need to get off the content bus and start thinking about, using, designing and exploiting learning environments full of experiences and interactivity.
  • Theron DesRosier on 01 Jun 10
     
    "Dr Ebbinghaus' experiment revealed we suffer an exponential 'forgetting curve' and that about 50% of context-free information is lost in the first hour after acquisition if there is no opportunity to reinforce it with practice."
Nils Peterson

Views: Changing the Equation - Inside Higher Ed - 1 views

www.insidehighered.com/...bassis

shared by Nils Peterson on 25 Mar 10 - Cached
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resources
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resource
  • But each year, after some gnashing of teeth, we opted to set tuition and institutional aid at levels that would maximize our net tuition revenue. Why? We were following conventional wisdom that said that investing more resources translates into higher quality and higher quality attracts more resources
  • ...19 more annotations...
  • year we strug
  • year we strug
  • those who control influential rating systems of the sort published by U.S. News & World Report -- define academic quality as small classes taught by distinguished faculty, grand campuses with impressive libraries and laboratories, and bright students heavily recruited. Since all of these indicators of quality are costly, my college’s pursuit of quality, like that of so many others, led us to seek more revenue to spend on quality improvements. And the strategy worked.
  • Based on those concerns, and informed by the literature on the “teaching to learning” paradigm shift, we began to change our focus from what we were teaching to what and how our students were learning.
  • No one wants to cut costs if their reputation for quality will suffer, yet no one wants to fall off the cliff.
  • When quality is defined by those things that require substantial resources, efforts to reduce costs are doomed to failure
  • some of the best thinkers in higher education have urged us to define the quality in terms of student outcomes.
  • Faculty said they wanted to move away from giving lectures and then having students parrot the information back to them on tests. They said they were tired of complaining that students couldn’t write well or think critically, but not having the time to address those problems because there was so much material to cover. And they were concerned when they read that employers had reported in national surveys that, while graduates knew a lot about the subjects they studied, they didn’t know how to apply what they had learned to practical problems or work in teams or with people from different racial and ethnic backgrounds.
  • Our applications have doubled over the last decade and now, for the first time in our 134-year history, we receive the majority of our applications from out-of-state students.
  • We established what we call college-wide learning goals that focus on "essential" skills and attributes that are critical for success in our increasingly complex world. These include critical and analytical thinking, creativity, writing and other communication skills, leadership, collaboration and teamwork, and global consciousness, social responsibility and ethical awareness.
  • despite claims to the contrary, many of the factors that drive up costs add little value. Research conducted by Dennis Jones and Jane Wellman found that “there is no consistent relationship between spending and performance, whether that is measured by spending against degree production, measures of student engagement, evidence of high impact practices, students’ satisfaction with their education, or future earnings.” Indeed, they concluded that “the absolute level of resources is less important than the way those resources are used.”
  • After more than a year, the group had developed what we now describe as a low-residency, project- and competency-based program. Here students don’t take courses or earn grades. The requirements for the degree are for students to complete a series of projects, captured in an electronic portfolio,
  • students must acquire and apply specific competencies
  • Faculty spend their time coaching students, providing them with feedback on their projects and running two-day residencies that bring students to campus periodically to learn through intensive face-to-face interaction
  • At the very least, finding innovative ways to lower costs without compromising student learning is wise competitive positioning for an uncertain future
  • As the campus learns more about the demonstration project, other faculty are expressing interest in applying its design principles to courses and degree programs in their fields. They created a Learning Coalition as a forum to explore different ways to capitalize on the potential of the learning paradigm.
  • a problem-based general education curriculum
  • After a year and a half, the evidence suggests that students are learning as much as, if not more than, those enrolled in our traditional business program
  • the focus of student evaluations has changed noticeably. Instead of focusing almost 100% on the instructor and whether he/she was good, bad, or indifferent, our students' evaluations are now focusing on the students themselves - as to what they learned, how much they have learned, and how much fun they had learning.
    • Nils Peterson
      Nils Peterson on 25 Mar 10
       
      gary diigoed this article. this comment shines another light -- the focus of the course eval shifted from faculty member to course & student learning when the focus shifted from teaching to learning
  • Gary Brown on 25 Mar 10
     
    A must read spotted by Jane Sherman--I've highlighed, as usual, much of it.
Nils Peterson

Half an Hour: Open Source Assessment - 0 views

halfanhour.blogspot.com/...open-source-assessment.html

Downes learning2.0 outcomes_assessment learning_community end_of_LMS

shared by Nils Peterson on 13 Sep 10 - Cached
  • When posed the question in Winnipeg regarding what I thought the ideal open online course would look like, my eventual response was that it would not look like a course at all, just the assessment.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      I remembered this Downes post on the way back from HASTAC. It is some of the roots of our Spectrum I think.
  • The reasoning was this: were students given the opportunity to attempt the assessment, without the requirement that they sit through lectures or otherwise proprietary forms of learning, then they would create their own learning resources.
  • In Holland I encountered a person from an organization that does nothing but test students. This is the sort of thing I long ago predicted (in my 1998 Future of Online Learning) so I wasn't that surprised. But when I pressed the discussion the gulf between different models of assessment became apparent.Designers of learning resources, for example, have only the vaguest of indication of what will be on the test. They have a general idea of the subject area and recommendations for reading resources. Why not list the exact questions, I asked? Because they would just memorize the answers, I was told. I was unsure how this varied from the current system, except for the amount of stuff that must be memorized.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      assumes a test as the form of assessment, rather than something more open ended.
  • ...8 more annotations...
  • As I think about it, I realize that what we have in assessment is now an exact analogy to what we have in software or learning content. We have proprietary tests or examinations, the content of which is held to be secret by the publishers. You cannot share the contents of these tests (at least, not openly). Only specially licensed institutions can offer the tests. The tests cost money.
    • Nils Peterson
      Nils Peterson on 13 Sep 10
       
      See our Where are you on the spectrum, Assessment is locked vs open
  • Without a public examination of the questions, how can we be sure they are reliable? We are forced to rely on 'peer reviews' or similar closed and expert-based evaluation mechanisms.
  • there is the question of who is doing the assessing. Again, the people (or machines) that grade the assessments work in secret. It is expert-based, which creates a resource bottleneck. The criteria they use are not always apparent (and there is no shortage of literature pointing to the randomness of the grading). There is an analogy here with peer-review processes (as compared to recommender system processes)
  • What constitutes achievement in a field? What constitutes, for example, 'being a physicist'?
  • This is a reductive theory of assessment. It is the theory that the assessment of a big thing can be reduced to the assessment of a set of (necessary and sufficient) little things. It is a standards-based theory of assessment. It suggests that we can measure accomplishment by testing for accomplishment of a predefined set of learning objectives.Left to its own devices, though, an open system of assessment is more likely to become non-reductive and non-standards based. Even if we consider the mastery of a subject or field of study to consist of the accomplishment of smaller components, there will be no widespread agreement on what those components are, much less how to measure them or how to test for them.Consequently, instead of very specific forms of evaluation, intended to measure particular competences, a wide variety of assessment methods will be devised. Assessment in such an environment might not even be subject-related. We won't think of, say, a person who has mastered 'physics'. Rather, we might say that they 'know how to use a scanning electron microscope' or 'developed a foundational idea'.
  • We are certainly familiar with the use of recognition, rather than measurement, as a means of evaluating achievement. Ludwig Wittgenstein is 'recognized' as a great philosopher, for example. He didn't pass a series of tests to prove this. Mahatma Gandhi is 'recognized' as a great leader.
  • The concept of the portfolio is drawn from the artistic community and will typically be applied in cases where the accomplishments are creative and content-based. In other disciplines, where the accomplishments resemble more the development of skills rather than of creations, accomplishments will resemble more the completion of tasks, like 'quests' or 'levels' in online games, say.Eventually, over time, a person will accumulate a 'profile' (much as described in 'Resource Profiles').
  • In other cases, the evaluation of achievement will resemble more a reputation system. Through some combination of inputs, from a more or less define community, a person may achieve a composite score called a 'reputation'. This will vary from community to community.
  • Nils Peterson on 13 Sep 10
     
    Fine piece, transformative. "were students given the opportunity to attempt the assessment, without the requirement that they sit through lectures or otherwise proprietary forms of learning, then they would create their own learning resources."
Theron DesRosier

Participatory Learning and the New Humanities: An Interview with Cathy Davidson | Acade... - 0 views

www.academiccommons.org/...ities-interview-cathy-davidson

digital humanities web2.0 pedagogy participatory social networking learning design

shared by Theron DesRosier on 05 Mar 09 - Cached
  • Theron DesRosier on 05 Mar 09
     
    "Participatory Learning includes the ways in which new technologies enable learners (of any age) to contribute in diverse ways to individual and shared learning goals. Through games, wikis, blogs, virtual environments, social network sites, cell phones, mobile devices, and other digital platforms, learners can participate in virtual communities where they share ideas, comment upon one another's projects, and plan, design, advance, implement, or simply discuss their goals and ideas together. Participatory learners come together to aggregate their ideas and experiences in a way that makes the whole ultimately greater than the sum of the parts."
  • S Spaeth on 09 Mar 09
     
    Theron helped me keep up with developments at HASTAC by socially sharing this bookmark and excerpt in the CTLT and Friends Group. I add this comment to acknowledge his contribution to my ongoing professional development. The comment function also gives me a link (perma?) to his bookmark.
Theron DesRosier

Virtual-TA - 2 views

www.virtual-ta.com/how-we-do-it.php

virtual ta outsource assessment

shared by Theron DesRosier on 07 Apr 10 - Cached
  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  • Theron DesRosier on 07 Apr 10
     
    I went to Virtual TA and Highlighted their language describing how it works.
Gary Brown

71 Presidents Pledge to Improve Their Colleges' Teaching and Learning - Faculty - The C... - 0 views

chronicle.com/...125285

accountability

shared by Gary Brown on 05 Nov 10 - No Cached
  • In a venture known as the Presidents' Alliance for Excellence in Student Learning and Accountability, they have promised to take specific steps to gather more evidence about student learning, to use that evidence to improve instruction, and to give the public more information about the quality of learning on their campuses.
  • The 71 pledges, officially announced on Friday, are essentially a dare to accreditors, parents, and the news media: Come visit in two years, and if we haven't done these things, you can zing us.
  • deepen an ethic of professional stewardship and self-regulation among college leaders
  • ...4 more annotations...
  • Beginning in 2011, all first-year students at Westminster will be required to create electronic portfolios that reflect their progress in terms of five campuswide learning goals. And the college will expand the number of seniors who take the Collegiate Learning Assessment, so that the test can be used to help measure the strength of each academic major.
  • "The crucial thing is that all of our learning assessments have been designed and driven by the faculty," says Pamela G. Menke, Miami Dade's associate provost for academic affairs. "The way transformation of learning truly occurs is when faculty members ask the questions, and when they're willing to use what they've found out to make change.
  • Other assessment models might point some things out, but they won't be useful if faculty members don't believe in them."
  • "In the long term, as more people join, I hope that the Web site will provide a resource for the kinds of innovations that seem to be successful," he says. "That process might be difficult. Teaching is an art, not a science. But there is still probably a lot that we can learn from each other."
Matthew Tedder

A New School Teaches Students Through Videogames | Popular Science - 1 views

www.popsci.com/...es-students-through-videogames

education

shared by Matthew Tedder on 11 Jan 10 - Cached
  • Matthew Tedder on 11 Jan 10
     
    Nothing more powerfully engages students than video games. It's just be very difficult finding ways to exploit this for educational purposes without destroying that affect in the process. My own best idea on the holy grail of a truly addictive game useful for very general and comprehensive educational purposes is an RTS game from an FPS perspective beginning the neolithic times, in a persistent world. A student would begin as a primitive man and gradually work his way toward inventing all the technologies of the modern world in building his civilization. He'd invent each tool by learning the physics and usefulness of it. Then he could add it to the village he founds to expand it. The village and eventual civilization would be, along with its annals, would be a e-portfolio (why the world needs to be persistent, not starting fresh each time the student logs on--he must always be building upon the foundations already established). The student would design the economic system, etc. and his "subjects" would follow the rules he stipulates. He could trade with the villages of others for items he might need to get ahead but cannot produce them himself until he learns the principles behind the technology. The population might be given needs also for entertainment, thus poetry, etc. for a more pacified people. Many ideas can be added within this framework. It's a student's own world in which he can feel safe and for which he should develop more interest as it continue to operation even when he is offline (to increase engagement). And being multiplayer can also provide the social aspect and teamwork for shared goals.... like say, building a trading route and defending it from bandits, investing materials for construction of a dam and irrigation... etc. I have a basic design to build the infrastructure for this. There wouldn't by chance be any grants out there that might apply?
  • Matthew Shirey on 11 Jan 10
     
    I really like this game idea. Seems like it would be a monster of an undertaking not just for the game engine itself, but more so for the content. Let me know if you get this one off the ground.
  • Matthew Tedder on 12 Jan 10
     
    I realized while writing this that it would be difficult to for education professionals to understand this concept. I should have known Shirey would get it. After so much experience in software, one starts to see two personality types--those who design software from a philosophical perspective and those who do so from an immediate, practical point of view. The philosophicals enjoy designing and writing new kinds of software. They are also the kind of people who tend to enjoy RTS games. The immediates struggle trying to write software from scratch, except for where they understand some pre-known framework for writing software of the particular class. They are more often relegated to debugging and tweaking software. These people tend to prefer FPS games. Systems administrators tend to fall more into this category, as well. It's a good complement, I think. I design and they maintain. Philosophicals tend not to be such good maintainers. Immediates tend to make good systems administrators, too. What this all suggests to me is that the only way non-philosophicals (the particular type I mean--don't use the term too generally) are unlikely to "get" the concept until the can see and use it. I would love to be proven wrong. I designed a framework that I think would make building it not so difficult or time consuming. But yes, building content is a chore. Therefore, the way I designed the framework is to allow run-time additions and modifications. That is, you can start simple and gradually add content over time. I think this makes sense in any case because as knowledge changes, so should educational content. Educational methods may also evolve. So I think it is very important that the mechanism for adding and editing be as easy to use as possible. This is where you want the input of non-software engineers.....even non-gamers.
Theron DesRosier

pagi: eLearning - 0 views

pagi.wikidot.com/elearning

citing CTLT

shared by Theron DesRosier on 02 Mar 09 - Cached
  • ePortfolio ePortfolios, the Harvesting Gradebook, Accountability, and Community (!!!) Harvesting gradebook Learning from the transformative grade book Implementing the transformed grade book Transformed gradebook worked example (!!) Best example: Calaboz ePortfolio (!!) Guide to Rating Integrative & Critical Thinking (!!!) Grant Wiggins, Authentic Education Hub and spoke model of course design (!!!) ePortfolio as the core learning application Case Studies of Electronic Portfolios for Learning
  • Theron DesRosier on 02 Mar 09
     
    Nils found this. It is a Spanish concept map on eLearning that includes CTLT and the Harvesting Gradebook.
Theron DesRosier

Aviation High School - 0 views

www.edutopia.org/dents-take-learning-new-levels

theme based school

shared by Theron DesRosier on 14 Nov 08 - Cached
  • Theron DesRosier on 14 Nov 08
     
    "In addition to core courses in math, science, language arts, and social studies, we offer electives such as art, environmental stewardship, forensics, Japanese, and science olympiad, plus a series of seminars focused on aviation and aerospace, including Aviation and the American Character, History of Aircraft Design, and Robotics. In each course, students complete projects that demonstrate a depth of understanding and skill related to our essential questions and schoolwide learning goals. The more complex projects are developed in collaboration with industry experts, such as a wing-design engineer, a transit planner, an Arctic researcher, and a local river-cleanup coalition. "
Nils Peterson

Building the Learning Design Community at Penn State - portfolio - 0 views

www.personal.psu.edu/...n-community-at-penn-state.html

shared by Nils Peterson on 13 Apr 09 - Cached
  • Learning Design. It's a superset of ID, encompassing not only ID, but instructional technology, systemic change, administration
    • Nils Peterson
      Nils Peterson on 13 Apr 09
       
      the key word is systemic change
Theron DesRosier

ePortfolios, the Harvesting Gradebook, Accountability, and Community | Penn State Learn... - 0 views

ets.tlt.psu.edu/...449

Harvesting_gradebook attention

shared by Theron DesRosier on 08 Jul 09 - Cached
  • Theron DesRosier on 08 Jul 09
     
    Penn State Learning Design Hub Link to the Harvesting Gradebook.
Nils Peterson

Stolen Knowledge - 3 views

www2.parc.com/...stolenknow.html

shared by Nils Peterson on 27 Oct 09 - Cached
  • This is certainly not a trivial challenge-particularly for schools. The workplace, where our work has been concentrated, is perhaps the easiest place to design because, despite the inevitable contradictions and conflict, it is rich with inherently authentic practice-with a social periphery that, as Orr's (1990) or Shaiken's (1990) work shows, can even supersede attempts to impoverish understanding. Consequently, people often learn, complex work skills despite didactic practices that are deliberately designed to deskill. Workplace designers (and managers) should be developing technology to honor that learning ability, not to circumvent it.
    • Nils Peterson
      Nils Peterson on 27 Oct 09
       
      Another John Seely Brown piece on Legitimate Peripheral Participation with interesting implications for our needs of professional development as OAI evolves. It also leads me back to Lave and Wenger so that I stop crediting JSB with the term.
Theron DesRosier

CDC Evaluation Working Group: Framework - 2 views

www.cdc.gov/framework.htm

evaluation cdc program_evaluation accountability

shared by Theron DesRosier on 02 Dec 09 - Cached
  • Framework for Program Evaluation
  • Purposes The framework was developed to: Summarize and organize the essential elements of program evaluation Provide a common frame of reference for conducting evaluations Clarify the steps in program evaluation Review standards for effective program evaluation Address misconceptions about the purposes and methods of program evaluation
  • Assigning value and making judgments regarding a program on the basis of evidence requires answering the following questions: What will be evaluated? (i.e. what is "the program" and in what context does it exist) What aspects of the program will be considered when judging program performance? What standards (i.e. type or level of performance) must be reached for the program to be considered successful? What evidence will be used to indicate how the program has performed? What conclusions regarding program performance are justified by comparing the available evidence to the selected standards? How will the lessons learned from the inquiry be used to improve public health effectiveness?
  • ...3 more annotations...
  • These questions should be addressed at the beginning of a program and revisited throughout its implementation. The framework provides a systematic approach for answering these questions.
  • Steps in Evaluation Practice Engage stakeholders Those involved, those affected, primary intended users Describe the program Need, expected effects, activities, resources, stage, context, logic model Focus the evaluation design Purpose, users, uses, questions, methods, agreements Gather credible evidence Indicators, sources, quality, quantity, logistics Justify conclusions Standards, analysis/synthesis, interpretation, judgment, recommendations Ensure use and share lessons learned Design, preparation, feedback, follow-up, dissemination Standards for "Effective" Evaluation Utility Serve the information needs of intended users Feasibility Be realistic, prudent, diplomatic, and frugal Propriety Behave legally, ethically, and with due regard for the welfare of those involved and those affected Accuracy Reveal and convey technically accurate information
  • The challenge is to devise an optimal — as opposed to an ideal — strategy.
  • Theron DesRosier on 02 Dec 09
     
    Framework for Program Evaluation by the CDC This is a good resource for program evaluation. Click through "Steps and Standards" for information on collecting credible evidence and engaging stakeholders.
Kimberly Green

Would You Like Credit With That Internship? - Students - The Chronicle of Higher Education - 0 views

chronicle.com/...65434

learning

shared by Kimberly Green on 10 May 10 - Cached
  • Kimberly Green on 10 May 10
     
    Students pay tuition to work for free ... unpaid internships are growing in this down economy, favoring the wealthy who can afford them. But internships are generally valuable for students, administrators say. The complementary courses involve journals, essays, oral presentations, or work portfolios. Independent studies lean toward academics. Companies often see academic credit as substitute compensation that qualifies interns as legally unpaid trainees and keeps them on their colleges' liability insurance. Advertisements specify: "Candidates must be able to receive academic credit." That makes some campus officials bristle. "What they're saying is holding the institution hostage," says Kathy L. Sims, director of career services at the University of California at Los Angeles. Employers don't know colleges' academic standards, she says. "It's really not their call whether their experience is creditworthy." Colleges have dealt with that quandary in various ways. Some, especially those with traditions of experiential learning, vet and monitor internships, enrolling students in courses designed to complement their real-world work. Others let professors sponsor independent studies based on internships. More and more have devised some form of noncredit recognition to try to satisfy employers without altering academic philosophies or making students pay tuition to work free. At Bates College, the game is up. "We're quite adamant about our refusal to play along," says James W. Hughes, a professor of economics. As chairman of the department eight years ago, he got dozens of calls from students, parents, and employers asking for credit for unpaid internships, mainly in the financial industry. "Why is it that we have to evaluate this experience," he says, "just so some multibillion-dollar bank can avoid paying $7.50 an hour?" But the law is vague, and arguably antiquated. In the for-profit sector, guidelines for legally unpaid internships come from a 1947 U
Gary Brown

News: Assessing the Assessments - Inside Higher Ed - 2 views

www.insidehighered.com/...vsa

assessment CLA VSA

shared by Gary Brown on 05 Nov 09 - Cached
  • The validity of a measure is based on evidence regarding the inferences and assumptions that are intended to be made and the uses to which the measure will be put. Showing that the three tests in question are comparable does not support Shulenburger's assertion regarding the value-added measure as a valid indicator of institutional effectiveness. The claim that public university groups have previously judged the value-added measure as appropriate does not tell us anything about the evidence upon which this judgment was based nor the conditions under which the judgment was reached. As someone familiar with the process, I would assert that there was no compelling evidence presented that these instruments and the value-added measure were validated for making this assertion (no such evidence was available at the time), which is the intended use in the VSA.
  • (however much the sellers of these tests tell you that those samples are "representative"), they provide an easy way out for academic administrators who want to avoid the time-and-effort consuming but incredibly valuable task of developing detailed major program learning outcome statements (even the specialized accrediting bodies don't get down to the level of discrete, operational statements that guide faculty toward appropriate assessment design)
  • f somebody really cared about "value added," they could look at each student's first essay in this course, and compare it with that same student's last essay in this course. This person could then evaluate each individual student's increased mastery of the subject-matter in the course (there's a lot) and also the increased writing skill, if any.
  • ...1 more annotation...
  • These skills cannot be separated out from student success in learning sophisticated subject-matter, because understanding anthropology, or history of science, or organic chemistry, or Japanese painting, is not a matter of absorbing individual facts, but learning facts and ways of thinking about them in a seamless, synthetic way. No assessment scheme that neglects these obvious facts about higher education is going to do anybody any good, and we'll be wasting valuable intellectual and financial resources if we try to design one.
  • Gary Brown on 05 Nov 09
     
    ongoing discussion of these tools. Note Longanecker's comment and ask me why.
Gary Brown

Views: The White Noise of Accountability - Inside Higher Ed - 2 views

www.insidehighered.com/...adelman

accountability

shared by Gary Brown on 06 Aug 10 - Cached
  • We don’t really know what we are saying
  • “In education, accountability usually means holding colleges accountable for the learning outcomes produced.” One hopes Burck Smith, whose paper containing this sentence was delivered at an American Enterprise Institute conference last November, held a firm tongue-in-cheek with the core phrase.
  • Our adventure through these questions is designed as a prodding to all who use the term to tell us what they are talking about before they otherwise simply echo the white noise.
  • ...20 more annotations...
  • when our students attend three or four schools, the subject of these sentences is considerably weakened in terms of what happens to those students.
  • Who or what is one accountable to?
  • For what?
  • Why that particular “what” -- and not another “what”?
  • To what extent is the relationship reciprocal? Are there rewards and/or sanctions inherent in the relationship? How continuous is the relationship?
  • In the Socratic moral universe, one is simultaneously witness and judge. The Greek syneidesis (“conscience” and “consciousness”) means to know something with, so to know oneself with oneself becomes an obligation of institutions and systems -- to themselves.
  • Obligation becomes self-reflexive.
  • There are no external authorities here. We offer, we accept, we provide evidence, we judge. There is nothing wrong with this: it is indispensable, reflective self-knowledge. And provided we judge without excuses, we hold to this Socratic moral framework. As Peter Ewell has noted, the information produced under this rubric, particularly in the matter of student learning, is “part of our accountability to ourselves.”
  • But is this “accountability” as the rhetoric of higher education uses the white noise -- or something else?
  • in response to shrill calls for “accountability,” U.S. higher education has placed all its eggs in the Socratic basket, but in a way that leaves the basket half-empty. It functions as the witness, providing enormous amounts of information, but does not judge that information.
  • Every single “best practice” cited by Aldeman and Carey is subject to measurement: labor market histories of graduates, ratios of resource commitment to various student outcomes, proportion of students in learning communities or taking capstone courses, publicly-posted NSSE results, undergraduate research participation, space utilization rates, licensing income, faculty patents, volume of non-institutional visitors to art exhibits, etc. etc. There’s nothing wrong with any of these, but they all wind up as measurements, each at a different concentric circle of putatively engaged acceptees of a unilateral contract to provide evidence. By the time one plows through Aldeman and Carey’s banquet, one is measuring everything that moves -- and even some things that don’t.
  • Sorry, but basic capacity facts mean that consumers cannot vote with their feet in higher education.
  • If we glossed the Socratic notion on provision-of-information, the purpose is self-improvement, not comparison. The market approach to accountability implicitly seeks to beat Socrates by holding that I cannot serve as both witness and judge of my own actions unless the behavior of others is also on the table. The self shrinks: others define the reference points. “Accountability” is about comparison and competition, and an institution’s obligations are only to collect and make public those metrics that allow comparison and competition. As for who judges the competition, we have a range of amorphous publics and imagined authorities.
  • There are no formal agreements here: this is not a contract, it is not a warranty, it is not a regulatory relationship. It isn’t even an issue of becoming a Socratic self-witness and judge. It is, instead, a case in which one set of parties, concentrated in places of power, asks another set of parties, diffuse and diverse, “to disclose more and more about academic results,” with the second set of parties responding in their own terms and formulations. The environment itself determines behavior.
  • Ewell is right about the rules of the information game in this environment: when the provider is the institution, it will shape information “to look as good as possible, regardless of the underlying performance.”
  • U.S. News & World Report’s rankings
  • The messengers become self-appointed arbiters of performance, establishing themselves as the second party to which institutions and aggregates of institutions become “accountable.” Can we honestly say that the implicit obligation of feeding these arbiters constitutes “accountability”?
  • But if the issue is student learning, there is nothing wrong with -- and a good deal to be said for -- posting public examples of comprehensive examinations, summative projects, capstone course papers, etc. within the information environment, and doing so irrespective of anyone requesting such evidence of the distribution of knowledge and skills. Yes, institutions will pick what makes them look good, but if the public products resemble AAC&U’s “Our Students’ Best Work” project, they set off peer pressure for self-improvement and very concrete disclosure. The other prominent media messengers simply don’t engage in constructive communication of this type.
  • Ironically, a “market” in the loudest voices, the flashiest media productions, and the weightiest panels of glitterati has emerged to declare judgment on institutional performance in an age when student behavior has diluted the very notion of an “institution” of higher education. The best we can say is that this environment casts nothing but fog over the specific relationships, responsibilities, and obligations that should be inherent in something we call “accountability.” Perhaps it is about time that we defined these components and their interactions with persuasive clarity. I hope that this essay will invite readers to do so.
  • Clifford Adelman is senior associate at the Institute for Higher Education Policy. The analysis and opinions expressed in this essay are those of the author, and do not necessarily represent the positions or opinions of the institute, nor should any such representation be inferred.
  • Gary Brown on 06 Aug 10
     
    Perhaps the most important piece I've read recently. Yes must be our answer to Adelman's last challenge: It is time for us to disseminate what and why we do what we do.
Gary Brown

Details | LinkedIn - 0 views

www.linkedin.com/groupItem

accountability

shared by Gary Brown on 11 Sep 10 - No Cached
  • Although different members of the academic hierarchy take on different roles regarding student learning, student learning is everyone’s concern in an academic setting. As I specified in my article comments, universities would do well to use their academic support units, which often have evaluation teams (or a designated evaluator) to assist in providing boards the information they need for decision making. Perhaps boards are not aware of those serving in evaluation roles at the university or how those staff members can assist boards in their endeavors.
  • Gary Brown • We have been using the Internet to post program assessment plans and reports (the programs that support this initiative at least), our criteria (rubric) for reviewing them, and then inviting external stakeholders to join in the review process.
Gary Brown

Learning Assessments: Let the Faculty Lead the Way - Measuring Stick - The Chronicle of... - 0 views

chronicle.com/...26779

assessment

shared by Gary Brown on 08 Sep 10 - No Cached
  • The barriers to faculty involvement in assessment have been extensively catalogued over the years. Promotion and tenure systems do not reward such work. Time is short and other agendas loom larger. Most faculty members have no formal training in assessment—or, for that matter, in teaching and course design. Given developments in K-12, there are concerns, too, about the misuse of data, and skepticism about whether assessment brings real benefits to learners.
  • Moreover, as Robin Wilson points out, some campuses have found ways to open up the assessment conversation, shifting the focus away from external reporting, and inviting faculty members to examine their own students’ learning in ways that lead to improvement.
  • Does engagement with assessment’s questions change the way a faculty member thinks about her students and their learning? How and under what conditions does it change what he does in his classroom—and are those changes improvements for learners? How does evidence—which can be messy, ambiguous, discouraging, or just plain wrong—actually get translated into pedagogical action? What effects—good, bad, or uncertain—might engagement in assessment have on a faculty member’s scholarship, career trajectory, or sense of professional identity?
  • Gary Brown on 08 Sep 10
     
    Hutchings is a critical leader in our work--good links to have available, too.
Gary Brown

Can We Promote Experimentation and Innovation in Learning as well as Accountability? In... - 0 views

www.academiccommons.org/...value-project-rhodes-interview

shared by Gary Brown on 18 Mar 09 - Cached
  • Theron DesRosier on 18 Mar 09
     
    he VALUE project comes into the middle of this tension, as it proposes to create frameworks (or metarubrics) that provide flexible criteria for making valid judgments about student work that might result from a wide range of assessments and learning opportunities, over time. In this interview, Terrel Rhodes, Director of the VALUE project and Vice President of the Association for American Colleges and Universities (AAC&U) describes the assumptions and goals behind the Project. He especially addresses how electronic portfolios serve those goals as the locus of evaluation by educators, providing frameworks for judgments tailored to local contexts but calibrated to "Essential Learning Outcomes," with broad significance for student achievement. The aims and ambitions of the VALUE Project have the potential to move us further down the road toward a more systematic engagement with the expansion of learning. -Randy Bass
  • Gary Brown on 18 Mar 09
     
    This paragraph is the one with the most interesting set of assumptions. There are implications about "validity" Bass notes earlier and the role of numbers as "less robust" rather than, say, an interesting and important ingredient in that conversation. Mostly though I see the designation that the rubrics are "too broad to be useful" as a flag that these are not really rubrics, but, well, flags...
1 - 20 of 42 Next › Last »
Showing 20▼ items per page