Skip to main content

Home/ CTLT and Friends/ Group items tagged assessment technology

Rss Feed Group items tagged

Theron DesRosier

Scottish Education blog: Assessment 2.0 - 0 views

  •  
    This matrix is a common representation of Web 2.0 assessment on the web. It attempts to connect web 2.0 tools with assessment. You've heard of e-learning 2.0, well here are some Web 2.0 technologies applied to assessment. The table seeks to show how teachers can use social software for assessment purposes.
Gary Brown

Schmidt - 3 views

  • There are a number of assessment methods by which learning can be evaluated (exam, practicum, etc.) for the purpose of recognition and accreditation, and there are a number of different purposes for the accreditation itself (i.e., job, social recognition, membership in a group, etc). As our world moves from an industrial to a knowledge society, new skills are needed. Social web technologies offer opportunities for learning, which build these skills and allow new ways to assess them.
  • This paper makes the case for a peer-based method of assessment and recognition as a feasible option for accreditation purposes. The peer-based method would leverage online communities and tools, for example digital portfolios, digital trails, and aggregations of individual opinions and ratings into a reliable assessment of quality. Recognition by peers can have a similar function as formal accreditation, and pathways to turn peer recognition into formal credits are outlined. The authors conclude by presenting an open education assessment and accreditation scenario, which draws upon the attributes of open source software communities: trust, relevance, scalability, and transparency.
  •  
    Kinship here, and familiar friends.
Gary Brown

Scholars Assess Their Progress on Improving Student Learning - Research - The Chronicle... - 0 views

  • International Society for the Scholarship of Teaching and Learning, which drew 650 people. The scholars who gathered here were cautiously hopeful about colleges' commitment to the study of student learning, even as the Carnegie Foundation winds down its own project. (Mr. Shulman stepped down as president last year, and the foundation's scholarship-of-teaching-and-learning program formally came to an end last week.) "It's still a fragile thing," said Pat Hutchings, the Carnegie Foundation's vice president, in an interview here. "But I think there's a huge amount of momentum." She cited recent growth in faculty teaching centers,
  • Mary Taylor Huber, director of the foundation's Integrative Learning Project, said that pressure from accrediting organizations, policy makers, and the public has encouraged colleges to pour new resources into this work.
  • The scholars here believe that it is much more useful to try to measure and improve student learning at the level of individual courses. Institutionwide tests like the Collegiate Learning Assessment have limited utility at best, they said.
  • ...6 more annotations...
  • Mr. Bass and Toru Iiyoshi, a senior strategist at the Massachusetts Institute of Technology's office of educational innovation and technology, pointed to an emerging crop of online multimedia projects where college instructors can share findings about their teaching. Those sites include Merlot and the Digital Storytelling Multimedia Archive.
  • "If you use a more generic instrument, you can give the accreditors all the data in the world, but that's not really helpful to faculty at the department level," said the society's president, Jennifer Meta Robinson, in an interview. (Ms. Robinson is also a senior lecturer in communication and culture at Indiana University at Bloomington.)
  • "We need to create 'middle spaces' for the scholarship of teaching and learning," said Randall Bass, assistant provost for teaching and learning initiatives at Georgetown University, during a conference session on Friday.
  • It is vital, Ms. Peseta said, for scholars' articles about teaching and learning to be engaging and human. But at the same time, she urged scholars not to dumb down their statistical analyses or the theoretical foundations of their studies. She even put in a rare good word for jargon.
  • No one had a ready answer. Ms. Huber, of the Carnegie Foundation, noted that a vast number of intervening variables make it difficult to assess the effectiveness of any educational project.
  • "Well, I guess we have a couple of thousand years' worth of evidence that people don't listen to each other, and that we don't build knowledge," Mr. Bass quipped. "So we're building on that momentum."
  •  
    Note our friends Randy Bass (AAEEBL) and Mary Huber are prominent.
Gary Brown

Program Assessment of Student Learning: July 2010 - 3 views

  • There are lots of considerations when considering a technology solution to the outcomes assessment process.  The first thing is to be very clear about what a system can and cannot do.  It CANNOT do your program assessment and evaluation for you!  The institution or program must first define the intended outcomes and performance indicators.  Without a doubt, that is the most difficult part of the process.  Once the indicators have been defined you need to be clear about the role of students and faculty in the use of the techology.  Also, who is the technology "owner"--who will maintain it, keep the outcomes/indicators current, generate reports, etc. etc.
  •  
    This question returns to us, so here is a resource and key to be able to point to.
Nils Peterson

It's Time to Improve Academic, Not Just Administrative, Productivity - Chronicle.com - 0 views

  •  
    Kimberly said of this: The focus on activity deals directly with the learning process - one that pushes students to take a more active role - while assessment supplies faculty members with the feedback necessary to diagnose and correct learning problems. Technology allows such active learning processes to be expanded to large courses and, as learning software and databases become better, to use faculty time more effectively. Relates to clickers and skylight learning activities/assessments, in the large class context, as well as the elusive LMS.
Nils Peterson

How Web-Savvy Edupunks Are Transforming American Higher Education | Page 3 | Fast Company - 0 views

  • If open courseware is about applying technology to sharing knowledge, and Peer2Peer is about social networking for teaching and learning, Bob Mendenhall, president of the online Western Governors University, is proudest of his college's innovation in the third, hardest-to-crack dimension of education: accreditation and assessment.
    • Nils Peterson
       
      Spoke too soon
  •  
    "We said, 'Let's create a university that actually measures learning,' " Mendenhall says. "We do not have credit hours, we do not have grades. We simply have a series of assessments that measure competencies, and on that basis, award the degree." WGU began by convening a national advisory board of employers, including Google and Tenet Healthcare. "We asked them, 'What is it the graduates you're hiring can't do that you wish they could?' We've never had a silence after that question." Then assessments were created to measure each competency area. Mendenhall recalls one student who had been self-employed in IT for 15 years but never earned a degree; he passed all the required assessments in six months and took home his bachelor's without taking a course.
Nils Peterson

Does having a computer at home improve results at school? | A World Bank Blog on ICT us... - 0 views

  • Does differential access to computer technology at home compound the educational disparities between and rich and poor? and Would a program of government provision of computers to early secondary school students reduce these disparities? In this case, Vigdor and Ladd found that the introduction of home computer technology is associated with modest but statistically significant and persistent negative impacts on student math and reading test scores. Further evidence suggests that providing universal access to home computers and high-speed internet access would broaden, rather than narrow, math and reading achievement gaps.
    • Nils Peterson
       
      so there is some contextualization of computers in the home that is also needed... as I find when my daughter wants to spend computer time dressing up Barbie.
  • A 2010 report from the OECD (Are New Millennium Learners Making the Grade? [pdf]) considers a number of studies, combined with new analysis it has done based on internationally comparable student achievement data (PISA), and finds that indeed that gains in educational performance are correlated with the frequency of computer use at home.
  • One way to try to make sense of all of these studies together is to consider that ICTs may function as a sort of 'amplifier' of existing learning environments in homes.  Where such environments are conducive to student learning (as a result, for example, of strong parental direction and support), ICT use can help; where home learning environments are not already strong (especially, for example, where children are left unsupervised to their own devices -- pun intended), we should not be surprised if the introduction of ICTs has a negative effect on learning.
  • ...1 more annotation...
  • On a broader note, and in response to his reading of the Vigdor/Ladd paper, Warschauer states on his insightful blog that the "aim of our educational efforts should not be mere access, but rather development of a social environment where access to technology is coupled with the most effective curriculum, pedagogy, instruction, and assessment."
    • Nils Peterson
       
      specific things need to be done to 'mobilize' the learning latent in the computing environment.
Lorena O'English

Effective Assessment in a Digital Age: A guide to technology-enhanced assessment and fe... - 1 views

  •  
    from JISC (pdf)
Kimberly Green

Commodification of Academic Research (Inside HIgher Ed) - 0 views

  •  
    This article provides an international view of the commodification of academic research, including this base line definition, from an email interview with Hans Radder, a professor of the philosophy of science and technology at Vrije Universiteit Amsterdam, Q: Academic research has always cost money to produce, and led to products that made money for others. How is the "commodification" of research different today than in past periods? A: Commodification means that all kinds of activities and their results are predominantly interpreted and assessed on the basis of economic criteria. In this sense, recent academic research is far more commodified than it was in the past. In general terms, one can say that the relation between "money" and specific academic activity has become much more direct. Consider the following examples: first, the amount of external funding acquired is often used as a measure of individual academic quality; second, specific assessments by individual scientists have a direct impact on departmental budgets; for instance, if I now pass this doctoral dissertation, my department receives a substantial sum of money; if not, it ends up with a budget deficit; third, the growing practice of patenting the results of academic research is explicitly aimed at acquiring commercial monopolies. Related to these financial issues are important and substantial changes of academic culture. Universities are increasingly being run as big corporations. They have a top-down command structure and an academic culture in which individual university scientists are forced to behave like mini-capitalists in order to survive, guided by an entrepreneurial ethos aimed at maximizing the capitalization of their knowledge.
S Spaeth

Matthews et al: Selecting influential members of social networks - 0 views

  •  
    Opinion leaders are influential members of their social networks, strategically selected for their ability to sway community norms. The aims of the study were to assess: 1) whether it is feasible to identify student opinion leaders (SOLs) and their social networks among Grade 11 students at two high schools in Cape Town, South Africa; and 2) whether these opinion leaders would be willing to be involved in an HIV/AIDS prevention program in their school. The students (N = 412) completed a semi-structured, anonymous, self-administered questionnaire. ... Of these, all but two at each school were willing and available to participate in a HIV/AIDS prevention program. ---------- Focuses on HIV/AIDS prevention but can we use principles in other contexts and Facebook recommendation tools to support the process?
  •  
    I've been thinking about how to support the development and visibility of SOLs using technology, without creating a creepy treehouse. How do we make them more visible and accessible?
Gary Brown

Encyclopedia of Educational Technology - 1 views

  • The revised taxonomy (Anderson and Krathwohl, 2001) incorporates both the kind of knowledge to be learned (knowledge dimension) and the process used to learn (cognitive process), allowing for the instructional designer to efficiently align objectives to assessment techniques. Both dimensions are illustrated in the following table that can be used to help write clear, focused objectives.
  • Teachers may also use the new taxonomy dimensions to examine current objectives in units, and to revise the objectives so that they will align with one another, and with assessments.
  • Anderson and Krathwohl also list specific verbs that can be used when writing objectives for each column of the cognitive process dimension.
  •  
    Bloom has not gone away, and this revision helps delimit the nominalist implications
Theron DesRosier

The Atlantic Century: Benchmarking EU and U.S. Innovation and Competitiveness | The Inf... - 1 views

  •  
    "ITIF uses 16 indicators to assess the global innovation-based competitiveness of 36 countries and 4 regions. This report finds that while the U.S. still leads the EU in innovation-based competitiveness, it ranks sixth overall. Moreover, the U.S. ranks last in progress toward the new knowledge-based innovation economy over the last decade."
Theron DesRosier

Virtual-TA - 2 views

  • We also developed a technology platform that allows our TAs to electronically insert detailed, actionable feedback directly into student assignments
  • Your instructors give us the schedule of assignments, when student assignments are due, when we might expect to receive them electronically, when the scored assignments will be returned, the learning outcomes on which to score the assignments, the rubrics to be used and the weights to be applied to different learning outcomes. We can use your rubrics to score assignments or design rubrics for sign-off by your faculty members.
  • review and embed feedback using color-coded pushpins (each color corresponds to a specific learning outcome) directly onto the electronic assignments. Color-coded pushpins provide a powerful visual diagnostic.
  • ...5 more annotations...
  • We do not have any contact with your students. Instructors retain full control of the process, from designing the assignments in the first place, to specifying learning outcomes and attaching weights to each outcome. Instructors also review the work of our TAs through a step called the Interim Check, which happens after 10% of the assignments have been completed. Faculty provide feedback, offer any further instructions and eventually sign-off on the work done, before our TAs continue with the remainder of the assignments
  • Finally, upon the request of the instructor, the weights he/she specified to the learning outcomes will be rubric-based scores which are used to generate a composite score for each student assignment
  • As an added bonus, our Virtual-TAs provide a detailed, summative report for the instructor on the overall class performance on the given assignment, which includes a look at how the class fared on each outcome, where the students did well, where they stumbled and what concepts, if any, need reinforcing in class the following week.
  • We can also, upon request, generate reports by Student Learning Outcomes (SLOs). This report can be used by the instructor to immediately address gaps in learning at the individual or classroom level.
  • Think of this as a micro-closing-of-the-loop that happens each week.  Contrast this with the broader, closing-the-loop that accompanies program-level assessment of learning, which might happen at the end of a whole academic year or later!
  •  
    I went to Virtual TA and Highlighted their language describing how it works.
Nils Peterson

Assessment and Teaching of 21st Century Skills ~ Stephen's Web ~ by Stephen Downes - 0 views

  • While people contemporary business work with others and use subject knowledge and a variety of technological tools and resources to analyze and solve complex, ill-structured problems or to create products for authentic audiences
    • Nils Peterson
       
      another quote in the report "The study found that as ICT is taken up by a firm,  computers substitute for workers who perform  routine physical and cognitive tasks but they complement workers who perform non‐routine  problem solving tasks. "
  •  
    Item Gary emailed around
Nils Peterson

Foreign Policy: The Next Big Thing: Personalized Education - 0 views

  • According to the analysis of business expert Clayton Christensen, personalized education is likely to begin outside formal school through a combination of entrepreneurial vendors on the one hand and ambitious students and parents on the other. Once far more efficient and effective education has been modeled in homes and clubs, those schools, communities, and/or societies that have the ambition, the means, and the willingness to take risks will follow suit.
  • Many more individuals will be well-educated because they will have learned in ways that suit them best. Even more importantly, these individuals will want to keep learning as they grow older because they have tasted success and are motivated to continue.
  • According to the analysis of business expert Clayton Christensen, personalized education is likely to begin outside formal school through a combination of entrepreneurial vendors on the one hand and ambitious students and parents on the other.
    • Nils Peterson
       
      That does seem right -- the system is unable to adapt and innovate and Christensen's Innovator's Dilemma seems to apply. But the previous paragraph, 'well programmed computers' seems to miss the collaborative, interpersonal, Web 2.0 potential for 1-1 tutoring.
  •  
    most of history, only the wealthy have been able to afford an education geared to the individual learner. For the rest of us, education has remained a mass affair, with standard curricula, pedagogy, and assessments. The financial crisis will likely change this state of affairs. With the global quest for long-term competitiveness assuming new urgency, education is on everyone's front burner. Societies are looking for ways to make quantum leaps in the speed and efficiency of learning. So long as we insist on teaching all students the same subjects in the same way, progress will be incremental. But now for the first time it is possible to individualize education-to teach each person what he or she needs and wants to know in ways that are most comfortable and most efficient, producing a qualitative spurt in educational effectiveness. In fact, we already have the technology to do so. Well-programmed computers-whether in the form of personal computers or hand-held devices-are becoming the vehicles of choice. They will offer many ways to master materials. Students (or their teachers, parents, or coaches) will choose the optimal ways of presenting the materials. Appropriate tools for assessment will be implemented.
Joshua Yeidel

Silverlight & WPF Chart - 0 views

  •  
    Visifire is a set of open source data visualization components - powered by Microsoft® Silverlight™ & WPF...Visifire can also be embedded in any webpage as a standalone Silverlight App. Visifire is independent of server side technology. It can be used with ASP, ASP.Net, PHP, JSP, ColdFusion, Ruby on Rails or just simple HTML. No radar charts, but for some things, this might be useful.
Theron DesRosier

How Smartphones and Handheld Computers Are Bringing on an Educational Revolution | Fast... - 0 views

  •  
    "As smartphones and handheld computers move into classrooms worldwide, we may be witnessing the start of an educational revolution. How technology could unleash childhood creativity -- and transform the role of the teacher. "
Joshua Yeidel

ILT - Nov 2009 issue - 0 views

  •  
    "In three issues for Inside Learning Technologies, Jane Hart shares the rpos and cons of building three types of social learning environment, and how to deliver them at low or no cost."
  •  
    Assessment is not even mentioned, but the series is still useful.
Nils Peterson

Clive Thompson on the New Literacy - 0 views

  • Lunsford is a professor of writing and rhetoric at Stanford University, where she has organized a mammoth project called the Stanford Study of Writing to scrutinize college students' prose. From 2001 to 2006, she collected 14,672 student writing samples—everything from in-class assignments, formal essays, and journal entries to emails, blog posts, and chat sessions.
    • Nils Peterson
       
      A new take on technology is hurting student's ability to write
  • "I think we're in the midst of a literacy revolution the likes of which we haven't seen since Greek civilization," she says. For Lunsford, technology isn't killing our ability to write. It's reviving it—and pushing our literacy in bold new directions.
  • Lunsford's team found that the students were remarkably adept at what rhetoricians call kairos—assessing their audience and adapting their tone and technique to best get their point across. The modern world of online writing, particularly in chat and on discussion threads, is conversational and public, which makes it closer to the Greek tradition of argument than the asynchronous letter and essay writing of 50 years ago. The fact that students today almost always write for an audience (something virtually no one in my generation did) gives them a different sense of what constitutes good writing. In interviews, they defined good prose as something that had an effect on the world.
    • Nils Peterson
       
      What if Cathy Davidson's rubric were changed from Not/Satisfactory to Would/would not have impact on the audience, or Useful to me/not useful
  • ...1 more annotation...
  • We think of writing as either good or bad. What today's young people know is that knowing who you're writing for and why you're writing might be the most crucial factor of all.
  •  
    The digital age appears to be reviving literacy... Good.
  •  
    The digital age is reviving literacy..
Gary Brown

The Profession: More Pressure on Faculty Members, From Every Direction - Almanac of Hig... - 2 views

shared by Gary Brown on 25 Aug 10 - Cached
  • Changes in the American professoriate’s employment patterns and types, demographics, and work life are the greatest we have seen in over half a century.
  • But averages obscure the widening salary ranges on campuses, particularly between presidents and faculty members
  • The drive toward institutional prestige that most professors consider a high priority at their four-year institutions has intensified the focus on research there.
  • ...4 more annotations...
  • Some faculty members, permanent and contingent, are expected to cover their full salaries with grants. With the tenure bottleneck narrowing, junior faculty members are often advised to focus on research, do a reasonable job of teaching, and avoid service.
  • Faculty members report spending more than half of their time on teaching and classroom-related activities. Professors are increasingly expected to use new technologies in both distance education and on-campus courses, and to be more systematic about assessing student learning at both course and program levels.
  • The scholarship of teaching and learning, in which faculty members examine the effects of their teaching strategies, is spreading; the advent of conferences and publications marks its increasing acceptance as serious scholarship.
  • The “corporatization” of institutional administrations in the face of fiscal distress and severe budget cuts imperils faculty governance, which falls increasingly to the shrinking number of permanent tenured faculty members.
  •  
    New realities rendered starkly.
  •  
    Note: A "premium content" article -- you must be a paid subscriber to see it, not just a registered site user.
1 - 20 of 28 Next ›
Showing 20 items per page