Skip to main content

Home/ ETAP640/ Group items tagged assessment

Rss Feed Group items tagged

5More

Assessment Design and Cheating Risk in Online Instruction - 0 views

  • It would be a mistake to minimize the problem of cheating in f2f classes. Four stylized facts emerge from a survey of the literature on cheating in f2f undergraduate courses. First, cheating by college students is considered widespread (McCabe and Drinan 1999). For example, estimates from five studies of college students reporting having cheated at least once during their college career range from 65% to 100% (Stearns 2001), and Whitley (1998) reports an average of 70% from a review of forty-six studies.   Second, cheating by college students is becoming more rather than less of a problem. Estimates from five studies of the percentage of college students cheating at least once in their college career have been steadily rising over the period 1940 to 2000 (Jensen, Arnett et al. 2002). A study administered in 1964 and replicated in 1994 focused on the incidence of serious cheating behaviors (McCabe, Trevion et al. 2001). This study reported that the incidence of serious cheating on written assignments was unchanged at 65-66%, but the incidence of serious cheating on exams increased from 39% to 64%.  Third, the format of assessment is correlated with cheating. Whitley (1998) reviewed 107 studies of cheating by students over the span of their college courses (published since 1970), and reported that from 10 studies a mean estimate of 47% for cheating by plagiarism, from 37 studies a mean estimate of 43% for cheating on exams, and from 13 studies a mean estimate of 41% for cheating on homework. Fourth, student characteristics of age and GPA are negatively correlated with cheating.  Whitley (1998) reviewed 107 studies on college cheating (published since 1970), and found 16 studies reporting a small negative correlation between GPA and cheating and 10 studies reporting a negative correlation between age and cheating.
  • In the growing literature about online instruction there are two opposing views on the integrity of assessments. One view is that cheating is as equally likely to occur in the f2f format as in the online format of instruction.
  • The alternative view is that proctored exams are the only way to protect the integrity of grades by guaranteeing both that a substitute is not taking the exam and that students are not working together on an exam.
  • ...1 more annotation...
  • Summary and Conclusions This study reports three principle findings.  First, from a survey of student opinion it is reported that 59% believe that the frequency of cheating is the same in both the online and the f2f instructional format. The proportion is significantly greater than 50% at the .05 level. It is also reported that the responses to the question of cheating and instructional format are significantly different depending on whether the student came from an online class or a f2f class, but only at a p-value of .1060.  Recalling the literature review in Table 1, which reported mixed findings by previous empirical studies, an interesting implication for future research is whether student experience with each instructional format influences student perceptions of differences in the frequency of cheating. Second, on proctoring and the frequency of cheating on essay exams and multiple choice exams, it is reported that roughly half of the respondents perceive unproctored assessments as having greater cheating risk than the same assessment in a proctored format, and half think they have equal cheating risk. These findings are consistent with the conventional perception that in a side by side comparison of two courses with comparable content and predominately multiple choice exam assessments, the course with unproctored exams is viewed as having greater cheating risk. Third, in our analysis of assessment design in 20 online courses it is reported that 70% base roughly half the course grade on unproctored multiple choice exams.     These findings imply that online courses, which have unproctored multiple choice exams, can reduce perceived cheating risk by proctoring some of their multiple choice exams without significantly altering the original mix of assessment types. Gresham’s Law suggests that online courses debased by assessment designs with high cheating risk will displace courses with relatively lower cheating risk. Institutions of higher education tone deaf to the issue of proctoring online multiple choice assessments may understandably find other institutions reluctant to accept these courses for transfer credit.  The benefit of proctoring is not without cost.  A proctored exam limits the spatial and the asynchronous dimensions of online instruction, which may have been the core reason the student enrolled in the online. These costs can be mitigated to some extent by early announcement of the time and date of the exam, by allowing for some flexibility of time of exam, and by permitting use of alternate certified proctoring centers. The costs to individual instructors are formidable but there are potentially significant economies of scale to be realized by integration of online courses with an existing system that administers proctoring of exams for f2f classes.  Proctoring of some multiple choice exam assessments will reduce cheating risk. The elephant in the room, however, is the cheating risk on non-exam unproctored assessments (for example term papers, essays, discussion, and group projects). These are widely used in f2f instruction and, as online instruction evolves, will likely become equally widely used in online courses. These assessments are valuable because they encourage learning by student-to-student and student-to-faculty interactions, and because they measure Bloom’s higher levels of learning. These assessments have higher cheating risk than proctored multiple choice exams. These assessments, more so than multiple choice exams, challenge the ability of faculty and administration to inspire students to behave ethically and to refrain from academic misconduct.
  •  
    Two views on online assessment. Student and teacher opinions on online assessment. How to reduce cheating.
5More

CL-1: Field-tested Learning Assessment Guide (FLAG): Assessment Primer (1 of 5) - 0 views

  • There is considerable evidence showing that assessment drives student learning. More than anything else, our assessment tools tell students what we consider to be important. They will learn what we guide them to learn through our assessments.
    • lkryder
       
      If you begin a course design with this in mind, and fold your feedback loops in carefully, students will know what matters and what to work at for success
  • Assessment is more than grades To many, the word "assessment" simply means the process by which we assign students grades. Assessment is much more than this, however. Assessment is a mechanism for providing instructors with data for improving their teaching methods and for guiding and motivating students to be actively involved in their own learning. As such, assessment provides important feedback to both instructors and students. Assessment is Feedback for Both Instructors and Students Assessment gives us essential information about what our students are learning and about the extent to which we are meeting our teaching goals. But the true power of assessment comes in also using it to give feedback to our students. Improving the quality of learning in our courses involves not just determining to what extent students have mastered course content at the end of the course; improving the quality of learning also involves determining to what extent students are mastering content throughout the course.
  • Assessment Drives Student Learning The types of assessment usually performed in first-year science, math, engineering, and technology (STEM) courses--giving students tests--merely inform students about their grade, or ranking, after they have received instruction. In addition, these common testing techniques--which typically test for fact-based knowledge and algorithmic problem solving--tell our students that this is the type of knowledge we think is most important. That is, we appear to value the understanding of concepts at a relatively low level. Given that this is the type of assessment our students most frequently encounter, and that it will eventually lead to their final course grades, students learn to study the content in our courses in an expeditious way that allows them to succeed in passing many first-year STEM courses without necessarily developing deep understanding of concepts. It is our assessment that drives students learning.
  •  
    The full primer for convenience
2More

REAP - Resources > Assessment Principles: Some possible candidates - 0 views

  • Table 1: Principles of good formative assessment and feedback. Help clarify what good performance is (goals, criteria, standards). To what extent do students in your course have opportunities to engage actively with goals, criteria and standards, before, during and after an assessment task? Encourage ‘time and effort’ on challenging learning tasks. To what extent do your assessment tasks encourage regular study in and out of class and deep rather than surface learning? Deliver high quality feedback information that helps learners self-correct. What kind of teacher feedback do you provide – in what ways does it help students self-assess and self-correct? Provide opportunities to act on feedback (to close any gap between current and desired performance) To what extent is feedback attended to and acted upon by students in your course, and if so, in what ways? Ensure that summative assessment has a positive impact on learning? To what extent are your summative and formative assessments aligned and support the development of valued qualities, skills and understanding. Encourage interaction and dialogue around learning (peer and teacher-student. What opportunities are there for feedback dialogue (peer and/or tutor-student) around assessment tasks in your course? Facilitate the development of self-assessment and reflection in learning. To what extent are there formal opportunities for reflection, self-assessment or peer assessment in your course? Give choice in the topic, method, criteria, weighting or timing of assessments. To what extent do students have choice in the topics, methods, criteria, weighting and/or timing of learning and assessment tasks in your course? Involve students in decision-making about assessment policy and practice. To what extent are your students in your course kept informed or engaged in consultations regarding assessment decisions? Support the development of learning communities To what extent do your assessments and feedback processes help support the development of learning communities? Encourage positive motivational beliefs and self-esteem. To what extent do your assessments and feedback processes activate your students’ motivation to learn and be successful? Provide information to teachers that can be used to help shape the teaching To what extent do your assessments and feedback processes inform and shape your teaching?
  •  
    a web resource with the REAP material in the JISC pdf for easier bookmarking
5More

educational-origami - 21st Century Assessment - 0 views

  • 21st Century Assessments are focused on both the learning process and the assessment outcome.
  • 21st Century Assessments are focused on both the learning process and the assessment outcome.
  • 21st Century Assessments are focused on both the learning process and the assessment outcome.
  • ...2 more annotations...
  • 21st Century Assessments are focused on both the learning process and the assessment outcome.
  • 21st Century Assessments are focused on both the learning process and the assessment outcome.
5More

Assessment and Online Teaching - 0 views

    • Jessica M
       
      "Assessment plays an important part in the learning process"
    • Jessica M
       
      "When designing learning programs, the assessment criteria and assessment constraints are usually key determinants of the teaching and learning strategies chosen"
    • Jessica M
       
      "Assessment for online is underpinned by the same principles of validity, reliability, flexibility and fairness, and uses many of the same strategies used in traditional face-to-face teaching (Booth, Clayton, Hyde, Hartcher & Hungar 2002). What differs mostly is the context of the assessment, the interactions between assessor and those being assessed, and collection and administration processes."
  • ...1 more annotation...
    • Jessica M
       
      "Assessment plays an important part in the learning process"
  •  
    "pedagogy advocating 'alternative assessment' in which assessment is integrated with learning process es and real - life performance as opposed to display of 'inert knowledge'."
1More

Red River College - Blackboard Exemplary Courses - 0 views

  •  
    To meet the challenge of decision making in client care, the nurse needs a comprehensive data base - gathering data is a prerequisite for problem solving and individualized interventions. Assessment is now a critical part of every nurse's practice, as all nursing decisions and actions are based on initial and ongoing assessments. Therefore it is extremely important for nursing students to develop excellent assessment skills. This blended course is designed to develop the cognitive processes and psychomotor skills necessary for conducting health assessments of healthy individuals. In other words, students learn how to gather data, what data to gather and what to do with the data once is has been gathered. Nursing students must understand what the expected assessment findings are for each system, before they can recognize any abnormalities that might be seen in clinical courses. To this extent, the students must complete the online theory portion of each unit prior to attending and practicing the skills on each other in the onsite lab component. This course prepares beginning practitioners to complete a health history as well as a head-to-toe physical assessment. These skills are essential for successful clinical practice.
4More

CL-1: Field-tested Learning Assessment Guide (FLAG): Assessment Primer (1 of 5) - 0 views

  • There is considerable evidence showing that assessment drives student learning. More than anything else, our assessment tools tell students what we consider to be important. They will learn what we guide them to learn through our assessments.
    • lkryder
       
      If you begin a course design with this in mind, and fold your feedback loops in carefully, students will know what matters and what to work at for success
  •  
    Using assessment for feedback loops in your course design
  •  
    I never start a course without reviewing this web site - especially the primer and the interactive tool for identifying CATs for curricular goals
9More

ITD Journal - 0 views

  • Teachers and students need assessment tools that connect to individual learning styles and provide key information to teachers. This information will help to guide instruction and allow students to connect with their unique learning style
    • Joan Erickson
       
      This sounds very vague to me. I would like to see concrete examples of this
  • assessment to provide feedback and adjustment for the instructional process
    • Joan Erickson
       
      Bingo!
  • Universal Design
  • ...4 more annotations...
  • assessment as a deliberate use of many methods to obtain evidence to indicate if students are meeting standards
  • Many of the premier online assessment vendors offer only rudimentary, machine scored true/false, or multiple-choice responses with automatic feedback or essay storage without scoring. Little research has been done to integrate the deep knowledge base we have of learning and assessment into future online assessment tools
  • diverse types of classroom assessments
  • Teachers using online assessment tools can better analyze and adjust teaching approaches based on real-time student assessment data only available through online assessment tools
8More

ScienceDirect - Educational Research Review : Peer assessment for learning from a socia... - 0 views

  • Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features
  • Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features
  • Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole
  • ...5 more annotations...
  • . Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole
  • Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole
  • Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole.
  • although peer assessment is a social process, interpersonal variables have hardly been studied; more specifically, they were measured in only 4 out of 15 studies.
  • Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features
1More

An evaluation of selected pedagogical attributes of online discussion boards - 0 views

  •  
    Paper lists learner centricity, asynchronous interaction, communication effectiveness and assessment facilitation as the major pedagogical attributes of online discussion boards. Also discusses the strategy of applying data mining techniques to aid assessment of discussion board transcripts. Text mining as an extension of data mining algorithm could be used effectively to assess discussion board transcripts with the goal of eliminating subjectivity in the assessment of discussion board contributions.
18More

The absolute basics about assessment - 0 views

  • assessment instruments or measures.)
    • Joan Erickson
       
      "assessment instruments or measures"----hmm, have to look it up. What are other assessment measures I can use?
  • analyze
    • Joan Erickson
       
      Don't forget to ask the students to give feedback
  • results
  • ...12 more annotations...
  • employ the results
    • Joan Erickson
       
      3 R's: results, reflect, refine
  • decide what skills, knowledge, and/or attitudes
  • Assessment is an ongoing process aimed at understanding and improving student learning
  • performance indicators
  • results
  • consider the results of your assessment.
  • results
  • results
  • results
  • results
  • reflection
  • refinement
5More

Student Self Assessment - 0 views

  • Student Self-AssessmentIntentionally involving your students in the assessment process helps students to become lifelong learners.  Peter Senge (2000) says, “A cornerstone of lifelong learning is the capacity for objective self-assessment – the ability to judge for yourself how well you are doing.”  Similarly, William McKeachie (2011) relates the importance of helping students become lifelong learners to faculty members who intentionally involve students in self-assessment:“After the course is over, students will not be able to depend on you to assess the quality of their learning.  If one of your goals is the development of lifelong learning skills, students need practice in self-assessment.
  • To encourage students to learn from past tests, faculty can assign a worksheet that asks students to look at more than the grade on the returned exam.  “Exam wrappers direct students to review and analyze their performance (and the instructor’s feedback) with an eye toward adapting their future learning” (Ambrose, et al, 2010).
  • Questions on an exam wrapper for a physics course might include the following:
  • ...2 more annotations...
  • Student Check Sheet for Literary Critical Essay
  • McKeachie, W. J., & Svinicki, M. D. (2005). McKeachie's teaching tips:  strategies, research and theory for college and university teachers. Boston: Houghton Mifflin.
1More

CTE - Peer-Assessment - 0 views

  •  
    Tools to help teachers assess student learning, such as using rubrics, designing effective test questions, and utilizing self-assessment and peer-assessment techniques.
1More

Purposes and Principles of Assessment - 0 views

  •  
    Describes forms of assessment, principles of assessment, and implications for assessment and course design.
3More

https://tspace.library.utoronto.ca/bitstream/1807/30005/1/The%20Reliability%2c%20Validi... - 0 views

    • Jessica M
       
       Most frequently heard is the claim that involving students in the assessment of their work, especially giving them opportunities  to contribute to the criteria on which that work will be judged, increases student engagement in assessment tasks. 
    • Jessica M
       
      Other teachers argue that self-assessment has distinctive features that warrant its use. For example, self-assessment provides information that is not easily determined, such as how much effort students expended in preparing for the task.
    • Jessica M
       
      Still others argue that students learn  more when they know that they will share  responsibility for the assessment of what they have learned. 
2More

http://spfk12.org/cms/lib07/NJ01001501/Centricity/Domain/9/Self-Assessment%20Through%20... - 0 views

    • Jessica M
       
      In the hands of students, a good rubric can orient learners to the concept of quality as defined by experts in a field, inform self- and peer assessment, and guide revision and improvement. Rubrics can be informative as well as evaluative.
    • Jessica M
       
      During self-assessment, students reflect on the quality of their work, judge the degree to which it reflects explicitly stated goals or criteria, and revise. Self-assessment is formative-students assess works in progress to find ways to improve their performance.
1More

Effective Online Instructional and Assessment Strategies - 1 views

  •  
    Describes effective online teaching strategies and forms of assessment. Lists benefits of online learning and assessments.
3More

Select or Design Assessments That Elicit Established Outcomes - 0 views

shared by Amy M on 22 Jun 12 - Cached
  • Clearly state the purpose for the assessment, and do not expect the assessment to meet purposes for which it was not designed.
  • Clearly define what it is you want to assess (the achievement target).
  •  
    Select or Design Assessments That Elicit Established Outcomes
1More

Archived: What Are Promising Ways to Assess Student Learning? - 0 views

  •  
    New forms of student assessment are designed to demonstrate what students are learning and what they can do with their knowledge. Known variously as "alternative" or "more authentic" measures, these assessments require students to "perform" in some way--by writing, demonstrating, explaining, or constructing a project or experiment--so they are also called "performance-based" tests.
2More

Authentic Assessment Toolbox - 0 views

    • Amy M
       
      This will help students build a foundation in assessment which they can then apply to badges.
  • The Authentic Assessment Toolbox site is a tutorial for learning all about authentic assessment. It is presented with hypertext and features creating authentic tasks, rubrics and standards for measuring and improving student learning. What is authentic assessment? Why do we need it? How do you do it? Answers to these questions as well as information on Standards, Rubrics, Portfolios, and Examples can be found here. Educators at all levels will find this site useful.
1 - 20 of 375 Next › Last »
Showing 20 items per page