Skip to main content

Home/ ETAP640/ Group items tagged frequency

Rss Feed Group items tagged

5More

Assessment Design and Cheating Risk in Online Instruction - 0 views

  • It would be a mistake to minimize the problem of cheating in f2f classes. Four stylized facts emerge from a survey of the literature on cheating in f2f undergraduate courses. First, cheating by college students is considered widespread (McCabe and Drinan 1999). For example, estimates from five studies of college students reporting having cheated at least once during their college career range from 65% to 100% (Stearns 2001), and Whitley (1998) reports an average of 70% from a review of forty-six studies.   Second, cheating by college students is becoming more rather than less of a problem. Estimates from five studies of the percentage of college students cheating at least once in their college career have been steadily rising over the period 1940 to 2000 (Jensen, Arnett et al. 2002). A study administered in 1964 and replicated in 1994 focused on the incidence of serious cheating behaviors (McCabe, Trevion et al. 2001). This study reported that the incidence of serious cheating on written assignments was unchanged at 65-66%, but the incidence of serious cheating on exams increased from 39% to 64%.  Third, the format of assessment is correlated with cheating. Whitley (1998) reviewed 107 studies of cheating by students over the span of their college courses (published since 1970), and reported that from 10 studies a mean estimate of 47% for cheating by plagiarism, from 37 studies a mean estimate of 43% for cheating on exams, and from 13 studies a mean estimate of 41% for cheating on homework. Fourth, student characteristics of age and GPA are negatively correlated with cheating.  Whitley (1998) reviewed 107 studies on college cheating (published since 1970), and found 16 studies reporting a small negative correlation between GPA and cheating and 10 studies reporting a negative correlation between age and cheating.
  • In the growing literature about online instruction there are two opposing views on the integrity of assessments. One view is that cheating is as equally likely to occur in the f2f format as in the online format of instruction.
  • The alternative view is that proctored exams are the only way to protect the integrity of grades by guaranteeing both that a substitute is not taking the exam and that students are not working together on an exam.
  • ...1 more annotation...
  • Summary and Conclusions This study reports three principle findings.  First, from a survey of student opinion it is reported that 59% believe that the frequency of cheating is the same in both the online and the f2f instructional format. The proportion is significantly greater than 50% at the .05 level. It is also reported that the responses to the question of cheating and instructional format are significantly different depending on whether the student came from an online class or a f2f class, but only at a p-value of .1060.  Recalling the literature review in Table 1, which reported mixed findings by previous empirical studies, an interesting implication for future research is whether student experience with each instructional format influences student perceptions of differences in the frequency of cheating. Second, on proctoring and the frequency of cheating on essay exams and multiple choice exams, it is reported that roughly half of the respondents perceive unproctored assessments as having greater cheating risk than the same assessment in a proctored format, and half think they have equal cheating risk. These findings are consistent with the conventional perception that in a side by side comparison of two courses with comparable content and predominately multiple choice exam assessments, the course with unproctored exams is viewed as having greater cheating risk. Third, in our analysis of assessment design in 20 online courses it is reported that 70% base roughly half the course grade on unproctored multiple choice exams.     These findings imply that online courses, which have unproctored multiple choice exams, can reduce perceived cheating risk by proctoring some of their multiple choice exams without significantly altering the original mix of assessment types. Gresham’s Law suggests that online courses debased by assessment designs with high cheating risk will displace courses with relatively lower cheating risk. Institutions of higher education tone deaf to the issue of proctoring online multiple choice assessments may understandably find other institutions reluctant to accept these courses for transfer credit.  The benefit of proctoring is not without cost.  A proctored exam limits the spatial and the asynchronous dimensions of online instruction, which may have been the core reason the student enrolled in the online. These costs can be mitigated to some extent by early announcement of the time and date of the exam, by allowing for some flexibility of time of exam, and by permitting use of alternate certified proctoring centers. The costs to individual instructors are formidable but there are potentially significant economies of scale to be realized by integration of online courses with an existing system that administers proctoring of exams for f2f classes.  Proctoring of some multiple choice exam assessments will reduce cheating risk. The elephant in the room, however, is the cheating risk on non-exam unproctored assessments (for example term papers, essays, discussion, and group projects). These are widely used in f2f instruction and, as online instruction evolves, will likely become equally widely used in online courses. These assessments are valuable because they encourage learning by student-to-student and student-to-faculty interactions, and because they measure Bloom’s higher levels of learning. These assessments have higher cheating risk than proctored multiple choice exams. These assessments, more so than multiple choice exams, challenge the ability of faculty and administration to inspire students to behave ethically and to refrain from academic misconduct.
  •  
    Two views on online assessment. Student and teacher opinions on online assessment. How to reduce cheating.
21More

The Technology Source Archives - Seven Principles of Effective Teaching: A Practical Le... - 0 views

  • Instructors should provide clear guidelines for interaction with students.
  • Establish policies describing the types of communication that should take place over different channels.
  • Well-designed discussion assignments facilitate meaningful cooperation among students.
  • ...18 more annotations...
  • Set clear standards for instructors' timelines for responding to messages.
  • Discussions should be focused on a task.
  • Discussion groups should remain small.
  • Only at the end of all presentations did the instructor provide an overall reaction to the cases and specifically comment about issues the class identified or failed to identify. In this way, students learned from one another as well as from the instructor.
  • Tasks should always result in a product.
  • Tasks should engage learners in the content.
  • Learners should receive feedback on their discussions.
  • earners should be required to participate
  • Instructors should post expectations for discussions.
  • "information feedback" and "acknowledgement feedback."
  • Information feedback provides information or evaluation, such as an answer to a question, or an assignment grade and comments.
  • Acknowledgement feedback confirms that some event has occurred.
  • We found that instructors gave prompt information feedback at the beginning of the semester, but as the semester progressed and instructors became busier, the frequency of responses decreased, and the response time increased.
  • nstructors can still give prompt feedback on discussion assignments by responding to the class as a whole instead of to each individual student. In this way, instructors can address patterns and trends in the discussion without being overwhelmed by the amount of feedback to be given.
  • egularly-distributed deadlines encourage students to spend time on tasks and help students with busy schedules avoid procrastination. They also provide a context for regular contact with the instructor and peers.
  • Communicating high expectations for student performance is essential. One way for instructors to do this is to give challenging assignments.
  • Another way to communicate high expectations is to provide examples or models for students to follow, along with comments explaining why the examples are goo
  • Allowing students to choose project topics incorporates diverse views into online courses.
28More

Online Teaching Effectiveness: A Tale of Two Instructors | Gorsky | The International R... - 0 views

  • We propose, as have others (i.e., Shea, Pickett, & Pelz, 2003), that the community of inquiry model (Garrison, Anderson, & Archer, 2000) reflects the principles of good practice in undergraduate education and can accurately quantify them.
    • Irene Watts-Politza
       
      Go, Dr. Pickett!
  • issues of pedagogy, dialogue, and interaction
  • guide the coding of transcripts.
  • ...22 more annotations...
  • Social presence is the perceived presence of others in mediated communication (Rourke, Garrison, & Archer, 1999), which Garrison et al. (2000) contend supports both cognitive and teaching presence through its ability to instigate, to sustain, and to support interaction. It had its genesis in the work of John Dewey and is consistent with all theoretical approaches to learning in higher education.
  • Teaching presence is defined as “the design, facilitation and direction of cognitive and social processes for the purpose of realizing [students’] personally meaningful and educationally worthwhile outcomes” (Anderson et al., 2001, p.5). Vygotsky’s (1978) scaffolding analogies illustrate an assistive role for teachers in providing instructional support to students from their position of greater content knowledge. Although many authors recommend a “guide on the side” approach to moderating student discussions, a key feature of this social cognition model is the adult, the expert, or the more skilled peer who scaffolds a novice’s learning
  • Shea, Pickett, & Pelz , 2004
  • Each category of a tutor’s presence is vital to learning and to the establishment of the learning community; tutors' behavior must be such that they are seen to be “posting regularly, responding in a timely manner and modeling good online communication and interaction” (Palloff & Pratt, 2003, p.118). Without an instructor’s explicit guidance and “teaching presence,” students were found to engage primarily in “serial monologues” (Pawan et al., 2003). Baker (2004) discovered that “instructor immediacy, i.e., teaching presence (Rourke et al., 1999), was a more reliable predictor of effective cognitive learning than whether students felt close to each other. Studies have demonstrated that instructor participation in threaded discussion is critical to the development of social presence (Shea, Li, Swan, & Pickett, 2005; Swan & Shih, 2005) and sometimes not fully appreciated by online faculty (Liu, Bonk, Magjuka, Lee, & Su, 2005). Shea, Li, and Pickett (2006) proposed that teaching presence – viewed as the core role of the online instructor – is a promising mechanism for developing learning community in online environments.
  • students ranked instructor modeling as the most important element in building online community, while instructors ranked it fourth.
  • Shea (2006), who completed an extensive study of teaching presence and online learning, concluded that two categories (“design” and “directed facilitation”) sufficed to define the construct.
  • Kalman, Ravid, Raban, and Rafaeli (2006) argued that interactivity is an essential characteristic of effective online communication and plays an important role in keeping message threads and their authors together. Interactive communication (online as well as in traditional settings) is engaging, and loss of interactivity results in a breakdown of the communicative process.
  • Research indicates the existence of a relationship between learners’ perceptions of social presence and their motivation for participation in online discussions (Weaver & Albion, 2005).
  • Northrup (2002) found that online learners felt it was important for instructors to promote collaboration and conversation. When interactive activities are carefully planned, they lead not only to greater learning but also to enhanced motivation (Berge 1999; Northrup, 2002).
  • Researchers have suggested that timing of messages can serve as a proxy for a sense of social presence (Blanchard, 2004), as an indication of attentiveness (Walther & Bunz, 2005) or respect (Bargh & McKenna, 2004), and as a clue to the sociability of a community (Maloney-Krichmar & Preece, 2005). As such, the frequency of messages may serve as a signal for how engaged participants are with the community.
    • Irene Watts-Politza
       
      Agreed.
  • Eom found that the most significant factors for increasing student satisfaction with online classes are paying attention to students and responding to their concerns.
  • The highly esteemed instructor was especially active from semester midpoint to semester end; she more than doubled her active participation in both teaching presence (especially discourse and instruction) and social presence (all three categories).
  • the lack of specific, progressively structured inquiry tasks and/or the lack of facilitation skills (teaching presence/facilitating discourse) may have contributed to the relatively limited occurrences of cognitive presence.
  • something else accounted for the extreme satisfaction and dissatisfaction experienced by students in the two forums. The something else may be the two exceptional events that occurred during the third month: The instructor held in low esteem became nearly dysfunctional, while the highly esteemed instructor exhibited very high teacher presence and social presence (see Table 3 and 4).
  • Shea, Pickett, and Pelt (2003) found that students’ perceived teacher presence also correlates with perceived learning as well as with students’ satisfaction with the forum. This correlation points to the tentative conclusion that teaching presence affords learning by setting a convenient climate.
  • we suggest that students’ perceived learning in course forums has a significant impact on their participation
  • the table is suggestive of the eventual possibility of having an “objective” tool for evaluating the quality of a given forum.
  • (Anderson et al., 2001).
  • Teaching effectiveness may be defined as how an instructor can best direct, facilitate, and support students toward certain academic ends, such as achievement and satisfaction. Teaching effectiveness has been investigated extensively in traditional classrooms for more than seven decades (for a meta-analysis of empirical studies from 1995-2004, see Seidel & Shavelson, 2007). Over the past five years, research has become directed toward teaching effectiveness in online or virtual classes. As a preface to our study, we discuss findings and conclusions concerning teaching effectiveness in traditional classrooms.
  • Journal Help ISSN: 1492-3831 Journal Content Search All Authors Title Abstract Index terms Full Text Browse By Issue By Author By Title User Username Password Remember me Article Tools Abstract Print this article Indexing metadata How to cite item Review policy Email this article (Login required) Email the author (Login required) Post a Comment (Login required) Font Size Make font size smaller Make font size default Make font size larger SUBSCRIBE TO MAILING LIST 5,591  subscribers Select Language​▼ function googleTranslateElementInit() { new google.translate.TranslateElement({ pageLanguage: 'en', autoDisplay: false, layout: google.translate.TranslateElement.InlineLayout.SIMPLE }, 'google_translate_element'); } Home About Register Archives Announcements Resources Submissions http://www.irrodl.org/
  • One of the most widely cited sources for teacher effectiveness in traditional classrooms is Chickering and Gamson (1987), who suggested seven principles for good practice in undergraduate education.
  • encourages student-faculty contact, encourages cooperation among students, encourages active learning, gives prompt feedback, emphasizes time on task, communicates high expectations, respects diverse talents and ways of learning.
14More

Online Instructional Effort Measured through the Lens of Teaching Presence in the Commu... - 1 views

  • The focus of this paper is teaching presence, which has been defined as “the design, facilitation and direction of cognitive and social processes for the purpose of realizing personally meaningful and educationally worthwhile outcomes” (Garrison et al., 2000).
  • Instructor teaching presence is hypothesized to be an indicator of online instructional quality.  Empirical research has supported this view with evidence indicating strong correlations between the quality of teaching presence and student satisfaction and learning (Bangert, 2008; Picciano, 2002; Shea, Pickett, & Pelz, 2003)
  • First, there is a need to revisit two of the original three teaching presence elements.
  • ...10 more annotations...
  • The second limitation relates to design and organization (DE).
  • The third limitation relates to the locus of research investigating teaching presence which has been limited largely to threaded discussions.
  • Lastly, a careful review of the original teaching presence indicators developed by Anderson et al. (2001) reveals that they are largely reliant upon the threaded discussion activities of the instructor and thus fall short in identifying and articulating the full range of online collaborative tasks and effort demonstrated by both instructors and students.
  • If students’ perceptions indicate that they place a premium on instructor interaction (Anderson, 2003; Shea et al., 2006) instructors must actively manage students’ expectations about the nature of online learning and the role of the instructor in this process. Online instructors can accomplish this by taking the time to communicate that online courses are not teacher-centered models of learning and by explaining the rationale behind student-to-student interaction in negotiating shared meaning through discourse.
  • These results suggest that students’ teaching presence may have a “floor” threshold level and when the instructor's participation within the threaded discussion drops to zero students attempt to recreate “instructional equilibrium.”
  • When accounting for instructor teaching presence in all areas of a course, we see that there is a certain ebb and flow to teaching presence.
  • restricting analysis of teaching presence to discussion areas may present too narrow a view of individual instructor’s effort. Some instructors may take a strategic approach by participating in early discussions to model how to formulate probing questions and by providing direct feedback with the goal of withdrawing once this scaffolding is completed
  • These results also document a significant correlation between instructional effort reflected in frequency of teaching presence behaviors and learning outcomes evidence through instructor-assigned grades on closely related assignments. 
  • Where does teaching presence occur in online courses? 2. How do instructors employ communicative functionality within the course to   demonstrate teaching presence? 3. In what ways do students demonstrate teaching presence? 4. Does teaching presence shift over time? 5. Does teaching presence correlate with learning outcomes reflected in instructor-assigned grades?
  • In this study we found that the effectiveness of the instructor did not depend on participation within the threaded discussion per se, but that responsiveness and effective interaction with students was carried out through a variety of forums, including the ask-a-question area, email, and other modes of communication.  We suggest that benchmarks for effective interaction be communicated to instructors and that institutions provide training and support for online faculty around teaching presence. 
  •  
    With more than 4 million students enrolled in online courses in the US alone (Allen & Seaman, 2010), it is now time to inquire into the nature of instructional effort in online environments. Reflecting the community of inquiry (CoI) framework (Garrison, Anderson, & Archer, 2000) this paper addresses the following questions: How has instructor teaching presence (Anderson, Rourke, Garrison, & Archer, 2001) traditionally been viewed by researchers? What does productive instructor effort look like in an entire course, not just the main threaded discussion? Results suggest that conventional research approaches, based on quantitative content analysis, fail to account for the majority of teaching presence behaviors and thus may significantly under represent productive online instructional effort.
6More

The Technology Source Archives - Seven Principles of Effective Teaching: A Practical Le... - 0 views

  • Learners should be required to participate (and their grade should depend on participation). Discussion groups should remain small. Discussions should be focused on a task. Tasks should always result in a product. Tasks should engage learners in the content. Learners should receive feedback on their discussions. Evaluation should be based on the quality of postings (and not the length or number). Instructors should post expectations for discussions.
  • Lesson for online instruction: Instructors need to provide two types of feedback: information feedback and acknowledgment feedback.
  • We found that instructors gave prompt information feedback at the beginning of the semester, but as the semester progressed and instructors became busier, the frequency of responses decreased, and the response time increased.
  • ...3 more annotations...
  • Similarly, we found that instructors rarely provided acknowledgement feedback
  • The rationale was that many students needed flexibility because of full-time jobs. However, regularly-distributed deadlines encourage students to spend time on tasks and help students with busy schedules avoid procrastination.
  • Lesson for online instruction: Challenging tasks, sample cases, and praise for quality work communicate high expectations.
1 - 7 of 7
Showing 20 items per page