Group items tagged

This article provides a relatively compact, organized overview of the reasons and audiences for assessing teacher performance, followed by a review of various specific methods as actually practiced (mostly in the United States) and evaluating (meta-assessing?) these assessment methods. Despite being described as a "literature review," this reader found it to be more of an overview in general-few specific works of research are discussed. However, this reader will find its references section to be very useful as this project is continued.

Review of teacher appraisal practices.

Cao, M. (2014). Understanding learners' experience in MOOCs: a review of literature. Retrieved from http://repositories.lib.utexas.edu/handle/2152/26325 Abstract "MOOCs have become a popular topic in the educational field since 2008. This report reviews the literature from 2008 to March 2014 on the development of MOOCs with a focus on learners' experience. By looking into the topics researchers have been investigating, this review identifies eight themes on this topic: (1) Platforms and Technology, (2) Instructional Materials and Assessment, (3) Instructors, (4) Participants' demographics, (5) Motivation and Engagement Patterns, (6) Self-directed Learning and Learner Interaction, (7) Blended Education, and (8) Completion rates. The review also indicates that MOOC course design (pedagogies, technical support, assessment and instructors) and learner characteristics (motivation, engagement levels, self-directed learning and digital literacy) influence learners' experience. Possible future research questions are also proposed in this report." (p.1) This report is a literature review for a masters by a student at University of Texas at Austin. At the time of writing (March 2014) the author found relatively few references focusing on learners' experience in MOOCs from scholarly journals- 15 in total and she reported on them. These articles disproportionately analyzed cMOOCs as compared with xMOOCs and in both cases data was drawn from relatively early courses. Most references cover only one course. The report identifies 8 themes to categorize the articles' content: (1) Platforms and Technology, (2) Instructional Materials and Assessment, (3) Instructors, (4) Participants' demographics, (5) Motivation and Engagement Patterns, (6) Self-directed Learning and Learner Interaction, (7) Blended Education, and (8) Completion rates. Analysis shows that all these categories are inter-related and affect each other. The author identifies 5 areas for further r

I thought I could read my students' body language. I was wrong. As an experiment, I used Socrative when I taught binary numbers. What I learned forever changed my views on being a better teacher. Formative assessment is done as students are learning. Summative assessment is at the end (like a test). This is a very interesting link about some online (formative) assessment tools. Plickers looks very interesting.

Overview of teacher assessment by 3 Dutch scholars

Useful overview of teacher assessment as practiced in the UK circa 2009.

"While language learning and place-based learning linked to history, geography, sociology, and social studies are already available for such devices, the next developments are focused on using wearable devices linked to smartphones for self-assessment linked to a much wider range of learning. Imagine being a student four weeks away from final examinations in chemistry. What if your Apple Watch or smartphone asked you chemistry questions related to your course of study twice a day, every day for these four weeks? The daily feedback could help you focus review on topics you are weak in and reinforce your mastery of topics in which you are strong. These adaptive assessments are becoming more widely used and can be linked to open educational resources on the specific topics the student needs to master so as to aid their learning."

Study examining a failed (authors' conclusion) teacher assessment program in Ontario, circa 2000.

Ho, A. D., Reich, J., Nesterko, S., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2014). HarvardX and MITx: The first year of open online courses (HarvardX and MITx Working Paper No. 1). Retrieved from http://ssrn.com/abstract=2381263 The report analyzes in detail the interaction between the students and courses and draws conclusions based on the findings and suggests further research. One of the insights that makes MOOCs quite different than traditional classroom courses is the usage patterns. The authors pointed out that "[n]ew metrics, far beyond grades and course certification, are necessary to capture the diverse usage patterns in the data. A simple comparison of grades and viewed content shows thousands of users who fit a range of profiles. Of particular interest may be those students who accessed substantial course content but did not participate in assessments." (Ho, et al., 2014, p. 3.)

To Marian: I never really paid that much attention to MOOCs until you presented all this information on them. I suppose distance learning and MOOCs are the wave of the future. I am going to have to learn a lot more about MOOCs to understand where higher education may well be going -- at least at the undergraduate level.

Marian: We have an unusual culture where I work. If there is work, it comes with a price. We have many faculty who feel that they need to be paid a lot more to develop in this platform model. 100 students in a course is hard for them to imagine, but much of the grading can be automated. I would like to encourage the use of MOOCs for a few reasons, but I have two that are of value to the education industry. The first is students who are unsure of their educational goals can take advantage of the free or very low cost access to content to see if the path is for them. Second, there seems to be an opportunity for increased enrollment. This is an area that many institutions across the nation are struggling with. Having so much more online availability and larger classes could be part of the solution.

This paper discusses ethics and student assessment, as applicable to the growing field of distance education. Since we are all taking online courses I thought this would be a good share.

Great points made in this article about how difficult it is to know who is really completing the work in an online course or exam. So much to consider when the exams really matter in terms of professional advancement. I think of all the exams I had to sit for in Albany for New York State teacher licensing five years ago and there they fingerprint you when you take the exam to ensure that someone else is not taking it for you.

This is a great practical guide. I'm teaching my first online high school course this semester -- it's an experiment my superintendent is indulging -- and it's the kind of useful info I can use.

Project Spotlight Page 2 of 2 Sometimes it's Lafreniere providing that assistance, and sometimes it's a fellow student. The system generates a unique set of problems for each student, while ensuring that they are based on the same mathematical concept. That randomization means students can work collaboratively, helping each other understand the mathematical procedure without copying each others' work.

Despite the growing interest in 1:1 computing initiatives, relatively little empirical research has focused on the outcomes of these investments. The current special edition of the Journal of Technology and Assessment presents four empirical studies of K-12 1:1 computing programs and one review of key themes in the conversation about 1:1 computing among advocates and critics.

Babette Moeller & Tim Reitzes (2011) Education Development Center, Inc. (EDC). Integrating Technology with Student-Centered Learning. Quincy, MA: Nellie Mae Education Foundation. Retrieved from http://www.nmefoundation.org/getmedia/befa9751-d8ad-47e9-949d-bd649f7c0044/integrating The intent of this report is to detail the concepts of using technology with master of skills in mind. Beginning on page 17, details of assessment, advantages of technology-based assessment, mastery learning approach. Further they discuss the concepts of tools like clickers for quick feedback on levels of understanding and the details necessary for successful online learning - both synchronous and asynchronous.

Bill, I was somewhat surprised that the article includes a introductory headline: "Not surprising, 43 percent of students feel unprepared to use technology as they look ahead to higher education or their work life" without including some qualification as to why it's not surprising. If this comment is related to digital immigrants, learners disadvantaged by socioeconomic constraints and/or learners residing in remote locations lacking access to technology hardware, software and/or reliable Internet connection, the statement seems less surprising. As I read the article, the rationale for including the headline became clear - the article focuses on specific technology constraints related to many types of learners. The article outlines a plethora of opportunities to change educational paradigms that focus on the integration and utilization of technology-rich learning methodologies.

Turkish study on an appraisal/development program carried out experimentally in one school.

"Brown, B. B. (1966). Bringing Philosophy into the Study of Teacher Effectiveness. Journal Of Teacher Education, 17(1), 35-40. "

Suhr, K.A., Hernandez, D.A., Grimes, D., & Warschauer, M. (2010). Laptops and Fourth-Grade Literacy: Assisting the Jump over the Fourth-Grade Slump. Journal of Technology, Learning, and Assessment, 9(5).

Weston, M.E. & Bain, A. (2010). The End of Techno-Critique: The Naked Truth about 1:1 Laptop Initiatives and Educational Change. Journal of Technology, Learning, and Assessment, 9(6)

Reference Gasevic, D., Kovanovic, V. Joksimovic, S., Siemens, G. (2014). Where is Research on Massive Open Online Courses Headed ? A Data Analysis of the MOOC Research Initiative. The International Review of Research in Open and Distance Learning, 15(5), 135 -176. Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/1954/3111

Marian, this is an involved research report on MOOC research initiative! Specifically, the issue of low course completion and high degree of student attrition was often pronounced as the key challenge of MOOCs & that understanding factors that affect student engagement, completion and success in MOOCs is a complicated psychological process. Theory of planned behavior (TPB) - used to study behavioral change - in the study's case, changing students intention to complete a MOOC and thus, increase their likelihood of course completion - it remains to be seen to what extent a student's intention can be changed if the student did not have an intention to complete a MOOC in the first place. What would be a reason that could motivate a student to change their intention in cases when she/he only enrolled in a MOOC to access information provided without intentions to take any formal assessments? Side note - are you aware of (or have you already taken) ESC's EDU-681111 Metacognitive Analysis: U Albany & Empire State College MOOC? Also, you may be interested in reading this article - Beyond MOOCs: Is IT Creating a New, Connected Age? EDUCAUSE Sprint 2013.

Jordan, K. (2014). Initial trends in enrolment and completion of Massive Open Online Courses. International Review of Research in Open and Distance Learning, 15(1), 133-160. Retrieved from http://www.irrodl.org/index.php/irrodl/article/viewFile/1651/2813 Abstract "The past two years have seen rapid development of massive open online courses (MOOCs) with the rise of a number of MOOC platforms. The scale of enrolment and participation in the earliest mainstream MOOC courses has garnered a good deal of media attention. However, data about how the enrolment and completion figures have changed since the early courses is not consistently released. This paper seeks to draw together the data that has found its way into the public domain in order to explore factors affecting enrolment and completion. The average MOOC course is found to enroll around 43,000 students, 6.5% of whom complete the course. Enrolment numbers are decreasing over time and are positively correlated with course length. Completion rates are consistent across time, university rank, and total enrolment, but negatively correlated with course length. This study provides a more detailed view of trends in enrolment and completion than was available previously, and a more accurate view of how the MOOC field is developing." p.133 This is a peer reviewed article by a frequently cited author from the Open University who has set up for other researchers a MOOC Research Literature Browser that currently has 257 annotated research articles. It was written in 2013 using enrolment and completion data that was available on the Internet. It lists the data in a long table (for transparency) and shows in graphs enrolment and completion analysis. The article's main contribution is the aggregation of data for a large number of courses undertaken from 2011-2013 on 3 US based platforms, data not readily ava

We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a "harvester" account and then submits correct answers using a separate "master" account. We use "clickstream" learner data to detect CAMEO use among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1,237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses.

Recently, the usage of plagiarism detection software such as Turnitin® has increased dramatically among university instructors. At the same time, academic criticism of this software's employment has also increased. We interviewed 23 faculty members from various departments at a medium-sized, public university in the southeastern US to determine their perspectives on Turnitin® and student plagiarism.