Skip to main content

Home/ Learning Analytics/ Group items tagged evaluate

Rss Feed Group items tagged

Dianne Rees

Nuts and Bolts: How to Evaluate e-Learning by Jane Bozarth : Learning Solutions Magazine - 3 views

  • The linearity and causality implied within the taxonomy (for instance, the assumption that passing a test at Level 2 will result in improved job performance at Level 3) masks the reality of transferring training into measurable results. Many factors enable — or hinder — the transfer of training to on-the-job behavior change, including support from supervisors, rewards for improved performance, culture of the work unit, issues with procedures and paperwork, and political concerns
  • Robert Brinkerhoff takes a systems view of evaluation of training, believing it should focus on sustained performance rather than attempting to isolate the training effort:
  • learn best from the outliers
  • ...4 more annotations...
  • The method asks evaluators to: Identify individuals or teams that have been most successful in using some new capability or method provided through the training; Document the nature of the success; and Compare to instances of nonsuccess.
  • Stufflebeam
  • training as part of a system
  • a means of formative as well as summative evaluation.
  •  
    Evaluating training: some alternatives to the Kirkpatrick method
hansdezwart

http://www.ifets.info/journals/11_3/16.pdf - 0 views

  •  
    As the integration of community-centred teaching practices intensifies, an understanding of the types of relationships that manifest in this network and the associated impact on student learning is required. This paper explores the relationship between a student's position in a classroom social network and their reported level of sense of community. Quantitative methods, such as Rovai's (2002b) Classroom Community Scale and social network centrality measures, were incorporated to evaluate an individual's level of sense of community and their position within the classroom social network. Qualitative methods such as discussion forum content analysis and student interviews were adopted to clarify and further inform this relationship. The results demonstrate that the centrality measures of  closeness and  degrees are positive predictors of an individual's reported sense of community whereas,  betweenness indicates a negative correlation. Qualitative analyses indicate that an individual's pre-existing external social network influences the type of support and information exchanges an individual requires and therefore, the degree of sense of community ultimately experienced. The paper concludes by discussing future recommendations for teaching practices incorporating computer-mediated communications. 
Phillip Long

http://www.ifets.info/journals/17_4/4.pdf - 0 views

  •  
    Papamitsiou, Z., & Economides, A. (2014). Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence. Educational Technology & Society, 17 (4), 49-64. This paper aims to provide the reader with a comprehensive background for understanding current knowledge on Learning Analytics (LA) and Educational Data Mining (EDM) and its impact on adaptive learning. It constitutes an overview of empirical evidence behind key objectives of the potential adoption of LA/EDM in generic educational strategic planning. We examined the literature on experimental case studies conducted in the domain during the past six years (2008-2013). Search terms identified 209 mature pieces of research work, but inclusion criteria limited the key studies to 40. We analyzed the research questions, methodology and findings of these published papers and categorized them accordingly. We used non-statistical methods to evaluate and interpret findings of the collected studies. The results have highlighted four distinct major directions of the LA/EDM empirical research. We discuss on the emerged added value of LA/EDM research and highlight the significance of further implications. Finally, we set our thoughts on possible uncharted key questions to investigate both from pedagogical and technical considerations.
Dianne Rees

LeanLearning - learning_analytics - 1 views

  •  
    Kirkpatrick's method is just one approach to considering data from a training program
Tony Searl

U. of Texas Adopts Plan to Publish Performance Data on Professors and Campuses - Facult... - 2 views

  • help ensure that taxpayers are getting their money's worth
    • Tony Searl
       
      as I attempted to raise during LAK11, intent is critical. If LAK is primarily accountability driven, then more complex outcomes available IF questioning of data is deeper, may be missed (or ignored/buried/not sought)
  • Among other things, the system will report such factors as research expenditures, publications, teaching evaluations, and external support.
    • Tony Searl
       
      myschool is already developing into such a site. Insightful LAK, with holistic intention, not narow agendas, is preferable. Metrics, data, inclusions and questions need bipartisan support IF education is to be apolitical.
  • That was a swipe at the Texas Public Policy Foundation, a conservative think tank supported by Gov. Rick Perry that has advocated a controversial blueprint known as the "Seven Solutions" to higher education
    • Tony Searl
       
      Perry, potential president? Fascinating 2012 election
  • ...2 more annotations...
  • It also calls for a review system in which outside experts analyze the performance of individual colleges within the system's universities.
    • Tony Searl
       
      intent, questions asked, data deemed inclusive, all crucial for LAK outcomes. Enormous potential for misrepresentations exist IF analytics is poorly conceived and managed.
  • Mr. Powell said the database would allow students, parents, legislators, and others to easily examine detailed data about how different campuses and departments performed.
    • Tony Searl
       
      exact definition of intent of our 2 year old myschool data
  •  
    The plan unveiled on Thursday designates money to create a "dashboard"-an interactive, online database-to give students, parents, and legislators access to detailed measures of departments' and colleges' productivity and efficiency. Data on individual professors will probably also be included, although Dr. Cigarroa stressed that each campus would be able to develop its own system of metrics and the details have not yet been worked out
1 - 5 of 5
Showing 20 items per page