Group items tagged

STAR METRICS programme - "The first aim of the programme is to build a 'clean' database of all federally funded researchers in the United States ... Later on, the plan is to track patents, citations and other metrics of the research's impact. ... researchers' use of the Internet to communicate and publish will enable STAR METRICS to track the creation and transfer of knowledge properly for the first time"

The workshop centered on projects investigating or proposing new metrics, including the MESUR project, Eigenfactor, h-bar index, and PLoS ONE's article-level metrics.

The Public Library of Science (PLoS) is the first publisher to place transparent and comprehensive information about the usage and reach of published articles onto the articles themselves, so that the entire academic community can assess their value. We call these measures for evaluating articles 'Article-Level Metrics', and they are distinct from the journal-level measures of research quality that have traditionally been made available until now.

This is the first public version of the collective proposal led by C. Neylon to develop alternative metrics of scholarly output that wil combine measures of usage and re-use and social metrics (commenting, discussions, etc.) with citation and peer review metrics.

Evaluating scholars simply by tallying their citations is "like saying Britney Spears is the most important artist who ever existed because she's sold 50 million records," said Johan Bollen, an associate professor of informatics and computing at Indiana University at Bloomington, as he introduced a daylong workshop on academic metrics here on Wednesday.

AIP Publishing, a division of the American Institute of Physics (AIP), announces the launch of article-level metrics for its new, open access journal AIP Advances

"The term "altmetrics" is short for "alternative metrics." These are a range of nontraditional metrics that can be used to assess the impact that scholars have on research in their areas of study. They can include the number of article downloads, citation of research in online news/social media sources, Mendeley bookmarks (a web-based system for sharing and extracting information from PDFs and other electronic documents), and nontraditional forms of scholarship. "

STAR METRICS is a federal and university partnership which is developing an empirical framework to measure the outcomes of science investments and demonstrate the benefits of scientific investments to the public. The project is led by the National Institutes of Health (NIH) and the National Science Foundation (NSF) under the auspices of Office of Science and Technology Policy (OSTP).

An excellent overview of the profusion of measures and metrics, among other topics.

A project proposed by Cameron Neylon to convene (funders, publishers and individuals) and developers to develop useful research metrics that encourage more open usage and re-usage of research data.

Metrics collected by reference management software are especially intriguing because they offer a measure of active interest without requiring researchers to do anything more than what they are already doing. Scientists collect the papers they find interesting, take notes on them, and store the information in a place that is accessible and useful to them

"This new SPARC primer is designed to give campus leaders and other interested parties an overview of what ALMs are, why they matter, how they complement established utilities and metrics, and how they might be considered for use in the tenure and promotion process."

From the abstract: ", we propose a social framework based on crowdsourced annotations of scholars, designed to keep up with the rapidly evolving disciplinary and interdisciplinary landscape. We describe a system called Scholarometer, which provides a service to scholars by computing citation-based impact measures. This creates an incentive for users to provide disciplinary annotations of authors, which in turn can be used to compute disciplinary metrics. We first present the system architecture and several heuristics to deal with noisy bibliographic and annotation data. We report on data sharing and interactive visualization services enabled by Scholarometer. Usage statistics, illustrating the data collected and shared through the framework, suggest that the proposed crowdsourcing approach can be successful. Secondly, we illustrate how the disciplinary bibliometric indicators elicited by Scholarometer allow us to implement for the first time a universal impact measure proposed in the literature. Our evaluation suggests that this metric provides an effective means for comparing scholarly impact across disciplinary boundaries."

Incorporating web 2.0 behaviors (e.g. recommending, commenting, social bookmarking) into the array of valid reserch metrics is a long work in progress...

PLoS initiated a program to provide a series of metrics on the individual articles published in all the PLoS Journals.

IU Bloomington School of Informatics and Computing associate professor Johan Bollen and the National Information Standards Organization (NISO) will share the Mellon Foundation grant designed to build upon the Metrics from Scholarly Usage of Resources (MESUR) project that Bollen began in 2006

ReaderMeter adapts two popular impact metrics for authors (the H-Index [1] and the G-Index [2]) and redefines them using bookmarks instead of citations as an HR-Index and a GR-Index respectively: hover over the index values for an explanation of their meaning.

Bibliometric methods can be used to assess many types of impact. See the example from Science-Metrics and the Univeristy of Leiden Book of Abstracts.

uses coments, ratings, and recommendations metrics