In a study in which 43 experts evaluated 25 oncology grant applications submitted to the National Institutes of Health, the authors found lack of agreement between the experts for all dimensions of the evaluation, as well as large differences between experts in how they translated the number of strengths and weaknesses identified in their written critiques of the grant applications into an overall scientific impact score, highlighting the challenges of comparing evaluations of different applications by different reviewers.
Article #17-14379: "Low agreement among reviewers evaluating the same NIH grant applications," by Elizabeth L. Pier et al.
MEDIA CONTACT: Elizabeth L. Pier, University of Wisconsin-Madison, WI; tel: 617-838-0716; e-mail: <elizabeth.pier@gmail.com>
###