Editors' perspectives on the selection of reviewers and the quality of reviews

Abstract

This article describes the outcomes of a survey of 93 editors in chief and associate editors of behavior-analytic journals. We sought information about variables that influence their judgment of the selection of reviewers, selection of review panels, and quality of reviews. When selecting reviewers, participants rated highly expertise on the topic, history of conducting good reviews, and history of writing constructive and respectful reviews. When selecting review panels, participants rated highly stratifying reviewers based on their expertise, avoiding conflicts of interest, and the matching based on the area of expertise between reviewers and authors. When evaluating the quality of a review, participants rated highly considerations related to research design, the science underlying the main idea, and accurate interpretations of the data. Participants did not rate copyediting as important. Overall, the extent to which reviewer selection was influenced by membership in underrepresented groups varied. These findings can inform the development of training programs for teaching peer-review repertoires.