RSS-Feed abonnieren
DOI: 10.1055/s-0043-1768032
Experience with “Select Crowd Review” in Peer Review for The Thoracic and Cardiovascular Surgeon: 1-Year Experience
![](https://www.thieme-connect.de/media/thoracic/202308/lookinside/thumbnails/10-1055-s-0043-1768032_0220236836oc-1.jpg)
Abstract
Objective To evaluate the experience with a new peer review method, “Select Crowd Review” (SCR): anonymized PDFs of manuscripts are accessible to a reviewer crowd via an online platform. It has access for 10 days to enter anonymized comments directly into the manuscript. A SCR-Editor summarizes the annotations, giving a recommendation. Both reviewed PDF and summary are sent back to authors. Upon submission, authors are given a choice to accept or decline SCR.
Design All manuscript submissions since introduction in July 2021 until July 2022 were analyzed regarding acceptance and quality. Manuscripts were sent to a crowd of 45 reviewers and regular double-blinded peer review at the same time. Efficiency and performance of the crowd's reviews were compared with those of regular review. For thoracic manuscripts, a crowd was not yet available.
Results SCR was accepted by the authors for 73/179 manuscripts (40.8%). After desk rejections, 51 cardiac manuscripts entered SCR. For five manuscripts, the crowd did not respond. In all remaining papers, the crowd's recommendation concurred with that of the normal reviewers. Regular peer review took up to 6 weeks. Twelve manuscripts underwent repeated SCR after revision. A median of 2 (0–9) crowd members sent in reviews. In revisions, average response was one reviewer responding.
Conclusion SCR encountered good acceptance by authors. As the first experience showed concordant recommendations compared with traditional review, we have extended SCR to thoracic manuscripts for more experience. SCR may become the sole review method for eligible manuscripts. Efficiency should be increased, especially for re-review of revisions.
Publikationsverlauf
Eingereicht: 24. Februar 2023
Angenommen: 24. Februar 2023
Artikel online veröffentlicht:
09. April 2023
© 2023. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Smith R. Peer review: a flawed process at the heart of science and journals. J R Soc Med 2006; 99 (04) 178-182
- 2 Hames I. The changing face of peer review. Sci Ed 2014; 1 (01) 9-12
- 3 Pontille D, Thorny D. From manuscript evaluation to article valuation: the changing technologies of journal peer review. Hum Stud 2015; 38 (01) 57-79
- 4 Horbach SPJMS, Halffman WW. The changing forms and expectations of peer review. Res Integr Peer Rev 2018; 3: 8
- 5 List B. Crowd-based peer review can be good and fast. Nature 2017; 546 (7656): 9
- 6 Gottardi R, Henning P, Bogensberger J, Heinemann MK. Experience with “Select Crowd Review” in peer review for The Thoracic and Cardiovascular Surgeon . PRC22–0506. Accessed February 24, 2023 at: https://peerreviewcongress.org/peer-review-congress-2022-program/
- 7 Heinemann MK, Gottardi R, Henning PT. “Select Crowd Review”: a new, innovative review modality for The Thoracic and Cardiovascular Surgeon. Thorac Cardiovasc Surg 2021; 69 (05) 387-388