Joseph Wade, Wadsworth Center, New York State Department of Health<\/p>\n
Ready to be implemented<\/p>\n
One year initially, but potentially indefinitely.<\/p>\n
We introduced an additional option<\/span> to incentivize authors to initiate peer review. As an alternative to requesting traditional formal evaluation of their preprint that could potentially be used by a journal, authors can request informal guidance<\/span> on how to further develop and improve the impact of their study before journal submission, to support a key reason that authors post preprints. We expect that this opportunity will encourage both preprint deposition and peer review as it provides a novel service<\/span> not formally available elsewhere. <\/p>\n We all know that low quality peer review has damaging consequences on science and scientists. High quality peer review requires a panel of experts with relevant experience covering both technical and conceptual aspects of the paper, as well as oversight to ensure thoroughness and professionalism of each review. For submissions to journals, an editor selects appropriate reviewers and oversees the quality of the reviews. Our proposal creates this valuable peer review process for preprints by having an author-selected Liaison Team assume these responsibilities. To ensure accountability and high quality, the Liaison Team is named, and we added that they meet key criteria<\/span> (see below). Ultimately, ensuring high quality peer review<\/span> will effectively curate preprints by segregating strong preprints from those that do not garner sufficient interest for review. Instead of providing an overall rating of the preprint, the Liaison Team will write a non- quantitative Impact Summary , given that a single rating cannot capture all aspects. The time taken to complete reviews will be monitored to ensure a timely process and identify reliable reviewers .<\/p>\n Instead of providing an overall rating of the preprint, the Liaison Team will write a non- quantitative Impact Summary<\/span>, given that a single rating cannot capture all aspects. <\/p>\n The time taken to complete reviews will be monitored to ensure a timely process and identify reliable reviewers<\/span> .<\/p>\n Our proposal is a collaboration between Dr. Joseph Wade and LSE<\/a>, and we are discussing the proposal with biorxiv\/medrxiv. Endorsement and collaboration with the NIH, NCBI and Open Access journals would increase value.<\/p>\n<\/div>\n<\/div>\n The current system of peer review is highly inefficient. Many papers are rejected from at least one journal, and are re-reviewed at each journal. Reviews and the authors\u2019 responses are rarely made public. A few journals allow authors to transfer reviews from previous submissions, and in the case of eLife, authors can have reviews attached to a preprint. However, there is no widely adopted system to review preprints.<\/a><\/p>\n The goal is to create a widely adopted system for peer review of preprints. The key part is \u201cwidely adopted\u201d, since preprint review processes already exist but are rarely used.<\/p>\n A preprint review portal that is directly linked from preprint servers during the preprint submission process. Authors would suggest up to five possible editors, who would be contacted by email. If an editor agrees to handle a paper, their role would be to recruit three reviewers and to ensure that those reviewers post a review through the review portal. Authors then have the opportunity to respond to the reviews and to submit a revised manuscript to the preprint server.<\/p>\n Create a website that authors are directed to (with the option to decline) when uploading a preprint. The authors would then provide a list of possible \u201ceditors\u201d, who would be emailed automatically to ask if they would be willing to handle the paper. The first editor to accept would be chosen. The editor would be responsible for identifying peer reviewers, and soliciting 3+ reviews. Reviewers would be selected through the website by the editor, and would submit their reviews through the website. The editor would accept the reviews, or reject them in rare cases where they are inappropriate. The reviews would then be available for the authors to read \u2013 the editor\u2019s role is simply to solicit reviews, not assess them, although there could be an option for the editor to write a 2-3 sentence \u201cimpact summary\u201d. Reviews would be posted to the preprint server alongside the paper, and the authors would have the option to upload a response letter with a revised version of the paper.<\/p>\n In the initial period (1 year?), there would be no incentive for editors and reviewers. However, after the initial period there would be a credit system. All authors are given a certain number of free review credits, e.g. credit for reviews of three papers. Without credits, a review could not be requested. Editors and reviewers would gain credits for their service. This is a key difference from services like Review Commons that require professional editors, and presumably will require payment.<\/p>\n A web-based portal for preprint peer review is essential, and this needs to be integrated within the existing preprint websites to maximize author buy-in. It could simply be a link to an external site, with a system to post editor-approved reviews on the preprint site, alongside the associated papers. There are currently sites that facilitate preprint peer review, but they are rarely used, and are not linked to the preprint upload process.<\/p>\n Ideally, the project would get buy-in from journals, since I anticipate that many authors will want to transfer the reviews to a journal submission. Ultimately, I foresee a world where people only publish on preprint servers, but initially, journals would need to agree to use peer reviews acquired through the preprint peer review pipeline.<\/p>\n<\/div>\n<\/div>\n Paying authors, reviewers, and editors, would certainly promote buy-in, and would be fairly cheap. The system would require a website that would need to be designed and maintained.<\/p>\n","protected":false},"excerpt":{"rendered":" Organizer Joseph Wade, Wadsworth Center, New York State Department of Health Website or social media links @wadelab Current stage of development Ready to be implemented Project duration One year initially, […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[48],"tags":[],"class_list":["post-3402","post","type-post","status-publish","format-standard","hentry","category-preprint-sprint-proposals"],"acf":[],"_links":{"self":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3402","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/comments?post=3402"}],"version-history":[{"count":1,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3402\/revisions"}],"predecessor-version":[{"id":4456,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3402\/revisions\/4456"}],"wp:attachment":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/media?parent=3402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/categories?post=3402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/tags?post=3402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Have you integrated any feedback received?<\/h4>\n
\n
\n
Have you started any collaborations?<\/h4>\n
<\/a>Project aims<\/h2>\n
Background information on current practices<\/h3>\n
<\/a>Overview of the challenge to overcome<\/h3>\n
The ideal outcome or output of the project<\/h3>\n
<\/a>Description of the intervention<\/h3>\n
<\/a>Plan for monitoring project outcome<\/h3>\n
\n
<\/a>What\u2019s needed for success<\/h3>\n
<\/a>Additional technology development<\/h4>\n
<\/a>Feedback, beta testing, collaboration, endorsement<\/h4>\n
<\/a>Funding<\/h4>\n