{"id":3378,"date":"2020-11-04T00:00:00","date_gmt":"2020-11-04T00:00:00","guid":{"rendered":"http:\/\/pl-asapbio.local\/encouraging-preprint-review-make-it-easier-to-create-reviews-make-it-easier-to-incorporate-reviews\/"},"modified":"2025-03-28T21:36:46","modified_gmt":"2025-03-28T21:36:46","slug":"encouraging-preprint-review-make-it-easier-to-create-reviews-make-it-easier-to-incorporate-reviews","status":"publish","type":"post","link":"https:\/\/asapbio.org\/encouraging-preprint-review-make-it-easier-to-create-reviews-make-it-easier-to-incorporate-reviews\/","title":{"rendered":"Encouraging preprint review: make it easier to create reviews, make it easier to incorporate reviews."},"content":{"rendered":"<h2 class=\"wp-block-heading\" id=\"block-142df3fd-7c2a-4e47-a4b7-a9b99f94ec74\">Organizer<\/h2>\n<p id=\"block-97a13903-aeab-4407-969a-7d261d018e16\">Nokome Bentley, Alexander Ketchakmadze &amp; Colette Doughty from Stencila<\/p>\n<h4 class=\"wp-block-heading\" id=\"block-e94c12a1-ee82-409b-8158-14207fc0dc88\">Website or social media links<\/h4>\n<p><a href=\"https:\/\/stenci.la\/\" target=\"_blank\" rel=\"noopener\">https:\/\/stenci.la\/<\/a><\/p>\n<p><a href=\"https:\/\/twitter.com\/stencila\" target=\"_blank\" rel=\"noopener\">https:\/\/twitter.com\/stencila<\/a><\/p>\n<h4 class=\"wp-block-heading\" id=\"block-7c45ccf9-b544-41da-870a-6baf9c08b8c9\">Current stage of development<\/h4>\n<p id=\"block-3a3c24fc-54af-4274-808b-bcbf23b7961e\">Ongoing project<\/p>\n<h4 class=\"wp-block-heading\" id=\"block-faf68aec-8f33-4b83-ba7a-e666cdfdba3a\">Project duration<\/h4>\n<p id=\"block-f132a9fe-e868-40fe-8939-e692f120471f\">1 \u2013 3 months for integrations described here as part of Stencila\u2019s ongoing development<\/p>\n<div class=\"wp-block-group has-background\" style=\"background-color:#f7e7e7\">\n<div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h2 class=\"wp-block-heading\">Update<\/h2>\n<p>Our aim for the #PrePrintSprint was to use it as an opportunity to add reviewing functionality to our platform for executable documents. So, since the kick off we\u2019ve been heads down doing a lot of coding.&nbsp;<\/p>\n<p>We are happy to report that we managed to get most of our tickets moved from the \u201cTo do\u201d column to the \u201cDone\u201d column! We\u2019ve added the ability to mint DOIs for both preprints, and reviews as well as integrations to extract reviews from Google Docs and GitHub pull request reviews.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/asapbio.org\/wp-content\/uploads\/2025\/03\/QU3mbs2FdDI-g9FuaIQsdK8qdfMjdSCa6ulN5AMETYMzhllXtqIFew7a3WgyfCvBSr0WcQfDmxrwc_0SrL9brSu8-JKJCp3rHyor5pCR404EfrCNPHDUKWDyU3z3-DhZp28kTXL_-2.png\" alt=\"\"><\/figure>\n<h3 class=\"wp-block-heading\">How has your project changed?<\/h3>\n<p>We found that there was more work involved in designing and implementing a workflow for requesting reviews and allowing potentially anonymous reviewers to accept or decline those.&nbsp;<\/p>\n<h3 class=\"wp-block-heading\">Have you integrated any feedback received?<\/h3>\n<p>We got some really useful ideas and suggestions from the breakout room at the sprint kickoff. We have only just got our development work completed to a stage where we can start seeking feedback from users. We\u2019d love to get some feedback from people after the sprint.<\/p>\n<h3 class=\"wp-block-heading\">Have you started any collaborations?<\/h3>\n<p>Yes, we have started exploring options for collaboration with PREreview. We are also talking to a journal who is interested in our integration with Github, including the ability to pull reviews from there.<\/p>\n<\/div>\n<\/div>\n<h2 class=\"wp-block-heading\" id=\"block-a0c5359e-b8ea-4ae5-acf2-d869d3477452\">Project aims<\/h2>\n<h3 class=\"wp-block-heading\" id=\"block-6f9c94bf-8004-4832-a3c1-3046338f62c3\">Background information&nbsp;on current practices<\/h3>\n<p>Preprints are rapidly becoming an integral part of the modern scientific workflow, dramatically increasing the speed at which new research is disseminated. However, although one of the benefits of preprints is their availability for early review, the number of preprints with reviews is relatively low.<\/p>\n<h3 class=\"wp-block-heading\" id=\"block-b16f8d89-68f8-473c-ba51-11ad593ed203\">Overview of the challenge to overcome<\/h3>\n<p>Part of the reason for the scarcity of preprint reviews is the burden it places on both authors and reviewers. Reducing this burden by reducing the friction in the workflow, for both authors and reviewers, provides an opportunity to both increase the number and speed of preprint reviews that are done <em>and<\/em> acted upon.<\/p>\n<h3 class=\"wp-block-heading\" id=\"block-df0c1c6c-77c4-4d4f-bc0b-7bff15fa5084\">The ideal outcome or output of the project<\/h3>\n<p id=\"block-ff7c9174-ff67-4a86-a053-7d0f3139614b\">Part of the reason for the scarcity of preprint reviews is the burden it places on both authors and reviewers. Reducing this burden by reducing the friction in the workflow, for both authors and reviewers, provides an opportunity to both increase the number and speed of preprint reviews that are done <em>and<\/em> acted upon.<\/p>\n<h3 class=\"wp-block-heading\" id=\"block-85d7b965-e58f-4696-a081-7e62160c280b\">Description of the intervention<\/h3>\n<p>This project will aim to dramatically reduce the friction in,<\/p>\n<ul class=\"wp-block-list\">\n<li>Authors being able to make their preprint available for review<\/li>\n<li>Reviewers being able to create reviews on a preprint<\/li>\n<li>Authors being able to incorporate reviewers\u2019 comments and suggestions and publish new versions of their preprint.<\/li>\n<\/ul>\n<p>To achieve this our approach will be to \u201cgo to where the users are\u201d and make use of existing platforms that already provide excellent facilities for reviewing alternative types of content but which are often overlooked for reviewing research articles.<\/p>\n<p>Our envisaged workflow is:<\/p>\n<ul class=\"wp-block-list\">\n<li>Authors upload or link their preprint authored in one of several formats (Microsoft Word, Google Docs, Markdown, RMarkdown, Jupyter Notebooks) to a Stencila Hub project and make it available for review on either Google Docs (most suitable for general reviews) or GitHub (most suitable for reviews of research involving a lot of code).<\/li>\n<li>Reviewers are invited to make reviews on the platform that the author has selected (Google Docs or GitHub) using the built in facilities for this (Pull Requests on Github, Suggestions and Comments on Google Docs).<\/li>\n<li>Authors respond to comments and suggestions from reviewers using the normal mechanisms for each platform (e.g. accepting changes in GitHub PRs; accepting or rejecting suggested changes on Google Docs).<\/li>\n<li>Authors create new versions of their preprint (a new \u201cnamed version\u201d on Google Docs; a \u201crelease\u201d on GitHub).<\/li>\n<li>A new HTML version of the preprint is automatically published on Stencila Hub (using our Webhook integrations with these platforms) with a newly minted DOI and both authors and reviewers are notified.<\/li>\n<\/ul>\n<h3 class=\"wp-block-heading\" id=\"block-44726407-0bf6-4c6d-a7d6-200b1dd32600\">Plan for monitoring project outcome<\/h3>\n<p>We will measure the success of this project by monitoring:<\/p>\n<ul class=\"wp-block-list\">\n<li>The number of reviews created (Reviewers making comments on Google Docs, Pull Requests on GitHub).<\/li>\n<li>The number of revisions of preprints created in response to reviews.<\/li>\n<\/ul>\n<h3 class=\"wp-block-heading\" id=\"block-00e094ab-ddce-462e-81a8-9630109a1c42\">What\u2019s needed for success<\/h3>\n<h4 class=\"wp-block-heading\" id=\"block-583dd79d-bfbd-4082-bb25-1db33b869eba\">Additional technology development<\/h4>\n<p>Stencila\u2019s open source software, principally <a href=\"https:\/\/github.com\/stencila\/hub\" target=\"_blank\" rel=\"noopener\">Hub<\/a> (integration with other platforms) and <a href=\"https:\/\/github.com\/stencila\/encoda\" target=\"_blank\" rel=\"noopener\">Encoda<\/a> (conversion between formats), already have the technical foundations necessary for this project. Some additional development and testing will be required for the API integrations between Stencila Hub and Crossref, Google Docs and GitHub. Refinements to format conversions may also be required.<\/p>\n<h4 class=\"wp-block-heading\" id=\"block-75b3c918-7a23-4762-93db-c2628201cb4b\">Feedback, beta testing, collaboration, endorsement<\/h4>\n<p>User feedback, in particular one-on-one user testing of the workflows for both authors and reviewers, will be important for the success of this project. We will draw on our existing pool of beta testers for this. Endorsements by ASAPbio, funders and journals will help substantially with uptake.<\/p>\n<h4 class=\"wp-block-heading\" id=\"block-1055ba2c-1030-45ef-a4f6-528849ed4119\">Funding<\/h4>\n<p>The initial integrations with Google Docs and GitHub will be developed as part of Stencila\u2019s ongoing development and do not require any additional funding. If these prove successful funding may be needed for refinements and\/or integrations with other platforms.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Organizer Nokome Bentley, Alexander Ketchakmadze &amp; Colette Doughty from Stencila Website or social media links https:\/\/stenci.la\/ https:\/\/twitter.com\/stencila Current stage of development Ongoing project Project duration 1 \u2013 3 months for [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2054,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[48],"tags":[],"class_list":["post-3378","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-preprint-sprint-proposals"],"acf":[],"_links":{"self":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3378","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/comments?post=3378"}],"version-history":[{"count":1,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3378\/revisions"}],"predecessor-version":[{"id":3379,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3378\/revisions\/3379"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/media\/2054"}],"wp:attachment":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/media?parent=3378"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/categories?post=3378"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/tags?post=3378"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}