{"id":3550,"date":"2019-07-29T00:00:00","date_gmt":"2019-07-29T00:00:00","guid":{"rendered":"http:\/\/pl-asapbio.local\/scl-project-first-update\/"},"modified":"2025-03-28T21:37:36","modified_gmt":"2025-03-28T21:37:36","slug":"scl-project-first-update","status":"publish","type":"post","link":"https:\/\/asapbio.org\/scl-project-first-update\/","title":{"rendered":"To preprint or not to preprint? Research for a more transparent publishing system"},"content":{"rendered":"<p><em>This blogpost is cross-posted from the <\/em><a href=\"https:\/\/www.scholcommlab.ca\/2019\/07\/29\/preprint-research\/\" target=\"_blank\" rel=\"noopener\"><em>ScholCommLab blog<\/em><\/a><em> (Alice Feerackers, July 29 2019) and provides an update on a current research project by two visiting scholars supported by ASAPbio.<\/em><\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/asapbio.org\/wp-content\/uploads\/2025\/03\/Preprints-Cover-Image-2.jpg\" alt=\"A man in an academic library\"><figcaption><em>\u201cAcademic life\u201d by uonottingham is licensed under <a href=\"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/2.0\/?ref=ccsearch&amp;atype=html\" target=\"_blank\" rel=\"noopener\">CC BY-NC-SA 2.0<\/a><\/em><\/figcaption><\/figure>\n<p>\u201cFor researchers, there is immense pressure to publish in journals that are highly competitive,\u201d says Naomi Penfold, associate director of the scientist-driven nonprofit&nbsp;<a rel=\"noreferrer noopener\" href=\"https:\/\/asapbio.org\/about-us\" target=\"_blank\">ASAPbio<\/a>. \u201c[This, in turn,] means that the process of sharing what you have found, evaluating whether claims are valid or not, and gaining recognition and visibility is all wrapped up in the long, arduous, and mostly opaque process of publishing at these few journals.\u201d<\/p>\n<p>Improving this \u201clong, arduous\u201d process is core to ASAPbio\u2019s mission of advancing \u201cinnovation and transparency in life sciences communication.\u201d It\u2019s also the focus of&nbsp;<a href=\"http:\/\/www.scholcommlab.ca\/research\/preprints\/\" target=\"_blank\" rel=\"noreferrer noopener\">a new research collaboration between ASAPbio and the ScholCommLab<\/a>&nbsp;exploring the status of preprint adoption and impact in different research communities.<\/p>\n<p>In this post, we\u2019re shining a spotlight on the Preprints Uptake and Use research team, and offering a glimpse of their findings so far.<\/p>\n<h2 class=\"wp-block-heading\"><strong>Why study preprints?&nbsp;&nbsp;<\/strong><\/h2>\n<p>Academic peer review is often seen as a cornerstone of science, and remains one of the&nbsp;<a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1087\/20150104\" target=\"_blank\" rel=\"noreferrer noopener\">most trusted ways of assessing research quality<\/a>. But despite its status within academia, there\u2019s&nbsp;<a href=\"https:\/\/www.cochranelibrary.com\/cdsr\/doi\/10.1002\/14651858.MR000016.pub3\/full\" target=\"_blank\" rel=\"noreferrer noopener\">little evidence of its effectiveness<\/a>. (In fact, some research suggests&nbsp;<a href=\"https:\/\/www.pnas.org\/content\/113\/30\/8414\" target=\"_blank\" rel=\"noreferrer noopener\">peer review may actually prevent high quality science<\/a>&nbsp;from becoming published).<\/p>\n<p>Whether or not this is the case is still unclear, but scholars are exploring new avenues for disseminating their work.<em>&nbsp;Preprinting<\/em> \u2014 openly publishing research findings before submitting them for peer review \u2014 is one such avenue. By allowing researchers to circumvent the lengthy peer review process, preprints have the potential to catalyze research collaboration and innovation \u2014 months before the final journal article is published.<\/p>\n<h3 class=\"wp-block-heading\"><em>\u201cI see preprints as an online-first tool that allows anyone to discuss the latest findings while they\u2019re still fresh\u201d\u2014Naomi Penfold<\/em><\/h3>\n<p>\u201cI see preprints as an online-first tool that allows anyone to discuss the latest findings while they\u2019re still fresh,\u201d says Naomi. \u201cPreprints could help increase the likelihood and speed that science is seen, understood, tested, and built upon, which would be beneficial for individual researchers and society at large.\u201d<\/p>\n<p>But despite these potential benefits and substantial growth in preprinting in the past few years, little is known about the use of preprints in individual academic communities. While we can track preprint numbers in major subject categories and on individual servers, we currently do not have data to understand who is preprinting and whether there are nuances between individual research communities: Which researchers preprint more than others in their network? In which research fields is preprinting growing in popularity, and in which fields is adoption disproportionately low? These are just some of the questions that the Preprints Uptake and Use research team is exploring this summer\u2014questions that could help inform efforts to raise awareness of preprinting and measure their impact on science.<\/p>\n<h2 class=\"wp-block-heading\"><strong>Meet the Preprints Team: Mario Mali\u010dki and Janina Sarol&nbsp;<\/strong><\/h2>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/asapbio.org\/wp-content\/uploads\/2025\/03\/preprints-visiting-scholars-3.png\" alt=\"preprints visiting scholars Mario Malicki and Janina Sarol\" class=\"wp-image-2152\"><figcaption>Preprints visiting scholars Mario Mali\u010dki and Janina Sarol<\/figcaption><\/figure>\n<p>The ScholCommLab preprints team is comprised of two visiting scholars:&nbsp;<a href=\"https:\/\/www.scholcommlab.ca\/people\/mario-malicki\/\" target=\"_blank\" rel=\"noreferrer noopener\">Mario Mali\u010dki<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/www.scholcommlab.ca\/people\/janina-sarol\/\" target=\"_blank\" rel=\"noreferrer noopener\">Janina Sarol<\/a>. A recent postdoc at AMC and ASUS Amsterdam, Mario has been researching the role of journals in fostering responsible research conduct since 2017. Janina is a PhD student in Informatics at the University of Illinois at Urbana-Champaign with a background in Computer Science and Information Management. Together, they bring a unique mix of skills and interests to the research team.<\/p>\n<p>\u201cI used to work at the university library back in Illinois,\u201d Janina says, when asked how she first became interested in preprints. \u201cI was transforming all of their collections into linked data, and I was surprised by how much dirty data there was.\u201d There were so many authors and contributors, so many different articles and journals. Determining who had published what and where, she explains, turned out to be no small feat.<\/p>\n<p>While others may have been frustrated by the messiness of bibliometric data, Janina was fascinated by it. \u201cThat\u2019s what interested me,\u201d she says, \u201ctrying to clean the data, so that we could do a better analysis.\u201d She smiles, \u201cBibliometrics is like a library. All of the books seem to be stacked in the right place. But, when you dig deeper, things are not always so neat. \u201c<\/p>\n<h3 class=\"wp-block-heading\"><em>\u201cBibliometrics is like a library. All of the books seem to be stacked in the right place. But, when you dig deeper, things are not always so neat. \u201c \u2014 Janina Sarol<\/em><\/h3>\n<p>Like Janina, Mario\u2019s interest in scholarly publishing began when he discovered how flawed the system could be. It was 2011, and he had taken a step back from medical school to join the research department at the University of Split. He was working under the supervision of the editors of&nbsp;<em>Croatian Medical Journal<\/em>, the country\u2019s top medical publication.<\/p>\n<p>\u201cThey experienced a lot of people trying to bribe them to get into the journal,\u201d he explains. \u201cIn most Croatian universities at the time, you needed at least one publication in a journal with an impact factor higher than 1 to get your PhD,\u201d he continues. \u201cIn a country as small as ours, there was only one such journal\u2014and that was theirs.\u201d<\/p>\n<p>Witnessing these informal pressures firsthand sparked a deep interest in how the process of authorship works\u2014and how it could be improved. He dove into the world of meta-research, balancing his teaching responsibilities with this new passion. \u201cI completely fell in love with meta-research,\u201d he says, \u201cI realized that I would never go back to the hospital.\u201d<\/p>\n<h3 class=\"wp-block-heading\"><em>\u201cI completely fell in love with meta-research, and realized that I would never go back to the hospital.\u201d \u2014 Mario Mali\u010dki&nbsp;&nbsp;<\/em><\/h3>\n<h2 class=\"wp-block-heading\"><strong>A messy today and a bright tomorrow<\/strong><\/h2>\n<p>For the last month, Mario and Janina have been working under the supervision of ScholCommLab co-director&nbsp;<a rel=\"noreferrer noopener\" href=\"https:\/\/www.scholcommlab.ca\/people-2\/juan-pablo-alperin\/\" target=\"_blank\">Juan Pablo Alperin<\/a> to collect, consolidate, and analyze data from more than 60 different preprint servers. Eventually, they hope to use the data to answer such questions as:<\/p>\n<ul class=\"wp-block-list\">\n<li>How quickly do individual preprint servers develop?<\/li>\n<li>Who publishes preprints and how often?<\/li>\n<li>Do disciplinary or geographical factors influence preprint uptake or use?<\/li>\n<li>Are the preprints in any way different from the published papers?<\/li>\n<li>How many preprints end up being published?<\/li>\n<\/ul>\n<p>But first, the team has to clean the data\u2014a task, it turns out, that\u2019s more complex than expected.<\/p>\n<p>\u201cThe most striking thing about the project so far is that we had to go through each aspect of the metadata we were trying to collect\u2014author, date, subject\u2014and ask, \u2018Can we trust this or not?\u2019\u201d Janina explains. \u201cFor most things, the answer was, no.\u201d<\/p>\n<p>The data the team has analyzed so far is so riddled with missing metadata, duplicate entries, and conflicting information that excluding problematic entries simply isn\u2019t possible. \u201cWe\u2019re not talking about 10, 20, or 30 records with errors,\u201d Mario explains. \u201cWe\u2019re talking about 1,000 records. If you exclude those, it\u2019s ridiculous.\u201d<\/p>\n<p>But although the messy data poses challenges for Mario and Janina\u2019s study, it also raises important questions for the future of preprints research.<\/p>\n<h3 class=\"wp-block-heading\"><em>\u201cI think people presume that, because the data is out there, it\u2019s correct\u2026 We\u2019re hoping that, after this, people will be a bit more aware that you just can\u2019t trust those numbers.\u201d \u2014 Mario Mali\u010dki<\/em><\/h3>\n<p>\u201cI think people presume that, because the data is out there, it\u2019s correct,\u201d says Mario. \u201cBut preprint servers don\u2019t always have checks in place in the same way that journals do. We\u2019re hoping that, after this, people will be a bit more aware that you just can\u2019t trust those numbers.\u201d<\/p>\n<p>Despite the setbacks, the team is optimistic about the future. They\u2019re still plugging away at the data, and are in touch with some of the preprint servers with suggestions for how to improve their metadata systems.<\/p>\n<p>\u201cWe\u2019re excited to start analyzing the data,\u201d says Janina. \u201cIf all goes well, we\u2019ll be publishing a preprint of our own soon.\u201d<\/p>\n<p><strong><em>To stay up to date about the Preprints Uptake and Use project, visit the&nbsp;<\/em><\/strong><a rel=\"noreferrer noopener\" href=\"http:\/\/www.scholcommlab.ca\/research\/preprints\/\" target=\"_blank\"><strong><em>ScholCommLab\u2019s website<\/em><\/strong><\/a>&nbsp;<strong><em>or sign up for the lab\u2019s&nbsp;<\/em><\/strong><a rel=\"noreferrer noopener\" href=\"https:\/\/www.scholcommlab.ca\/stay-up-to-date\/\" target=\"_blank\"><strong><em>newsletter<\/em><\/strong><\/a><strong><em>.&nbsp;<\/em><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This blogpost is cross-posted from the ScholCommLab blog (Alice Feerackers, July 29 2019) and provides an update on a current research project by two visiting scholars supported by ASAPbio. \u201cAcademic [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2328,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[41,42],"tags":[],"class_list":["post-3550","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-asapbio-news","category-guest-posts"],"acf":[],"_links":{"self":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/comments?post=3550"}],"version-history":[{"count":1,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3550\/revisions"}],"predecessor-version":[{"id":3551,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/posts\/3550\/revisions\/3551"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/media\/2328"}],"wp:attachment":[{"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/media?parent=3550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/categories?post=3550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/asapbio.org\/wp-json\/wp\/v2\/tags?post=3550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}