Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature

Detalhes bibliográficos
Autor(a) principal: Carneiro, Clarissa F. D
Data de Publicação: 2020
Outros Autores: Queiroz, Victor G. S, Moulin, Thiago C, Carvalho, Carlos A. M, Hass, Clarissa B, Rayêe, Danielle, Henshall, David E, Souza, Evandro A. de, Espinelli, Felippe, Boss, Flávia Z, Guercio, Gerson D, Costa, Igor R, Hajdu, Karina L, Modrák, Martin, Tan, Pedro B, Burgess, Steven J, Guerra, Sylvia de Fátima dos Santos, Bortoluzzi, Vanessa T, Amaral, Olavo B
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Digital do Instituto Evandro Chagas (Patuá)
Texto Completo: http://patua.iec.gov.br//handle/iec/4227
Resumo: Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review.
id IEC-2_49e5d88ee77afdd6730774d3bf37e9f9
oai_identifier_str oai:patua.iec.gov.br:iec/4227
network_acronym_str IEC-2
network_name_str Repositório Digital do Instituto Evandro Chagas (Patuá)
repository_id_str
spelling Carneiro, Clarissa F. DQueiroz, Victor G. SMoulin, Thiago CCarvalho, Carlos A. MHass, Clarissa BRayêe, DanielleHenshall, David ESouza, Evandro A. deEspinelli, FelippeBoss, Flávia ZGuercio, Gerson DCosta, Igor RHajdu, Karina LModrák, MartinTan, Pedro BBurgess, Steven JGuerra, Sylvia de Fátima dos SantosBortoluzzi, Vanessa TAmaral, Olavo B2021-01-29T12:22:03Z2021-01-29T12:22:03Z2020CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020.http://patua.iec.gov.br//handle/iec/422710.1101/581892Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review.FAPERJ (Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro)Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Ministério da Saúde. Secretaria de Vigilância em Saúde. Instituto Evandro Chagas. Ananindeua, PA, Brasil / Universidade do Estado do Pará. Departamento de Morfologia e Ciências Fisiológicas. Belém, PA, Brazil / Centro Universitário Metropolitano da Amazônia. Instituto Euro-Americano de Educação, Ciência e Tecnologia. Belém, PA, Brazil.University of Groningen. Department of Neuroscience. Section Medical Physiology. Groningen, The Netherlands.Federal University of Rio de Janeiro. Biomedical Sciences Institute. Rio de Janeiro, RJ, Brazil.University of Edinburgh Medical School. Scotland, United Kingdom.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Universidade Federal de São Paulo. Programa de Pós-Graduação em Psicobiologia. São Paulo, SP, Brazil.University of Minnesota. Department of Psychiatry. Minneapolis, MN, USA.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Biomedical Sciences Institute. Rio de Janeiro, RJ, Brazil.Institute of Microbiology of the Czech Academy of Sciences. Czech Republic.University of Illinois at Urbana-Champaign. Carl R Woese Institute for Genomic Biology. Urbana, Illinois, USA.Universidade do Estado do Pará. Departamento de Morfologia e Ciências Fisiológicas. Belém, PA, Brazil / Centro Universitário Metropolitano da Amazônia. Instituto Euro-Americano de Educação, Ciência e Tecnologia. Belém, PA, Brazil / Ministério da Saúde. Secretaria de Vigilância em Saúde. Instituto Evandro Chagas. Ananindeua, PA, Brasil.Universidade Federal do Rio Grande do Sul. Instituto de Ciências Básicas da Saúde. Departamento de Bioquímica. Rio Grande do Sul, RS, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.engCold Spring Harbor LaboratoryComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literatureinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleLiteratura de Revisão como AssuntoPré-Publicações como AssuntoArtigo de RevistaRelatório de Pesquisainfo:eu-repo/semantics/openAccessreponame:Repositório Digital do Instituto Evandro Chagas (Patuá)instname:Instituto Evandro Chagas (IEC)instacron:IECLICENSElicense.txtlicense.txttext/plain; charset=utf-82182https://patua.iec.gov.br/bitstreams/1909a3e2-f9db-422c-9f5e-aa89dec6d4f3/download11832eea31b16df8613079d742d61793MD52TEXTComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.txtComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.txtExtracted texttext/plain85295https://patua.iec.gov.br/bitstreams/cbf5657e-f6fe-4106-93f6-7acf3fb60cc2/download142b6c77c6115f778b7aee5424202503MD56THUMBNAILComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.jpgComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.jpgGenerated Thumbnailimage/jpeg5126https://patua.iec.gov.br/bitstreams/63b33f1a-8bcd-4be1-ab5a-94793c70fdd8/download3317aa7e365e39617a1a5b0969e57cddMD57ORIGINALComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdfComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdfapplication/pdf1749725https://patua.iec.gov.br/bitstreams/8be82927-807a-4031-a8ca-dd46c6498f0b/downloadb0fccb227654c475fb0c03a977341e39MD55iec/42272022-10-20 21:05:27.567oai:patua.iec.gov.br:iec/4227https://patua.iec.gov.brRepositório InstitucionalPUBhttps://patua.iec.gov.br/oai/requestclariceneta@iec.gov.br || Biblioteca@iec.gov.bropendoar:2022-10-20T21:05:27Repositório Digital do Instituto Evandro Chagas (Patuá) - Instituto Evandro Chagas (IEC)falsePGI+TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmE8L2I+DQoNClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUGF0dcOhIGRldmUgY29uY2VkZXIgYW8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIHVtYSBMaWNlbsOnYSBkZSBEaXN0cmlidWnDp8OjbyBOw6NvIEV4Y2x1c2l2YSBwYXJhIHRvcm5hciBlIG1hbnRlciBhY2Vzc8OtdmVpcyBvcyBzZXVzIGRvY3VtZW50b3MgZW0gZm9ybWF0byBkaWdpdGFsLiANCg0KQ29tIGEgY29uY2Vzc8OjbyBkZXNzYSBsaWNlbsOnYSBuw6NvIGV4Y2x1c2l2YSwgbyBkZXBvc2l0YW50ZSBjb250aW51YSBhIHJldGVyIHRvZG9zIG9zIGRpcmVpdG9zIGRlIGF1dG9yLg0KDQpBbyBhc3NpbmFyIGUgZW50cmVnYXIgZXN0YSBsaWNlbsOnYSB2b2PDqiAoYXV0b3Igb3UgZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzKQ0KDQphKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGEgcG9sw610aWNhIGRlIGNvcHlyaWdodCBkYSBlZGl0b3JhIGRlIHNldSBkb2N1bWVudG8uDQoNCmIpIENvbmNlZGUgYW8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIG8gZGlyZWl0byBuw6NvIGV4Y2x1c2l2byBkZSBhcnF1aXZhciwgcmVwcm9kdXppciwgY29udmVydGVyIChjb21vIGRlZmluaWRvIGEgc2VndWlyKSwgY29tdW5pY2FyIGUvb3UgZGlzdHJpYnVpciBubyA8Yj5QYXR1w6E8L2I+LCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIHF1YWxxdWVyIG91dHJvIG1laW8uDQoNCmMpIERlY2xhcmEgcXVlIGF1dG9yaXphIG8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIGEgYXJxdWl2YXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRlc3NlIGRvY3VtZW50byBlIGNvbnZlcnTDqi1sbywgc2VtIGFsdGVyYXIgbyBzZXUgY29udGXDumRvLCBwYXJhIHF1YWxxdWVyIGZvcm1hdG8gZGUgZmljaGVpcm8sIG1laW8gb3Ugc3Vwb3J0ZSwgcGFyYSBlZmVpdG9zIGRlIHNlZ3VyYW7Dp2EsIHByZXNlcnZhw6fDo28gKGJhY2t1cCkgZSBhY2Vzc28uDQoNCmQpIERlY2xhcmEgcXVlIG8gZG9jdW1lbnRvIHN1Ym1ldGlkbyDDqSBvIHNldSB0cmFiYWxobyBvcmlnaW5hbCBlIHF1ZSBkZXTDqW0gbyBkaXJlaXRvIGRlIGNvbmNlZGVyIGEgdGVyY2Vpcm9zIG9zIGRpcmVpdG9zIGNvbnRpZG9zIG5lc3RhIGxpY2Vuw6dhLiBEZWNsYXJhIHRhbWLDqW0gcXVlIGEgZW50cmVnYSBkbyBkb2N1bWVudG8gbsOjbyBpbmZyaW5nZSBvcyBkaXJlaXRvcyBkZSBxdWFscXVlciBvdXRyYSBwZXNzb2Egb3UgZW50aWRhZGUuDQoNCmUpIERlY2xhcmEgcXVlLCBubyBjYXNvIGRvIGRvY3VtZW50byBzdWJtZXRpZG8gY29udGVyIG1hdGVyaWFsIGRvIHF1YWwgbsOjbyBkZXTDqW0gb3MgZGlyZWl0b3MgZGUgYXV0b3IsIG9idGV2ZSBhIGF1dG9yaXphw6fDo28gaXJyZXN0cml0YSBkbyByZXNwZWN0aXZvIGRldGVudG9yIGRlc3NlcyBkaXJlaXRvcywgcGFyYSBjZWRlciBhbyBJbnN0aXR1dG8gRXZhbmRybyBDaGFnYXMgb3MgZGlyZWl0b3MgcmVxdWVyaWRvcyBwb3IgZXN0YSBMaWNlbsOnYSBlIGF1dG9yaXphciBhIHV0aWxpesOhLWxvcyBsZWdhbG1lbnRlLiBEZWNsYXJhIHRhbWLDqW0gcXVlIGVzc2UgbWF0ZXJpYWwgY3Vqb3MgZGlyZWl0b3Mgc8OjbyBkZSB0ZXJjZWlyb3MgZXN0w6EgY2xhcmFtZW50ZSBpZGVudGlmaWNhZG8gZSByZWNvbmhlY2lkbyBubyB0ZXh0byBvdSBjb250ZcO6ZG8gZG8gZG9jdW1lbnRvIGVudHJlZ3VlLg0KDQpmKSBTRSBPIERPQ1VNRU5UTyBFTlRSRUdVRSBGT1IgQkFTRUFETyBFTSBUUkFCQUxITyBGSU5BTkNJQURPIE9VIEFQT0lBRE8gUE9SIE9VVFJBIElOU1RJVFVJw4fDg08gUVVFIE7Dg08gTyBJTlNUSVRVVE8gRVZBTkRSTyBDSEFHQVMsIERFQ0xBUkEgUVVFIENVTVBSSVUgUVVBSVNRVUVSIE9CUklHQcOHw5VFUyBFWElHSURBUyBQRUxPIFJFU1BFQ1RJVk8gQ09OVFJBVE8gT1UgQUNPUkRPLg0KDQpPIEluc3RpdHV0byBFdmFuZHJvIENoYWdhcyBpZGVudGlmaWNhcsOhIGNsYXJhbWVudGUgbyhzKSBub21lKHMpIGRvKHMpIGF1dG9yKGVzKSBkb3MgZGlyZWl0b3MgZG8gZG9jdW1lbnRvIGVudHJlZ3VlIGUgbsOjbyBmYXLDoSBxdWFscXVlciBhbHRlcmHDp8OjbyBhbMOpbSBkbyBwcmV2aXN0byBuYSBhbMOtbmVhIGIpLg==
dc.title.pt_BR.fl_str_mv Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
title Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
spellingShingle Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
Carneiro, Clarissa F. D
Literatura de Revisão como Assunto
Pré-Publicações como Assunto
Artigo de Revista
Relatório de Pesquisa
title_short Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
title_full Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
title_fullStr Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
title_full_unstemmed Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
title_sort Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
author Carneiro, Clarissa F. D
author_facet Carneiro, Clarissa F. D
Queiroz, Victor G. S
Moulin, Thiago C
Carvalho, Carlos A. M
Hass, Clarissa B
Rayêe, Danielle
Henshall, David E
Souza, Evandro A. de
Espinelli, Felippe
Boss, Flávia Z
Guercio, Gerson D
Costa, Igor R
Hajdu, Karina L
Modrák, Martin
Tan, Pedro B
Burgess, Steven J
Guerra, Sylvia de Fátima dos Santos
Bortoluzzi, Vanessa T
Amaral, Olavo B
author_role author
author2 Queiroz, Victor G. S
Moulin, Thiago C
Carvalho, Carlos A. M
Hass, Clarissa B
Rayêe, Danielle
Henshall, David E
Souza, Evandro A. de
Espinelli, Felippe
Boss, Flávia Z
Guercio, Gerson D
Costa, Igor R
Hajdu, Karina L
Modrák, Martin
Tan, Pedro B
Burgess, Steven J
Guerra, Sylvia de Fátima dos Santos
Bortoluzzi, Vanessa T
Amaral, Olavo B
author2_role author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv Carneiro, Clarissa F. D
Queiroz, Victor G. S
Moulin, Thiago C
Carvalho, Carlos A. M
Hass, Clarissa B
Rayêe, Danielle
Henshall, David E
Souza, Evandro A. de
Espinelli, Felippe
Boss, Flávia Z
Guercio, Gerson D
Costa, Igor R
Hajdu, Karina L
Modrák, Martin
Tan, Pedro B
Burgess, Steven J
Guerra, Sylvia de Fátima dos Santos
Bortoluzzi, Vanessa T
Amaral, Olavo B
dc.subject.decsPrimary.pt_BR.fl_str_mv Literatura de Revisão como Assunto
Pré-Publicações como Assunto
Artigo de Revista
Relatório de Pesquisa
topic Literatura de Revisão como Assunto
Pré-Publicações como Assunto
Artigo de Revista
Relatório de Pesquisa
description Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review.
publishDate 2020
dc.date.issued.fl_str_mv 2020
dc.date.accessioned.fl_str_mv 2021-01-29T12:22:03Z
dc.date.available.fl_str_mv 2021-01-29T12:22:03Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.citation.fl_str_mv CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020.
dc.identifier.uri.fl_str_mv http://patua.iec.gov.br//handle/iec/4227
dc.identifier.doi.-.fl_str_mv 10.1101/581892
identifier_str_mv CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020.
10.1101/581892
url http://patua.iec.gov.br//handle/iec/4227
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Cold Spring Harbor Laboratory
publisher.none.fl_str_mv Cold Spring Harbor Laboratory
dc.source.none.fl_str_mv reponame:Repositório Digital do Instituto Evandro Chagas (Patuá)
instname:Instituto Evandro Chagas (IEC)
instacron:IEC
instname_str Instituto Evandro Chagas (IEC)
instacron_str IEC
institution IEC
reponame_str Repositório Digital do Instituto Evandro Chagas (Patuá)
collection Repositório Digital do Instituto Evandro Chagas (Patuá)
bitstream.url.fl_str_mv https://patua.iec.gov.br/bitstreams/1909a3e2-f9db-422c-9f5e-aa89dec6d4f3/download
https://patua.iec.gov.br/bitstreams/cbf5657e-f6fe-4106-93f6-7acf3fb60cc2/download
https://patua.iec.gov.br/bitstreams/63b33f1a-8bcd-4be1-ab5a-94793c70fdd8/download
https://patua.iec.gov.br/bitstreams/8be82927-807a-4031-a8ca-dd46c6498f0b/download
bitstream.checksum.fl_str_mv 11832eea31b16df8613079d742d61793
142b6c77c6115f778b7aee5424202503
3317aa7e365e39617a1a5b0969e57cdd
b0fccb227654c475fb0c03a977341e39
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Digital do Instituto Evandro Chagas (Patuá) - Instituto Evandro Chagas (IEC)
repository.mail.fl_str_mv clariceneta@iec.gov.br || Biblioteca@iec.gov.br
_version_ 1809190032838230016