Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
Autor(a) principal: | |
---|---|
Data de Publicação: | 2020 |
Outros Autores: | , , , , , , , , , , , , , , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Digital do Instituto Evandro Chagas (Patuá) |
Texto Completo: | http://patua.iec.gov.br//handle/iec/4227 |
Resumo: | Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review. |
id |
IEC-2_49e5d88ee77afdd6730774d3bf37e9f9 |
---|---|
oai_identifier_str |
oai:patua.iec.gov.br:iec/4227 |
network_acronym_str |
IEC-2 |
network_name_str |
Repositório Digital do Instituto Evandro Chagas (Patuá) |
repository_id_str |
|
spelling |
Carneiro, Clarissa F. DQueiroz, Victor G. SMoulin, Thiago CCarvalho, Carlos A. MHass, Clarissa BRayêe, DanielleHenshall, David ESouza, Evandro A. deEspinelli, FelippeBoss, Flávia ZGuercio, Gerson DCosta, Igor RHajdu, Karina LModrák, MartinTan, Pedro BBurgess, Steven JGuerra, Sylvia de Fátima dos SantosBortoluzzi, Vanessa TAmaral, Olavo B2021-01-29T12:22:03Z2021-01-29T12:22:03Z2020CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020.http://patua.iec.gov.br//handle/iec/422710.1101/581892Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review.FAPERJ (Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro)Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Ministério da Saúde. Secretaria de Vigilância em Saúde. Instituto Evandro Chagas. Ananindeua, PA, Brasil / Universidade do Estado do Pará. Departamento de Morfologia e Ciências Fisiológicas. Belém, PA, Brazil / Centro Universitário Metropolitano da Amazônia. Instituto Euro-Americano de Educação, Ciência e Tecnologia. Belém, PA, Brazil.University of Groningen. Department of Neuroscience. Section Medical Physiology. Groningen, The Netherlands.Federal University of Rio de Janeiro. Biomedical Sciences Institute. Rio de Janeiro, RJ, Brazil.University of Edinburgh Medical School. Scotland, United Kingdom.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Universidade Federal de São Paulo. Programa de Pós-Graduação em Psicobiologia. São Paulo, SP, Brazil.University of Minnesota. Department of Psychiatry. Minneapolis, MN, USA.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Biomedical Sciences Institute. Rio de Janeiro, RJ, Brazil.Institute of Microbiology of the Czech Academy of Sciences. Czech Republic.University of Illinois at Urbana-Champaign. Carl R Woese Institute for Genomic Biology. Urbana, Illinois, USA.Universidade do Estado do Pará. Departamento de Morfologia e Ciências Fisiológicas. Belém, PA, Brazil / Centro Universitário Metropolitano da Amazônia. Instituto Euro-Americano de Educação, Ciência e Tecnologia. Belém, PA, Brazil / Ministério da Saúde. Secretaria de Vigilância em Saúde. Instituto Evandro Chagas. Ananindeua, PA, Brasil.Universidade Federal do Rio Grande do Sul. Instituto de Ciências Básicas da Saúde. Departamento de Bioquímica. Rio Grande do Sul, RS, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.Federal University of Rio de Janeiro. Institute of Medical Biochemistry Leopoldo de Meis. Rio de Janeiro, RJ, Brazil.engCold Spring Harbor LaboratoryComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literatureinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleLiteratura de Revisão como AssuntoPré-Publicações como AssuntoArtigo de RevistaRelatório de Pesquisainfo:eu-repo/semantics/openAccessreponame:Repositório Digital do Instituto Evandro Chagas (Patuá)instname:Instituto Evandro Chagas (IEC)instacron:IECLICENSElicense.txtlicense.txttext/plain; charset=utf-82182https://patua.iec.gov.br/bitstreams/1909a3e2-f9db-422c-9f5e-aa89dec6d4f3/download11832eea31b16df8613079d742d61793MD52TEXTComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.txtComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.txtExtracted texttext/plain85295https://patua.iec.gov.br/bitstreams/cbf5657e-f6fe-4106-93f6-7acf3fb60cc2/download142b6c77c6115f778b7aee5424202503MD56THUMBNAILComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.jpgComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdf.jpgGenerated Thumbnailimage/jpeg5126https://patua.iec.gov.br/bitstreams/63b33f1a-8bcd-4be1-ab5a-94793c70fdd8/download3317aa7e365e39617a1a5b0969e57cddMD57ORIGINALComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdfComparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature.pdfapplication/pdf1749725https://patua.iec.gov.br/bitstreams/8be82927-807a-4031-a8ca-dd46c6498f0b/downloadb0fccb227654c475fb0c03a977341e39MD55iec/42272022-10-20 21:05:27.567oai:patua.iec.gov.br:iec/4227https://patua.iec.gov.brRepositório InstitucionalPUBhttps://patua.iec.gov.br/oai/requestclariceneta@iec.gov.br || Biblioteca@iec.gov.bropendoar:2022-10-20T21:05:27Repositório Digital do Instituto Evandro Chagas (Patuá) - Instituto Evandro Chagas (IEC)falsePGI+TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmE8L2I+DQoNClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUGF0dcOhIGRldmUgY29uY2VkZXIgYW8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIHVtYSBMaWNlbsOnYSBkZSBEaXN0cmlidWnDp8OjbyBOw6NvIEV4Y2x1c2l2YSBwYXJhIHRvcm5hciBlIG1hbnRlciBhY2Vzc8OtdmVpcyBvcyBzZXVzIGRvY3VtZW50b3MgZW0gZm9ybWF0byBkaWdpdGFsLiANCg0KQ29tIGEgY29uY2Vzc8OjbyBkZXNzYSBsaWNlbsOnYSBuw6NvIGV4Y2x1c2l2YSwgbyBkZXBvc2l0YW50ZSBjb250aW51YSBhIHJldGVyIHRvZG9zIG9zIGRpcmVpdG9zIGRlIGF1dG9yLg0KDQpBbyBhc3NpbmFyIGUgZW50cmVnYXIgZXN0YSBsaWNlbsOnYSB2b2PDqiAoYXV0b3Igb3UgZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzKQ0KDQphKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGEgcG9sw610aWNhIGRlIGNvcHlyaWdodCBkYSBlZGl0b3JhIGRlIHNldSBkb2N1bWVudG8uDQoNCmIpIENvbmNlZGUgYW8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIG8gZGlyZWl0byBuw6NvIGV4Y2x1c2l2byBkZSBhcnF1aXZhciwgcmVwcm9kdXppciwgY29udmVydGVyIChjb21vIGRlZmluaWRvIGEgc2VndWlyKSwgY29tdW5pY2FyIGUvb3UgZGlzdHJpYnVpciBubyA8Yj5QYXR1w6E8L2I+LCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIHF1YWxxdWVyIG91dHJvIG1laW8uDQoNCmMpIERlY2xhcmEgcXVlIGF1dG9yaXphIG8gSW5zdGl0dXRvIEV2YW5kcm8gQ2hhZ2FzIGEgYXJxdWl2YXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRlc3NlIGRvY3VtZW50byBlIGNvbnZlcnTDqi1sbywgc2VtIGFsdGVyYXIgbyBzZXUgY29udGXDumRvLCBwYXJhIHF1YWxxdWVyIGZvcm1hdG8gZGUgZmljaGVpcm8sIG1laW8gb3Ugc3Vwb3J0ZSwgcGFyYSBlZmVpdG9zIGRlIHNlZ3VyYW7Dp2EsIHByZXNlcnZhw6fDo28gKGJhY2t1cCkgZSBhY2Vzc28uDQoNCmQpIERlY2xhcmEgcXVlIG8gZG9jdW1lbnRvIHN1Ym1ldGlkbyDDqSBvIHNldSB0cmFiYWxobyBvcmlnaW5hbCBlIHF1ZSBkZXTDqW0gbyBkaXJlaXRvIGRlIGNvbmNlZGVyIGEgdGVyY2Vpcm9zIG9zIGRpcmVpdG9zIGNvbnRpZG9zIG5lc3RhIGxpY2Vuw6dhLiBEZWNsYXJhIHRhbWLDqW0gcXVlIGEgZW50cmVnYSBkbyBkb2N1bWVudG8gbsOjbyBpbmZyaW5nZSBvcyBkaXJlaXRvcyBkZSBxdWFscXVlciBvdXRyYSBwZXNzb2Egb3UgZW50aWRhZGUuDQoNCmUpIERlY2xhcmEgcXVlLCBubyBjYXNvIGRvIGRvY3VtZW50byBzdWJtZXRpZG8gY29udGVyIG1hdGVyaWFsIGRvIHF1YWwgbsOjbyBkZXTDqW0gb3MgZGlyZWl0b3MgZGUgYXV0b3IsIG9idGV2ZSBhIGF1dG9yaXphw6fDo28gaXJyZXN0cml0YSBkbyByZXNwZWN0aXZvIGRldGVudG9yIGRlc3NlcyBkaXJlaXRvcywgcGFyYSBjZWRlciBhbyBJbnN0aXR1dG8gRXZhbmRybyBDaGFnYXMgb3MgZGlyZWl0b3MgcmVxdWVyaWRvcyBwb3IgZXN0YSBMaWNlbsOnYSBlIGF1dG9yaXphciBhIHV0aWxpesOhLWxvcyBsZWdhbG1lbnRlLiBEZWNsYXJhIHRhbWLDqW0gcXVlIGVzc2UgbWF0ZXJpYWwgY3Vqb3MgZGlyZWl0b3Mgc8OjbyBkZSB0ZXJjZWlyb3MgZXN0w6EgY2xhcmFtZW50ZSBpZGVudGlmaWNhZG8gZSByZWNvbmhlY2lkbyBubyB0ZXh0byBvdSBjb250ZcO6ZG8gZG8gZG9jdW1lbnRvIGVudHJlZ3VlLg0KDQpmKSBTRSBPIERPQ1VNRU5UTyBFTlRSRUdVRSBGT1IgQkFTRUFETyBFTSBUUkFCQUxITyBGSU5BTkNJQURPIE9VIEFQT0lBRE8gUE9SIE9VVFJBIElOU1RJVFVJw4fDg08gUVVFIE7Dg08gTyBJTlNUSVRVVE8gRVZBTkRSTyBDSEFHQVMsIERFQ0xBUkEgUVVFIENVTVBSSVUgUVVBSVNRVUVSIE9CUklHQcOHw5VFUyBFWElHSURBUyBQRUxPIFJFU1BFQ1RJVk8gQ09OVFJBVE8gT1UgQUNPUkRPLg0KDQpPIEluc3RpdHV0byBFdmFuZHJvIENoYWdhcyBpZGVudGlmaWNhcsOhIGNsYXJhbWVudGUgbyhzKSBub21lKHMpIGRvKHMpIGF1dG9yKGVzKSBkb3MgZGlyZWl0b3MgZG8gZG9jdW1lbnRvIGVudHJlZ3VlIGUgbsOjbyBmYXLDoSBxdWFscXVlciBhbHRlcmHDp8OjbyBhbMOpbSBkbyBwcmV2aXN0byBuYSBhbMOtbmVhIGIpLg== |
dc.title.pt_BR.fl_str_mv |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
title |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
spellingShingle |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature Carneiro, Clarissa F. D Literatura de Revisão como Assunto Pré-Publicações como Assunto Artigo de Revista Relatório de Pesquisa |
title_short |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
title_full |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
title_fullStr |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
title_full_unstemmed |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
title_sort |
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature |
author |
Carneiro, Clarissa F. D |
author_facet |
Carneiro, Clarissa F. D Queiroz, Victor G. S Moulin, Thiago C Carvalho, Carlos A. M Hass, Clarissa B Rayêe, Danielle Henshall, David E Souza, Evandro A. de Espinelli, Felippe Boss, Flávia Z Guercio, Gerson D Costa, Igor R Hajdu, Karina L Modrák, Martin Tan, Pedro B Burgess, Steven J Guerra, Sylvia de Fátima dos Santos Bortoluzzi, Vanessa T Amaral, Olavo B |
author_role |
author |
author2 |
Queiroz, Victor G. S Moulin, Thiago C Carvalho, Carlos A. M Hass, Clarissa B Rayêe, Danielle Henshall, David E Souza, Evandro A. de Espinelli, Felippe Boss, Flávia Z Guercio, Gerson D Costa, Igor R Hajdu, Karina L Modrák, Martin Tan, Pedro B Burgess, Steven J Guerra, Sylvia de Fátima dos Santos Bortoluzzi, Vanessa T Amaral, Olavo B |
author2_role |
author author author author author author author author author author author author author author author author author author |
dc.contributor.author.fl_str_mv |
Carneiro, Clarissa F. D Queiroz, Victor G. S Moulin, Thiago C Carvalho, Carlos A. M Hass, Clarissa B Rayêe, Danielle Henshall, David E Souza, Evandro A. de Espinelli, Felippe Boss, Flávia Z Guercio, Gerson D Costa, Igor R Hajdu, Karina L Modrák, Martin Tan, Pedro B Burgess, Steven J Guerra, Sylvia de Fátima dos Santos Bortoluzzi, Vanessa T Amaral, Olavo B |
dc.subject.decsPrimary.pt_BR.fl_str_mv |
Literatura de Revisão como Assunto Pré-Publicações como Assunto Artigo de Revista Relatório de Pesquisa |
topic |
Literatura de Revisão como Assunto Pré-Publicações como Assunto Artigo de Revista Relatório de Pesquisa |
description |
Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, we compared random samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. We found that peer-reviewed articles had, on average, higher quality of reporting than preprints, although this difference was small. We found larger differences favoring PubMed in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Interestingly, an exploratory analysis showed that preprints with figures and legends embedded within text had reporting scores similar to PubMed articles. These differences cannot be directly attributed to peer review or editorial processes, as manuscripts might already differ before submission due to greater uptake of preprints by particular research communities. Nevertheless, our results show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions. An ongoing second phase of the project is comparing preprints to their own published versions in order to more directly assess the effects of peer review. |
publishDate |
2020 |
dc.date.issued.fl_str_mv |
2020 |
dc.date.accessioned.fl_str_mv |
2021-01-29T12:22:03Z |
dc.date.available.fl_str_mv |
2021-01-29T12:22:03Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020. |
dc.identifier.uri.fl_str_mv |
http://patua.iec.gov.br//handle/iec/4227 |
dc.identifier.doi.-.fl_str_mv |
10.1101/581892 |
identifier_str_mv |
CARNEIRO, Clarissa F. D. et al. Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature. Biorxiv, p. 1-10, Mar. 2020. 10.1101/581892 |
url |
http://patua.iec.gov.br//handle/iec/4227 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Cold Spring Harbor Laboratory |
publisher.none.fl_str_mv |
Cold Spring Harbor Laboratory |
dc.source.none.fl_str_mv |
reponame:Repositório Digital do Instituto Evandro Chagas (Patuá) instname:Instituto Evandro Chagas (IEC) instacron:IEC |
instname_str |
Instituto Evandro Chagas (IEC) |
instacron_str |
IEC |
institution |
IEC |
reponame_str |
Repositório Digital do Instituto Evandro Chagas (Patuá) |
collection |
Repositório Digital do Instituto Evandro Chagas (Patuá) |
bitstream.url.fl_str_mv |
https://patua.iec.gov.br/bitstreams/1909a3e2-f9db-422c-9f5e-aa89dec6d4f3/download https://patua.iec.gov.br/bitstreams/cbf5657e-f6fe-4106-93f6-7acf3fb60cc2/download https://patua.iec.gov.br/bitstreams/63b33f1a-8bcd-4be1-ab5a-94793c70fdd8/download https://patua.iec.gov.br/bitstreams/8be82927-807a-4031-a8ca-dd46c6498f0b/download |
bitstream.checksum.fl_str_mv |
11832eea31b16df8613079d742d61793 142b6c77c6115f778b7aee5424202503 3317aa7e365e39617a1a5b0969e57cdd b0fccb227654c475fb0c03a977341e39 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Digital do Instituto Evandro Chagas (Patuá) - Instituto Evandro Chagas (IEC) |
repository.mail.fl_str_mv |
clariceneta@iec.gov.br || Biblioteca@iec.gov.br |
_version_ |
1809190032838230016 |