QUALIS: The journal ranking system undermining the impact of Brazilian science

Detalhes bibliográficos
Autor(a) principal: JAFFÉ,RODOLFO
Data de Publicação: 2020
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Anais da Academia Brasileira de Ciências (Online)
Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0001-37652020000500702
Resumo: Abstract A system called QUALIS was implemented in Brazil in 2009, intended to rank graduate programs from different subject areas and promote selected national journals. Since this system uses a complicated suit of criteria (differing among subject areas) to group journals into discrete categories, it could potentially create incentives to publish in low-impact journals ranked highly by QUALIS. Here I assess the influence of the QUALIS journal ranking system on the global impact of Brazilian science. Brazil shows a steeper decrease in the number of citations per document since the implementation of this QUALIS system, compared to the top Latin American countries publishing more scientific articles. All subject areas showed some degree of bias, with social sciences being usually more biased than natural sciences. Lastly, the decrease in the number of citations over time proved steeper in a more biased subject area, suggesting a faster shift towards low-impact journals. Overall, the findings documented here suggest that the QUALIS system has undermined the global impact of Brazilian science, and reinforce a recent recommendation from an official committee evaluating graduate programs to eliminate QUALIS. A system based on impact metrics could avoid introducing distorted incentives, and thereby boost the global impact of Brazilian science.
id ABC-1_d1501d53fa26325688986f838ed8bfb2
oai_identifier_str oai:scielo:S0001-37652020000500702
network_acronym_str ABC-1
network_name_str Anais da Academia Brasileira de Ciências (Online)
repository_id_str
spelling QUALIS: The journal ranking system undermining the impact of Brazilian scienceCAPEScitationsimpact factorscientometricsScimagoScopusAbstract A system called QUALIS was implemented in Brazil in 2009, intended to rank graduate programs from different subject areas and promote selected national journals. Since this system uses a complicated suit of criteria (differing among subject areas) to group journals into discrete categories, it could potentially create incentives to publish in low-impact journals ranked highly by QUALIS. Here I assess the influence of the QUALIS journal ranking system on the global impact of Brazilian science. Brazil shows a steeper decrease in the number of citations per document since the implementation of this QUALIS system, compared to the top Latin American countries publishing more scientific articles. All subject areas showed some degree of bias, with social sciences being usually more biased than natural sciences. Lastly, the decrease in the number of citations over time proved steeper in a more biased subject area, suggesting a faster shift towards low-impact journals. Overall, the findings documented here suggest that the QUALIS system has undermined the global impact of Brazilian science, and reinforce a recent recommendation from an official committee evaluating graduate programs to eliminate QUALIS. A system based on impact metrics could avoid introducing distorted incentives, and thereby boost the global impact of Brazilian science.Academia Brasileira de Ciências2020-01-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0001-37652020000500702Anais da Academia Brasileira de Ciências v.92 n.3 2020reponame:Anais da Academia Brasileira de Ciências (Online)instname:Academia Brasileira de Ciências (ABC)instacron:ABC10.1590/0001-3765202020201116info:eu-repo/semantics/openAccessJAFFÉ,RODOLFOeng2020-11-09T00:00:00Zoai:scielo:S0001-37652020000500702Revistahttp://www.scielo.br/aabchttps://old.scielo.br/oai/scielo-oai.php||aabc@abc.org.br1678-26900001-3765opendoar:2020-11-09T00:00Anais da Academia Brasileira de Ciências (Online) - Academia Brasileira de Ciências (ABC)false
dc.title.none.fl_str_mv QUALIS: The journal ranking system undermining the impact of Brazilian science
title QUALIS: The journal ranking system undermining the impact of Brazilian science
spellingShingle QUALIS: The journal ranking system undermining the impact of Brazilian science
JAFFÉ,RODOLFO
CAPES
citations
impact factor
scientometrics
Scimago
Scopus
title_short QUALIS: The journal ranking system undermining the impact of Brazilian science
title_full QUALIS: The journal ranking system undermining the impact of Brazilian science
title_fullStr QUALIS: The journal ranking system undermining the impact of Brazilian science
title_full_unstemmed QUALIS: The journal ranking system undermining the impact of Brazilian science
title_sort QUALIS: The journal ranking system undermining the impact of Brazilian science
author JAFFÉ,RODOLFO
author_facet JAFFÉ,RODOLFO
author_role author
dc.contributor.author.fl_str_mv JAFFÉ,RODOLFO
dc.subject.por.fl_str_mv CAPES
citations
impact factor
scientometrics
Scimago
Scopus
topic CAPES
citations
impact factor
scientometrics
Scimago
Scopus
description Abstract A system called QUALIS was implemented in Brazil in 2009, intended to rank graduate programs from different subject areas and promote selected national journals. Since this system uses a complicated suit of criteria (differing among subject areas) to group journals into discrete categories, it could potentially create incentives to publish in low-impact journals ranked highly by QUALIS. Here I assess the influence of the QUALIS journal ranking system on the global impact of Brazilian science. Brazil shows a steeper decrease in the number of citations per document since the implementation of this QUALIS system, compared to the top Latin American countries publishing more scientific articles. All subject areas showed some degree of bias, with social sciences being usually more biased than natural sciences. Lastly, the decrease in the number of citations over time proved steeper in a more biased subject area, suggesting a faster shift towards low-impact journals. Overall, the findings documented here suggest that the QUALIS system has undermined the global impact of Brazilian science, and reinforce a recent recommendation from an official committee evaluating graduate programs to eliminate QUALIS. A system based on impact metrics could avoid introducing distorted incentives, and thereby boost the global impact of Brazilian science.
publishDate 2020
dc.date.none.fl_str_mv 2020-01-01
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0001-37652020000500702
url http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0001-37652020000500702
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.1590/0001-3765202020201116
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv text/html
dc.publisher.none.fl_str_mv Academia Brasileira de Ciências
publisher.none.fl_str_mv Academia Brasileira de Ciências
dc.source.none.fl_str_mv Anais da Academia Brasileira de Ciências v.92 n.3 2020
reponame:Anais da Academia Brasileira de Ciências (Online)
instname:Academia Brasileira de Ciências (ABC)
instacron:ABC
instname_str Academia Brasileira de Ciências (ABC)
instacron_str ABC
institution ABC
reponame_str Anais da Academia Brasileira de Ciências (Online)
collection Anais da Academia Brasileira de Ciências (Online)
repository.name.fl_str_mv Anais da Academia Brasileira de Ciências (Online) - Academia Brasileira de Ciências (ABC)
repository.mail.fl_str_mv ||aabc@abc.org.br
_version_ 1754302869289304064