Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil

Detalhes bibliográficos
Autor(a) principal: Caballero Rivero, Alejandro
Data de Publicação: 2023
Outros Autores: Macedo dos Santos, Raimundo Nonato, Trzesniak, Piotr
Tipo de documento: Artigo
Idioma: por
Título da fonte: Informação & Informação
Texto Completo: https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/47178
Resumo: Objective: A bibliometric study of the scientific production of Health Sciences in Brazil is carried out to determine whether the publication patterns of researchers evaluated by the two main funding agencies of Brazil, the Coordination for the Improvement of Higher Education Personnel and the National Council for Scientific and Technological Development, differ from those of researchers who are not evaluated. The analysis is complemented by Richard Whitley's theoretical framework on “weak” and “strong” evaluation systems and the mechanisms that influence knowledge production. Methology: Data on scientific production were collected from the Lattes platform. A stratified random sample formed by homogeneous groups of researchers, considering whether they are evaluated by these agencies was used. Results: Results show that scientific production of researchers with productivity grants and being permanent professors of graduate programs is in line with the evaluation criteria used by the two agencies, while those of researchers who do not have productivity grants and are not permanent professors are not lined with these criteria. Important differences are verified between the publication patterns of these two groups, specifically on the used language, journal’s country, journal’s indexing in the Web of Science, journal’s Impact Factor on the Journal Citation Reports, and journal’s classification in the upper strata of Qualis Periódicos. Conclusions: Results suggest that these differences could be based on the fact that evaluated researchers are directly influenced by the mechanisms of resource allocation and reputation that underlie the evaluation systems used by the two agencies, while not evaluated researchers do not feel this influence directly.
id UEL-8_e8a0d6e85bc4a8df467c6658261f7557
oai_identifier_str oai:ojs.pkp.sfu.ca:article/47178
network_acronym_str UEL-8
network_name_str Informação & Informação
repository_id_str
spelling Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in BrazilAsociación entre los Sistemas de Evaluación de la Investigación y los Patrones de Publicación en las Ciencias de la Salud en BrasilAssociação entre os Sistemas de Avaliação da Pesquisa e os Padrões de Publicação nas Ciências da Saúde no BrasilResearch evaluation systemsPublication patternsHealth SciencesBrazilSistemas de evaluación de la investigaciónPatrones de publicaciónCiencias de la SaludBrasilSistemas de avaliação da pesquisaPadrões de publicaçãoCiências da SaúdeBrasilObjective: A bibliometric study of the scientific production of Health Sciences in Brazil is carried out to determine whether the publication patterns of researchers evaluated by the two main funding agencies of Brazil, the Coordination for the Improvement of Higher Education Personnel and the National Council for Scientific and Technological Development, differ from those of researchers who are not evaluated. The analysis is complemented by Richard Whitley's theoretical framework on “weak” and “strong” evaluation systems and the mechanisms that influence knowledge production. Methology: Data on scientific production were collected from the Lattes platform. A stratified random sample formed by homogeneous groups of researchers, considering whether they are evaluated by these agencies was used. Results: Results show that scientific production of researchers with productivity grants and being permanent professors of graduate programs is in line with the evaluation criteria used by the two agencies, while those of researchers who do not have productivity grants and are not permanent professors are not lined with these criteria. Important differences are verified between the publication patterns of these two groups, specifically on the used language, journal’s country, journal’s indexing in the Web of Science, journal’s Impact Factor on the Journal Citation Reports, and journal’s classification in the upper strata of Qualis Periódicos. Conclusions: Results suggest that these differences could be based on the fact that evaluated researchers are directly influenced by the mechanisms of resource allocation and reputation that underlie the evaluation systems used by the two agencies, while not evaluated researchers do not feel this influence directly.Objetivo: Realiza un estudio bibliométrico de la producción científica de las Ciencias de la Salud en Brasil para determinar si los patrones de publicación de los investigadores evaluados por las dos principales agencias de financiamiento del país (Coordinación para el Perfeccionamiento del Personal de Educación Superior y el Consejo Científico y Tecnológico), difieren de los que no son evaluados. El análisis se complementa con el marco teórico de Richard Whitley sobre los sistemas de evaluación “débiles” y “fuertes” y los mecanismos que influyen en la producción científica. Metodología: Los datos de producción científica fueron recolectados de la plataforma Lattes. Utiliza una muestra aleatoria estratificada formada por grupos homogéneos de investigadores, considerando si son evaluados o no. Resultados: Los resultados muestran que la producción científica de los investigadores con becas de productividad y profesores permanentes de programas de posgrado está alineada con los criterios de evaluación utilizados por las dos agencias, mientras que la de los investigadores que no son becarios o profesores permanentes no lo está. Se verifican diferencias importantes relacionadas con el idioma utilizado, el país de publicación de la revista, su indexación en Web of Science, su Factor de Impacto en el Journal Citation Reports y su clasificación en los estratos superiores de Qualis Periódicos. Conclusiones: Las diferencias podrían ser resultado de que los investigadores evaluados están influenciados directamente por los mecanismos de asignación de recursos y mejora de la reputación que subyacen en los sistemas de evaluación utilizados por las agencias, mientras que los no evaluados no sienten esa influencia de manera directa.Objetivo: Realiza estudo bibliométrico da produção científica das Ciências da Saúde no Brasil para determinar se os padrões de publicação dos pesquisadores submetidos às avaliações das duas principais agências de fomento no país (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior e Conselho Nacional de Desenvolvimento Científico e Tecnológico), diferem daqueles dos que não são avaliados. A análise é complementada pelo quadro teórico de Richard Whitley sobre sistemas de avaliação “fracos” e “fortes” e os mecanismos que influenciam a produção científica. Metodologia: Os dados da produção científica foram coletados da plataforma Lattes. Utiliza uma amostra aleatória estratificada conformada por grupos homogêneos de pesquisadores, considerando se estão submetidos ou não às avaliações. Resultados: Os resultados mostram que a produção científica dos pesquisadores bolsistas de produtividade e docentes permanentes de programas de pós-graduação está alinhada com os critérios de avaliação utilizados pelas duas agências, enquanto a dos pesquisadores que não são bolsistas, nem docentes permanentes, não está. Verifica diferenças importantes relativas ao idioma utilizado, o país de publicação da revista, sua indexação na Web of Science, seu Fator de Impacto do Journal Citation Reports, e seu enquadramento nos estratos superiores do Qualis Periódicos. Conclusões: Os resultados sugerem que essas diferenças poderiam ter como base o fato de os pesquisadores avaliados serem influenciados pelos mecanismos de alocação de recursos e incremento de reputação que subjazem os sistemas de avaliação utilizados pelas agências, enquanto seus pares não avaliados não sentem tal influência de forma direta.Universidade Estadual de Londrina2023-04-27info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://ojs.uel.br/revistas/uel/index.php/informacao/article/view/4717810.5433/1981-8920.2022v27n3p288Informação & Informação; v. 27 n. 3 (2022): Estudos Métricos da Informação; 288-3161981-8920reponame:Informação & Informaçãoinstname:Universidade Estadual de Londrina (UEL)instacron:UELporhttps://ojs.uel.br/revistas/uel/index.php/informacao/article/view/47178/48808Copyright (c) 2023 Dr. Alejandro Caballero Rivero, Dr. Prof. Raimundo Nonato Macedo dos Santos, Dr. Prof. Piotr Trzesniakhttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessCaballero Rivero, AlejandroMacedo dos Santos, Raimundo NonatoTrzesniak, Piotr2023-12-14T19:30:56Zoai:ojs.pkp.sfu.ca:article/47178Revistahttps://www.uel.br/revistas/uel/index.php/informacao/indexPUBhttps://www.uel.br/revistas/uel/index.php/informacao/oai||infoeinfo@uel.br10.5433/1981-89201981-89201414-2139opendoar:2023-12-14T19:30:56Informação & Informação - Universidade Estadual de Londrina (UEL)false
dc.title.none.fl_str_mv Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
Asociación entre los Sistemas de Evaluación de la Investigación y los Patrones de Publicación en las Ciencias de la Salud en Brasil
Associação entre os Sistemas de Avaliação da Pesquisa e os Padrões de Publicação nas Ciências da Saúde no Brasil
title Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
spellingShingle Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
Caballero Rivero, Alejandro
Research evaluation systems
Publication patterns
Health Sciences
Brazil
Sistemas de evaluación de la investigación
Patrones de publicación
Ciencias de la Salud
Brasil
Sistemas de avaliação da pesquisa
Padrões de publicação
Ciências da Saúde
Brasil
title_short Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
title_full Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
title_fullStr Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
title_full_unstemmed Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
title_sort Association between Research Evaluation Systems and Publication Patterns in Heath Sciences in Brazil
author Caballero Rivero, Alejandro
author_facet Caballero Rivero, Alejandro
Macedo dos Santos, Raimundo Nonato
Trzesniak, Piotr
author_role author
author2 Macedo dos Santos, Raimundo Nonato
Trzesniak, Piotr
author2_role author
author
dc.contributor.author.fl_str_mv Caballero Rivero, Alejandro
Macedo dos Santos, Raimundo Nonato
Trzesniak, Piotr
dc.subject.por.fl_str_mv Research evaluation systems
Publication patterns
Health Sciences
Brazil
Sistemas de evaluación de la investigación
Patrones de publicación
Ciencias de la Salud
Brasil
Sistemas de avaliação da pesquisa
Padrões de publicação
Ciências da Saúde
Brasil
topic Research evaluation systems
Publication patterns
Health Sciences
Brazil
Sistemas de evaluación de la investigación
Patrones de publicación
Ciencias de la Salud
Brasil
Sistemas de avaliação da pesquisa
Padrões de publicação
Ciências da Saúde
Brasil
description Objective: A bibliometric study of the scientific production of Health Sciences in Brazil is carried out to determine whether the publication patterns of researchers evaluated by the two main funding agencies of Brazil, the Coordination for the Improvement of Higher Education Personnel and the National Council for Scientific and Technological Development, differ from those of researchers who are not evaluated. The analysis is complemented by Richard Whitley's theoretical framework on “weak” and “strong” evaluation systems and the mechanisms that influence knowledge production. Methology: Data on scientific production were collected from the Lattes platform. A stratified random sample formed by homogeneous groups of researchers, considering whether they are evaluated by these agencies was used. Results: Results show that scientific production of researchers with productivity grants and being permanent professors of graduate programs is in line with the evaluation criteria used by the two agencies, while those of researchers who do not have productivity grants and are not permanent professors are not lined with these criteria. Important differences are verified between the publication patterns of these two groups, specifically on the used language, journal’s country, journal’s indexing in the Web of Science, journal’s Impact Factor on the Journal Citation Reports, and journal’s classification in the upper strata of Qualis Periódicos. Conclusions: Results suggest that these differences could be based on the fact that evaluated researchers are directly influenced by the mechanisms of resource allocation and reputation that underlie the evaluation systems used by the two agencies, while not evaluated researchers do not feel this influence directly.
publishDate 2023
dc.date.none.fl_str_mv 2023-04-27
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/47178
10.5433/1981-8920.2022v27n3p288
url https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/47178
identifier_str_mv 10.5433/1981-8920.2022v27n3p288
dc.language.iso.fl_str_mv por
language por
dc.relation.none.fl_str_mv https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/47178/48808
dc.rights.driver.fl_str_mv http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Estadual de Londrina
publisher.none.fl_str_mv Universidade Estadual de Londrina
dc.source.none.fl_str_mv Informação & Informação; v. 27 n. 3 (2022): Estudos Métricos da Informação; 288-316
1981-8920
reponame:Informação & Informação
instname:Universidade Estadual de Londrina (UEL)
instacron:UEL
instname_str Universidade Estadual de Londrina (UEL)
instacron_str UEL
institution UEL
reponame_str Informação & Informação
collection Informação & Informação
repository.name.fl_str_mv Informação & Informação - Universidade Estadual de Londrina (UEL)
repository.mail.fl_str_mv ||infoeinfo@uel.br
_version_ 1799305987841064960