Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!

Detalhes bibliográficos
Autor(a) principal: Torres, Adriana Amadeu Garcia
Data de Publicação: 2018
Tipo de documento: Tese
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da UNIGRANRIO
Texto Completo: http://localhost:8080/tede/handle/tede/334
Resumo: The evaluation is a complex subject, which consists in judging the value and merit of evaluand (SCRIVEN, 1991). Higher Education in Brazil is evaluation by a national evaluation system (Sinaes) and this thesis aims to identify how and what is evaluated by Sinaes and to whom this evaluation process is intended, considering its cyclic process. Its relevance is to allow: the public power to rethink norms and procedures; the society makes its participation effective; the higher education institutions to maintain their identities; the students to broaden their view of the system; and the staff involved in the process works in gaps. So, in order to understand concepts, typologies and the evaluation process itself, three important publications were considered: Pfeifer (2012), Silva (2016) and Worthen et al. (2004). Besides that, the possible of ways to use it were found in: The evaluation of the quality of Davok (2006) and the Vector of Excellence (EWELL, 1984) and the Effectiveness Framework (KRAKOWER, 1985) of the National Center for the Management System of Higher Education (NCHEMS). For methodology required searching in different documents to develop a descriptive study capable of analyzing The Sinaes’s process and make recommendations and judgments. The analysis was performed in two ways: categorical, based on the six approach of the evaluation of Worthen et al. (2004); and of content; both with inferences and interpretations respecting the Bardin's proposal (2011). For that, was used a diversified data sources, constructing the research corpus with quantitative and qualitative data simultaneously. As a conclusion, there are two processes: proposed and implemented, via Sinaes, and many distortions were find, such as its beginning: in the plan it appears as being if by the institutional report; and in practice by the National Student Performance Exam (Enade). To identify what has been evaluated, two fronts must be considered: the visit and the Enade. In the visit, the 10 dimensions provided for in the Law that considered the HEI mission, its policies (teaching, management and personnel), interaction with society, infrastructure and financial sustainability are measured, albeit to a limited extent. The Enade measures the knowledge and skills of the student via exam and their perception on three institutional aspects: infrastructure, didactic-pedagogical organization and opportunities for extension of the training, by questionnaire. In relation to: for whom is measured. It is noted that, in practice, decisions are made by specific group based on legislation. Nevertheless, as a evaluation research, recommendations were made, and it was possible to propose a system of responsive evaluation that works a database for feeding all the actors involved. To do so, one must separate the processes of evaluation (judgments) and data collection (inputs), knowing that quality is not a single concept, but rather the result of a judgment.
id UGRI_b93bd6df10f5970d66891f25f01d0ddd
oai_identifier_str oai:localhost:tede/334
network_acronym_str UGRI
network_name_str Biblioteca Digital de Teses e Dissertações da UNIGRANRIO
repository_id_str
spelling Wanderley, Sérgio Eduardo de P. VelhoBarros, Denise FrancaZouain, Déborah MoraesSilva, Maria de Lourdes Sá E. de M. eOliveira, Fátima Bayma deSilva, Angela Carrancho daTorres, Adriana Amadeu Garcia2019-02-12T18:53:05Z2018-05-03Torres, Adriana Amadeu Garcia. Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!. 2018. 227 f. Tese (Programa de Pós-Graduacão em Administração) - Universidade do Grande Rio, Rio de Janeiro.http://localhost:8080/tede/handle/tede/334The evaluation is a complex subject, which consists in judging the value and merit of evaluand (SCRIVEN, 1991). Higher Education in Brazil is evaluation by a national evaluation system (Sinaes) and this thesis aims to identify how and what is evaluated by Sinaes and to whom this evaluation process is intended, considering its cyclic process. Its relevance is to allow: the public power to rethink norms and procedures; the society makes its participation effective; the higher education institutions to maintain their identities; the students to broaden their view of the system; and the staff involved in the process works in gaps. So, in order to understand concepts, typologies and the evaluation process itself, three important publications were considered: Pfeifer (2012), Silva (2016) and Worthen et al. (2004). Besides that, the possible of ways to use it were found in: The evaluation of the quality of Davok (2006) and the Vector of Excellence (EWELL, 1984) and the Effectiveness Framework (KRAKOWER, 1985) of the National Center for the Management System of Higher Education (NCHEMS). For methodology required searching in different documents to develop a descriptive study capable of analyzing The Sinaes’s process and make recommendations and judgments. The analysis was performed in two ways: categorical, based on the six approach of the evaluation of Worthen et al. (2004); and of content; both with inferences and interpretations respecting the Bardin's proposal (2011). For that, was used a diversified data sources, constructing the research corpus with quantitative and qualitative data simultaneously. As a conclusion, there are two processes: proposed and implemented, via Sinaes, and many distortions were find, such as its beginning: in the plan it appears as being if by the institutional report; and in practice by the National Student Performance Exam (Enade). To identify what has been evaluated, two fronts must be considered: the visit and the Enade. In the visit, the 10 dimensions provided for in the Law that considered the HEI mission, its policies (teaching, management and personnel), interaction with society, infrastructure and financial sustainability are measured, albeit to a limited extent. The Enade measures the knowledge and skills of the student via exam and their perception on three institutional aspects: infrastructure, didactic-pedagogical organization and opportunities for extension of the training, by questionnaire. In relation to: for whom is measured. It is noted that, in practice, decisions are made by specific group based on legislation. Nevertheless, as a evaluation research, recommendations were made, and it was possible to propose a system of responsive evaluation that works a database for feeding all the actors involved. To do so, one must separate the processes of evaluation (judgments) and data collection (inputs), knowing that quality is not a single concept, but rather the result of a judgment.Diante da complexidade do tema avaliação, que consiste no ato de julgar valor e mérito de um objeto (SCRIVEN, 1991a); e da importância do Sistema Nacional de Avaliação da Educação Superior (Sinaes) no cenário nacional, nesta tese o objetivo geral foi identificar como e o que é avaliado pelo Sinaes e a quem este processo de avaliação se destina, considerando sua adoção no processo de recredenciamento dos cursos. Sua relevância contempla permitir: ao poder público repensar normas e procedimentos; à sociedade tornar sua participação efetiva; às instituições de ensino manter suas identidades; aos estudantes ampliar sua visão do sistema; e à própria equipe envolvida no processo tratar as lacunas presentes. Como referencial teórico, para compreender conceitos, tipologias e o processo de avaliação em si, três trabalhos foram importantes: Pfeifer (2012), Silva (2016) e Worthen et al. (2004). Já as formas de “usos” (SCRIVEN, 1991a) da avaliação foram tratadas segundo três modelos: o de avaliação da qualidade de Davok (2006) e dos Vetor de excelência (EWELL, 1984) e da Estrutura de effectiveness (KRAKOWER, 1985) do Centro Nacional para o Sistema de Gestão do Ensino Superior (NCHEMS). A metodologia exigiu busca em documentos distintos, para desenvolver a “arqueologia” do Sinaes, num estudo descritivo, em que analisei o Sinaes de duas formas: categorial, com base nas seis abordagens da avaliação de Worthen et al. (2004); e de conteúdo. Em ambos os casos inferências e interpretações foram incluídas respeitando a proposta da Bardin (2011). A construção do corpus de pesquisa foi por meio de fontes de dados diversificadas, contendo dados quantitativos e qualitativos. Como conclusão foram identificados dois processos: proposto e implementado, via Sinaes, demonstrando distorções, como, por exemplo, quanto ao seu início: no plano consta como sendo via relatório institucional; e na prática via Exame Nacional de Desempenho do Estudante (Enade). Para identificar o que vem sendo avaliado foi preciso considerar duas frentes que atuam em paralelo: a visita in loco e o Enade. Na visita in loco, são medidas, ainda que de forma limitada, as 10 dimensões previstas na Lei que contemplam a missão da IES, suas políticas (ensino, gestão e pessoal), interação com a sociedade, infraestrutura e sustentabilidade financeira. O Enade mede os conhecimentos e habilidades do estudante via prova e sua percepção sobre três aspectos institucionais: infraestrutura, organização didáticopedagógica e oportunidades de ampliação da formação, via questionário. Em relação ao destino dos resultados, dado o objetivo proposto pelo Sinaes, na prática, as decisões são tomadas pelo Inep baseado na legislação. Como recomendações, sugiro separar os processos de avaliação (julgamentos) e de coleta de dados (insumos), sabendo que qualidade não é um conceito único, mas sim resultado de julgamento para, então, trabalhar o sistema de avaliação responsivo delineado, baseado num banco de dados que alimenta todos os atores envolvidos.Submitted by Patricia Vieira Silva (patricia.silva@unigranrio.com.br) on 2019-02-12T18:53:05Z No. of bitstreams: 1 Tese - Adriana Amadeu.pdf: 10573516 bytes, checksum: 2deee3e22b5e3d6996f2b56304ea71e3 (MD5)Made available in DSpace on 2019-02-12T18:53:05Z (GMT). No. of bitstreams: 1 Tese - Adriana Amadeu.pdf: 10573516 bytes, checksum: 2deee3e22b5e3d6996f2b56304ea71e3 (MD5) Previous issue date: 2018-05-03application/pdfporUniversidade do Grande RioPrograma de Pós-Graduacão em AdministraçãoUNIGRANRIOBrasilUnigranrio::AdministraçãoAdministraçãoSistema Nacional de Avaliação da Educação Superior (Brasil)Ensino SuperiorAdministraçãoGestão organizacionalUma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisinfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UNIGRANRIOinstname:Universidade do Grande Rio (UNIGRANRIO)instacron:UNIGRANRIOORIGINALTese - Adriana Amadeu.pdfTese - Adriana Amadeu.pdfapplication/pdf10573516http://localhost:8080/tede/bitstream/tede/334/2/Tese+-+Adriana+Amadeu.pdf2deee3e22b5e3d6996f2b56304ea71e3MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-81982http://localhost:8080/tede/bitstream/tede/334/1/license.txt4a50535e8405f611398e6e2d408dbd1bMD51tede/3342019-02-12 16:53:05.388oai:localhost:tede/334CkxJQ0VOw4dBIERFIERJU1RSSUJVScOHw4NPIE7Dg08tRVhDTFVTSVZBCgpDb20gYSBhcHJlc2VudGHDp8OjbyBkZXN0YSBsaWNlbsOnYSwgdm9jw6ogKG8gYXV0b3IgKGVzKSBvdSBvIHRpdHVsYXIgZG9zIGRpcmVpdG9zIGRlIGF1dG9yKSBjb25jZWRlIMOgIFVuaXZlcnNpZGFkZSAKVU5JR1JBTlJJTyBvIGRpcmVpdG8gbsOjby1leGNsdXNpdm8gZGUgcmVwcm9kdXppciwgIHRyYWR1emlyIChjb25mb3JtZSBkZWZpbmlkbyBhYmFpeG8pLCBlL291IApkaXN0cmlidWlyIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAoaW5jbHVpbmRvIG8gcmVzdW1vKSBwb3IgdG9kbyBvIG11bmRvIG5vIGZvcm1hdG8gaW1wcmVzc28gZSBlbGV0csO0bmljbyBlIAplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVOSUdSQU5SSU8gcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAKcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBhIFVOSUdSQU5SSU8gcG9kZSBtYW50ZXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRhIHN1YSB0ZXNlIG91IApkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcyAKbmVzdGEgbGljZW7Dp2EuIFZvY8OqIHRhbWLDqW0gZGVjbGFyYSBxdWUgbyBkZXDDs3NpdG8gZGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBuw6NvLCBxdWUgc2VqYSBkZSBzZXUgCmNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3XDqW0uCgpDYXNvIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiAKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVOSUdSQU5SSU8gCm9zIGRpcmVpdG9zIGFwcmVzZW50YWRvcyBuZXN0YSBsaWNlbsOnYSwgZSBxdWUgZXNzZSBtYXRlcmlhbCBkZSBwcm9wcmllZGFkZSBkZSB0ZXJjZWlyb3MgZXN0w6EgY2xhcmFtZW50ZSAKaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBvcmEgZGVwb3NpdGFkYS4KCkNBU08gQSBURVNFIE9VIERJU1NFUlRBw4fDg08gT1JBIERFUE9TSVRBREEgVEVOSEEgU0lETyBSRVNVTFRBRE8gREUgVU0gUEFUUk9Dw41OSU8gT1UgCkFQT0lPIERFIFVNQSBBR8OKTkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTsODTyBTRUpBIEEgVU5JR1JBTlJJTywgClZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PIApUQU1Cw4lNIEFTIERFTUFJUyBPQlJJR0HDh8OVRVMgRVhJR0lEQVMgUE9SIENPTlRSQVRPIE9VIEFDT1JETy4KCkEgVU5JR1JBTlJJTyBzZSBjb21wcm9tZXRlIGEgaWRlbnRpZmljYXIgY2xhcmFtZW50ZSBvIHNldSBub21lIChzKSBvdSBvKHMpIG5vbWUocykgZG8ocykgCmRldGVudG9yKGVzKSBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzIApjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://tede.unigranrio.edu.br/PUBhttp://tede.unigranrio.edu.br/oai/requestrepositorio@instituicao.br||repositorio@instituicao.bropendoar:2019-02-12T18:53:05Biblioteca Digital de Teses e Dissertações da UNIGRANRIO - Universidade do Grande Rio (UNIGRANRIO)false
dc.title.por.fl_str_mv Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
title Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
spellingShingle Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
Torres, Adriana Amadeu Garcia
Administração
Sistema Nacional de Avaliação da Educação Superior (Brasil)
Ensino Superior
Administração
Gestão organizacional
title_short Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
title_full Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
title_fullStr Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
title_full_unstemmed Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
title_sort Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!
author Torres, Adriana Amadeu Garcia
author_facet Torres, Adriana Amadeu Garcia
author_role author
dc.contributor.advisor1.fl_str_mv Wanderley, Sérgio Eduardo de P. Velho
dc.contributor.referee1.fl_str_mv Barros, Denise Franca
dc.contributor.referee2.fl_str_mv Zouain, Déborah Moraes
dc.contributor.referee3.fl_str_mv Silva, Maria de Lourdes Sá E. de M. e
dc.contributor.referee4.fl_str_mv Oliveira, Fátima Bayma de
dc.contributor.referee5.fl_str_mv Silva, Angela Carrancho da
dc.contributor.author.fl_str_mv Torres, Adriana Amadeu Garcia
contributor_str_mv Wanderley, Sérgio Eduardo de P. Velho
Barros, Denise Franca
Zouain, Déborah Moraes
Silva, Maria de Lourdes Sá E. de M. e
Oliveira, Fátima Bayma de
Silva, Angela Carrancho da
dc.subject.por.fl_str_mv Administração
Sistema Nacional de Avaliação da Educação Superior (Brasil)
Ensino Superior
topic Administração
Sistema Nacional de Avaliação da Educação Superior (Brasil)
Ensino Superior
Administração
Gestão organizacional
dc.subject.cnpq.fl_str_mv Administração
Gestão organizacional
description The evaluation is a complex subject, which consists in judging the value and merit of evaluand (SCRIVEN, 1991). Higher Education in Brazil is evaluation by a national evaluation system (Sinaes) and this thesis aims to identify how and what is evaluated by Sinaes and to whom this evaluation process is intended, considering its cyclic process. Its relevance is to allow: the public power to rethink norms and procedures; the society makes its participation effective; the higher education institutions to maintain their identities; the students to broaden their view of the system; and the staff involved in the process works in gaps. So, in order to understand concepts, typologies and the evaluation process itself, three important publications were considered: Pfeifer (2012), Silva (2016) and Worthen et al. (2004). Besides that, the possible of ways to use it were found in: The evaluation of the quality of Davok (2006) and the Vector of Excellence (EWELL, 1984) and the Effectiveness Framework (KRAKOWER, 1985) of the National Center for the Management System of Higher Education (NCHEMS). For methodology required searching in different documents to develop a descriptive study capable of analyzing The Sinaes’s process and make recommendations and judgments. The analysis was performed in two ways: categorical, based on the six approach of the evaluation of Worthen et al. (2004); and of content; both with inferences and interpretations respecting the Bardin's proposal (2011). For that, was used a diversified data sources, constructing the research corpus with quantitative and qualitative data simultaneously. As a conclusion, there are two processes: proposed and implemented, via Sinaes, and many distortions were find, such as its beginning: in the plan it appears as being if by the institutional report; and in practice by the National Student Performance Exam (Enade). To identify what has been evaluated, two fronts must be considered: the visit and the Enade. In the visit, the 10 dimensions provided for in the Law that considered the HEI mission, its policies (teaching, management and personnel), interaction with society, infrastructure and financial sustainability are measured, albeit to a limited extent. The Enade measures the knowledge and skills of the student via exam and their perception on three institutional aspects: infrastructure, didactic-pedagogical organization and opportunities for extension of the training, by questionnaire. In relation to: for whom is measured. It is noted that, in practice, decisions are made by specific group based on legislation. Nevertheless, as a evaluation research, recommendations were made, and it was possible to propose a system of responsive evaluation that works a database for feeding all the actors involved. To do so, one must separate the processes of evaluation (judgments) and data collection (inputs), knowing that quality is not a single concept, but rather the result of a judgment.
publishDate 2018
dc.date.issued.fl_str_mv 2018-05-03
dc.date.accessioned.fl_str_mv 2019-02-12T18:53:05Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv Torres, Adriana Amadeu Garcia. Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!. 2018. 227 f. Tese (Programa de Pós-Graduacão em Administração) - Universidade do Grande Rio, Rio de Janeiro.
dc.identifier.uri.fl_str_mv http://localhost:8080/tede/handle/tede/334
identifier_str_mv Torres, Adriana Amadeu Garcia. Uma avaliação do Sistema Nacional de Avaliação da Educação Superior (SINAES) : medir o quê para quem, eis a questão!. 2018. 227 f. Tese (Programa de Pós-Graduacão em Administração) - Universidade do Grande Rio, Rio de Janeiro.
url http://localhost:8080/tede/handle/tede/334
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade do Grande Rio
dc.publisher.program.fl_str_mv Programa de Pós-Graduacão em Administração
dc.publisher.initials.fl_str_mv UNIGRANRIO
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Unigranrio::Administração
publisher.none.fl_str_mv Universidade do Grande Rio
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UNIGRANRIO
instname:Universidade do Grande Rio (UNIGRANRIO)
instacron:UNIGRANRIO
instname_str Universidade do Grande Rio (UNIGRANRIO)
instacron_str UNIGRANRIO
institution UNIGRANRIO
reponame_str Biblioteca Digital de Teses e Dissertações da UNIGRANRIO
collection Biblioteca Digital de Teses e Dissertações da UNIGRANRIO
bitstream.url.fl_str_mv http://localhost:8080/tede/bitstream/tede/334/2/Tese+-+Adriana+Amadeu.pdf
http://localhost:8080/tede/bitstream/tede/334/1/license.txt
bitstream.checksum.fl_str_mv 2deee3e22b5e3d6996f2b56304ea71e3
4a50535e8405f611398e6e2d408dbd1b
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UNIGRANRIO - Universidade do Grande Rio (UNIGRANRIO)
repository.mail.fl_str_mv repositorio@instituicao.br||repositorio@instituicao.br
_version_ 1800409281475903488