Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil

Detalhes bibliográficos
Autor(a) principal: Arantes, Karla Loyola de Oliveira
Data de Publicação: 2016
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da PUC_RS
Texto Completo: http://tede2.pucrs.br/tede2/handle/tede/7027
Resumo: Introduction: Prognostic scores are useful tools in assessing the effectiveness of treatments, mortality risk and quality of services, allowing the comparison between different Intensive Care Units as the implementation and improvement of treatment and public health policies and protocols. The PIM (Pediatric Index of Mortality) is one of the most widely used prognostic scores in pediatrics and has improved generating PIM 2 and PIM 3. The latest has not been validated in developing countries. Objectives: Validation of PIM 3 score in a tertiary pediatric hospital in southeastern Brazil, and comparison of its performance with the PIM 2, currently used. Methods: A contemporary cohort study undertaken between January 1 and December 31, 2014, at the Pediatric Intensive Care Unit of HEINSG (Hospital Estadual Infantil Nossa Senhora da Glória). The sample characterization was performed using the observed frequency, percentage, measures of central tendency and variability. The calibration of the scores was analyzed by the Hosmer-Lemeshow test setting, while the Z statistic Flora was used to evaluate the similarity between overall mortality and the one observed through the standardized mortality rate (SMR - Standardized Mortality Rate). For Flora z test, it is considered critical values for the non-null hypothesis rejected the two standard deviations (SD) (or between <1.96 and> -1.96). The area under the ROC curve (Receiver Operating Characteristic) was used to analyze the discrimination capacity of PIM2 and PIM3 models among patients who were discharged or died, and the assessment of the concordance between the measures of PIM 2 and PIM3 was performed using the Student t test for independent samples. The agreement between the measures of PIM 2 and PIM3 was evaluated by Bland & Altman plot. The significance alpha level used in the analyzes was 5% and 95% confidence interval. Data were collected in an Excel table, confirmed on medical records and later transferred to IBM SPSS software to perform all analyzes. Results: 293 patients were admitted to the PICU during the studied period, 38 of whom presented exclusion criteria. 35 (13.7%) of the 255 patients studied died. The average score PIM2 was significantly higher than the PIM3, and Flora Z statistics showed no difference between the overall mortality observed and the expected one in PIM2, but this difference was found in PIM3. The PIM2 score got an excellent discrimination (AUC = 0.830) and its sensitivity was 85.7, and the specificity was 69.1. On the other hand, the PIM 3 score had an acceptable discrimination (AUC = 0.748), while its sensitivity was 74.3, and its specificity was 67.7. The comparison between the areas under the ROC curve of PIM2 and PIM3 was significant (p = 0.015), showing that there is a difference between their areas, with better performance for PIM2 compared to PIM 3 (Z Flora 2.427). The Bland-Altman diagramme indicated that the 95% limits of concordance between the two versions of PIM ranged from -1.2 to 2.3, indicating that the measures are inconsistent. There is discordance of 10.6% above and below the limit ± 1.96 standard deviations (SD) between the mentioned values, that is about twice the tolerable 5%. Conclusion: In our study, the PIM 2 shows better results to discriminate those patients who will die. We suggest, based on these results, that data collection should be maintained using the 2 versions of the score in this unit. Than, these data could be reanalyzed with a larger sample, and these results could be compared with new studies conducted in locations where population have similar characteristics.
id P_RS_b177f546dae5655eca61410ce099b431
oai_identifier_str oai:tede2.pucrs.br:tede/7027
network_acronym_str P_RS
network_name_str Biblioteca Digital de Teses e Dissertações da PUC_RS
repository_id_str
spelling Garcia, Pedro Celiny Ramos114.237.140-91http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4787221J8052.967.237-59http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4766301T4Arantes, Karla Loyola de Oliveira2016-11-09T10:20:25Z2016-08-31http://tede2.pucrs.br/tede2/handle/tede/7027Introduction: Prognostic scores are useful tools in assessing the effectiveness of treatments, mortality risk and quality of services, allowing the comparison between different Intensive Care Units as the implementation and improvement of treatment and public health policies and protocols. The PIM (Pediatric Index of Mortality) is one of the most widely used prognostic scores in pediatrics and has improved generating PIM 2 and PIM 3. The latest has not been validated in developing countries. Objectives: Validation of PIM 3 score in a tertiary pediatric hospital in southeastern Brazil, and comparison of its performance with the PIM 2, currently used. Methods: A contemporary cohort study undertaken between January 1 and December 31, 2014, at the Pediatric Intensive Care Unit of HEINSG (Hospital Estadual Infantil Nossa Senhora da Glória). The sample characterization was performed using the observed frequency, percentage, measures of central tendency and variability. The calibration of the scores was analyzed by the Hosmer-Lemeshow test setting, while the Z statistic Flora was used to evaluate the similarity between overall mortality and the one observed through the standardized mortality rate (SMR - Standardized Mortality Rate). For Flora z test, it is considered critical values for the non-null hypothesis rejected the two standard deviations (SD) (or between <1.96 and> -1.96). The area under the ROC curve (Receiver Operating Characteristic) was used to analyze the discrimination capacity of PIM2 and PIM3 models among patients who were discharged or died, and the assessment of the concordance between the measures of PIM 2 and PIM3 was performed using the Student t test for independent samples. The agreement between the measures of PIM 2 and PIM3 was evaluated by Bland & Altman plot. The significance alpha level used in the analyzes was 5% and 95% confidence interval. Data were collected in an Excel table, confirmed on medical records and later transferred to IBM SPSS software to perform all analyzes. Results: 293 patients were admitted to the PICU during the studied period, 38 of whom presented exclusion criteria. 35 (13.7%) of the 255 patients studied died. The average score PIM2 was significantly higher than the PIM3, and Flora Z statistics showed no difference between the overall mortality observed and the expected one in PIM2, but this difference was found in PIM3. The PIM2 score got an excellent discrimination (AUC = 0.830) and its sensitivity was 85.7, and the specificity was 69.1. On the other hand, the PIM 3 score had an acceptable discrimination (AUC = 0.748), while its sensitivity was 74.3, and its specificity was 67.7. The comparison between the areas under the ROC curve of PIM2 and PIM3 was significant (p = 0.015), showing that there is a difference between their areas, with better performance for PIM2 compared to PIM 3 (Z Flora 2.427). The Bland-Altman diagramme indicated that the 95% limits of concordance between the two versions of PIM ranged from -1.2 to 2.3, indicating that the measures are inconsistent. There is discordance of 10.6% above and below the limit ± 1.96 standard deviations (SD) between the mentioned values, that is about twice the tolerable 5%. Conclusion: In our study, the PIM 2 shows better results to discriminate those patients who will die. We suggest, based on these results, that data collection should be maintained using the 2 versions of the score in this unit. Than, these data could be reanalyzed with a larger sample, and these results could be compared with new studies conducted in locations where population have similar characteristics.Introdução: Escores prognósticos são ferramentas úteis na avaliação da eficácia de tratamentos, risco de mortalidade e qualidade de serviços, possibilitando comparação entre diferentes UTI (Unidade de Terapia Intensiva), além de implementação e melhorias de protocolos de tratamento e políticas de saúde pública. O PIM (Pediatric Index of Mortality) é atualmente um dos escores prognósticos mais utilizados na pediatria, tendo sido aperfeiçoado gerando o PIM 2 e mais recentemente o PIM 3, este último até o momento não validado em países em desenvolvimento. Objetivos: Validação do PIM3 em um hospital pediátrico terciário no sudeste do Brasil, e comparação de sua performance com o PIM 2, escore atualmente utilizado. Métodos: Estudo de coorte histórico retrospectivo, realizado entre 1º de janeiro e 31 de dezembro de 2014 na Unidade de Terapia Intensiva Pediátrica (UTIP) do HEINSG (Hospital Estadual Infantil Nossa Senhora da Glória). A caracterização da amostra foi realizada através da frequência observada, porcentagem, medidas de tendência central e de variabilidade. A calibração dos escores foi analisada pelo teste de ajuste de Hosmer-Lemeshow, enquanto a estatística Z de Flora foi utilizada para avaliar a semelhança entre a mortalidade geral e observada através do índice padronizado de mortalidade (SMR - Standardized Mortality Rate). Para o teste z de Flora, considerou-se valores críticos para não-rejeição da hipótese nula o intervalo de dois desvios padrão (DP) (ou entre < 1,96 e > -1,96). A área sob a curva ROC (Receiver Operating Characteristic) foi utilizada para a análise da capacidade de discriminação dos modelos PIM2 e PIM3 entre os pacientes que teriam alta ou evoluiriam para o óbito, e a avaliação da semelhança entre as médias do PIM2 e PIM3 foi feita através do teste t de Student para amostras independentes. A concordância entre as medidas do PIM2 e PIM3 foi avaliada pelo gráfico de Bland & Altman. O nível alfa de significância utilizado nas análises foi de 5% e intervalo de confiança de 95%. Os dados foram coletados em uma tabela Excel, conferidos em prontuários médicos e posteriormente transferidos para o software IBM SPSS para a realização de todas as análises. Resultados: Foram admitidos 293 pacientes no período estudado, sendo 38 excluídos por apresentarem um dos critérios de exclusão. Dos 255 pacientes analisados, 35 (13,7%) foram a óbito. O escore médio do PIM2 foi significativamente maior que o do PIM3, e a estatística Z de flora evidenciou não haver diferença entre a mortalidade geral observada e esperada no PIM2, mas há diferença destas no PIM3. O PIM2 obteve uma discriminação excelente (AUC = 0.830) e sua sensibilidade foi de 85.7 e especificidade de 69.1. Já o PIM3 obteve uma discriminação aceitável (AUC = 0.748) e sua sensibilidade foi de 74.3 e especificidade de 67.7. A comparação entre as áreas sob a curva ROC do PIM2 e PIM3 foi significativa (p = 0.015), evidenciando que há diferença entre as suas áreas, com melhor desempenho do PIM2 em relação ao PIM 3 (Z de Flora 2.427). O gráfico de Bland-Altman indicou que os limites de 95% de concordância entre as 2 versões do PIM variaram de -1,2 a 2,3, indicando que as medidas são inconsistentes, havendo discordância entre as mesmas que incluem 10,6% valores acima e abaixo do limite ± 1,96 DP, cerca do dobro do tolerável de 5%. Conclusões: Neste estudo, o PIM 2 apresentou melhores resultados para discriminar aqueles pacientes que irão a óbito, se comparado ao PIM 3. Poderia se sugerir, partindo desses resultados, que fosse mantida a coleta de dados utilizando as 2 versões do escore nesta unidade, para que estes dados possam ser novamente analisados com uma amostra maior, e que esses resultados possam ser comparados com novos estudos que devem surgir em locais com populações com características semelhantes.Submitted by Setor de Tratamento da Informação - BC/PUCRS (tede2@pucrs.br) on 2016-11-09T10:20:25Z No. of bitstreams: 1 DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf: 498884 bytes, checksum: bb7c00542339d8c42d7f409e045abdf5 (MD5)Made available in DSpace on 2016-11-09T10:20:25Z (GMT). No. of bitstreams: 1 DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf: 498884 bytes, checksum: bb7c00542339d8c42d7f409e045abdf5 (MD5) Previous issue date: 2016-08-31application/pdfhttp://tede2.pucrs.br:80/tede2/retrieve/166653/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.jpgporPontifícia Universidade Católica do Rio Grande do SulPrograma de Pós-Graduação em Medicina/Pediatria e Saúde da CriançaPUCRSBrasilFaculdade de MedicinaCRIANÇASMORTALIDADE INFANTILPROGNÓSTICOUNIDADES DE TERAPIA INTENSIVAPEDIATRIAMEDICINACIENCIAS DA SAUDE::MEDICINAValidação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasilinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesistrabalho_sem_restricao3098206005268432148600600600-8624664729441623247-969369452308786627info:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da PUC_RSinstname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)instacron:PUC_RSTHUMBNAILDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.jpgDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.jpgimage/jpeg3139http://tede2.pucrs.br/tede2/bitstream/tede/7027/5/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.jpgd08e8992a03918365e48a03bc8b3273cMD55TEXTDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.txtDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.txttext/plain21079http://tede2.pucrs.br/tede2/bitstream/tede/7027/4/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.txt96544c435cca0c6a6afa0b1064772d7aMD54LICENSElicense.txtlicense.txttext/plain; charset=utf-8610http://tede2.pucrs.br/tede2/bitstream/tede/7027/3/license.txt5a9d6006225b368ef605ba16b4f6d1beMD53ORIGINALDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdfDIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdfapplication/pdf498884http://tede2.pucrs.br/tede2/bitstream/tede/7027/2/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdfbb7c00542339d8c42d7f409e045abdf5MD52tede/70272016-11-09 12:01:11.492oai:tede2.pucrs.br:tede/7027QXV0b3JpemHDp8OjbyBwYXJhIFB1YmxpY2HDp8OjbyBFbGV0csO0bmljYTogQ29tIGJhc2Ugbm8gZGlzcG9zdG8gbmEgTGVpIEZlZGVyYWwgbsK6OS42MTAsIGRlIDE5IGRlIGZldmVyZWlybyBkZSAxOTk4LCBvIGF1dG9yIEFVVE9SSVpBIGEgcHVibGljYcOnw6NvIGVsZXRyw7RuaWNhIGRhIHByZXNlbnRlIG9icmEgbm8gYWNlcnZvIGRhIEJpYmxpb3RlY2EgRGlnaXRhbCBkYSBQb250aWbDrWNpYSBVbml2ZXJzaWRhZGUgQ2F0w7NsaWNhIGRvIFJpbyBHcmFuZGUgZG8gU3VsLCBzZWRpYWRhIGEgQXYuIElwaXJhbmdhIDY2ODEsIFBvcnRvIEFsZWdyZSwgUmlvIEdyYW5kZSBkbyBTdWwsIGNvbSByZWdpc3RybyBkZSBDTlBKIDg4NjMwNDEzMDAwMi04MSBiZW0gY29tbyBlbSBvdXRyYXMgYmlibGlvdGVjYXMgZGlnaXRhaXMsIG5hY2lvbmFpcyBlIGludGVybmFjaW9uYWlzLCBjb25zw7NyY2lvcyBlIHJlZGVzIMOgcyBxdWFpcyBhIGJpYmxpb3RlY2EgZGEgUFVDUlMgcG9zc2EgYSB2aXIgcGFydGljaXBhciwgc2VtIMO0bnVzIGFsdXNpdm8gYW9zIGRpcmVpdG9zIGF1dG9yYWlzLCBhIHTDrXR1bG8gZGUgZGl2dWxnYcOnw6NvIGRhIHByb2R1w6fDo28gY2llbnTDrWZpY2EuCg==Biblioteca Digital de Teses e Dissertaçõeshttp://tede2.pucrs.br/tede2/PRIhttps://tede2.pucrs.br/oai/requestbiblioteca.central@pucrs.br||opendoar:2016-11-09T14:01:11Biblioteca Digital de Teses e Dissertações da PUC_RS - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)false
dc.title.por.fl_str_mv Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
title Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
spellingShingle Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
Arantes, Karla Loyola de Oliveira
CRIANÇAS
MORTALIDADE INFANTIL
PROGNÓSTICO
UNIDADES DE TERAPIA INTENSIVA
PEDIATRIA
MEDICINA
CIENCIAS DA SAUDE::MEDICINA
title_short Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
title_full Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
title_fullStr Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
title_full_unstemmed Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
title_sort Validação do escore prognóstico Pediatric Index of Mortality (PIM 3) em uma unidade de terapia intensiva no Brasil
author Arantes, Karla Loyola de Oliveira
author_facet Arantes, Karla Loyola de Oliveira
author_role author
dc.contributor.advisor1.fl_str_mv Garcia, Pedro Celiny Ramos
dc.contributor.advisor1ID.fl_str_mv 114.237.140-91
dc.contributor.advisor1Lattes.fl_str_mv http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4787221J8
dc.contributor.authorID.fl_str_mv 052.967.237-59
dc.contributor.authorLattes.fl_str_mv http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4766301T4
dc.contributor.author.fl_str_mv Arantes, Karla Loyola de Oliveira
contributor_str_mv Garcia, Pedro Celiny Ramos
dc.subject.por.fl_str_mv CRIANÇAS
MORTALIDADE INFANTIL
PROGNÓSTICO
UNIDADES DE TERAPIA INTENSIVA
PEDIATRIA
MEDICINA
topic CRIANÇAS
MORTALIDADE INFANTIL
PROGNÓSTICO
UNIDADES DE TERAPIA INTENSIVA
PEDIATRIA
MEDICINA
CIENCIAS DA SAUDE::MEDICINA
dc.subject.cnpq.fl_str_mv CIENCIAS DA SAUDE::MEDICINA
description Introduction: Prognostic scores are useful tools in assessing the effectiveness of treatments, mortality risk and quality of services, allowing the comparison between different Intensive Care Units as the implementation and improvement of treatment and public health policies and protocols. The PIM (Pediatric Index of Mortality) is one of the most widely used prognostic scores in pediatrics and has improved generating PIM 2 and PIM 3. The latest has not been validated in developing countries. Objectives: Validation of PIM 3 score in a tertiary pediatric hospital in southeastern Brazil, and comparison of its performance with the PIM 2, currently used. Methods: A contemporary cohort study undertaken between January 1 and December 31, 2014, at the Pediatric Intensive Care Unit of HEINSG (Hospital Estadual Infantil Nossa Senhora da Glória). The sample characterization was performed using the observed frequency, percentage, measures of central tendency and variability. The calibration of the scores was analyzed by the Hosmer-Lemeshow test setting, while the Z statistic Flora was used to evaluate the similarity between overall mortality and the one observed through the standardized mortality rate (SMR - Standardized Mortality Rate). For Flora z test, it is considered critical values for the non-null hypothesis rejected the two standard deviations (SD) (or between <1.96 and> -1.96). The area under the ROC curve (Receiver Operating Characteristic) was used to analyze the discrimination capacity of PIM2 and PIM3 models among patients who were discharged or died, and the assessment of the concordance between the measures of PIM 2 and PIM3 was performed using the Student t test for independent samples. The agreement between the measures of PIM 2 and PIM3 was evaluated by Bland & Altman plot. The significance alpha level used in the analyzes was 5% and 95% confidence interval. Data were collected in an Excel table, confirmed on medical records and later transferred to IBM SPSS software to perform all analyzes. Results: 293 patients were admitted to the PICU during the studied period, 38 of whom presented exclusion criteria. 35 (13.7%) of the 255 patients studied died. The average score PIM2 was significantly higher than the PIM3, and Flora Z statistics showed no difference between the overall mortality observed and the expected one in PIM2, but this difference was found in PIM3. The PIM2 score got an excellent discrimination (AUC = 0.830) and its sensitivity was 85.7, and the specificity was 69.1. On the other hand, the PIM 3 score had an acceptable discrimination (AUC = 0.748), while its sensitivity was 74.3, and its specificity was 67.7. The comparison between the areas under the ROC curve of PIM2 and PIM3 was significant (p = 0.015), showing that there is a difference between their areas, with better performance for PIM2 compared to PIM 3 (Z Flora 2.427). The Bland-Altman diagramme indicated that the 95% limits of concordance between the two versions of PIM ranged from -1.2 to 2.3, indicating that the measures are inconsistent. There is discordance of 10.6% above and below the limit ± 1.96 standard deviations (SD) between the mentioned values, that is about twice the tolerable 5%. Conclusion: In our study, the PIM 2 shows better results to discriminate those patients who will die. We suggest, based on these results, that data collection should be maintained using the 2 versions of the score in this unit. Than, these data could be reanalyzed with a larger sample, and these results could be compared with new studies conducted in locations where population have similar characteristics.
publishDate 2016
dc.date.accessioned.fl_str_mv 2016-11-09T10:20:25Z
dc.date.issued.fl_str_mv 2016-08-31
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://tede2.pucrs.br/tede2/handle/tede/7027
url http://tede2.pucrs.br/tede2/handle/tede/7027
dc.language.iso.fl_str_mv por
language por
dc.relation.program.fl_str_mv 3098206005268432148
dc.relation.confidence.fl_str_mv 600
600
600
dc.relation.department.fl_str_mv -8624664729441623247
dc.relation.cnpq.fl_str_mv -969369452308786627
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Pontifícia Universidade Católica do Rio Grande do Sul
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Medicina/Pediatria e Saúde da Criança
dc.publisher.initials.fl_str_mv PUCRS
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Faculdade de Medicina
publisher.none.fl_str_mv Pontifícia Universidade Católica do Rio Grande do Sul
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da PUC_RS
instname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
instacron:PUC_RS
instname_str Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
instacron_str PUC_RS
institution PUC_RS
reponame_str Biblioteca Digital de Teses e Dissertações da PUC_RS
collection Biblioteca Digital de Teses e Dissertações da PUC_RS
bitstream.url.fl_str_mv http://tede2.pucrs.br/tede2/bitstream/tede/7027/5/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.jpg
http://tede2.pucrs.br/tede2/bitstream/tede/7027/4/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf.txt
http://tede2.pucrs.br/tede2/bitstream/tede/7027/3/license.txt
http://tede2.pucrs.br/tede2/bitstream/tede/7027/2/DIS_KARLA_LOYOLA_DE_OLIVEIRA_ARANTES_PARCIAL.pdf
bitstream.checksum.fl_str_mv d08e8992a03918365e48a03bc8b3273c
96544c435cca0c6a6afa0b1064772d7a
5a9d6006225b368ef605ba16b4f6d1be
bb7c00542339d8c42d7f409e045abdf5
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da PUC_RS - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
repository.mail.fl_str_mv biblioteca.central@pucrs.br||
_version_ 1799765322537893888