Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid

Detalhes bibliográficos
Autor(a) principal: Sanchez, Maria Carmen Arroyo
Data de Publicação: 2020
Outros Autores: Celeste, Beatriz Julieta, Lindoso, José Angelo Lauletta, Fujimori, Mahyumi, Almeida, Roque Pacheco de, Fortaleza, Carlos Magno Castelo Branco, Druzian, Angelita Fernandes, Lemos, Ana Priscila Freitas, Melo, Vanessa Campos Andrade de, Paniago, Anamaria Mello Miranda, Silva, Igor Thiago Borges de Queiroz e, Goto, Hiro
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UFRN
Texto Completo: https://repositorio.ufrn.br/handle/123456789/31309
Resumo: Background: The development of rK39-based immunochromatographic rapid diagnostic tests represents an important advance for serodiagnosis of visceral leishmaniasis, being cheap and easy to use at the point of care (POC). Although the use of rK39 have considerably improved the sensitivity and specificity of serological tests compared with total antigens, great variability in sensitivity and specificity was reported. This study aimed at the evaluation of “Kalazar Detect™ Rapid Test, Whole Blood” (Kalazar Detect RDT) for Visceral Leishmaniasis (VL) diagnosis using oral fluid, whole blood and serum specimens collected at different endemic areas of VL of Brazil. Methodology: To evaluate Kalazar Detect RDT, oral fluid, whole blood and serum specimens from 128 VL patients, 85 healthy individuals, 22 patients with possible cross-reactivity diseases and 20 VL/aids coinfected patients were collected and assayed at the POC. Principal findings and conclusions: The performance of Kalazar Detect RDT in whole blood and serum was similar; however, using oral fluid, the sensitivity was low. Particularly in samples from the city of Natal, Rio Grande do Norte state in Northeastern Brazil, we observed low sensitivity, 80.0% (95% CI: 62.7–90.5), using whole blood and serum, and poor sensitivity, 43.3% (95% CI: 27.4–60.8) with oral fluid. Those values were much lower than in the other regions, where sensitivity ranged from 92.7–96.3% in whole blood and serum, and 80.0–88.9% in oral fluid. Besides, in VL/aids coinfected patients, lower sensitivity was achieved compared with VL patients. In samples from Natal, the sensitivity was 0.0% (95% CI: 0.0–49.0) and 25.0% (95% CI: 4.6–69.9), using oral fluid and serum/whole blood, respectively; in samples from the other regions, the sensitivity ranged from 40.0–63.6% and 80.0–81.8%, respectively. As for specificity, high values were observed across the fluids, 100.0% (95% CI: 96.5–100.0) in whole blood, 96.3% (95% CI: 90.8–98.5) in serum, and 95.3% (95% CI: 89.5–98.0) in oral fluid; across localities, specificity ranged from 85.7–100.0%. Serum samples sent by the collaborating centers to Instituto de Medicina Tropical (n = 250) were tested by Kalazar Detect RDT, Direct Agglutination Test, Indirect immunofluorescence assay, Enzyme-linked immunosorbent assay, and IT-Leish® RDT. The regional difference in the performance of rK39-based RDT and lower sensitivity in Leishmania/HIV coinfected patients raise concern on the routine use of these products for the diagnosis of VL
id UFRN_2d3d6227057ce302d0b86e2ebfbf2991
oai_identifier_str oai:https://repositorio.ufrn.br:123456789/31309
network_acronym_str UFRN
network_name_str Repositório Institucional da UFRN
repository_id_str
spelling Sanchez, Maria Carmen ArroyoCeleste, Beatriz JulietaLindoso, José Angelo LaulettaFujimori, MahyumiAlmeida, Roque Pacheco deFortaleza, Carlos Magno Castelo BrancoDruzian, Angelita FernandesLemos, Ana Priscila FreitasMelo, Vanessa Campos Andrade dePaniago, Anamaria Mello MirandaSilva, Igor Thiago Borges de Queiroz eGoto, Hiro2021-01-25T18:02:01Z2021-01-25T18:02:01Z2020-04-02SANCHEZ, Maria Carmen Arroyo; CELESTE, Beatriz Julieta; LINDOSO, José Angelo Lauletta; FUJIMORI, Mahyumi; ALMEIDA, Roque Pacheco de; FORTALEZA, Carlos Magno Castelo Branco; DRUZIAN, Angelita Fernandes; LEMOS, Ana Priscila Freitas; MELO, Vanessa Campos Andrade de; PANIAGO, Anamaria Mello Miranda; SILVA, Igor Thiago Borges de Queiroz e; GOTO, Hiro. Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid. Plos One, [s. l.], v. 15, n. 4, p. 1-19, 02 abr. 2020. Disponível em: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0230610. Acesso em: 20 jan. 2021. http://dx.doi.org/10.1371/journal.%20pone.0230610.1932-6203 (online)https://repositorio.ufrn.br/handle/123456789/3130910.1371/journal.%20pone.0230610Public Library of ScienceAttribution 3.0 Brazilhttp://creativecommons.org/licenses/by/3.0/br/info:eu-repo/semantics/openAccessAntibodies, ProtozoanFluorescent Antibody Technique, IndirectProtozoan ProteinsSerologic TestsLeishmaniasis, VisceralDiagnostic Tests, RoutinePerformance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluidinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleBackground: The development of rK39-based immunochromatographic rapid diagnostic tests represents an important advance for serodiagnosis of visceral leishmaniasis, being cheap and easy to use at the point of care (POC). Although the use of rK39 have considerably improved the sensitivity and specificity of serological tests compared with total antigens, great variability in sensitivity and specificity was reported. This study aimed at the evaluation of “Kalazar Detect™ Rapid Test, Whole Blood” (Kalazar Detect RDT) for Visceral Leishmaniasis (VL) diagnosis using oral fluid, whole blood and serum specimens collected at different endemic areas of VL of Brazil. Methodology: To evaluate Kalazar Detect RDT, oral fluid, whole blood and serum specimens from 128 VL patients, 85 healthy individuals, 22 patients with possible cross-reactivity diseases and 20 VL/aids coinfected patients were collected and assayed at the POC. Principal findings and conclusions: The performance of Kalazar Detect RDT in whole blood and serum was similar; however, using oral fluid, the sensitivity was low. Particularly in samples from the city of Natal, Rio Grande do Norte state in Northeastern Brazil, we observed low sensitivity, 80.0% (95% CI: 62.7–90.5), using whole blood and serum, and poor sensitivity, 43.3% (95% CI: 27.4–60.8) with oral fluid. Those values were much lower than in the other regions, where sensitivity ranged from 92.7–96.3% in whole blood and serum, and 80.0–88.9% in oral fluid. Besides, in VL/aids coinfected patients, lower sensitivity was achieved compared with VL patients. In samples from Natal, the sensitivity was 0.0% (95% CI: 0.0–49.0) and 25.0% (95% CI: 4.6–69.9), using oral fluid and serum/whole blood, respectively; in samples from the other regions, the sensitivity ranged from 40.0–63.6% and 80.0–81.8%, respectively. As for specificity, high values were observed across the fluids, 100.0% (95% CI: 96.5–100.0) in whole blood, 96.3% (95% CI: 90.8–98.5) in serum, and 95.3% (95% CI: 89.5–98.0) in oral fluid; across localities, specificity ranged from 85.7–100.0%. Serum samples sent by the collaborating centers to Instituto de Medicina Tropical (n = 250) were tested by Kalazar Detect RDT, Direct Agglutination Test, Indirect immunofluorescence assay, Enzyme-linked immunosorbent assay, and IT-Leish® RDT. The regional difference in the performance of rK39-based RDT and lower sensitivity in Leishmania/HIV coinfected patients raise concern on the routine use of these products for the diagnosis of VLengreponame:Repositório Institucional da UFRNinstname:Universidade Federal do Rio Grande do Norte (UFRN)instacron:UFRNORIGINALPerformanceRk39Based_Silva_2020.pdfPerformanceRk39Based_Silva_2020.pdfapplication/pdf643472https://repositorio.ufrn.br/bitstream/123456789/31309/1/PerformanceRk39Based_Silva_2020.pdf9c708d7e29fc6e1ff7efce1a986209f9MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8914https://repositorio.ufrn.br/bitstream/123456789/31309/2/license_rdf4d2950bda3d176f570a9f8b328dfbbefMD52LICENSElicense.txtlicense.txttext/plain; charset=utf-81484https://repositorio.ufrn.br/bitstream/123456789/31309/3/license.txte9597aa2854d128fd968be5edc8a28d9MD53TEXTPerformanceRk39Based_Silva_2020.pdf.txtPerformanceRk39Based_Silva_2020.pdf.txtExtracted texttext/plain70797https://repositorio.ufrn.br/bitstream/123456789/31309/4/PerformanceRk39Based_Silva_2020.pdf.txtcdd85244b12650e62b7b74eed4806ca7MD54THUMBNAILPerformanceRk39Based_Silva_2020.pdf.jpgPerformanceRk39Based_Silva_2020.pdf.jpgGenerated Thumbnailimage/jpeg1762https://repositorio.ufrn.br/bitstream/123456789/31309/5/PerformanceRk39Based_Silva_2020.pdf.jpgbe4f75bdc33388816e879bbfab9c6c3aMD55123456789/313092021-01-31 05:19:43.615oai:https://repositorio.ufrn.br:123456789/31309Tk9OLUVYQ0xVU0lWRSBESVNUUklCVVRJT04gTElDRU5TRQoKCkJ5IHNpZ25pbmcgYW5kIGRlbGl2ZXJpbmcgdGhpcyBsaWNlbnNlLCBNci4gKGF1dGhvciBvciBjb3B5cmlnaHQgaG9sZGVyKToKCgphKSBHcmFudHMgdGhlIFVuaXZlcnNpZGFkZSBGZWRlcmFsIFJpbyBHcmFuZGUgZG8gTm9ydGUgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgb2YKcmVwcm9kdWNlLCBjb252ZXJ0IChhcyBkZWZpbmVkIGJlbG93KSwgY29tbXVuaWNhdGUgYW5kIC8gb3IKZGlzdHJpYnV0ZSB0aGUgZGVsaXZlcmVkIGRvY3VtZW50IChpbmNsdWRpbmcgYWJzdHJhY3QgLyBhYnN0cmFjdCkgaW4KZGlnaXRhbCBvciBwcmludGVkIGZvcm1hdCBhbmQgaW4gYW55IG1lZGl1bS4KCmIpIERlY2xhcmVzIHRoYXQgdGhlIGRvY3VtZW50IHN1Ym1pdHRlZCBpcyBpdHMgb3JpZ2luYWwgd29yaywgYW5kIHRoYXQKeW91IGhhdmUgdGhlIHJpZ2h0IHRvIGdyYW50IHRoZSByaWdodHMgY29udGFpbmVkIGluIHRoaXMgbGljZW5zZS4gRGVjbGFyZXMKdGhhdCB0aGUgZGVsaXZlcnkgb2YgdGhlIGRvY3VtZW50IGRvZXMgbm90IGluZnJpbmdlLCBhcyBmYXIgYXMgaXQgaXMKdGhlIHJpZ2h0cyBvZiBhbnkgb3RoZXIgcGVyc29uIG9yIGVudGl0eS4KCmMpIElmIHRoZSBkb2N1bWVudCBkZWxpdmVyZWQgY29udGFpbnMgbWF0ZXJpYWwgd2hpY2ggZG9lcyBub3QKcmlnaHRzLCBkZWNsYXJlcyB0aGF0IGl0IGhhcyBvYnRhaW5lZCBhdXRob3JpemF0aW9uIGZyb20gdGhlIGhvbGRlciBvZiB0aGUKY29weXJpZ2h0IHRvIGdyYW50IHRoZSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkbyBSaW8gR3JhbmRlIGRvIE5vcnRlIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdCB0aGlzIG1hdGVyaWFsIHdob3NlIHJpZ2h0cyBhcmUgb2YKdGhpcmQgcGFydGllcyBpcyBjbGVhcmx5IGlkZW50aWZpZWQgYW5kIHJlY29nbml6ZWQgaW4gdGhlIHRleHQgb3IKY29udGVudCBvZiB0aGUgZG9jdW1lbnQgZGVsaXZlcmVkLgoKSWYgdGhlIGRvY3VtZW50IHN1Ym1pdHRlZCBpcyBiYXNlZCBvbiBmdW5kZWQgb3Igc3VwcG9ydGVkIHdvcmsKYnkgYW5vdGhlciBpbnN0aXR1dGlvbiBvdGhlciB0aGFuIHRoZSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkbyBSaW8gR3JhbmRlIGRvIE5vcnRlLCBkZWNsYXJlcyB0aGF0IGl0IGhhcyBmdWxmaWxsZWQgYW55IG9ibGlnYXRpb25zIHJlcXVpcmVkIGJ5IHRoZSByZXNwZWN0aXZlIGFncmVlbWVudCBvciBhZ3JlZW1lbnQuCgpUaGUgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZG8gUmlvIEdyYW5kZSBkbyBOb3J0ZSB3aWxsIGNsZWFybHkgaWRlbnRpZnkgaXRzIG5hbWUgKHMpIGFzIHRoZSBhdXRob3IgKHMpIG9yIGhvbGRlciAocykgb2YgdGhlIGRvY3VtZW50J3MgcmlnaHRzCmRlbGl2ZXJlZCwgYW5kIHdpbGwgbm90IG1ha2UgYW55IGNoYW5nZXMsIG90aGVyIHRoYW4gdGhvc2UgcGVybWl0dGVkIGJ5CnRoaXMgbGljZW5zZQo=Repositório de PublicaçõesPUBhttp://repositorio.ufrn.br/oai/opendoar:2021-01-31T08:19:43Repositório Institucional da UFRN - Universidade Federal do Rio Grande do Norte (UFRN)false
dc.title.pt_BR.fl_str_mv Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
title Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
spellingShingle Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
Sanchez, Maria Carmen Arroyo
Antibodies, Protozoan
Fluorescent Antibody Technique, Indirect
Protozoan Proteins
Serologic Tests
Leishmaniasis, Visceral
Diagnostic Tests, Routine
title_short Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
title_full Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
title_fullStr Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
title_full_unstemmed Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
title_sort Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid
author Sanchez, Maria Carmen Arroyo
author_facet Sanchez, Maria Carmen Arroyo
Celeste, Beatriz Julieta
Lindoso, José Angelo Lauletta
Fujimori, Mahyumi
Almeida, Roque Pacheco de
Fortaleza, Carlos Magno Castelo Branco
Druzian, Angelita Fernandes
Lemos, Ana Priscila Freitas
Melo, Vanessa Campos Andrade de
Paniago, Anamaria Mello Miranda
Silva, Igor Thiago Borges de Queiroz e
Goto, Hiro
author_role author
author2 Celeste, Beatriz Julieta
Lindoso, José Angelo Lauletta
Fujimori, Mahyumi
Almeida, Roque Pacheco de
Fortaleza, Carlos Magno Castelo Branco
Druzian, Angelita Fernandes
Lemos, Ana Priscila Freitas
Melo, Vanessa Campos Andrade de
Paniago, Anamaria Mello Miranda
Silva, Igor Thiago Borges de Queiroz e
Goto, Hiro
author2_role author
author
author
author
author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv Sanchez, Maria Carmen Arroyo
Celeste, Beatriz Julieta
Lindoso, José Angelo Lauletta
Fujimori, Mahyumi
Almeida, Roque Pacheco de
Fortaleza, Carlos Magno Castelo Branco
Druzian, Angelita Fernandes
Lemos, Ana Priscila Freitas
Melo, Vanessa Campos Andrade de
Paniago, Anamaria Mello Miranda
Silva, Igor Thiago Borges de Queiroz e
Goto, Hiro
dc.subject.por.fl_str_mv Antibodies, Protozoan
Fluorescent Antibody Technique, Indirect
Protozoan Proteins
Serologic Tests
Leishmaniasis, Visceral
Diagnostic Tests, Routine
topic Antibodies, Protozoan
Fluorescent Antibody Technique, Indirect
Protozoan Proteins
Serologic Tests
Leishmaniasis, Visceral
Diagnostic Tests, Routine
description Background: The development of rK39-based immunochromatographic rapid diagnostic tests represents an important advance for serodiagnosis of visceral leishmaniasis, being cheap and easy to use at the point of care (POC). Although the use of rK39 have considerably improved the sensitivity and specificity of serological tests compared with total antigens, great variability in sensitivity and specificity was reported. This study aimed at the evaluation of “Kalazar Detect™ Rapid Test, Whole Blood” (Kalazar Detect RDT) for Visceral Leishmaniasis (VL) diagnosis using oral fluid, whole blood and serum specimens collected at different endemic areas of VL of Brazil. Methodology: To evaluate Kalazar Detect RDT, oral fluid, whole blood and serum specimens from 128 VL patients, 85 healthy individuals, 22 patients with possible cross-reactivity diseases and 20 VL/aids coinfected patients were collected and assayed at the POC. Principal findings and conclusions: The performance of Kalazar Detect RDT in whole blood and serum was similar; however, using oral fluid, the sensitivity was low. Particularly in samples from the city of Natal, Rio Grande do Norte state in Northeastern Brazil, we observed low sensitivity, 80.0% (95% CI: 62.7–90.5), using whole blood and serum, and poor sensitivity, 43.3% (95% CI: 27.4–60.8) with oral fluid. Those values were much lower than in the other regions, where sensitivity ranged from 92.7–96.3% in whole blood and serum, and 80.0–88.9% in oral fluid. Besides, in VL/aids coinfected patients, lower sensitivity was achieved compared with VL patients. In samples from Natal, the sensitivity was 0.0% (95% CI: 0.0–49.0) and 25.0% (95% CI: 4.6–69.9), using oral fluid and serum/whole blood, respectively; in samples from the other regions, the sensitivity ranged from 40.0–63.6% and 80.0–81.8%, respectively. As for specificity, high values were observed across the fluids, 100.0% (95% CI: 96.5–100.0) in whole blood, 96.3% (95% CI: 90.8–98.5) in serum, and 95.3% (95% CI: 89.5–98.0) in oral fluid; across localities, specificity ranged from 85.7–100.0%. Serum samples sent by the collaborating centers to Instituto de Medicina Tropical (n = 250) were tested by Kalazar Detect RDT, Direct Agglutination Test, Indirect immunofluorescence assay, Enzyme-linked immunosorbent assay, and IT-Leish® RDT. The regional difference in the performance of rK39-based RDT and lower sensitivity in Leishmania/HIV coinfected patients raise concern on the routine use of these products for the diagnosis of VL
publishDate 2020
dc.date.issued.fl_str_mv 2020-04-02
dc.date.accessioned.fl_str_mv 2021-01-25T18:02:01Z
dc.date.available.fl_str_mv 2021-01-25T18:02:01Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.citation.fl_str_mv SANCHEZ, Maria Carmen Arroyo; CELESTE, Beatriz Julieta; LINDOSO, José Angelo Lauletta; FUJIMORI, Mahyumi; ALMEIDA, Roque Pacheco de; FORTALEZA, Carlos Magno Castelo Branco; DRUZIAN, Angelita Fernandes; LEMOS, Ana Priscila Freitas; MELO, Vanessa Campos Andrade de; PANIAGO, Anamaria Mello Miranda; SILVA, Igor Thiago Borges de Queiroz e; GOTO, Hiro. Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid. Plos One, [s. l.], v. 15, n. 4, p. 1-19, 02 abr. 2020. Disponível em: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0230610. Acesso em: 20 jan. 2021. http://dx.doi.org/10.1371/journal.%20pone.0230610.
dc.identifier.uri.fl_str_mv https://repositorio.ufrn.br/handle/123456789/31309
dc.identifier.issn.none.fl_str_mv 1932-6203 (online)
dc.identifier.doi.none.fl_str_mv 10.1371/journal.%20pone.0230610
identifier_str_mv SANCHEZ, Maria Carmen Arroyo; CELESTE, Beatriz Julieta; LINDOSO, José Angelo Lauletta; FUJIMORI, Mahyumi; ALMEIDA, Roque Pacheco de; FORTALEZA, Carlos Magno Castelo Branco; DRUZIAN, Angelita Fernandes; LEMOS, Ana Priscila Freitas; MELO, Vanessa Campos Andrade de; PANIAGO, Anamaria Mello Miranda; SILVA, Igor Thiago Borges de Queiroz e; GOTO, Hiro. Performance of rK39-based immunochromatographic rapid diagnostic test for serodiagnosis of visceral leishmaniasis using whole blood, serum and oral fluid. Plos One, [s. l.], v. 15, n. 4, p. 1-19, 02 abr. 2020. Disponível em: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0230610. Acesso em: 20 jan. 2021. http://dx.doi.org/10.1371/journal.%20pone.0230610.
1932-6203 (online)
10.1371/journal.%20pone.0230610
url https://repositorio.ufrn.br/handle/123456789/31309
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution 3.0 Brazil
http://creativecommons.org/licenses/by/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution 3.0 Brazil
http://creativecommons.org/licenses/by/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Public Library of Science
publisher.none.fl_str_mv Public Library of Science
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFRN
instname:Universidade Federal do Rio Grande do Norte (UFRN)
instacron:UFRN
instname_str Universidade Federal do Rio Grande do Norte (UFRN)
instacron_str UFRN
institution UFRN
reponame_str Repositório Institucional da UFRN
collection Repositório Institucional da UFRN
bitstream.url.fl_str_mv https://repositorio.ufrn.br/bitstream/123456789/31309/1/PerformanceRk39Based_Silva_2020.pdf
https://repositorio.ufrn.br/bitstream/123456789/31309/2/license_rdf
https://repositorio.ufrn.br/bitstream/123456789/31309/3/license.txt
https://repositorio.ufrn.br/bitstream/123456789/31309/4/PerformanceRk39Based_Silva_2020.pdf.txt
https://repositorio.ufrn.br/bitstream/123456789/31309/5/PerformanceRk39Based_Silva_2020.pdf.jpg
bitstream.checksum.fl_str_mv 9c708d7e29fc6e1ff7efce1a986209f9
4d2950bda3d176f570a9f8b328dfbbef
e9597aa2854d128fd968be5edc8a28d9
cdd85244b12650e62b7b74eed4806ca7
be4f75bdc33388816e879bbfab9c6c3a
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFRN - Universidade Federal do Rio Grande do Norte (UFRN)
repository.mail.fl_str_mv
_version_ 1797777082713899008