Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report
Autor(a) principal: | |
---|---|
Data de Publicação: | 2011 |
Outros Autores: | , , , , , , , |
Tipo de documento: | Relatório |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/10400.18/448 |
Resumo: | Every year, influenza virus is responsible for epidemics that affect human health causing respiratory infections that could lead to serious health complications of individuals belonging to risk groups, as well as on the functioning of health services. In order to mitigate influenza impacts, vaccination has been one of the main measures, being recognized its role in reducing the risk of developing the disease and the occurrence of their complications. Thus, since the vaccine is reformulated every season estimating the influenza vaccine effectiveness (VE) every season and in an early stage is of major importance to support public health decisions. Since 2008-2009, Portugal has been participating in I-MOVE project that aims to estimate seasonal and pandemic vaccine effectiveness during and after the influenza season. Last season, 2010-2011, Portugal once again joined the I-MOVE multi-center case control study (with the national VE study- Euroeva) together with Spain, Ireland, France, Italy, Romania, Hungary and Poland, using a common protocol and with the objective of estimate the 2010-11 seasonal influenza vaccine effectiveness respectively in the elderly (65+) and in all age groups. Additionally, using information on 2010-11 seasonal vaccine coverage in the population, it has been also proposed to estimate 2010-11 seasonal vaccine effectiveness using the screening method. Material and Methods Two different approaches were used so as to estimate vaccine effectiveness: a) For the test negative design (TND), a case-control approach was used, where laboratory confirmed influenza cases (ILI+) were compared to laboratory negative influenza ILI patients (ILI-). On a weekly basis, each GP selected systematically ILI patients (two per week from all ages and all ILI patients with 65 years and more) using the EU ILI case definition. Data on confounding factors and effect modifiers was collected using a standardized questionnaire. VE was estimated as one minus the odds ratio of being vaccinated in cases versus controls adjusted for confounders by logistic regression. b) For the screening method, the 2010-11 seasonal vaccine coverage was compared between a sample of ILI cases and a sample of ILI cases laboratory confirmed for influenza with the vaccine coverage estimated in the general population. ILI cases and ILI Positive cases were the same as the one used in the TND. Vaccine coverage in the population was obtained from a sample of 1074 households stratified by region (homogeneous allocation) selected from a dual sample frame – random digit dialing mobile and landline phones (ECOS sample). The relevant information was collected by CATI (Computer Assisted Telephone interview) with the same questionnaire – one respondent by household (proxy for the rest of the household members). VE was estimated by comparing the proportion of cases vaccinated to the vaccine coverage in the source population using the Orenstein formula and the Farrington method to adjust for confounders. For both methods an ILI patient was considered vaccinated if he/she had received one dose of the vaccine at least 14 days prior onset of symptoms. Data analysis comprised ILI positive cases selected between week 45 of 2010 and week 11 of 2011. Results In Portugal, the 2010-2011 influenza season was characterized by a mixed circulation of influenza virus. In the early beginning of the season, B type virus dominated the season, until week 1 where A(H1N1)2009 virus started to dominate. Also in circulation, but in a minor proportion was the A(H3) virus. a) Test negative design results: Considering TND results, 58 GP’s accepted to participate in the study, with 60% participation rate (35 GP’s effectively participated in the study by selecting patients). Excluding 33 ILI cases (for not meeting the inclusion criteria) the final sample for analyses consisted on 253 ILI patients with a high positive rate (57%). Among cases, 73 were positive for B virus, 69 for A(H1N1)2009 and 2 for A(H3). For analysis purposes three groups of cases were defined: All influenza, Influenza B and Influenza A(H1N1)2009 that were compared to ILI cases that tested negative for influenza virus (109 Controls). After adjustment for age group, pandemic and seasonal vaccine 2009-10 season, any chronic disease, target group, GP visits and month of onset, VE point estimates were: • 58% (CI95% -61 – 89) for All influenza • 34% (CI95% -98 – 97) for Influenza A(H1N1)2009 and • 75% (CI95% -255 – 88) for Influenza B. Nevertheless, no statistical significance was obtained for either the analysis. b) Screening method results In season 2010-2011, 903 households of the ECOS-sample were interviewed (which corresponds to 2684 individuals). The final estimated vaccine coverage was 17.5% (CI95% 15.1-20.3), with a gradient evolution since September 2010 (3.5%) till December 2010 (16.6%). Crude and adjusted VE (using the Farrington method) estimates were computed for medically attended ILI cases and ILI influenza positive cases. Overall results indicate that after adjustment for confounding (age group and presence of chronic diseases), VE point estimates decreased from 47.0% to 33.3% in ILI cases and from 70.1% to 63.7% in ILI positive cases. Due to the small sample size, no VE estimates were computed for the individuals of the vaccination target group, i.e., individuals with 65 years and more and the ones with at least one chronic disease. Conclusions Overall results obtained by the Euroeva study indicate that crude 2010-11 seasonal VE estimate against medically attended influenza was 79% (CI95% 43-94) and 70% (CI95% 32-87), respectively for the TND and screening method. After adjustment the respective VE estimates decreased: 58 (CI95% -61-89) and 64% (CI95% 17-84). These results were in accordance to the up to now published results (42-65%). The TND study was also able to provide strain specific 2010-11 seasonal VE estimates: influenza B, crude VE=87% (CI95% 41-99) and adjusted VE=75% (CI95% -98-97) and for influenza A(H1N1)2009, crude VE=74% (CI95% 14-94) and adjusted VE=34% (CI95% -254-88). These results suggest that the 2010-11 seasonal VE was lower than the monovalent A(H1N1)2009 VE estimated by the IMOVE multicenter study in the season 2009-10: 72% (CI95% 46-86). Our study was unable to estimate VE for specific seasonal vaccine target groups. This result enhances, as in previous studies, the unavoidable need for pooling data from network of VE studies with common protocol as IMOVE. Recommendations The main recommendations focused on: • To calculate sample size taking into consideration: o the context of the multicentre case-control study: minimum sample size per site in order to assure a minimum homogeneity for pooled analysis; o different expected VE point estimates, i.e. for low, medium and high VE; o minimum set of factors for stratified analysis; o the adjustment for confounders. • To increase sample size, mainly in the elderly population (aged 65 years or more); • To increase the total number of participating GP’s in the study by exploring other sources of GP’s recruitment; • To study the inclusion of the population based vaccine coverage uncertainty in the screening method; • To explore with participating GP’s the best way to obtain estimates of the Euroeva ILI sample fraction. Finally we also recommend continuing the harmonization of the study designs between participating countries with the multi-centre study objective. |
id |
RCAP_6548b958513df56b4781cd85774473fd |
---|---|
oai_identifier_str |
oai:repositorio.insa.pt:10400.18/448 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final reportCuidados de SaúdeEstados de Saúde e de DoençaInfluenzaVaccine EffectivenessTest Negative DesignScreening MethodEvery year, influenza virus is responsible for epidemics that affect human health causing respiratory infections that could lead to serious health complications of individuals belonging to risk groups, as well as on the functioning of health services. In order to mitigate influenza impacts, vaccination has been one of the main measures, being recognized its role in reducing the risk of developing the disease and the occurrence of their complications. Thus, since the vaccine is reformulated every season estimating the influenza vaccine effectiveness (VE) every season and in an early stage is of major importance to support public health decisions. Since 2008-2009, Portugal has been participating in I-MOVE project that aims to estimate seasonal and pandemic vaccine effectiveness during and after the influenza season. Last season, 2010-2011, Portugal once again joined the I-MOVE multi-center case control study (with the national VE study- Euroeva) together with Spain, Ireland, France, Italy, Romania, Hungary and Poland, using a common protocol and with the objective of estimate the 2010-11 seasonal influenza vaccine effectiveness respectively in the elderly (65+) and in all age groups. Additionally, using information on 2010-11 seasonal vaccine coverage in the population, it has been also proposed to estimate 2010-11 seasonal vaccine effectiveness using the screening method. Material and Methods Two different approaches were used so as to estimate vaccine effectiveness: a) For the test negative design (TND), a case-control approach was used, where laboratory confirmed influenza cases (ILI+) were compared to laboratory negative influenza ILI patients (ILI-). On a weekly basis, each GP selected systematically ILI patients (two per week from all ages and all ILI patients with 65 years and more) using the EU ILI case definition. Data on confounding factors and effect modifiers was collected using a standardized questionnaire. VE was estimated as one minus the odds ratio of being vaccinated in cases versus controls adjusted for confounders by logistic regression. b) For the screening method, the 2010-11 seasonal vaccine coverage was compared between a sample of ILI cases and a sample of ILI cases laboratory confirmed for influenza with the vaccine coverage estimated in the general population. ILI cases and ILI Positive cases were the same as the one used in the TND. Vaccine coverage in the population was obtained from a sample of 1074 households stratified by region (homogeneous allocation) selected from a dual sample frame – random digit dialing mobile and landline phones (ECOS sample). The relevant information was collected by CATI (Computer Assisted Telephone interview) with the same questionnaire – one respondent by household (proxy for the rest of the household members). VE was estimated by comparing the proportion of cases vaccinated to the vaccine coverage in the source population using the Orenstein formula and the Farrington method to adjust for confounders. For both methods an ILI patient was considered vaccinated if he/she had received one dose of the vaccine at least 14 days prior onset of symptoms. Data analysis comprised ILI positive cases selected between week 45 of 2010 and week 11 of 2011. Results In Portugal, the 2010-2011 influenza season was characterized by a mixed circulation of influenza virus. In the early beginning of the season, B type virus dominated the season, until week 1 where A(H1N1)2009 virus started to dominate. Also in circulation, but in a minor proportion was the A(H3) virus. a) Test negative design results: Considering TND results, 58 GP’s accepted to participate in the study, with 60% participation rate (35 GP’s effectively participated in the study by selecting patients). Excluding 33 ILI cases (for not meeting the inclusion criteria) the final sample for analyses consisted on 253 ILI patients with a high positive rate (57%). Among cases, 73 were positive for B virus, 69 for A(H1N1)2009 and 2 for A(H3). For analysis purposes three groups of cases were defined: All influenza, Influenza B and Influenza A(H1N1)2009 that were compared to ILI cases that tested negative for influenza virus (109 Controls). After adjustment for age group, pandemic and seasonal vaccine 2009-10 season, any chronic disease, target group, GP visits and month of onset, VE point estimates were: • 58% (CI95% -61 – 89) for All influenza • 34% (CI95% -98 – 97) for Influenza A(H1N1)2009 and • 75% (CI95% -255 – 88) for Influenza B. Nevertheless, no statistical significance was obtained for either the analysis. b) Screening method results In season 2010-2011, 903 households of the ECOS-sample were interviewed (which corresponds to 2684 individuals). The final estimated vaccine coverage was 17.5% (CI95% 15.1-20.3), with a gradient evolution since September 2010 (3.5%) till December 2010 (16.6%). Crude and adjusted VE (using the Farrington method) estimates were computed for medically attended ILI cases and ILI influenza positive cases. Overall results indicate that after adjustment for confounding (age group and presence of chronic diseases), VE point estimates decreased from 47.0% to 33.3% in ILI cases and from 70.1% to 63.7% in ILI positive cases. Due to the small sample size, no VE estimates were computed for the individuals of the vaccination target group, i.e., individuals with 65 years and more and the ones with at least one chronic disease. Conclusions Overall results obtained by the Euroeva study indicate that crude 2010-11 seasonal VE estimate against medically attended influenza was 79% (CI95% 43-94) and 70% (CI95% 32-87), respectively for the TND and screening method. After adjustment the respective VE estimates decreased: 58 (CI95% -61-89) and 64% (CI95% 17-84). These results were in accordance to the up to now published results (42-65%). The TND study was also able to provide strain specific 2010-11 seasonal VE estimates: influenza B, crude VE=87% (CI95% 41-99) and adjusted VE=75% (CI95% -98-97) and for influenza A(H1N1)2009, crude VE=74% (CI95% 14-94) and adjusted VE=34% (CI95% -254-88). These results suggest that the 2010-11 seasonal VE was lower than the monovalent A(H1N1)2009 VE estimated by the IMOVE multicenter study in the season 2009-10: 72% (CI95% 46-86). Our study was unable to estimate VE for specific seasonal vaccine target groups. This result enhances, as in previous studies, the unavoidable need for pooling data from network of VE studies with common protocol as IMOVE. Recommendations The main recommendations focused on: • To calculate sample size taking into consideration: o the context of the multicentre case-control study: minimum sample size per site in order to assure a minimum homogeneity for pooled analysis; o different expected VE point estimates, i.e. for low, medium and high VE; o minimum set of factors for stratified analysis; o the adjustment for confounders. • To increase sample size, mainly in the elderly population (aged 65 years or more); • To increase the total number of participating GP’s in the study by exploring other sources of GP’s recruitment; • To study the inclusion of the population based vaccine coverage uncertainty in the screening method; • To explore with participating GP’s the best way to obtain estimates of the Euroeva ILI sample fraction. Finally we also recommend continuing the harmonization of the study designs between participating countries with the multi-centre study objective.European Center for Disease prevention and ControlInstituto Nacional de Saúde Doutor Ricardo Jorge, IPRepositório Científico do Instituto Nacional de SaúdeNunes, BaltazarPechirra, PedroMachado, AusendaFalcão, IsabelGonçalves, PauloConde, PatriciaBatista, InêsGuiomar, RaquelMarinho Falcão, José2012-01-30T18:09:06Z2011-06-012011-06-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/reportapplication/pdfhttp://hdl.handle.net/10400.18/448enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-20T15:38:11Zoai:repositorio.insa.pt:10400.18/448Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T18:35:37.349598Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
title |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
spellingShingle |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report Nunes, Baltazar Cuidados de Saúde Estados de Saúde e de Doença Influenza Vaccine Effectiveness Test Negative Design Screening Method |
title_short |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
title_full |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
title_fullStr |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
title_full_unstemmed |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
title_sort |
Case control study for measuring influenza vaccine effectiveness in Portugal - Season 2010-11- Final report |
author |
Nunes, Baltazar |
author_facet |
Nunes, Baltazar Pechirra, Pedro Machado, Ausenda Falcão, Isabel Gonçalves, Paulo Conde, Patricia Batista, Inês Guiomar, Raquel Marinho Falcão, José |
author_role |
author |
author2 |
Pechirra, Pedro Machado, Ausenda Falcão, Isabel Gonçalves, Paulo Conde, Patricia Batista, Inês Guiomar, Raquel Marinho Falcão, José |
author2_role |
author author author author author author author author |
dc.contributor.none.fl_str_mv |
Repositório Científico do Instituto Nacional de Saúde |
dc.contributor.author.fl_str_mv |
Nunes, Baltazar Pechirra, Pedro Machado, Ausenda Falcão, Isabel Gonçalves, Paulo Conde, Patricia Batista, Inês Guiomar, Raquel Marinho Falcão, José |
dc.subject.por.fl_str_mv |
Cuidados de Saúde Estados de Saúde e de Doença Influenza Vaccine Effectiveness Test Negative Design Screening Method |
topic |
Cuidados de Saúde Estados de Saúde e de Doença Influenza Vaccine Effectiveness Test Negative Design Screening Method |
description |
Every year, influenza virus is responsible for epidemics that affect human health causing respiratory infections that could lead to serious health complications of individuals belonging to risk groups, as well as on the functioning of health services. In order to mitigate influenza impacts, vaccination has been one of the main measures, being recognized its role in reducing the risk of developing the disease and the occurrence of their complications. Thus, since the vaccine is reformulated every season estimating the influenza vaccine effectiveness (VE) every season and in an early stage is of major importance to support public health decisions. Since 2008-2009, Portugal has been participating in I-MOVE project that aims to estimate seasonal and pandemic vaccine effectiveness during and after the influenza season. Last season, 2010-2011, Portugal once again joined the I-MOVE multi-center case control study (with the national VE study- Euroeva) together with Spain, Ireland, France, Italy, Romania, Hungary and Poland, using a common protocol and with the objective of estimate the 2010-11 seasonal influenza vaccine effectiveness respectively in the elderly (65+) and in all age groups. Additionally, using information on 2010-11 seasonal vaccine coverage in the population, it has been also proposed to estimate 2010-11 seasonal vaccine effectiveness using the screening method. Material and Methods Two different approaches were used so as to estimate vaccine effectiveness: a) For the test negative design (TND), a case-control approach was used, where laboratory confirmed influenza cases (ILI+) were compared to laboratory negative influenza ILI patients (ILI-). On a weekly basis, each GP selected systematically ILI patients (two per week from all ages and all ILI patients with 65 years and more) using the EU ILI case definition. Data on confounding factors and effect modifiers was collected using a standardized questionnaire. VE was estimated as one minus the odds ratio of being vaccinated in cases versus controls adjusted for confounders by logistic regression. b) For the screening method, the 2010-11 seasonal vaccine coverage was compared between a sample of ILI cases and a sample of ILI cases laboratory confirmed for influenza with the vaccine coverage estimated in the general population. ILI cases and ILI Positive cases were the same as the one used in the TND. Vaccine coverage in the population was obtained from a sample of 1074 households stratified by region (homogeneous allocation) selected from a dual sample frame – random digit dialing mobile and landline phones (ECOS sample). The relevant information was collected by CATI (Computer Assisted Telephone interview) with the same questionnaire – one respondent by household (proxy for the rest of the household members). VE was estimated by comparing the proportion of cases vaccinated to the vaccine coverage in the source population using the Orenstein formula and the Farrington method to adjust for confounders. For both methods an ILI patient was considered vaccinated if he/she had received one dose of the vaccine at least 14 days prior onset of symptoms. Data analysis comprised ILI positive cases selected between week 45 of 2010 and week 11 of 2011. Results In Portugal, the 2010-2011 influenza season was characterized by a mixed circulation of influenza virus. In the early beginning of the season, B type virus dominated the season, until week 1 where A(H1N1)2009 virus started to dominate. Also in circulation, but in a minor proportion was the A(H3) virus. a) Test negative design results: Considering TND results, 58 GP’s accepted to participate in the study, with 60% participation rate (35 GP’s effectively participated in the study by selecting patients). Excluding 33 ILI cases (for not meeting the inclusion criteria) the final sample for analyses consisted on 253 ILI patients with a high positive rate (57%). Among cases, 73 were positive for B virus, 69 for A(H1N1)2009 and 2 for A(H3). For analysis purposes three groups of cases were defined: All influenza, Influenza B and Influenza A(H1N1)2009 that were compared to ILI cases that tested negative for influenza virus (109 Controls). After adjustment for age group, pandemic and seasonal vaccine 2009-10 season, any chronic disease, target group, GP visits and month of onset, VE point estimates were: • 58% (CI95% -61 – 89) for All influenza • 34% (CI95% -98 – 97) for Influenza A(H1N1)2009 and • 75% (CI95% -255 – 88) for Influenza B. Nevertheless, no statistical significance was obtained for either the analysis. b) Screening method results In season 2010-2011, 903 households of the ECOS-sample were interviewed (which corresponds to 2684 individuals). The final estimated vaccine coverage was 17.5% (CI95% 15.1-20.3), with a gradient evolution since September 2010 (3.5%) till December 2010 (16.6%). Crude and adjusted VE (using the Farrington method) estimates were computed for medically attended ILI cases and ILI influenza positive cases. Overall results indicate that after adjustment for confounding (age group and presence of chronic diseases), VE point estimates decreased from 47.0% to 33.3% in ILI cases and from 70.1% to 63.7% in ILI positive cases. Due to the small sample size, no VE estimates were computed for the individuals of the vaccination target group, i.e., individuals with 65 years and more and the ones with at least one chronic disease. Conclusions Overall results obtained by the Euroeva study indicate that crude 2010-11 seasonal VE estimate against medically attended influenza was 79% (CI95% 43-94) and 70% (CI95% 32-87), respectively for the TND and screening method. After adjustment the respective VE estimates decreased: 58 (CI95% -61-89) and 64% (CI95% 17-84). These results were in accordance to the up to now published results (42-65%). The TND study was also able to provide strain specific 2010-11 seasonal VE estimates: influenza B, crude VE=87% (CI95% 41-99) and adjusted VE=75% (CI95% -98-97) and for influenza A(H1N1)2009, crude VE=74% (CI95% 14-94) and adjusted VE=34% (CI95% -254-88). These results suggest that the 2010-11 seasonal VE was lower than the monovalent A(H1N1)2009 VE estimated by the IMOVE multicenter study in the season 2009-10: 72% (CI95% 46-86). Our study was unable to estimate VE for specific seasonal vaccine target groups. This result enhances, as in previous studies, the unavoidable need for pooling data from network of VE studies with common protocol as IMOVE. Recommendations The main recommendations focused on: • To calculate sample size taking into consideration: o the context of the multicentre case-control study: minimum sample size per site in order to assure a minimum homogeneity for pooled analysis; o different expected VE point estimates, i.e. for low, medium and high VE; o minimum set of factors for stratified analysis; o the adjustment for confounders. • To increase sample size, mainly in the elderly population (aged 65 years or more); • To increase the total number of participating GP’s in the study by exploring other sources of GP’s recruitment; • To study the inclusion of the population based vaccine coverage uncertainty in the screening method; • To explore with participating GP’s the best way to obtain estimates of the Euroeva ILI sample fraction. Finally we also recommend continuing the harmonization of the study designs between participating countries with the multi-centre study objective. |
publishDate |
2011 |
dc.date.none.fl_str_mv |
2011-06-01 2011-06-01T00:00:00Z 2012-01-30T18:09:06Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/report |
format |
report |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10400.18/448 |
url |
http://hdl.handle.net/10400.18/448 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Instituto Nacional de Saúde Doutor Ricardo Jorge, IP |
publisher.none.fl_str_mv |
Instituto Nacional de Saúde Doutor Ricardo Jorge, IP |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799132083103203328 |