Generating Synthetic Missing Data: A Review by Missing Mechanism

• Autor(a) principal: Santos, Miriam Seoane
• Data de Publicação: 2019
• Outros Autores: Pereira, Ricardo Cardoso, Costa, Adriana Fonseca, Soares, Jastin Pompeu, Santos, Joao, Abreu, Pedro Henriques
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: http://hdl.handle.net/10316/101583; https://doi.org/10.1109/ACCESS.2019.2891360
• topic: Data preprocessing; missing data; missing data generation; missing data mechanisms

The performance evaluation of imputation algorithms often involves the generation of missing values. Missing values can be inserted in only one feature (univariate con guration) or in several features (multivariate con guration) at different percentages (missing rates) and according to distinct missing mechanisms, namely, missing completely at random, missing at random, and missing not at random. Since the missing data generation process de nes the basis for the imputation experiments (con guration, missing rate, and missing mechanism), it is essential that it is appropriately applied; otherwise, conclusions derived from ill-de ned setups may be invalid. The goal of this paper is to review the different approaches to synthetic missing data generation found in the literature and discuss their practical details, elaborating on their strengths and weaknesses. Our analysis revealed that creating missing at random and missing not at random scenarios in datasets comprising qualitative features is the most challenging issue in the related work and, therefore, should be the focus of future work in the field.