Mixed Data Imputation Using Generative Adversarial Networks

Wasif Khan, Nazar Zaki, Amir Ahmad, Mohammad Mehedy Masud, Luqman Ali, Nasloon Ali, Luai A. Ahmed

Research output: Contribution to journalArticlepeer-review

Abstract

Missing values are common in real-world datasets and pose a significant challenge to the performance of statistical and machine learning models. Generally, missing values are imputed using statistical methods, such as the mean, median, mode, or machine learning approaches. These approaches are limited to either numerical or categorical data. Imputation in mixed datasets that contain both numerical and categorical attributes is challenging and has received little attention. Machine learning-based imputation algorithms usually require a large amount of training data. However, obtaining such data is difficult. Furthermore, no considerate work has been conducted in the literature that focuses on the effects of the training and testing size with increasing amounts of missing data. To address this gap, we proposed that increasing the amount of training data will improve imputation performance. We first used generative adversarial network (GAN) methods to increase the amount of training data. We considered two state-of-the-art GANs (tabular and conditional tabular) to add synthetic samples using observed data with different synthetic sample ratios. We then used three state-of-the-art imputation models that can handle mixed data: MissForest, multivariate imputation by chained equations, and denoising auto encoder (DAE). We proposed robust experimental setups on four publicly available datasets with different training-testing data divisions that have increasing missingness ratios. Extensive experimental results show that incorporating synthetic samples with training data achieves better performance compared to the baseline methods for mixed data imputation in both categorical and numerical variables, especially for large missingness ratios.

Original languageEnglish
Pages (from-to)124475-124490
Number of pages16
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - 2022

Keywords

  • GANs
  • MICE
  • Mixed data imputation
  • denoising auto encoders
  • miss forest
  • missing data

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Mixed Data Imputation Using Generative Adversarial Networks'. Together they form a unique fingerprint.

Cite this