Variational Gaussian process for multisensor classification problems

Neda Rohani*, Pablo Ruiz, Rafael Molina, Aggelos K. Katsaggelos

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Scopus citations


This paper proposes a new model for multi-sensory data classification. To tackle this problem, probabilistic modeling and variational Bayesian inference are used. A Gaussian Process (GP) classifier is built upon the introduced modeling. Its posterior distribution is approximated using variational Bayesian inference. Finally, labels of test samples are predicted employing this classifier. Very importantly, and in contrast to alternative approaches, the proposed method does not discard samples with missing features and utilizes all available information for training. Furthermore, to take into account that the quality of the information provided by each sensor may differ (some modalities/sensors may provide more reliable/distinctive information than others), we introduce two versions of the algorithm. In the first one, the parameters modeling each sensor performance are shared while in the second one, each sensor parameters are estimated independently. Synthetic and real datasets are utilized to examine the validity of the proposed models. The results obtained for binary classification problems justify their use and confirm their superiority over existing fusion architectures.

Original languageEnglish (US)
Pages (from-to)80-87
Number of pages8
JournalPattern Recognition Letters
StatePublished - Dec 1 2018


  • Fusion
  • Gaussian process
  • Kernel
  • Posterior probability
  • Variational inference

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Variational Gaussian process for multisensor classification problems'. Together they form a unique fingerprint.

Cite this