Deep learning approaches to inverse problems in imaging: Past, present and future

Santiago López-Tapia*, Rafael Molina, Aggelos K. Katsaggelos

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In recent years, deep learning-based models have gained momentum in imaging problems such as image and video super-resolution, image restoration or inpainting. The analytical approaches that have traditionally been used to solve image inverse problems have started to be replaced by deep learning ones, being outperformed in terms of efficacy and efficiency in many applications. However, deep learning-based models lack the adaptability of analytical models, thus making them unsuitable for dealing simultaneously with different forward image formation models. In contrast to analytical methods, deep learning models typically do not use domain knowledge and rely on learning the solution to the inverse problem from large data sets. This is making them susceptible to errors caused by the presence of degradations not seen during training. Hybrid models combining analytical and deep learning approaches have been introduced to solve such generalization issues while retaining the efficacy of deep learning models. In this work, we review deep learning and hybrid methods for solving imaging inverse problems, focusing on image and video super-resolution and image restoration. Furthermore, we discuss open problems in this area that would be of critical importance in the future, the challenges of applying deep learning models to solve them, and how future research could address them.

Original languageEnglish (US)
Article number103285
JournalDigital Signal Processing: A Review Journal
Volume119
DOIs
StatePublished - Dec 2021

Keywords

  • Convolutional neural network
  • Deep learning
  • Inverse imaging problems
  • Video super-resolution

ASJC Scopus subject areas

  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Statistics, Probability and Uncertainty
  • Computational Theory and Mathematics
  • Electrical and Electronic Engineering
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Deep learning approaches to inverse problems in imaging: Past, present and future'. Together they form a unique fingerprint.

Cite this