Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods

Alice Lucas, Michael Iliadis, Rafael Molina, Aggelos K. Katsaggelos

Research output: Contribution to journalArticlepeer-review

436 Scopus citations

Abstract

Traditionally, analytical methods have been used to solve imaging problems such as image restoration, inpainting, and superresolution (SR). In recent years, the fields of machine and deep learning have gained a lot of momentum in solving such imaging problems, often surpassing the performance provided by analytical approaches. Unlike analytical methods for which the problem is explicitly defined and domain-knowledge carefully engineered into the solution, deep neural networks (DNNs) do not benefit from such prior knowledge and instead make use of large data sets to learn the unknown solution to the inverse problem. In this article, we review deep-learning techniques for solving such inverse problems in imaging. More specifically, we review the popular neural network architectures used for imaging tasks, offering some insight as to how these deep-learning tools can solve the inverse problem. Furthermore, we address some fundamental questions, such as how deeplearning and analytical methods can be combined to provide better solutions to the inverse problem in addition to providing a discussion on the current limitations and future directions of the use of deep learning for solving inverse problem in imaging.

Original languageEnglish (US)
Article number8253590
Pages (from-to)20-36
Number of pages17
JournalIEEE Signal Processing Magazine
Volume35
Issue number1
DOIs
StatePublished - Jan 2018

Funding

This work was supported in part by the U.S. Department of Energy under grant DE-NA0002520, Office of Naval Research award N00014-15-1-2735, National Science Foundation IDEAS program, the Defense Advanced Research Projects Agency ReImagine, and the Spanish Ministry of Economy and Competitiveness through projects TIN2013-43880-R and DPI2016-77869-C2-2-R.

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods'. Together they form a unique fingerprint.

Cite this