Adaptive Image Sampling Using Deep Learning and Its Application on X-Ray Fluorescence Image Reconstruction

Qiqin Dai, Henry Chopp, Emeline Pouyet, Oliver Strides Cossairt, Marc Walton, Aggelos K. Katsaggelos*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

This paper presents an adaptive image sampling algorithm based on Deep Learning (DL). It consists of an adaptive sampling mask generation network which is jointly trained with an image inpainting network. The sampling rate is controlled by the mask generation network, and a binarization strategy is investigated to make the sampling mask binary. In addition to the image sampling and reconstruction process, we show how it can be extended and used to speed up raster scanning such as the X-Ray fluorescence (XRF) image scanning process. Recently XRF laboratory-based systems have evolved into lightweight and portable instruments thanks to technological advancements in both X-Ray generation and detection. However, the scanning time of an XRF image is usually long due to the long exposure requirements (e.g., 100\; μ s-1 ms per point). We propose an XRF image inpainting approach to address the long scanning times, thus speeding up the scanning process, while being able to reconstruct a high quality XRF image. The proposed adaptive image sampling algorithm is applied to the RGB image of the scanning target to generate the sampling mask. The XRF scanner is then driven according to the sampling mask to scan a subset of the total image pixels. Finally, we inpaint the scanned XRF image by fusing the RGB image to reconstruct the full scan XRF image. The experiments show that the proposed adaptive sampling algorithm is able to effectively sample the image and achieve a better reconstruction accuracy than that of existing methods.

Original languageEnglish (US)
Article number8930037
Pages (from-to)2564-2578
Number of pages15
JournalIEEE Transactions on Multimedia
Volume22
Issue number10
DOIs
StatePublished - Oct 2020

Keywords

  • Adaptive sampling
  • convolutional neural network
  • inpainting
  • X-Ray fluorescence

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Adaptive Image Sampling Using Deep Learning and Its Application on X-Ray Fluorescence Image Reconstruction'. Together they form a unique fingerprint.

Cite this