3D denoised completion network for deep single-pixel reconstruction of hyperspectral images

Valeriya Pronina, Antonio Lorente Mur, Juan F.P.J. Abascal, Françoise Peyrin, Dmitry V. Dylov, Nicolas Ducros

Research output: Contribution to journalArticlepeer-review

Abstract

Single-pixel imaging acquires an image by measuring its coefficients in a transform domain, thanks to a spatial light modulator. However, as measurements are sequential, only a few coefficients can be measured in the real-time applications. Therefore, single-pixel reconstruction is usually an underdetermined inverse problem that requires regularization to obtain an appropriate solution. Combined with a spectral detector, the concept of single-pixel imaging allows for hyperspectral imaging. While each channel can be reconstructed independently, we propose to exploit the spectral redundancy between channels to regularize the reconstruction problem. In particular, we introduce a denoised completion network that includes 3D convolution filters. Contrary to black-box approaches, our network combines the classical Tikhonov theory with the deep learning methodology, leading to an explainable network. Considering both simulated and experimental data, we demonstrate that the proposed approach yields hyperspectral images with higher quantitative metrics than the approaches developed for grayscale images.

Original languageEnglish
Pages (from-to)39559-39573
Number of pages15
JournalOptics Express
Volume29
Issue number24
DOIs
Publication statusPublished - 22 Nov 2021

Fingerprint

Dive into the research topics of '3D denoised completion network for deep single-pixel reconstruction of hyperspectral images'. Together they form a unique fingerprint.

Cite this