Abstract:Multimodal and multi-information microscopy techniques such as Fluorescence Lifetime Imaging Microscopy (FLIM) extend the informational channels beyond intensity-based fluorescence microscopy but suffer from reduced image quality due to complex noise patterns. For FLIM, the intrinsic relationship between intensity and lifetime information means noise in each channel is a multivariate function across channels without necessarily sharing structural features. Based on this, we present a novel Zero-Shot Denoising Framework with an Intensity-Guided Learning approach. Our correlation-preserving strategy maintains important biological information that might be lost when channels are processed independently. Our framework implements separate processing paths for each channel and utilizes a pre-trained intensity denoising prior to guide the refinement of lifetime components across multiple channels. Through experiments on real-world FLIM-acquired biological samples, we show that our approach outperforms existing methods in both noise reduction and lifetime preservation, thereby enabling more reliable extraction of physiological and molecular information.
Abstract:Fluorescence microscopy has enabled a dramatic development in modern biology. Due to its inherently weak signal, fluorescence microscopy is not only much noisier than photography, but also presented with Poisson-Gaussian noise where Poisson noise, or shot noise, is the dominating noise source, instead of Gaussian noise that dominates in photography. To get clean fluorescence microscopy images, it is highly desirable to have effective denoising algorithms and datasets that are specifically designed to denoise fluorescence microscopy images. While such algorithms exist, there are no such datasets available. In this paper, we fill this gap by constructing a dataset - the Fluorescence Microscopy Denoising (FMD) dataset - that is dedicated to Poisson-Gaussian denoising. The dataset consists 12,000 real fluorescence microscopy images obtained with commercial confocal, two-photon, and wide-field microscopes and representative biological samples such as cells, zebrafish, and mouse brain tissues. We use imaging averaging to effectively obtain ground truth images and 60,000 noisy images with different noise levels. We use this dataset to benchmark 10 representative denoising algorithms and find that deep learning methods have the best performance. To our knowledge, this is the first microscopy image dataset for Poisson-Gaussian denoising purposes and it could be an important tool for high-quality, real-time denoising applications in biomedical research.