Removing Imaging Artifacts in Electron Microscopy using an Asymmetrically Cyclic Adversarial Network without Paired Training Data

Abstract

We propose an asymmetrically cyclic adversarial network that performs denoising tasks to improve electron microscopy (EM) image analysis. Deep learning-based denoising methods have typically been trained either with matching pairs of noise-free and noise-corrupted images or by leveraging prior knowledge of noise distributions. Neither of these options is feasible in high-throughput EM imaging pipelines. Our proposed denoising method employs independently acquired noise-free, noise pattern, and noise-corrupted images to automatically learn the underlying noise model and generate denoised outputs. This method is based on three way cyclic constraints with adversarial training of a deep network to improve the quality of acquired images without paired training data. Its utility is demonstrated for cases where imaging substrates add noise and where acquisition conditions contribute noise. We show that our method, which builds on the concept of CycleGAN, outperforms the current state-of-the-art denoising approaches Noise2Noise and Noise2Void, as well as other learning-based techniques.

Removing Imaging Artifacts in Electron Microscopy using an Asymmetrically Cyclic Adversarial Network without Paired Training Data

  • [PDF] Tran Minh Quan, David Grant Colburn Hildebrand, Kanggeun Lee, Logan A. Thomas, Aaron T. Kuan, Wei-Chung Allen Lee, and Won-Ki Jeong. Removing Imaging Artifacts in Electron Microscopy using an Asymmetrically Cyclic Adversarial Network without Paired Training Data. In Proceedings of the IEEE International Conference on Computer Vision Workshops, page 0–0, 2019.
    [Bibtex]
    @inproceedings{quantm_lci_2019,
    title={Removing Imaging Artifacts in Electron Microscopy using an Asymmetrically Cyclic Adversarial Network without Paired Training Data},
    author={Minh Quan, Tran and Grant Colburn Hildebrand, David and Lee, Kanggeun and Thomas, Logan A and Kuan, Aaron T and Allen Lee, Wei-Chung and Jeong, Won-Ki},
    booktitle={Proceedings of the IEEE International Conference on Computer Vision Workshops},
    pages={0--0},
    year={2019}
    }