Global Structure-Aware Diffusion Process for Low-light Image Enhancement

Jinhui Hou1, Zhiyu Zhu1, Junhui Hou1, Hui Liu2, Huanqiang Zeng3, Hui Yuan4
1City University of Hong Kong, 2Caritas Institute of Higher Education 3Huaqiao University 4Shandong University

Abstract

This paper studies a diffusion-based framework to address the low-light image enhancement problem. To harness the capabilities of diffusion models, we delve into this intricate process and advocate for the regularization of its inherent ODE-trajectory. To be specific, inspired by the recent research that low curvature ODE-trajectory results in a stable and effective diffusion process, we formulate a curvature regularization term anchored in the intrinsic non-local structures of image data, i.e., global structure-aware regularization, which gradually facilitates the preservation of complicated details and the augmentation of contrast during the diffusion process. This incorporation mitigates the adverse effects of noise and artifacts resulting from the diffusion process, leading to a more precise and flexible enhancement. To additionally promote learning in challenging regions, we introduce an uncertainty-guided regularization technique, which wisely relaxes constraints on the most extreme regions of the image. Experimental evaluations reveal that the proposed diffusion-based framework, complemented by rank-informed regularization, attains distinguished performance in low-light enhancement. The outcomes indicate substantial advancements in image quality, noise suppression, and contrast amplification in comparison with state-of-the-art methods. We believe this innovative approach will stimulate further exploration and advancement in low-light image processing, with potential implications for other applications of diffusion models.

Method

Interpolate start reference image.

Illustration of the training workflow of the proposed method.

Results

Interpolate start reference image.

Quantitative results on LOLv1 and LOLv2.

Interpolate start reference image.

Visual results on LOLv1 and LOLv2.

Interpolate start reference image.

Visual results on unpaired real low-light images.

BibTeX

   @article{hou23global,
      title={Global Structure-Aware Diffusion Process for Low-Light Image Enhancement},
      author={Jinhui Hou, Zhiyu Zhu, Junhui Hou, Hui Liu, Huanqiang Zeng, and Hui Yuan},
      journal={arXiv preprint arXiv:2310.17577},
      year={2023}
    }