Intelligent Agent-Based Architecture for Low-Light Image Enhancement Using an A3C Framework
Keywords:
Image Processing, Low-Light Image Enhancement, Reinforcement Learning AgentAbstract
Low-light image enhancement (LLIE) is an important area of research as many applications such as photography, video surveillance, and security are confronted with image degradation in low-light environments. This paper presents an intelligent agent-based method for LLIE using the Asynchronous Advantage Actor-Critic (A3C) framework. The enhancement task is effectively cast in this work into the framework of a Markov Decision Process. This method enables an agent to learn a policy that successively improves image quality. In the agent, features are extracted by a Fully Convolutional Network (FCN), a policy network for choosing an action, and a value network for estimating the reward. In training, non-reference loss functions are also used to measure image quality without the availability of the reference image or ground truth images. Such functions include spatial consistency loss, exposure control loss, and illumination smoothness loss, and the approach achieves end-to-end enhancement without reference image. The experimental results on LOL and MIT-Adobe dataset also show that the proposed technique enhances image brightness, Contrast, and structure much better as compared to other state-of-the-art methods. Especially, the methodology proposed scored 25.93 PSNR, 0.932 SSIM, and 0.053 LPIPS on the LOL dataset, achieving better results than related strategies. The designed agent-based approach works under a wide range of low-light situations. This approach allows obtaining enhancement results that will be satisfactory in terms of the users’ preferences and needs of the specific applications. The findings highlight the method's robustness and flexibility, making it suitable for various practical applications. This work demonstrates that reinforcement learning agents have promising applications in improved image processing capabilities, and establishes a new record for low-light image improvement.
Downloads
References
Y. Wang, Y. Yu, W. Yang, L. Guo, L. P. Chau, A. C. Kot, et al., "Exposurediffusion: Learning to expose for low-light image enhancement," in Proc. IEEE/CVF Int. Conf. Comput. Vis., 2023, pp. 12438-12448.
W. Wang, D. Yan, X. Wu, W. He, Z. Chen, X. Yuan, et al., "Low-light image enhancement based on virtual exposure," Signal Process.: Image Commun., vol. 118, p. 117016, 2023.
W. Ren et al., "Low-light image enhancement via a deep hybrid network," IEEE Trans. Image Process., vol. 28, no. 9, pp. 4364-4375, 2019.
X. Xu, R. Wang, and J. Lu, "Low-light image enhancement via structure modeling and guidance," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2023, pp. 9893-9903.
W. Kim, "Low-light image enhancement: A comparative review and prospects," IEEE Access, vol. 10, pp. 84535-84557, 2022.
Z. Zhao, B. Xiong, L. Wang, Q. Ou, L. Yu, and F. Kuang, "RetinexDIP: A unified deep framework for low-light image enhancement," IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 3, pp. 1076-1088, 2021.
G. D. Fan, B. Fan, M. Gan, G. Y. Chen, and C. P. Chen, "Multiscale low-light image enhancement network with illumination constraint," IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 11, pp. 7403-7417, 2022.
I. A. Alzuabidi, "Application of machine learning techniques for countering side-channel attacks in cryptographic systems," Alkadhim J. Comput. Sci., vol. 2, no. 3, 2024.
J. Guo, J. Ma, Á. F. García-Fernández, Y. Zhang, and H. Liang, "A survey on image enhancement for Low-light images," Heliyon, vol. 9, no. 4, 2023.
F. A. Bida, "Medical image improvement using a proposed algorithm," Alkadhim J. Comput. Sci., vol. 2, no. 1, pp. 1-11, 2024.
X. Xu, R. Wang, C. W. Fu, and J. Jia, "SNR-aware low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2022, pp. 17714-17724.
J. Hai, Z. Xuan, R. Yang, Y. Hao, F. Zou, F. Lin, et al., "R2rnet: Low-light image enhancement via real-low to real-normal network," J. Visual Commun. Image Represent., vol. 90, p. 103712, 2023.
L. W. Wang, Z. S. Liu, W. C. Siu, and D. P. Lun, "Lightening network for low-light image enhancement," IEEE Trans. Image Process., vol. 29, pp. 7984-7996, 2020.
W. Wang, X. Wu, X. Yuan, and Z. Gao, "An experiment-based review of low-light image enhancement methods," IEEE Access, vol. 8, pp. 87884-87917, 2020.
L. Ma, T. Ma, R. Liu, X. Fan, and Z. Luo, "Toward fast, flexible, and robust low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2022, pp. 5637-5646.
W. Yang, S. Wang, Y. Fang, Y. Wang, and J. Liu, "From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2020, pp. 3063-3072.
K. Kurihara, H. Yoshida, and Y. Iiguni, "Low-light image enhancement via adaptive shape and texture prior," in Proc. 15th Int. Conf. Signal-Image Technol. Internet-Based Syst. (SITIS), Nov. 2019, pp. 74-81.
S. Yang, D. Zhou, J. Cao, and Y. Guo, "LightingNet: An integrated learning method for low-light image enhancement," IEEE Trans. Comput. Imaging, vol. 9, pp. 29-42, 2023.
D. Liang, L. Li, M. Wei, S. Yang, L. Zhang, W. Yang, et al., "Semantically contrastive learning for low-light image enhancement," in Proc. AAAI Conf. Artif. Intell., vol. 36, no. 2, 2022, pp. 1555-1563.
Y. Wang, W. Song, G. Fortino, L. Z. Qi, W. Zhang, and A. Liotta, "An experimental-based review of image enhancement and image restoration methods for underwater imaging," IEEE Access, vol. 7, pp. 140233-140251, 2019.
G. Zhai, W. Sun, X. Min, and J. Zhou, "Perceptual quality assessment of low-light image enhancement," ACM Trans. Multimedia Comput. Commun. Appl., vol. 17, no. 4, pp. 1-24, 2021.
J. Li, X. Feng, and Z. Hua, "Low-light image enhancement via progressive-recursive network," IEEE Trans. Circuits Syst. Video Technol., vol. 31, no. 11, pp. 4227-4240, 2021.
Y. Wu, C. Pan, G. Wang, Y. Yang, J. Wei, C. Li, et al., "Learning semantic-aware knowledge guidance for low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2023, pp. 1662-1671.
X. Yi, H. Xu, H. Zhang, L. Tang, and J. Ma, "Diff-retinex: Rethinking low-light image enhancement with a generative diffusion model," in Proc. IEEE/CVF Int. Conf. Comput. Vis., 2023, pp. 12302-12311.
C. Wei, W. Wang, W. Yang, and J. Liu, "Deep retinex decomposition for low-light enhancement," arXiv preprint arXiv:1808.04560, 2018.
S. M. Pizer, E. P. Amburn, J. D. Austin, R. Cromartie, A. Geselowitz, T. Greer, et al., "Adaptive histogram equalization and its variations," Comput. Vision Graph. Image Process., vol. 39, no. 3, pp. 355-368, 1987.
O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Proc. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2015, pp. 234-241.
Y. Hu, H. He, C. Xu, B. Wang, and S. Lin, "Exposure: A white-box photo post-processing framework," ACM Trans. Graph., vol. 37, no. 2, pp. 1-17, 2018.
R. Yu, W. Liu, Y. Zhang, Z. Qu, D. Zhao, and B. Zhang, "Deepexposure: Learning to expose photos with asynchronously reinforced adversarial learning," in Proc. Neural Inf. Process. Syst., 2018.
K. Yu, C. Dong, L. Lin, and C. C. Loy, "Crafting a toolchain for image restoration by deep reinforcement learning," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2018, pp. 2443-2452.
R. Furuta, N. Inoue, and T. Yamasaki, "Pixelrl: Fully convolutional network with reinforcement learning for image processing," IEEE Trans. Multimedia, vol. 22, no. 7, pp. 1704-1719, 2019.
J. He, Y. Liu, Y. Qiao, and C. Dong, "Conditional sequential modulation for efficient global image retouching," in Proc. Eur. Conf. Comput. Vis., 2020, pp. 679-695.
S. Moran, P. Marza, S. McDonagh, S. Parisot, and G. Slabaugh, "Deeplpf: Deep local parametric filters for image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2020, pp. 12826-12835.
H. U. Kim, Y. J. Koh, and C. S. Kim, "Global and local enhancement networks for paired and unpaired image enhancement," in Proc. Eur. Conf. Comput. Vis., 2020, pp. 339-354.
S. Kosugi and T. Yamasaki, "Unpaired image enhancement featuring reinforcement-learning-controlled image editing software," in Proc. AAAI Conf. Artif. Intell., vol. 34, no. 7, 2020, pp. 11296-11303.
C. Yang, M. Jin, Y. Xu, R. Zhang, Y. Chen, and H. Liu, "Seplut: Separable image-adaptive lookup tables for real-time image enhancement," in Proc. Eur. Conf. Comput. Vis., 2022, pp. 201-217.
C. Yang, M. Jin, X. Jia, Y. Xu, and Y. Chen, "Adaint: learning adaptive intervals for 3d lookup tables on real-time image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2022, pp. 17522-17531.
H. Zeng, J. Cai, L. Li, Z. Cao, and L. Zhang, "Learning image-adaptive 3d lookup tables for high performance photo enhancement in real-time," IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 4, pp. 2058-2073, 2020.
Y. Wang, X. Li, K. Xu, D. He, Q. Zhang, F. Li, et al., "Neural color operators for sequential image retouching," in Proc. Eur. Conf. Comput. Vis., 2022, pp. 38-55.
W. Wu, J. Weng, P. Zhang, X. Wang, W. Yang, and J. Jiang, "Uretinex-net: Retinex-based deep unfolding network for low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2022, pp. 5901-5910.
Z. Zhang, H. Zheng, R. Hong, M. Xu, S. Yan, and M. Wang, "Deep color consistent network for low-light image enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2022, pp. 1899-1908.
Y. Wang, R. Wan, W. Yang, H. Li, L.-P. Chau, and A. Kot, "Low-light image enhancement with normalizing flow," in Proc. AAAI Conf. Artif. Intell., vol. 36, no. 3, 2022, pp. 2604-2612.
K. Jiang, Z. Wang, Z. Wang, C. Chen, P. Yi, T. Lu, et al., "Degrade is upgrade: Learning degradation for low-light image enhancement," in Proc. AAAAI Conf. Artif. Intell., vol. 36, no. 1, 2022, pp. 1078-1086.
Y. Feng, S. Hou, H. Lin, Y. Zhu, P. Wu, W. Dong, et al., "DiffLight: Integrating Content and Detail for Low-light Image Enhancement," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2024, pp. 6143-6152.
Z. Wang, D. Li, G. Li, Z. Zhang, and R. Jiang, "Multimodal low-light image enhancement with depth information," in Proc. ACM Int. Conf. Multimedia, 2024, pp. 4976-4985.
S. Sewak and M. Sewak, "Actor-critic models and the A3C: The asynchronous advantage actor-critic model," in Deep Reinforcement Learning: Frontiers of Artificial Intelligence, 2019, pp. 141-152.
V. Mnih, "Asynchronous methods for deep reinforcement learning," in arXiv preprint arXiv:1602.01783, 2016.
V. Bychkovsky, S. Paris, E. Chan, and F. Durand, "Learning photographic global tonal adjustment with a database of input/output image pairs," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 97-104.
X. Guo, Y. Li, and H. Ling, "LIME: Low-light image enhancement via illumination map estimation," IEEE Trans. Image Process., vol. 26, no. 2, pp. 982-993, 2016.
S. Wang, J. Zheng, H. M. Hu, and B. Li, "Naturalness preserved enhancement algorithm for non-uniform illumination images," IEEE Trans. Image Process., vol. 22, no. 9, pp. 3538-3548, 2013.
T. Wang, K. Zhang, T. Shen, W. Luo, B. Stenger, and T. Lu, "Ultra-high-definition low-light image enhancement: A benchmark and transformer-based method," in Proc. AAAI Conf. Artif. Intell., vol. 37, no. 3, 2023, pp. 2654-2662.
Published
How to Cite
Issue
Section
Copyright (c) 2024 Muthana Mahdi (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
