HS-Former V3: An Uncertainty-Aware Hybrid Transformer–CNN Framework with Adaptive Frequency-Domain Learning and Edge-Aware Fusion for Low-Light Image Enhancement
DOI:
https://doi.org/10.59992/IJESA.2026.v5n10p13Keywords:
Low-Light Images Enhancement, Swin Transformer V2, CNN, Learning in Frequency Domain, Edge Aware Fusion, UncertaintyAbstract
improving low-light images is a very challenging vision task, since degradation in the low-light image is usually caused under complex low-light conditions that destroys the visibility of the image, sources of noise are often present, and the high-frequency structure information is lost. To address these problems, in this paper, we propose HS-Former V3: a hybrid Transformer-CNN setup, which aims to learn the modeling of global illumination together with the restoration of local structures. The setup contains a Swin Transformer V2 branch, a lightweight convolution branch, an Edge-Aware Cross Fusion (EACF) module, and a Dynamic Frequency-Selective Loss (DFL). Besides, we propose a masked-frequency pre-training strategy to further explore the effectiveness of unpaired low-light images and design an uncertainty estimation head to locate uncertain enhancement regions. The overall system is inspired by two deficiencies, i.e. deficiency of the traditional reconstruction objectives and the deficiency of features and efficiency of models. The evaluation protocol includes full-reference image-quality metrics, no-reference quality evaluation, computational complexity, corruption robustness, and downstream object detection. This structure will pave the way towards reproducible research on adaptive spectral supervision and edge-guided fusion, to be validated in a controlled successful implementation.
References
1. Wei, C. Wang, W. Yang, W. & Liu, J. Deep retinex decomposition for low-light enhancement Proceedings of the British Machine Vision Conference (BMVC) 2018.
2. Y. Zhang, J. Zhang, and X. Guo, "Kindling the Darkness: A Practical Low-light Image Enhancer, " Proceedings of the ACM International Conference on Multimedia, vol. 2019-October, pp. 16321640, 2019. Doi: 10.1145/3343031.3350926.
3. C. Guo, C. Li, J. Guo, C. C. Loy, J. Hou, S. Kwong, R. Cong, Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020, pp. 17801789.
4. Y. Jiang, H. Liu, X. Wang, W. Qi, J. He. "Enlighten GAN: Deep Light Enhancement without Paired Supervision," IEEE Transactions on Image Processing, 2021 (open-access version) the full bibliographic record for this publication is also available in the publisher's record.
5. S. W. Zamir, A. Arora, S. Khan, M. Hayat, F. S. Khan, and M.-H. Yang, "Restormer: Efficient Transformer for High-Resolution Image Restoration," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 pp. 57285739.
6. Z. Liu et al. "Swin Transformer V2: Scaling Up Capacity and Resolution, " Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022 pp. 1200912019.
7. Y. Cai, H. Bian, J. Lin, H. Wang, R. Timofte, and Y. Zhang. Retinex former: One-Stage Retinex-Based Transformer for Low-Light Image Enhancement. Proceedings of the IEEE/CVF International Conference on Computer Vision 1250412513 2023.
8. C. Chen, Q. Chen, J. Xu, and V. Koltun Learning to see in the dark Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018 pp. 32913300. Doi: 10.1109/CVPR.2018.00347
9. Y. P. Loh and C. S. Chan, "Getting to Know Low-Light Images with the Exclusively Dark Dataset," Computer Vision and Image Understanding, vol. 178, pp. 3042, 2019. Https://doi.org/10.1016/j.cviu.2018.10.010.
