论文标题
爆发摄影用于学习增强极度黑暗的图像
Burst Photography for Learning to Enhance Extremely Dark Images
论文作者
论文摘要
在极低的光线条件下捕获图像对标准摄像机管道构成了重大挑战。图像变得太黑了,太嘈杂了,这使得传统的增强技术几乎不可能应用。最近,基于学习的方法对此任务显示出非常有希望的结果,因为它们具有更大的表现力能力以提高质量。在本文中,我们的旨在利用这些研究的动机,以利用爆发摄影来提高性能,并从极深的原始图像中获得更清晰,更准确的RGB图像。我们提出的框架的骨干是一种新颖的粗到精细网络体系结构,逐渐生成高质量的输出。粗网络预测了一个低分辨率的原始图像,然后将其馈送到罚款网络以恢复细节细节和逼真的纹理。为了进一步降低噪声水平并提高颜色的准确性,我们将该网络扩展到置换不变结构,以便将一系列低光图像作为输入,并从功能级别的多个图像中合并信息。我们的实验表明,与最先进的方法相比,我们的方法通过产生更详细且质量更高的图像而导致更令人愉悦的结果。
Capturing images under extremely low-light conditions poses significant challenges for the standard camera pipeline. Images become too dark and too noisy, which makes traditional enhancement techniques almost impossible to apply. Recently, learning-based approaches have shown very promising results for this task since they have substantially more expressive capabilities to allow for improved quality. Motivated by these studies, in this paper, we aim to leverage burst photography to boost the performance and obtain much sharper and more accurate RGB images from extremely dark raw images. The backbone of our proposed framework is a novel coarse-to-fine network architecture that generates high-quality outputs progressively. The coarse network predicts a low-resolution, denoised raw image, which is then fed to the fine network to recover fine-scale details and realistic textures. To further reduce the noise level and improve the color accuracy, we extend this network to a permutation invariant structure so that it takes a burst of low-light images as input and merges information from multiple images at the feature-level. Our experiments demonstrate that our approach leads to perceptually more pleasing results than the state-of-the-art methods by producing more detailed and considerably higher quality images.