论文标题

南:噪音吸引的nerfs爆发

NAN: Noise-Aware NeRFs for Burst-Denoising

论文作者

Pearl, Naama, Treibitz, Tali, Korman, Simon

论文摘要

现在,爆发deNoising比以往任何时候都更加重要,因为计算摄影有助于克服手机和小型相机固有的敏感性问题。爆发的一个主要挑战是应对像素的未对准,到目前为止,它以相当简单的简单运动的假设或对预处理进行协调的能力。在大型运动和高噪声的情况下,这种假设是不现实的。我们表明,最初针对基于物理学的小说视图渲染的神经辐射场(NERF)可以作为爆发deNosing的强大框架。 NERFS在整合来自多个图像的信息时具有固有的处理噪声功能,但是它们在这样做的限制中,主要是因为它们是基于适合理想成像条件的Pixel Wise操作构建的。我们的方法称为Nan,利用NERF中的视图和空间信息来更好地处理噪音。它实现了最新的导致爆发的爆发,并且在很高的噪音下应对大型运动和遮挡方面特别成功。随着加速NERF的快速发展,它可以为在具有挑战性的环境中提供一个强大的平台。

Burst denoising is now more relevant than ever, as computational photography helps overcome sensitivity issues inherent in mobile phones and small cameras. A major challenge in burst-denoising is in coping with pixel misalignment, which was so far handled with rather simplistic assumptions of simple motion, or the ability to align in pre-processing. Such assumptions are not realistic in the presence of large motion and high levels of noise. We show that Neural Radiance Fields (NeRFs), originally suggested for physics-based novel-view rendering, can serve as a powerful framework for burst denoising. NeRFs have an inherent capability of handling noise as they integrate information from multiple images, but they are limited in doing so, mainly since they build on pixel-wise operations which are suitable to ideal imaging conditions. Our approach, termed NAN, leverages inter-view and spatial information in NeRFs to better deal with noise. It achieves state-of-the-art results in burst denoising and is especially successful in coping with large movement and occlusions, under very high levels of noise. With the rapid advances in accelerating NeRFs, it could provide a powerful platform for denoising in challenging environments.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源