论文标题
图像恢复不足的摄像机
Image Restoration for Under-Display Camera
论文作者
论文摘要
全屏设备的新趋势鼓励我们将相机放置在屏幕后面。删除挡板并在屏幕下集中摄像头会带来较大的显示与身体比率，并增强视频聊天中的眼神交流，但也会导致图像降解。在本文中，我们将重点放在新定义的下播放摄像机（UDC）上，这是一种新颖的现实世界单图修复问题。首先，我们采用4K透明的OLED（T-OLED）和电话五方OLED（P-OLED），并分析其光学系统以了解降解。其次，我们设计了一个监视机摄像机成像系统（MCIS），以更轻松的真实数据获取，以及基于模型的数据合成管道，以生成点扩展功能（PSF）和UDC数据，仅从显示模式和相机测量中。最后，我们使用基于反卷积的管道和基于学习的方法来解决复杂的降解。我们的模型展示了实时的高质量恢复。提出的方法和结果揭示了UDC的有希望的研究值和方向。
The new trend of full-screen devices encourages us to position a camera behind a screen. Removing the bezel and centralizing the camera under the screen brings larger display-to-body ratio and enhances eye contact in video chat, but also causes image degradation. In this paper, we focus on a newly-defined Under-Display Camera (UDC), as a novel real-world single image restoration problem. First, we take a 4k Transparent OLED (T-OLED) and a phone Pentile OLED (P-OLED) and analyze their optical systems to understand the degradation. Second, we design a Monitor-Camera Imaging System (MCIS) for easier real pair data acquisition, and a model-based data synthesizing pipeline to generate Point Spread Function (PSF) and UDC data only from display pattern and camera measurements. Finally, we resolve the complicated degradation using deconvolution-based pipeline and learning-based methods. Our model demonstrates a real-time high-quality restoration. The presented methods and results reveal the promising research values and directions of UDC.
