Towards Plenoptic Raumzeit Reconstruction

The goal of image-based rendering is to evoke a visceral sense

of presence in a scene using only photographs or videos. A huge variety of different approaches have been developed during the last decade. Examining the underlying models we find three different main categories: view interpolation based on geometry proxies, pure image interpolation techniques and complete scene flow reconstruction. In this paper we present three approaches for free-viewpoint video, one for each of these categories and discuss their individual benefits and drawbacks.We hope that studying the different approaches will help others in making important design decisions when planning a free-viewpoint video system.