Creating 360-degree 3D content is challenging because it requires either a multi-camera rig or a collection of many images taken from different perspectives. Our approach aims to generate a 360◦ VR scene from a single panoramic image using a learning-based inpainting method adapted for panoramic content. We introduce a pipeline capable of transforming an equirectangular panoramic RGB image into a complete 360◦ 3D virtual reality scene represented as a textured mesh, which is easily rendered on a VR headset using standard graphics rendering pipelines. We qualitatively evaluate our results on a synthetic dataset consisting of 360 panoramas in indoor scenes.
You can explore the output mesh generated by our method using our VR viewer. For the best experience, we recommend using Google Chrome on desktop or a compatible VR headset. Our viewer has been thoroughly tested on an Oculus Quest 2 in tethered mode that allows seamless exploration of walkable spaces. You can also explore the space by swiping with your mouse or using touch.
