Project 5

Advanced Technologies for 3D Capture, Communication, and Display

In this research project, broad investigations into advanced hardware and software technologies are conducted, aiming to support future systems for immersive 3D telepresence with multiple users per site and providing bidirectional eye contact.

These approaches are expected to cover predominantly the areas of 3D capture/acquisition, advanced 3D displays, as well as aspects of communication between sites.

This project concentrates on the feasibility of the proposed approaches for these ambitious and challenging tasks.

Reconstruction and data processing

Multiview reconstruction aims at computing the geometry of a scene observed by a set of cameras. Accurate 3D reconstruction and the rendering of dynamic scenes is a key component in a large variety of applications, ranging from visual effects to telepresence and medical imaging. The main focus of this project is the development of representations and algorithms to efficiently reconstruct and render dynamic scenes captured by a set of hybrid color-depth cameras, in addition to identifying inliers and outliers of noisy data.