Supporting the capture and reconstruction of users as point cloud and TVM including the alignment and further enhancement of the capture in a delay sensitive matter. The goal is to capture a full 3D user representation with a quality that is suitable for “natural” interactions between users.

One of the most crucial technical parameters (i.e. QoS, Quality of Service) for communication is latency or delay. The overall delay of a system is also called glass-to-glass or capture to render delay. In order to allow communication in a natural way the delay has to be as low as possible in all stages of the system (Capture, Encoding, Transmission & Rendering).

New immersive video needs new formats and encodings in VRT we address this with a new form Geometry-based Point Cloud Compression (G-PCC). Our compression allows us to cluster, compress and transmit point cloud data with considerable bandwidth savings and under strict real-time (communication) constraints.

In order to build connections for video and audio transmission between different end devices we implemented an Media Orchestration. This is the Medio Orchestration handles all session initialisation and metadata to connection clients and to facilitate a consistent and synchronized VR experience between them.

Full lightweight pipeline that allows a simplified setup to support home usage and low powered devices (including non-tethered VR HMDs) from capture to rendering. This pipeline is based on off-the-shelf hardware (e.g. supporting any OpenXR display HMD device) and established web technology to keep a low entry burden for users.

Sharing is caring and immersive content in VR can not only be pre-rendered but also be live. This is, in VRTogether we developed a new way to capture, (re-)format and broadcast immersive content in real time.