VRTogether partner CERTH will soon start capturing face content in 3D (RGB-D), with and without a head-mounted display (HMD), to be used for HMD-removal and any other research purpose of the project. In this post, we present the key components of the experiment and provide shots of the user lab located at CERTH.

The photos below depict the capturing environment, as well as the experimental setup. The user lab is located at the Visual Computing Lab of CERTH. The data will be recorded under controlled illumination and static background.

Each subject will be asked to complete two sessions of changing facial expressions with and without wearing HMD. Three different HMDs will be used: HTC Vive, Oculus and FOVE.

Three calibrated RGB-D sensors will capture both colour and depth facial information from different points of view. The main goal for the dataset is to capture 60-100 subjects and a significant amount of data for research purposes.

We’ll keep you updated on these experiments developments and results!