PrimeSense – VRTogether https://vrtogether.eu An end-to-end system for the production and delivery of photorealistic and social virtual reality experiences Wed, 29 Jul 2020 18:59:04 +0000 en-US hourly 1 https://vrtogether.eu/wp-content/uploads/2018/04/cropped-iconavr-32x32.png PrimeSense – VRTogether https://vrtogether.eu 32 32 New venues for capturing facial performance https://vrtogether.eu/2018/04/04/new-venues-for-capturing-facial-performance/?utm_source=rss&utm_medium=rss&utm_campaign=new-venues-for-capturing-facial-performance Wed, 04 Apr 2018 07:21:30 +0000 http://vrtogether.eu/?p=470 VR together partners Artanim and Entropy will soon start shooting cinematic content to be used for showcasing the technology developed by the consortium. In this post we bring some of the production effort developed at Artanim, which is currently exploring the use of Apple’s iPhone X face tracking technology in the production pipeline of 3D […]

The post New venues for capturing facial performance appeared first on VRTogether.

]]> VR together partners Artanim and Entropy will soon start shooting cinematic content to be used for showcasing the technology developed by the consortium. In this post we bring some of the production effort developed at Artanim, which is currently exploring the use of Apple’s iPhone X face tracking technology in the production pipeline of 3D animations.

The photos below show the iPhone X holding rig, and an early version of the face tracking recording tool that was developed by Artanim. The tool integrates with full body and hands motion capture technology from Vicon to allow the simultaneous recording of body, hands and face performance from multiple actors.

With the recent surge of consumer virtual reality, interest for motion capture has dramatically increased. The iPhone X and ARKit SDK from Apple integrate depth sensing and facial animation technologies, and are a good example of this trend. Apple’s effort to integrate advanced face tracking to their mobile devices may be related to the recent acquisition of PrimeSense and FaceShift. The former was involved in the development of the technology powering the first Kinect back in 2011, the latter is recognized for their face tracking technology, which is briefly showcased in the making of Star Wars: The Force Awakens trailer. These are exciting times, when advanced motion tracking technologies are becoming ubiquitous in our life.

Images from the iPhone X keynote presentation from Apple

Text and pictures: Henrique Debarba – Artanim

The post New venues for capturing facial performance appeared first on VRTogether.

]]>