Copy
VR Digest: Apple reveals fruit of
PrimeSense & Faceshift acquisitions

The week's top VR news brought to you
pre-digested and ready for assimilation!
VR Digest: A VR newsletter brought to you by Studio Transcendent
written by John Dewar (@jstarrdewar) Issue 137 – September 14, 2017

VR Digest: A Virtual Reality newsletter brought to you by Studio Transcendent

Apple Reveals Fruit of PrimeSense and Faceshift Acquisitions

Tuesday, Apple revealed its fall product lineup. iPhones get wireless and fast charging across the board, while Apple Watch gets cellular capability. Of particular interest to the VR community is the new iPhone X, the first iPhone with an OLED display and an array of new sensors. The new iPhone’s display is supplied by Samsung (for now), so theoretically the device should be capable of low-persistence, and the screen’s 2436 x 1125 resolution is comparable to the S8. Apple did not announce a Daydream or Gear VR competitor at the event, but the phone is perfectly suited should they decide to support one. Sadly, Apple’s 120 frames-per-second ProMotion technology, which debuted on the iPad Pro, did not make it to the iPhone this year.

We have long wondered why Apple purchased PrimeSense and Faceshift and if they intended to apply them to AR or VR. PrimeSense developed the technology that powered the original Microsoft Kinect, while Faceshift developed a system that analyzed a user’s face in real time and mapped their expressions onto an animated character. Many people thought Apple would put those sensors on the back of the phone the way Google did with Project Tango, to enable advanced 3D mapping capabilities.

Instead, Apple put the sensors on the front. PrimeSense’s technology is used primarily to power the FaceID facial recognition security system, which replaces TouchID. The infrared projection feature allows FaceID to work in the dark. Apple calls this the “TrueDepth” sensor.

Faceshift’s technology makes an appearance in the Camera app (for Snapchat-style 3D face masks and relighting selfies) as well as “animoji”, 3D emojis that you can animate by making faces at the phone. This led us to the unforgettable moment where Jonathan Ive appears in a design video as sad poop.

It remains unclear how much the animoji rely on the TrueDepth sensor since other face tracking solutions on the market do not require a depth sensor to work, but Apple appears to be making the feature exclusive to the X.

We’ve seen some tweets lamenting the fact that Apple’s use case for this technology is so selfie-focused, but take heart — if developers get a TrueDepth API, some really interesting use cases will still be possible. A 3D scanning app could be made to stream its data to a companion application on an iPad for example, so it’s still possible that the iPhone X could be a useful as a handheld scanner. The sensor should also enable some great 3D avatar creation systems like the one Sony showed off at IFA (incidentally the Sony phone’s sensors are on the back, so you need help to create an avatar; there are definite advantages to the front-facing setup). In addition, indie game developers could certainly benefit from a setup-free facial performance capture app. So the future looks bright for the X’s sensor package.

In addition, Apple announced that iOS 11 will be released on September 19, finally bringing ARKit officially to the public and the first wave of ARKit app releases. [Demos: The MachinesIKEA
 

Bits

4A-Games, creators of the Metro series are now offering their VR experience ARKTIKA.1 for pre-order on the Oculus store.

The hit VR multiplayer tactical shooter Onward is offering a free preview weekend.

Acer improved the back headstrap on their Windows Mixed Reality VR headset before launching to consumers. [Road to VR]

Felix & Paul’s The People’s House 360 video won an Emmy. [Road to VR]

UploadVR reviewed the Pico Goblin standalone VR headset. The upshot? It’s surprisingly good for its $249 price point. But it is yet another attempt to start a new VR content ecosystem with a tiny library of launch content. It is not effortless for developers to support new platforms even if porting to them is completely seamless. Thus, starting a new ecosystem is incredibly difficult. The Goblin will also face rumors of a similar $200 device from Oculus, which consumers would certainly consider to be a safer investment.

Another potentially more successful platform play is being made by Omni, maker of the slippery dish shaped VR treadmill. The company has pivoted from attempting to sell to home users and is focusing their entire platform on the arcade marketplace. Their Omniverse content platform enables content creators to charge by the minute for their games, and arcade owners to find an easy central repository of compatible experiences with instant licensing. [Upload]

Pimax is offering its ultra high resolution, ultra wide field of view headset on Kickstarter. The device is interesting because it's one of the first aside from the HTC Vive to integrate Valve's lighthouse tracking tech. It uses two screens set at angles similar to the StarVR headset. Unfortunately, we have yet to see lens compensation working properly in that configuration, and, according to Road to VR, the last public demo of the Pimax still suffered from lens warping issues. The headset will support SteamVR as well as a proprietary PiHome portal.

Upload clearly has the top VR news publishing operation right now, as well as a budding chain of VR-specific coworking enclaves, but the organization has run into trouble. TechCrunch reports that the company settled a sexual harassment lawsuit brought back in May, but that current and former employees feel not enough has been done in response. The company did bring on two new female executives which is certainly a step in the right direction, but it remains to be seen how much damage was done; a $12 million fundraising round for a new VC initiative may have been scuttled by the news and Upload closed their last round of funding just as it broke in May, so they don’t have long before they need to move beyond the controversy and raise more capital.

VR Digest™ is a Virtual Reality Newsletter brought to you by Studio Transcendent, a producer of premium Virtual Reality experiences. We publish weekly on Thursdays.

 
Subscribe Now
Copyright © 2017 Studio Transcendent, All rights reserved.