Meta is updating its integrated real-time tracking system with support for a variety of movements, including movements such as clapping. A new version of the Presence Platform API introduces everyone after a limited introduction to several developers, promising a more sophisticated and reliable interface on the Meta (formerly Oculus) Quest headset.
The current Platform Update is designed to improve Quest mobile search – which uses head-mounted cameras to replace standard device controls – across the board. In addition to the general confidence update, it focuses on motion recognition when part of your hand is blocked from viewing the camera. It is now thought to hold the palms, the five-limbed, the interlocking hands, and other movements involving the eyelids. Thumb-raising movements, as well as more intangible interactions such as pinching, grasping, and playing, are expected to improve as well. Producers who have built custom moves (hit the box with real boxing, for example) may see those also improve.
Camera-based tracking is not necessarily the ultimate Meta game of integration – although the press briefly refers to the use of the current Platform system for “future devices” as well as Quest. The company is working on an enhanced real-time hand grip that reads nerve movement in your hand, based on the technology it acquired at the start of CTRL-Labs in 2019. It is also testing a haptic glove that can produce a touch response when add movement control. But these systems are years down the road, while camera-based manual monitoring requires nothing but software upgrades to standard VR headset sensors. It’s one of the things that has helped push Quest from a VR-focused device to one that combines a visual and visual world – even if it’s not yet the first way many people interact with the site.