Inuitive, a developer of advanced 3D computer vision and image processors, and gestigon, known for hand and finger tracking gesture control middleware, have announced a collaboration to bring gesture recognition to embedded virtual reality platforms. The first stage of this collaboration will be demonstrated by both companies at CES 2016 in Las Vegas.

“Using today’s head-mounted VR displays, my hands are either not visible, or the tracking is so slow and inaccurate that the hands feel more like a robot’s and not my own,” said Moritz v. Grotthuss, CEO of gestigon.

Second generation head-mounted-devices will include front-facing 3D sensors to improve realism, but component cost and power consumption are key concerns.  Bringing together the Inuitive NU3000 multi-core imaging processor and gestigon gesture recognition algorithms, the collaboration between the two companies aims to address these concerns.

“Our unique technology and architecture uses input from standard, low-cost cameras to efficiently generate depth maps. Now, through our collaboration with gestigon, we can offer a complete one-stop solution to our customers, shortening the development cycle,” said Shlomo Gadot, CEO and co-founder of Inuitive.

Inuitive’s NU3000 processor incorporates two CEVA MM3101 high-performance, low-power imaging and computer vision vector DSP cores. In addition, it integrates a dedicated hardware accelerator capable of extracting real-time depth maps from stereo vision input. The gestigon gesture recognition algorithms, based on its Carnival AR/VR Interaction Suite, are customized and optimized to run directly on this processor to provide fingertip and hand tracking, as well as gesture recognition.

“Gestigon is in the business of enabling new 3D sensors for global OEMs;  Inuitive provides a unique and attractive solution especially suited for embedded environments.” stated Grotthuss.

“This collaboration is a key step Inuitive is taking towards the goal of offering a complete reference design for VR and AR products,” added Gadot.

The CES 2016 demonstration consists of a depth sensing module utilizing the Inuitive NU3000 processing engine and featuring gestigon’s gesture recognition software. For demo purposes, the unit is assembled on an Oculus Rift development kit.