Moritz Grotthuss, CEO of Gestigon, said: “Using today’s head-mounted VR displays, my hands are either not visible, or the tracking is so slow and inaccurate that the hands feel more like a robot’s and not my own.”
Second generation head-mounted-devices will include front-facing 3D sensors to improve realism, but component cost and power consumption are key concerns.Bringing together the Inuitive NU3000 multi-core imaging processor and Gestigon gesture recognition algorithms, the collaboration between the two companies aims to address these concerns.
The NU3000 processor incorporates two CEVA MM3101 imaging and computer vision vector DSP cores. In addition, it integrates a dedicated hardware accelerator capable of extracting real-time depth maps from stereo vision input. Gestigon’s gesture recognition algorithms, based on its Carnival AR/VR Interaction Suite, are customised and optimised to run directly on this processor to provide fingertip and hand tracking, as well as gesture recognition.
Shlomo Gadot, CEO and co-founder of Inuitive, added: “Our unique technology and architecture uses input from standard, low-cost cameras to efficiently generate depth maps. Now, through our collaboration with Gestigon, we can offer a complete one-stop solution to our customers, shortening the development cycle.”