The solution comprises free engineering software to be used with ST’s VL53L5CX FlightSense time-of-flight (ToF) multizone ranging sensor. Gesture recognition with ToF sensors is a new technology that enables sophisticated interactions with a wide variety of devices.
Initially a feature of high-end vehicles, gesture-based interaction can enhance numerous types of equipment, including kitchen appliances, thermostats, smart-home and smart-lighting controls, laptops, AR/VR headsets, tablets, and smartphones. Also, user interfaces able to interpret touchless gestures can help prevent infections from spreading through equipment like vending and ticketing machines, elevator controls, and interactive signage.
ST is now looking to make gesture detection simpler and more affordable for mass-market applications with this latest companion software for its VL53L5CX multi-zone ToF ranging sensor. Together, the sensor and software calculate in real-time the X/Y/Z coordinates of the hand, enabling hand tracking and thus recognition of gestures like tapping, swiping, level control, and more.
Conventional gesture-recognition systems typically use more expensive and intrusive camera-based machine vision. ST’s solution will enable designers to build systems that benefit from greater user privacy and lower power consumption, and that work in the dark without needing external illumination, unlike vision-based solutions. The lightweight gesture algorithm can run on a low-power microcontroller and demands minimal system resources, so is easily integrated in an existing application.
“Current trends are driving so-called edge devices to become more affordable and energy efficient, as well as more advanced and powerful,” said Eric Aussedat, ST’s Executive VP, Imaging Sub-Group General Manager. “ST is setting the pace with technologies such as our FlightSense imaging product portfolio, which now adds free and ready-to-use software that helps integrate gesture sensing for touchless control in all kinds of consumer and industrial equipment.”
The STSW-IMG035 software package is specially designed for the VL53L5CX multi-zone direct time-of-flight (dToF) ranging sensor and can be used with all STM32 microcontrollers. The VL53L5CX is ST’s latest-generation ToF sensor, providing 64 zones with high-accuracy ranging up to 400cm with a wide, square-edged 63°-diagonal field of view.
