It is also now available with the NVIDIA Holoscan sensor processing platform and the NVIDIA Jetson platform for edge AI and robotics.
Humanoid robots, which resemble and act like humans, represent a growing sector that was valued at $1.8 billion in 2023 and is predicted to increase to more than $13 billion by 2028, according to research firm MarketsandMarkets.
These robots are engineered to imitate human expressions, interactions and movements, but in order to do this, they require an array of cameras, sensors, and artificial intelligence (AI) and machine learning (ML) technologies.
NVIDIA Holoscan is a full-stack AI sensor processing platform for low-latency sensor and network connectivity that includes optimised libraries for data processing, AI and core microservices to run streaming, imaging and other applications, from embedded, to edge, to cloud.
The platform can be used to build streaming AI pipelines for a variety of domains, including medical devices, high-performance computing at the edge, and industrial inspection.
NVIDIA Jetson is a platform for robotics and embedded edge AI applications and offers compact, high-performance compute, supported by the NVIDIA JetPack software development kit to help accelerate software development and NVIDIA application frameworks like NVIDIA Holoscan, NVIDIA Metropolis and NVIDIA Isaac.
“Humanoid robotic systems are complex and demand high processing capabilities for AI. OMNIVISION’s total camera solution supports four cameras simultaneously capturing high-resolution colour images with an integrated ISP, which serves as a backend resource to support more AI functions,” said Kelly Yan, senior product marketing manager, OMNIVISION.
“The solution has been verified and is ready with the NVIDIA Holoscan sensor bridge, which features an Ethernet output and supports long-distance transmission for flexible robotic camera placement. Our roadmap for robotics includes bringing an even more compact design to market in the future, using our recently announced 2.2-micron GS product family.”
OMNIVISION’s high-performance 2-megapixel (MP) OG02B10 GS sensor uses advanced 3 x 3-micron OmniPixel3-GS pixel technology which eliminates motion artifacts and blurring and improves low-light sensitivity. The OAX4000 companion ISP is capable of processing up to four camera modules with 140 dB high dynamic range (HDR), reducing design complexity and space and improving overall reliability.
