In order run these AI workloads, however, it requires significant compute power which in turn requires considerable amounts of embedded memory integrated on chip as close to the compute units as possible to reduce latency.
Delivering the inferencing power that users now expect requires massively parallel processing arrays which means not only increased power consumption, but also ever challenging thermal loads placing demands on packaging and cooling needs.
In response, sureCore has further optimised its PowerMiser IP to drive down dynamic power further as well as exploiting the power efficiencies of FinFET technology and has delivered a memory technology that minimises thermal impact whilst delivering the demanding performance profile needed by AI. The technology has been named PowerMiser AI.
According to Paul Wells, sureCore’s CEO,“Our typical customer has been using our ultra-low power SRAM IP in battery-powered applications to provide a longer operational life between recharges. The surge in AI augmentation means that whole new areas for our low power memory solutions have appeared in new and exciting areas that are not constrained by battery life and can be mains powered or are even in the automotive space.
“Power consumption is still a critical factor for these applications, but the constraining factor is starting to become heat dissipation and potential thermal damage. To keep product form factors under control and obviate the need for forced cooling so as to prevent overheating, new low power solutions are needed.
“Our recent announcements about working on ultra-low power memory IP for use in cryostats in the quantum computing arena, where heat generation by chips must be minimised, has resulted in enquiries from companies who also need to keep AI chips operating within temperature boundaries albeit at the other end of the scale.
“Standard off-the-shelf SRAM IP has been optimised for area or speed, but not power. Our technology is extremely power efficient and therefore generates less heat making it the ideal solution for the next generation of AI-enabled chips. This includes everything from Edge devices to in-car applications, and even to data centres all of which must minimise thermal overheads. This will become increasingly important as products increasingly rely on AI at the Edge and less on cloud-based solutions.”
Embedded SRAM can be a significant power drain when, for example, pattern matching and on a large AI-enabled chip, memory can account for as much as 50% of the power usage and is therefore a major contributor to power consumption and thermal load.
According to estimates provided by sureCore, by using PowerMiser AI it should be possible to reduce dynamic power consumption by as much as 50% delivering compelling cuts in thermal load, meaning heat sinks or other cooling systems are either not required or are dramatically reduced thereby increasing overall system reliability.
