Syntiant introduces small language model assistant

1 min read

Syntiant, a specialist in low power edge AI deployments, has unveiled its proprietary small language model assistant (SLMA).

Credit: Achiraya - adobe.stock.com

Described as highly accurate, cloud-free, on-device AI voice assistant capable of offering a seamless, natural voice interface for human-machine interactions it is suitable for set-top box manufacturers, service providers and other device manufacturers, eliminating the need to significantly upgrade or replace existing hardware.

“With our technology, AI language models that typically demand extensive computing resources can now operate efficiently on local devices,” said Kurt Busch, CEO of Syntiant. “While voice applications for our SLMA extend across many industries, imagine the advantage for set-top box manufacturers. Instead of providing static guides or instructions, manufacturers can now integrate a more dynamic, conversational AI assistant to help users without a Web connection, reducing one of the main customer friction points for service providers.”

Syntiant's SLMA is currently being used to power voice interfaces in home appliances, networking equipment, video conferencing systems, among other devices. Coupled with the company’s automatic speech recognition (ASR) models, the SLMA can provide a natural voice-interface at a fraction of the computational cost of LLMs.

“The integration of Syntiant’s SLMA on our Synaptics Astra SL1680 high-performance, low-power system on chip offers a transformative opportunity, allowing users to control their environments, communicate, and perform tasks with unprecedented ease,” explained Siddarth Chandrasekar, senior director of product marketing at Synaptics.

With only 23 million parameters, Syntiant’s SLMA is highly scalable and can run on most existing set top box CPUs.

The small language model’s always-on capability ensures continuous interactions anytime, without the limitations of human agents, such as work hours or fatigue.