Edge AI processor tackles compute demands of generative AI, transformer-based models

KINARA Ara-2 Edge AI processor powers edge servers and laptops with high performance, cost effective and energy efficient inference to run applications such as video analytics, Large Language Models (LLMs), and other Generative AI models. Chip is suitable for edge applications running traditional AI models and state-of-the-art AI models with transformer-based architectures. With an experientially enhanced feature set and more than 5-8 times the performance of its first-generation Ara-1 processor, device combines real-time responsiveness with high throughput, merging its proven latency optimized design with perfectly balanced on-chip memories and high off-chip bandwidth to execute very large models with extremely low latency.

click here for more info