Overview

AI Audio on Mobile CPU

Stability AI, renowned for its generative AI models in image, video, audio, and 3D, partnered with Arm to bring its text-to-audio AI model, Stable Audio Open, to mobile CPUs for the first time. This breakthrough, running on an Arm-based CPU, enables creators to generate audio, including sound effects entirely on-device, with no internet connectivity required.

 

By seamlessly leveraging the Arm software stack, including the Arm KleidiAI library, and distilling the Stable Audio Open model, Stability AI achieved remarkable AI performance optimizations and reduced response times by 30 times—from minutes to seconds.

Impact
chip icon

First text-to-audio gen on mobile CPU

A minimalistic speedometer with motion lines.

Optimized for up to 30x faster model response

A simple line drawing of a cloud with sparkles.

Offline on-device custom sound creation

“Thanks to these model optimizations and Arm KleidiAI, we moved from minutes to mere seconds to generate audio entirely on the Arm CPU on the smartphone.” 
Prem Akkaraju, CEO, Stability AI
A space-inspired scene with planets floating like marbles.
Technologies Used

Redefining GenAI Performance

A near-instantaneous user experience is also made possible because of the model distillation by Stability AI and Arm. Arm KleidiAI open-source library kernels are integrated into the ExecuTorch AI framework via the XNNPACK library and provide access to the latest AI features in the Arm architecture.

The faster model responses for generative AI on mobile CPU show how collaborating with Arm and developer enablement technologies such as KleidiAI can make previously unattainable AI applications, models, and workloads run smoothly on mobile.

A similar collage-style image featuring fantasy, space, and surreal elements.

A New Frontier in Creativity

The collaboration between Arm and Stability AI has set a new standard for on-device AI:

  • Enhanced user experience: A significant performance uplift transforms creative workflows, providing a smooth, responsive experience that meets the demands of today’s content creators.
  • Broad accessibility: By optimizing performance on Arm CPUs, bespoke audio AI generation can be accessed on a wide array of smartphones entirely on-device with no connection required, empowering a diverse community of users.
  • Driving future innovation: The partnership between Arm and Stability AI is helping to accelerate AI innovation and paving the way for future breakthroughs in AI-driven creative tools.

Discover how Arm and Stability AI are pushing the boundaries of generative AI in our latest blog.

Read Blog

Stability AI and Arm

Stability AI imagines a world where you can find the perfect sound effects for every video you take, and every social media post you make. All customized, all in seconds, all on device—no connectivity required. By collaborating with Arm, Stability AI has been able to achieve this – and with no additional development overhead.

Discover GenAI on Arm

Explore Similar Stories

Arm for GitHub Copilot Extension

Enabling Cloud Development on Arm

Turn a complex process into an intuitive, AI-guided experience with AI-powered development capabilities.

Meta 人工智慧技術

順暢的人工智慧開發

Meta 提供的開放原始碼架構和模型奠定基礎,在 Arm 架構上大規模革新人工智慧創新的未來發展。

vivo X200 Series Flagship Mobile Phones

Superior Mobile Experiences

The newly released vivo X200 series flagship smartphones are equipped with the Arm compute platform, including the Armv9 architecture with Arm Cortex-X925 CPU and Arm Immortalis-G925 GPU.

Discover More Success Stories