NVIDIA and Arm Partner to Bring Deep Learning to Billions of IoT Devices
SAN JOSE, Calif.—GPU Technology Conference—March 27, 2018—NVIDIA and Arm today announced that they are partnering to bring deep learning inferencing to the billions of mobile, consumer electronics and Internet of Things devices that will enter the global marketplace.
Under this partnership, NVIDIA and Arm will integrate the open-source NVIDIA Deep Learning Accelerator (NVDLA) architecture into Arm’s Project Trillium platform for machine learning. The collaboration will make it simple for IoT chip companies to integrate AI into their designs and help put intelligent, affordable products into the hands of billions of consumers worldwide.
“Inferencing will become a core capability of every IoT device in the future,” said Deepu Talla, vice president and general manager of Autonomous Machines at NVIDIA. “Our partnership with Arm will help drive this wave of adoption by making it easy for hundreds of chip companies to incorporate deep learning technology.”
“Accelerating AI at the edge is critical in enabling Arm’s vision of connecting a trillion IoT devices,” said Rene Haas, executive vice president, and president of the IP Group, at Arm. “Today we are one step closer to that vision by incorporating NVDLA into the Arm Project Trillium platform, as our entire ecosystem will immediately benefit from the expertise and capabilities our two companies bring in AI and IoT.”
Based on NVIDIA® Xavier™, the world’s most powerful autonomous machine system on a chip, NVDLA is a free, open architecture to promote a standard way to design deep learning inference accelerators. NVDLA’s modular architecture is scalable, highly configurable and designed to simplify integration and portability.
NVDLA brings a host of benefits that speed the adoption of deep learning inference. It is supported by NVIDIA’s suite of powerful developer tools, including upcoming versions of TensorRT, a programmable deep learning accelerator. The open-source design allows for cutting-edge features to be added regularly, including contributions from the research community.
The integration of NVDLA with Project Trillium will give deep learning developers the highest levels of performance as they leverage Arm’s flexibility and scalability across the wide range of IoT devices.
“This is a win/win for IoT, mobile and embedded chip companies looking to design accelerated AI inferencing solutions,” said Karl Freund, lead analyst for deep learning at Moor Insights & Strategy. “NVIDIA is the clear leader in ML training and Arm is the leader in IoT end points, so it makes a lot of sense for them to partner on IP.”
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on X
Embedded World 2025, over and out! 🎬
Always a highlight of our annual calendar, it's been great connecting with the AI, IoT and automotive ecosystem to share why the embedded industry is built on Arm.
📷 Here's a look at some of our highlights.
Collaboration is key!
Listen as Christopher Rumpf, Senior Director Software and Solutions, Auto, breaks down the importance of the automotive industry working together on SDVs. 🤝
🚙 @CipiaVision is improving the driving experience with in-cabin sensing, enabled by AI and computer vision on the Arm compute platform.
By detecting drowsiness, distraction, phone use, seatbelt, driver ID, and more, we're bringing trust and safety to the road.
Here's how it…
💭 How can developers accelerate edge AI?
John Thompson, Senior Director of Software and Ecosystems, IoT, shares how Arm Kleidi for IoT is unlocking CPU performance for the next generation of edge AI applications - with some impressive results so far.
Edge AI is evolving fast. 💨
With the new Armv9 edge AI platform is set to drive the next wave of innovation, Paul Williamson, SVP and GM for IoT, shares his thoughts on what to expect next, from LLMs and SLMs on-device to new use cases across industries.
Listen in.
👇
With @alifsemi's latest MCUs and the Arm Ethos-U85, you can efficiently execute transformer networks for genAI workloads.
That means faster, more accurate processing for vision, voice, text and sensor data - without relying on the cloud. ☁️
#EmbeddedWorld #ew25
OEMs are increasingly focused on enhancing the emotional connection between humans and their cars.
Christopher Rumpf shares how the SOAFEE SIG makes this possible, experimenting with the cloud-to-car continuum on Arm to shape the future of AI-enabled, software-defined vehicles.…
Here's to the final day of Embedded World 2025!
We're ready for a jam-packed day filled with insight, conversations and innovation.
One stars of the show has been our SoCks! 🧦
If you picked up a pair - past or present - we’d love to see them in action. Share your best SoCks…
Tech leaders take on “This or That” at Embedded World 2025! 🔥
We put some of Arm’s brightest minds in the hot seat. Watch now and play along!
#ew25
🚨 Don't miss Rene Haas and @LizClaman today at #SXSW 2025 for an inside look at the state of AI, Arm’s role in it, and what to expect next!
🕝 2:30–3:30 PM CT
https://okt.to/Y9AxlB
Spotted at Embedded World! 👀
Have you managed to catch any of our speakers at the show?
🚘 Generative AI is enabling rapid advancement in the automotive industry, and we are right at the front of it.
Watch below as Suraj Gajendra, VP of Products and Solutions for Automotive, explains the impact of AI, and what new user experiences are coming into play.
How are we supporting the growth of IoT development for our ecosystem? 🌐
➡️ Enhancing AI performance, bringing Arm KleidiAI to the IoT, and investing in the range of devices built on Arm.
Paul Williamson, SVP and GM for IoT, gives us all the details.
Ready to star in your own unique story with our Generative AI Photo Booth? 🪄
Using the YOLO11 model, Raspberry Pi 5 detects objects and creates an amazing story using the TinyStories SLM.
If you're at the event, come check it out, and get it all printed on a postcard to take…
Cortex-A320 supports both rich and real-time operating systems. 💪
Listen as John Thompson, Senior Director of Software and Ecosystems, talks to us more about it.
🚗 The biggest challenge for vehicle OEMs today?
Ensuring robust software infrastructure, seamless deployment, and planning for the future demands of AI driven applications.
Suraj Gajendra, VP of Products and Solutions for Automotive, breaks it down.ai-d
#EmbeddedWorld #EW25
By leveraging the leading-edge capabilities of the Arm compute platform, @RenesasGlobal's new RZ/V2N brings advanced endpoint vision AI to a huge range of applications, from smart city to industrial.
See it for yourself this Embedded World! #ew25 #EmbeddedWorld
Introducing the new RZ/V2N MPU, targeting high-volume vision AI. With the latest addition of the RZ/V2N, the RZ/V series has now expanded to cover a full range of markets, from the low-end RZ/V2L to the high-end RZ/V2H.
Learn more: https://bit.ly/41VyDx8
#MPU #DRP
Great conversations and valuable connections. 🤝 💬
Earlier this week at #EmbeddedWorld, we brought developers together for an Edge AI roundtable to discuss how we can best address their needs, and the future of IoT Development.
If you joined us, thank you. For those building…
🚶 Head to the Embedded World booth with us as we kick off day 2 of the show! 🌐
From AI at the edge to cloud-to-car intelligence, explore cutting-edge demos like @AlifSemi’s Ethos-U85 for transformers at the edge and @CipiaVision’s in-cabin sensing.
➕ Receive a personalized…
📸 Here's a few things that caught our eye on Day 1 of Embedded World!
We're ready to do it all over again tomorrow! #ew25
Arm Kleidi 🤝 Automotive
Fresh from yesterday’s announcement, Suraj Gajendra, VP of Products and Solutions, for Automotive shares what Arm Kleidi means for developers building the AI-enabled, software-defined vehicle.
Get the latest ⬇️
#ew25 #EmbeddedWorld
It wouldn’t be Embedded World without the annual SOAFEE reception!
This year was extra special, as the team unveiled the latest SOAFEE blueprints, offering a firsthand look at the advancements in the field. #ew25 #EmbeddedWorld
Just last month we announced our ✨new✨ Armv9 edge AI platform that will drive the edge AI revolution.
Here’s everything you need to know.👇
#ew25 #EmbeddedWorld
Grab a prop and pose! 📸
Here’s a sneak peak of our generative AI Photo Booth demo on show at #EmbeddedWorld. Using Raspberry Pi 5 and the YOLO11 model, it creates a unique story just for you.
Ready for your close up?
