TOPIC 1

Build AI/ML Apps

Optimize ML inference and training performance on Arm Neoverse, as well as best practices for ML inference using PyTorch 2.0, and more.

 

Best Practices to Optimize ML Performance on AWS Graviton

Deep learning inference performance on the Yitian 710

  • In this blog post, we focus on Alibaba Elastic Cloud Service (ECS) powered by Yitian 710 to test and compare the performance of deep learning inference.

Optimizing Inference Performance with PyTorch 2.0

  • Example tutorial showcasing how to achieve the best inference performance with bfloat16 kernels, and the right back-end selection.

Docker Images for TensorFlow and PyTorch on Arm

  • Learn how to build and use Docker images for TensorFlow and PyTorch for Arm.
TOPIC 2

Build GenAI Apps

Learn the capabilities of Arm Neoverse CPUs running LLMs and SLMs, and accelerate Hugging Face (HF) models on Arm.

 

LLM Performance on Arm Neoverse

LLM Chatbot on Arm

Small Language Models (SLMs)

  • Overview of the usability of SLMs in a more efficient and sustainable way, requiring fewer resources, and being easier to customize and control compared to LLMs.

Accelerate HF Models using Arm Neoverse

  • Learn about the key features in Arm Neoverse CPUs for ML, with a Sentiment Analysis use case.

Accelerate and Deploy NLP Models from HF

TOPIC 3

Accelerate GenAI, AI, and ML

Accelerate your AI/ML framework, tools, and cloud services with open-source Arm libraries and optimized Arm SIMD code.

 

Accelerating Pytorch Inference

Arm Compute Library (ACL)

  • ACL is an open-source fully featured library, with a collection of low-level ML functions optimized for Arm Neoverse and other Arm architectures.

Arm Kleidi

Arm SIMD code

  • Optimize your AI/ML workloads with Arm SIMD code, either in assembly or using Arm Intrinsics in C/C++, to leverage huge performance gains.

Join the Arm Developer Program

 

Arm Developer Program logo

 

Join the Arm Developer Program to build your future on Arm. Get fresh insights directly from Arm experts,
connect with like-minded peers for advice, or build on your expertise and become an Arm Ambassador.

Join Now
Arm Developer Program

Community Support

Learn from the Community

Talk directly to Arm expert, Zach Lasiuk, and the broader Arm community in the servers and cloud computing today.

Zach Lasiuk

Zach helps software devs do their best work on Arm, specializing in cloud migration and GenAI apps. He is an XTC judge in Deep Tech and AI Ethics.

Tell Us What We Are Missing

Think we are missing some resources? Have some examples to share from your experience? Let us know directly via the link below.