Arm launches AI-optimized Arm Terminal computing subsystem and new Arm Kleidi software to redefine the mobile experience

Source: Arm Author: Arm

    The Arm Terminal Computing Subsystem (CSS) is a new computing solution that combines the benefits of the Armv9 architecture with a tried-and-proven production-ready implementation of new Arm cpus and Gpus based on three-nanometer process nodes, enabling chip partners to innovate quickly and accelerate their time-to-market.

    With a new generation Arm Cortex-X CPU, the artificial intelligence (AI) optimized Arm terminal CSS delivers the highest IPC improvement year over year, with a 36% performance increase. The new Arm Immortalis GPU improves graphics performance by 37%.

    The new KleidiAI software integrates with popular AI frameworks to provide a seamless developer experience; KleidiAI with Arm CSS significantly improves the performance of computing applications through a range of Arm acceleration technologies such as Neon, SVE2 and SME2.

    Arm Holdings Limited (NASDAQ: Arm (" Arm ") today announced the launch of the Arm Terminal Computing Subsystem (CSS) to deliver leading artificial intelligence (AI) experiences that will help chip partners more easily and quickly build ARM-based solutions and accelerate their time-to-market. The Arm Terminal CSS provides the fundamental computing elements for the flagship system-on-chip (SoC) with the latest Armv9 CPU, Arm Immortalis GPU, productionready CPU and GPU physical implementations based on the three-nanometer process. And the latest CoreLink system Interconnect and System Memory Management Unit (SMMU). In addition, the simultaneous launch of Arm Kleidi today will help software developers seamlessly get the best performance on Arm cpus, including KleidiAI for AI workloads and KleidiCV for computer vision applications.

    Chris Bergey, senior vice president and general manager of Devices at Arm, said: "The Arm platform is built on the energy efficiency philosophy of Arm DNA and is laying the foundation for the next wave of computing needs as the age of AI accelerates. Arm Terminal CSS delivers significant advancements in platform functionality and continues to push the limits of the high-end mobile experience."

    The Arm Terminal CSS is the fastest Arm computing platform to date, increasing compute and graphics performance by more than 30% for Android workloads in demanding real-world use cases, while also increasing AI reasoning speed by 59%. Suitable for a wider range of AI/ machine learning (ML) and computational vision workloads.

    The key to Arm Terminal CSS is Arm‘s most powerful, most efficient, and most versatile CPU cluster to date, delivering the best performance and power efficiency. The new Arm Cortex-X925 delivers the highest year-over-year performance improvement since the introduction of the Cortex-X series, and the CPU leverages the leading three-nanometer process node at a 3.8GHz clock rate and maximum cache size, compared to the four-nanometer SoC for flagship smartphones in 2023. Its single-threaded performance has increased by 36%. When it comes to AI performance, the Cortex-X925 achieves a staggering 41% performance improvement, significantly improving the responsiveness of device-side generative AI such as Large Language Model (LLM).

    The new Arm Cortex-A725 CPU combines a relentless pursuit of cutting-edge performance with outstanding efficiency, which improves performance efficiency for AI and mobile gaming use cases by 35%. This improvement is also due to the updated Arm Cortex-A520 CPU and the updated DSU-120, allowing consumer electronics devices with the latest Armv9 CPU cluster to improve energy efficiency and scalability.

    The new Arm Immortalis-G925 GPU is Arm‘s most powerful and efficient GPU, delivering a 37% performance improvement across leading mobile gaming applications and a 34% performance improvement across multiple AI and ML networks. The Immortalis-G925 is aimed at the flagship smartphone market, while the new line of highly scalable Gpus, including the Arm Mali-G725 and Mali-G625 Gpus, is aimed at a wide range of consumer electronics devices, from high-end phones to smartwatches and XR wearables.

    Arm is always focused on the millions of developers around the world to ensure they have access to the performance, tools and software libraries they need to build the next wave of AI applications. To enable developers to quickly implement these innovations with maximum performance, Arm introduced Arm Kleidi, which includes KleidiAI for AI workloads and KleidiCV for computer vision applications. KleidiAI is a set of computing cores for AI framework developers, enabling them to easily get the best performance on Arm cpus on a wide range of devices and supporting key Arm architecture features such as Neon, SVE2 and SME2. KleidiAI integrates with popular AI frameworks such as PyTorch, Tensorflow, and MediaPipe to accelerate the performance of key models such as Meta Llama 3 and Phi-3, and is also backwards compatible. To ensure that Arm can still adapt to the needs of future markets as it introduces more technologies.

    With a unique combination of cutting-edge CPU and GPU technology, production-ready physics, and continuous software optimization, Arm Terminal CSS, combined with Kleidi software, will provide the computing platform for the future of AI, and Arm is the cornerstone of that future.

    "Intel Foundry has deep cooperation with Arm, and this release highlights Arm‘s progress in the terminal business. We are working closely on cutting-edge technology nodes such as the Intel 18A process to deliver best-in-class power, performance and area metrics, and to enable the next generation of mobile SoCs based on the new ARM-based CSS."

Suk Lee, vice president of Foundry and general manager of Intel‘s Ecosystem Technology Office

    "In the second half of this year, we will launch our new generation flagship mobile chip, the Guet 9400, which will feature the latest Armv9 Cortex-X925 CPU and Arm Immortalis-G925 GPU. We have a long and close relationship with Arm and are committed to continuously improving the performance and functionality of mobile chips and jointly driving the rapid development of computing technology."

    "Embedding generative AI capabilities in mobile devices is a major customer demand, which requires the integration of cutting-edge chip technology with leading computing solutions. The Arm Cortex-X925 CPU solution, combined with the latest three-nanometer GAA process node from Samsung Fountainers, can meet this need. Our long-term partnership with Arm allows us to work closely from an early stage to maximize DTCO and PPA, delivering chips on time and meeting performance and efficiency requirements."

    "Samsung and Arm continue to challenge the status quo of technology and continue to break the limits of mobile development. The increasing ubiquity of AI has transformed entire industries and society, and we will continue to develop cutting-edge technologies to facilitate and enrich People‘s Daily lives." We are excited to partner with Arm to start a new chapter in mobile AI and bring more AI computing power to people around the world on their devices."

Roh Tae-moon, President and head of Mobile Experience (MX) business, Samsung Electronics

    "The AI-optimized Arm CSS is an example of how Arm and TSMC are working together to enable chip designers to achieve unprecedented performance and energy efficiency, pushing the limits of semiconductor innovation for AI. By working with Arm and our Open Innovation Platform (OIP) ecosystem partners, we are able to provide the most advanced process technology and design solutions to empower our customers to accelerate AI innovation."

Dan Kochpatcharin, head of Ecosystem and Alliance Management at TSMC

    "vivo attaches great importance to user experience, based on the technology of Arm CSS, we work closely with Arm to jointly promote the developer ecosystem, make the mobile phone more smooth and better to use, but also bring cutting-edge AI experience to the device side." "We are excited to see the new direction introduced by the Arm terminal CSS and the new generation of device-side generative AI that will be enabled by the Armv9 CPU and Arm GPU, enabling immersive smart mobile solutions."

vivo chief chip planning expert Xia Xiaofei

Arm technology is building the future of computing. Arm‘s low-power processor designs and software platforms are used in more than 280 billion chips for advanced computing, and Arm‘s technology securely powers electronic devices, from sensors to smartphones to supercomputing. Together with more than 1,000 technology partners, Arm makes artificial intelligence ubiquitous and underpins trust in the digital world, from chips to the cloud, in cybersecurity. The Arm architecture is the cornerstone of the future.