V-Help
← All news
Artificial intelligence

AWS Limits Internal CPU Usage Due to Rising AI Agent Workloads

AWS Limits Internal CPU Usage Due to Rising AI Agent Workloads

Photo: Tom's Hardware

Quick answer

AWS limits internal CPU usage due to resource shortages caused by rising AI agent workloads.

Amazon Web Services (AWS) is tightening control over internal compute resource usage. In May, the company held a meeting with engineers, demanding a reduction in "wasteful" CPU consumption on EC2 instances. The goal is to ensure sufficient capacity for customers amid a sharp rise in processor demand driven by AI technologies.

Previously, AWS engineers could quickly deploy virtual machines for development, but now they must wait days to access resources. The change is due to AI agents, which require significantly more compute power than traditional workloads. For instance, one coding agent exceeded its budget by 860%, spending $1.8 million on tokens.

CPU demand has surged to the point where GPU-to-CPU ratios in data centers are approaching 1:1. Companies like Intel and AMD are actively expanding their processor lineups for AI infrastructure. AMD recently introduced the Zen 6 "Venice" for servers, while Nvidia is promoting its Arm-based Vera CPU.

Despite the shortage, issues primarily affect spot instances, while contracted capacities remain available. AWS continues to use AMD, Intel, and its own Graviton5 chips to meet growing market demands.

Common questions

Why is AWS limiting CPU usage for its engineers?
AWS is facing a CPU shortage due to increased demand from AI agents and high compute resource requirements from customers. The company is reallocating resources to ensure stable service operations.
Which processors does AWS use in its EC2 instances?
AWS utilizes AMD, Intel, and its own Graviton5 chips based on the Arm architecture. Graviton5 is currently the company’s most powerful CPU.
How do AI agents impact CPU demand?
AI agents require complex compute orchestration, including CPU tool calls and GPU operations, leading to increased CPU demand. Traditional GPU-to-CPU ratios (4:1 or 8:1) are no longer sufficient.
Share:

Dzen feed: /feed/dzen.xml · RSS: /feed.xml

Why trust this

Prepared by the V-Help editorial team from the primary source with a published date.

Published by: V-Help.ru news desk

Source: Tom's Hardware