Hardware

Next-gen AI accelerator promises 4x efficiency as the power crunch bites

A new training chip claims four times the performance per watt of the current generation — arriving as utilities warn that AI datacenter demand is outpacing the grid.

By Daniel Reyes, Chips & Infrastructure Editor — TAIPEI

TAIPEI — A next-generation AI accelerator unveiled on Thursday promises four times the training performance per watt of today's flagship parts, a claim that lands at the centre of the industry's most pressing constraint: electricity.

The chip abandons incremental die shrinks in favour of aggressive 3D packaging, stacking high-bandwidth memory directly on top of compute tiles to cut the energy cost of moving data — now the dominant power drain in large training runs.

Cloud providers have reportedly pre-committed to the first year of production. Utilities, meanwhile, continue to warn that gigawatt-scale AI campuses are forcing grid upgrades measured in years against demand arriving in months.

Enable JavaScript to read the full story on Neural Daily News.