Beyond the Thermal Wall: Intelligent Cooling Architecture for the AI Era

Maurizio Miozza, CCO of GemaTEG

AI workloads are driving chip power densities beyond the reach of conventional liquid-cooling architectures. As GPUs exceed 2 kW and chiplet designs integrate increasingly dense HBM memory stacks, traditional thermal solutions are hitting hard limits, with direct consequences for energy consumption, infrastructure cost, and datacenter scalability.

The presentation examines chiplet-level independent thermal control as an architectural response to the constraints of conventional cooling. Rather than treating a compute package as a single thermal entity, independent management of GPU dies and HBM memory stacks enables cooling resources to be allocated where and when they are needed most. The approach supports facility water temperatures of 40–45°C without mechanical refrigeration, reducing cooling-related energy consumption, while preserving silicon performance.

By introducing localized temperature control, the architecture adds a new dimension to datacenter operation. Combined with continuous telemetry and infrastructure-wide orchestration, thermal management evolves from a passive heat-rejection function into an active optimization layer, capable of anticipating thermal excursions, optimizing cooling asset utilization, and minimizing downtime through predictive maintenance.

Results are drawn from DaTEG^® 2.0, a patented implementation of the architecture developed by GemaTEG, and from deployment experience with the GemaTEG Supervisor™ platform. The findings suggest that closing the gap between AI compute density and cooling infrastructure capability will require not just improved heat removal, but coordinated thermal intelligence designed to evolve alongside the hardware it serves.

Maurizio Miozza, Co-Founder and CCO of GemaTEG, has three decades of expertise in semiconductor technologies, especially in silicon. His approach integrates business development with engineering, guided by a mantra of Integration.

Maurizio leads efforts on CPUs and GPUs, overseeing teams in Italy, Switzerland, and the USA, and fostering key technical and strategic partnerships. His dual role in research and business led to the creation of a groundbreaking TOF detector and drove UmbraGroup’s expansion in the US. Renowned for market foresight, Maurizio’s leadership focuses on risk management, trust-building, and mindset transformation, turning potential into achievement.