Intel has unveiled Xeon 6 with Performance-cores (P-cores) and Gaudi 3 AI accelerators. The Xeon 6 processors double the performance of their predecessors, with increased core counts, memory bandwidth, and embedded AI acceleration, catering to AI applications from the edge to the cloud. The Gaudi 3 AI Accelerator, tailored for generative AI, is equipped with 64 Tensor processor cores, eight matrix multiplication engines, and 128GB of HBM2e memory, offering up to 20% more throughput and twice the price/performance compared to the H100 for LLaMa 2 70B inference.

News

• News Release: Intel Unveils Next-Generation AI Solutions with the Launch of Xeon 6 and Gaudi 3
• Fact Sheet: Leadership performance with Intel Xeon 6900 P-core series
• Quote Sheet: A New Era of High-Performance Enterprise AI Systems and Solutions

Intel Gaudi 3 Explained in 60 Seconds

Here’s a one-minute breakdown of three things to know about Intel® Gaudi® 3 Al accelerators. Launched at the company’s AI event on Sept. 24, 2024, Gaudi 3 boosts breakthroughs in AI compute muscle, memory bandwidth and flexibility, offering customers open, community-based software and industry-standard Ethernet networking.

Social Animation: Intel’s latest Xeon 6 processor

Improved AI workload performance, increased memory bandwidth, and twice the number of cores – Intel’s latest Xeon 6 processor delivers performance gains like never before. (Credit: Intel Corporation)

Social Animation: Intel Gaudi 3

With an AI dedicated compute engine, memory boost for LLMs and efficient scaling for enterprises, Intel Gaudi 3 is the next hero in GenAI. Let the AI acceleration begin. (Credit: Intel Corporation)