AMD's Threadripper Halo is a local-AI workstation for researchers with deep pockets

On-PREM

AI workstation promises to put up to 576 GB of HBM3e and 16 TB/s of memory bandwidth on your desk

Machine learning researchers have a new and expensive option for doing local AI. AMD just raided its spare parts bin and cobbled together a DGX Station rival boasting up to 576 GB of HBM3e memory that it’s calling the Threadripper Halo.

Announced at IFA 2026, the system, which is set to launch next year, marks the first time that AMD’s Instinct accelerators have been offered in a workstation form factor.

But much like the AI Halo we reviewed earlier this year, the Threadripper Halo isn’t packing anything we haven’t seen before. The liquid-cooled system is powered by a 96-core Threadripper PRO 9995WX, which you may recall made its debut in 2025. The CPU is backed by up to 2 TB of DDR5 memory and up to 2.6 TB of combined system memory.

As you probably already guessed, AMD is positioning the box as a local AI workstation for researchers. From what we gather, the system can be had with up to four of the company’s PCIe-based Instinct GPUs — though the systems displayed at IFA only showed two installed.

Launched back in May, the MI350P is essentially half of an MI350X that’s been crammed into a PCIe form factor. Each accelerator packs 144 GB of speedy HBM3e good for 4 TB/s of memory bandwidth, and up to 4.6 petaFLOPS of FP4 compute. But we’ll note that it's in its 600 W configuration. When deployed in the Threadripper Halo, we expect AMD will be running the cards in the more sedate 450 W config.

Combined, the Threadripper Halo promises up to 576 GB of HBM3e and 16 TB/s of memory bandwidth, enabling the system to run models exceeding a trillion parameters in size (at four-bit precision) entirely in GPU memory. By offloading some of the model to system memory, the system should be able to run the largest open weights models, like Moonshot.AI’s 2.8 trillion-parameter Kimi K3.

The ability to run large frontier-class models on your desk won’t come cheap and may not be available in every market, at least not without an electrical service upgrade. AMD hasn’t shared pricing, but as configured, we expect it to sell for somewhere between $100,000 and $150,000.

A quad MI350P system is going to push the limits of a standard North American power outlet unless AMD either underclocks the cards from 600 W to 300 W or it mandates a 20 amp circuit. This might explain why the system AMD showed off at IFA only had two. 

At this price and power level, the system is well positioned to compete with Nvidia’s own high-end AI workstation, the DGX Station. Announced at GTC in 2025, the DGX Station features a 252 GB B300 GPU and a 72-core Grace CPU along with 496 GB of LPDDR5x memory, and it retails for around $100,000 if you can find one in stock.

The House of Zen boasts that the system offers up to 3.4x the total system memory and more than twice the memory bandwidth of the DGX Station, which should give an edge in LLM inference, assuming tensor parallel operations don’t bottleneck on the CPU’s PCIe bus.

AMD says the Threadripper Halo will be available starting next year. ®