Memory to the Moon: The Third Leg of the AI Infra Bill
DRAM prices have tripled, NAND has doubled, and Samsung, SK Hynix and Micron are on track to sextuple operating income — quietly rewriting the math on every DAX40 cloud contract..
For two years, the story of AI infrastructure has been about two things: power and GPUs. Hyperscalers buy data centres, sign nuclear contracts, and queue up for Nvidia chips. A third cost has now muscled into the conversation: memory. Every AI chip needs special, very fast memory chips bolted next to it — called HBM, or high-bandwidth memory — and the factories that make ordinary computer memory (DRAM and NAND, the kind in your laptop and phone) are being redirected to feed AI servers. The result: the price of memory has roughly tripled in a year. That is now showing up in Microsoft’s, Meta’s, and soon SAP’s and Deutsche Telekom’s bills. For any CIO who budgeted AI infrastructure in late 2025, the number penciled in for memory was almost certainly wrong.
On the Microsoft fiscal third-quarter call in late April, Amy Hood paused on a slide most analysts had not been waiting for. The CFO walked through the company’s revised $190 billion capex plan for fiscal 2026 — sixty-one percent above the prior year — and then, with the dry precision of someone who has learned to deliver bad news flatly, told investors that twenty-five billion dollars of that increase was not buying more servers, more land, or more transformers. It was simply covering higher prices for memory and other components. Microsoft is paying more, she said, for exactly the same hardware it had already planned to deploy. The call landed in a quarter that had already broken records elsewhere. SK Hynix, the South Korean memory maker that supplies the lion’s share of HBM stacks bolted onto Nvidia’s GPUs, reported a 72 percent operating margin in Q1 2026 — a number normally associated with software companies, not semiconductor fabs. Revenue rose 198 percent year-on-year. Operating profit jumped 405 percent. Management told analysts that cumulative HBM purchase commitments from hyperscalers and accelerator vendors now exceed three years of nameable forward supply. Samsung’s operating profit, reported the same week, rose 750 percent year-on-year to an all-time record. This is the moment a16z’s Charts of the Week captured under the heading “Memory to the moon” on May 15. The chart pack lined up four panels: DRAM contract prices up roughly 95 percent quarter-on-quarter in Q1; NAND flash up around 70 percent and accelerating; the three memory incumbents projected to roughly sextuple operating income in 2026 versus 2025; and a final panel showing memory ASPs on a curve that, plotted against the last five years, looked less like a cycle and more like a regime change. But the moment did not arrive out of nowhere. Three forces collided. HBM4, the next generation of high-bandwidth memory destined for Nvidia’s Rubin platform, requires up to 40 percent of the leading fabs’ DRAM wafer capacity according to SK Hynix’s own disclosures. Each Rubin GPU carries 288 GB of HBM4, against 80 GB of HBM3 on an H100 — meaning the same number of chips consumes roughly 3.6 times the memory. At the same time, the memory industry spent 2023 and most of 2024 in disciplined undersupply, cutting capex to repair balance sheets. Greenfield fab capacity announced today does not produce wafers before 2028. And every gigabyte of HBM diverted from regular DRAM lines tightens the supply for the laptops, phones, factory PLCs and enterprise servers that the rest of the world also keeps buying. The catch: nobody expected this third leg. Power was forecast. GPU scarcity was forecast. Memory was the part of the AI bill that everyone — CFOs, analysts, even hyperscaler procurement chiefs — had quietly assumed would behave like a commodity.
The headline figure is the easy one: DRAM contract prices rose 90 to 95 percent quarter-on-quarter in Q1 2026, according to TrendForce, with server-grade DRAM moving faster than commodity grades. Counterpoint Research expects another 50 to 60 percent layered on top in Q2. NAND, slower out of the gate, is now catching up: TrendForce sees Q2 2026 contract prices rising 70 to 75 percent quarter-on-quarter, outpacing DRAM for the first time in the cycle. Phison’s CEO confirmed in March that a 1 TB TLC NAND chip that cost $4.80 in July 2025 is now selling for $10.70 — a 123 percent move in eight months. The IDC point of comparison is sharper still: DRAM cost per gigabyte is forecast at $9.71 in 2026, against $3.76 in 2025. To put it in language a DAX40 CFO can use: memory pricing now consumes more dollars per server than the entire automotive semiconductor revenue line that Infineon, NXP and STMicroelectronics earned in a single quarter last year. The component that used to be a rounding error on the bill of materials is now, on Nvidia’s flagship B200, roughly 45 percent of cost of goods sold. HBM has eclipsed the logic die, the CoWoS interposer, and the packaging substrate combined. At the producer level, the math is staggering. SK Hynix posted KRW 37.61 trillion in Q1 operating profit, on a 72 percent margin. Samsung’s memory and foundry combined delivered the largest operating profit in company history. Micron’s fiscal Q2 2026 revenue of $23.86 billion beat its own guidance by 27 percent, with non-GAAP operating profit of $16.5 billion. Consensus 2026 operating income across the three is now projected at roughly six times the 2025 baseline — the “sextuple” headline a16z dropped into its chart pack. For enterprise buyers, the second-order numbers matter more. Microsoft’s $25 billion memory line item, baked into a $190 billion capex envelope, implies that roughly thirteen percent of the company’s entire 2026 infrastructure spend is now absorbing memory inflation. Alphabet and Meta have signalled similar exposures in their own April calls, with Big Four hyperscaler capex now forecast at $725 billion for 2026 — up 77 percent year-on-year. ASML disclosed that, for the first time on record, memory accounted for 51 percent of system sales in Q1 2026, narrowly eclipsing logic. The Veldhoven equipment maker raised its full-year guidance largely on this back. Memory customers, ASML’s CFO told analysts, are sold out for 2026 and constraints extend beyond. For European buyers, the most telegraphic number is the inventory line. As of January, Samsung had six weeks of DRAM inventory and SK Hynix two to three weeks — historically low by an order of magnitude. The market is not being rationed by price; it is being rationed by allocation. Hyperscalers signing letters of intent are jumping the queue. A DAX40 manufacturer ordering its 2026 private-cloud refresh in June is, in effect, buying at spot.
This is where the story stops being abstract for German enterprise buyers. Deutsche Telekom’s Industrial AI Cloud, the €1 billion sovereign AI factory in Munich built on roughly 10,000 Nvidia Blackwell GPUs, was costed in 2024 and 2025 — before the memory move. SAP, whose cloud revenue grew 27 percent at constant currencies in Q1, is now negotiating its own infrastructure build-out at exactly the moment memory contracts are repricing. CEO Christian Klein told analysts that cloud pricing will tilt toward consumption-based metrics — “memory used” was a phrase he used explicitly — as Business AI scales. Translation: SAP customers, including most of the DAX40, will increasingly pay variable rates against an input cost that has just tripled. Siemens, which operates its industrial AI stack jointly with Deutsche Telekom, faces a parallel problem in its factory edge: every smart sensor, every PLC, every machine vision controller carries DRAM that competes with the AI fabs for wafers. Procurement teams at automotive suppliers — Bosch, Continental, ZF — have already begun extending lead times on standard memory modules from twelve to twenty-six weeks. The Federation of German Industries reported anecdotally in early May that mid-cap Mittelstand IT refreshes are being deferred to 2027 or absorbed at sharply higher cost. The one DAX40 winner here is Infineon, but only obliquely. The Munich-based group makes power semiconductors and automotive MCUs, not memory; its exposure is to the same fabs only via shared lithography slots at ASML. Infineon and STMicroelectronics will see margin support from tight wafer supply, but neither captures the windfall directly. ASML, meanwhile, is now the cleanest European proxy for the memory cycle — its order book has effectively absorbed the demand shock that the memory makers themselves are unwilling to convert into capex. Analyst notes at Goldman and JP Morgan, surfaced via news coverage, suggest ASML’s 2026 EUV bookings from memory customers alone now exceed the value of the entire Dutch lithography sector’s output two years ago.
For DAX40 CIOs reforecasting Q2 and Q3 capex, the memory shock requires a line-item that did not exist in any 2025 budget template. Three actions are emerging as standard. First, lock in 2026 and 2027 memory commitments now via OEMs — Dell, HPE, Lenovo — rather than waiting for spot relief that analysts increasingly do not expect before late 2027. Second, separate AI-training memory budgets from steady-state IT refresh budgets, because the two are now competing for the same wafers and the AI workload will always outbid. Third, renegotiate consumption clauses in cloud contracts before SAP, AWS and Azure pass through the input costs more aggressively in the second half of the year. The CIOs who treated memory as a commodity have just learned an expensive lesson about what “commodity” means in an AI cycle.
Brussels has noticed. The European Chips Act, designed in the post-COVID era to insulate the bloc from semiconductor shocks, contains no provision for memory — DRAM and NAND production is entirely concentrated in South Korea, the United States and Taiwan, with zero European leading-edge fab capacity. The Commission’s industrial strategy unit is reportedly preparing a memorandum on “strategic memory dependency” for the June Council meeting, with discussion of whether to underwrite a European HBM packaging line via a Chips Act 2.0 envelope. Separately, German competition authorities have begun preliminary inquiries into whether coordinated price increases by the three incumbent suppliers warrant scrutiny, though most observers expect the inquiry to die quietly given the obvious demand-pull explanation. The real regulatory question is sovereignty: if every European AI factory depends on Korean memory, the Industrial AI Cloud is sovereign only down to the chip socket.
For founders, the memory cycle creates two trades. The bull trade is anything that reduces the memory footprint of inference — quantisation tooling, KV-cache compression, on-chip SRAM architectures of the Cerebras or Groq variety, and smaller fine-tuned models that fit in fewer HBM stacks. Several Series A rounds in May closed at notably higher valuations on this thesis alone. The bear trade is harder: any startup whose unit economics depend on cheap GPU-hours is now exposed to a cost line that just doubled outside their control. Inference-heavy consumer AI businesses are quietly rebuilding their cost models. For European VCs, the structural read is that memory-light architectures may be the rare category where a non-US, non-Asian startup can compete — the bottleneck is no longer pure compute, it is system design around scarce memory.
Sources 12 references
- [1]Charts of the Week (a16z) — Memory to the moon
- [2]Microsoft calls for $190B in 2026 capex on soaring memory prices (CNBC)
- [3]SK Hynix Q1 2026: 72% margin, HBM orders eclipse 3-year supply (KED Global)
- [4]Samsung, SK Hynix reportedly hike server DRAM 60-70% (TrendForce)
- [5]Phison CEO: NAND prices have more than doubled (Tom’s Hardware)
- [6]ASML sees memory chip orders exceed logic for first time (WCCFTech)
- [7]The Inference Shift (Stratechery, Ben Thompson)
- [8]How the AI bubble bursts in 2026 (Ed Zitron, Where’s Your Ed At)
- [9]Samsung and SK Hynix warn AI-driven memory shortages could last until 2027 (Tom’s Hardware)
- [10]SAP Announces Q1 2026 Results
- [11]Deutsche Telekom Industrial AI Cloud with NVIDIA
- [12]Big Tech capex hits $725B in 2026 (Tom’s Hardware)