The AI Bottleneck Moves From Silicon to Substrates

By
Jane Park
1 min read

When it is reported today that Nvidia’s next-gen Kyber NVL144 rack-scale architecture (packing 144 GPU packages and 576 dies for Rubin Ultra) would slip from 2027 to 2028, the market shrugged. Shares rose roughly 1% after Nvidia denied the delay, stating its roadmap remains intact. Yet behind this headline dispute lies a critical diagnostic signal: the stumbling block was not wafer supply, but manufacturability challenges with a complex multi-layer PCB midplane vital for high-speed module connections. A backup "back-to-back" NVL72x2 design was scrapped following customer pushback; larger optical-linked systems like the NVL576 face similar mechanical constraints.

For C-suite strategists, the lesson is fundamental: monolithic die scaling is over. Modern AI accelerators are now HBM-heavy, chiplet-dense systems constrained by package-area inflation. As electrical I/O hits copper limits and organic ABF substrates buckle under extreme warpage, flatness, and interconnect density demands, the true bottlenecks for extreme scale-up have shifted to Co-Packaged Optics (CPO) and glass substrates.

The Race to Overcome Mechanical and Electrical Physics

2026 marks the inflection year as the industry shifts from R&D pilots to qualification, driving price hikes from suppliers like Ajinomoto. To transcend reticle limits without signal loss, chipmakers are turning to borosilicate glass-core substrates for superior thermal properties and dimensional stability. A May 2026 SEMI and Global Net Corp. report projects initial AI/HPC production by 2028, forecasting a $13 billion market by 2040 at a 67.2% CAGR—far outpacing the broader $7.9 billion glass substrate market, growing at 3.6% annually toward $9.4 billion by 2031.

Foundries and memory giants are actively positioning for this shift. Intel leads commercialization, targeting high-volume manufacturing in Arizona and volume output in Rio Rancho, New Mexico. It has demonstrated thick-core "10-2-10" glass with EMIB on massive 78x77mm packages—exemplified by Clearwater Forest Xeon 6+ processors—while offering silicon photonics foundry services. SK Hynix’s Absolics subsidiary is qualifying full-panel demos from its $600 million Georgia fab with AMD and others. TSMC is countering with CoPoS (Chip-on-Panel-on-Substrate) on a 310x310mm format; pilot tools are arriving for a 2027 rollout bridging wafer scarcity with display-industry scale. Meanwhile, Samsung, Rapidus, Corning, SCHOTT, BOE, Ibiden, and heavily backed Chinese entrants—supported by roughly $1 billion in state investment—are ramping pilot lines.

Simultaneously, CPO is doing for network bandwidth what HBM did for memory: co-locating optics directly with switching ASICs to slash latency and power consumption. Broadcom is shipping its volume-production Tomahawk 5-Bailly switch and targeting 200G/lane in its third-generation roadmap. Nvidia is deeply focused on silicon photonics for its Quantum-X and Spectrum-X platforms, collaborating with TSMC on micro-ring modulators. With Meta publishing reliability data from high-temperature testing without link flaps, and suppliers like Coherent demonstrating mature assemblies at OFC, CPO has become essential for power-constrained datacenters.

A Qualification Tax, Not a Demand Supercycle

Here lies the crucial epiphany for capital allocators: three scaling regimes—reticle-limited silicon, copper-limited I/O, and organic package mechanics—are breaking simultaneously. Yet investors pricing in an HBM-style straight-line demand supercycle are confusing a new total addressable market with a brutal qualification choke point.

The proper historical precedent is not the 2023–2025 HBM shortage, but the industry's painful transitions from wire-bond to flip-chip BGA, and later from conventional packaging to 2.5D interposers. In each cycle, consensus underestimated qualification timelines and overestimated early yields. Glass substrates are not drop-in replacements for organic ABF; they demand new process flows for through-glass via (TGV) formation, metallization control, panel handling, and defect metrology. A glass panel with beautiful dimensional stability but poor process yield is merely a demo, not a product.

Consequently, the next two years will not bring a broad revenue explosion. Instead, they will impose a yield bottleneck tax where value concentrates in an oligopoly of incumbents embedded in multi-year qualification workflows. For investors and C-suite leaders, the superior risk-adjusted strategy avoids crowded AI platform names—which face increasing lock-in and vendor dependence—and focuses on the bottleneck layer. Real pricing power and qualification stickiness belong to specialized providers of defect metrology, advanced substrate tooling, external laser sources, high-reliability optical engines, and packaging capacity tied directly to anchor hyperscale customers.

not investment advice

You May Also Like

This article is submitted by our user under the News Submission Rules and Guidelines. The cover photo is computer generated art for illustrative purposes only; not indicative of factual content. If you believe this article infringes upon copyright rights, please do not hesitate to report it by sending an email to us. Your vigilance and cooperation are invaluable in helping us maintain a respectful and legally compliant community.

Subscribe to our Newsletter

Get the latest in enterprise business and tech with exclusive peeks at our new offerings

We use cookies on our website to enable certain functions, to provide more relevant information to you and to optimize your experience on our website. Further information can be found in our Privacy Policy and our Terms of Service . Mandatory information can be found in the legal notice