<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[The Diligence Stack - By Creative Strategies]]></title><description><![CDATA[The Diligence Stack is the publishing platform for Creative Strategies, an independent research firm. We connect semiconductors, infrastructure, platforms, software, and adoption to explain how technical change reshapes markets and business models.]]></description><link>https://www.thediligencestack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!at7f!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png</url><title>The Diligence Stack - By Creative Strategies</title><link>https://www.thediligencestack.com</link></image><generator>Substack</generator><lastBuildDate>Sat, 26 Sep 2026 22:19:51 GMT</lastBuildDate><atom:link href="https://www.thediligencestack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Creative Strategies, Inc.]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[creativestrategies@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[creativestrategies@substack.com]]></itunes:email><itunes:name><![CDATA[Creative Strategies]]></itunes:name></itunes:owner><itunes:author><![CDATA[Creative Strategies]]></itunes:author><googleplay:owner><![CDATA[creativestrategies@substack.com]]></googleplay:owner><googleplay:email><![CDATA[creativestrategies@substack.com]]></googleplay:email><googleplay:author><![CDATA[Creative Strategies]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Executive Interview: Lightmatter’s Bet on the Future of Computing]]></title><description><![CDATA[A conversation with founder and CEO Nick Harris on optical interconnect, the move from NPO to CPO, and a different manufacturing path for lasers.]]></description><link>https://www.thediligencestack.com/p/executive-interview-lightmatters</link><guid isPermaLink="false">https://www.thediligencestack.com/p/executive-interview-lightmatters</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 24 Sep 2026 16:36:23 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/637bbdf0-912b-443e-afa8-be39273ba746_1600x900.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><strong>Author&#8217;s note:</strong> On top of our expert interview features we are also featuring executive interviews with top technology leaders exclusive for subscribers. We kick this off with Nick Harris the founder and CEO of Lightmatter, one of the private companies taking a different approach to how optical interconnect gets designed and manufactured. The full video and audio are embedded below, followed by an edited transcript for readers who prefer text.</em></p><p>We have spent the last several weeks <a href="https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the">working through the optical supply chain</a> and the manufacturing steps that will set the pace of optical content inside AI systems. Demand is the easy part of the forecast everyone would adopt optical today if could be manufactured and was reliable at scale. The industry needs more bandwidth between accelerators, and copper hits a physical limit as link speeds go up and <a href="https://www.thediligencestack.com/p/cpugpu-ratios-and-the-race-to-the">scale-up domains get bigger</a>. The harder question, and the one we care most about, is how fast the supply chain can turn that demand into <strong>qualified</strong> optical engines that ship at repeatable yield.</p><p>In our inter interview Lightmatter CEO Nick Harris gave us a closer look at one of the more differentiated attempts to solve that problem. Most commercial lasers are still made on small indium phosphide wafers by a fairly small group of suppliers, and Nick makes the case that Lightmatter can move more of that work onto the 300-millimeter silicon base mature CMOS foundries already run. If that holds up at volume, it opens a different path to laser capacity. He walks through how the approach works and how Lightmatter is designing around the reliability problem that comes with thousands of optical links in one system.</p><p>He also gives his own timeline for when near-package and co-packaged optics ramp, which we found useful to hold up against our optical attach ladder, along with the reliability data Lightmatter has built up so far. As always, we would separate a product shipping from broad attach across deployed racks, and that gap is a big part of what we dig into with Nick Harris. The full video, audio and edited transcript are available to subscribers below.</p><p>Subscribers with <a href="https://atlas.creativestrategies.com/">CS Atlas access</a> can deeper on Lightmatter and the wider optical transition. The Lightmatter packet breaks down Passage and Guide and places the company on our timing ladder from NPO through CPO and the longer-term photonic-interposer roadmap. A separate manufacturing section tests the 300-millimeter claim against the yield and qualification steps that still have to be proven.</p><p>Subscribers can then use our optical-solutions comparison and interconnect SWOT to see which companies control each part of the stack, how their products differ, and where they are focused across scale-up, scale-out, and scale-across networks. Each company entry maps the manufacturing unit it must scale and the evidence we need before moving its timing or competitive position higher.</p><h2>For Subscribers</h2><ul><li><p>Full video interview</p></li><li><p>Why Lightmatter views interconnect as the problem that now sets the pace of compute.</p></li><li><p>How Passage and Guide address optical links from NPO through a photonic interposer.</p></li><li><p>How bonding indium phosphide onto 300-millimeter silicon photonics wafers changes the manufacturing approach.</p></li><li><p>Why reliability, optical test capacity, and foundry process control still govern scale.</p></li><li><p>Where Nick expects NPO, CPO, and photonic interposers to enter the deployment curve.</p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/executive-interview-lightmatters">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Expert Interview: From Gas to Gigawatts and What It Takes to Power AI]]></title><description><![CDATA[A conversation with Billy Sorensen of Lightfield Energy on delivering power, financing generation, and the role of natural gas.]]></description><link>https://www.thediligencestack.com/p/expert-interview-from-gas-to-gigawatts</link><guid isPermaLink="false">https://www.thediligencestack.com/p/expert-interview-from-gas-to-gigawatts</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 22 Sep 2026 17:21:26 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/b07f062f-5eaa-4cd3-8577-1014626b3bd9_1731x909.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><strong>Authors note:</strong> We are exciting to keep bringing new features along side our deeper industry, thematic, and company research.  This is the first of many expert interviews we have lined up and we plan to use our extensive network to bring the most valuable conversations to clients/subscribers.  Including CEO/Executive interviews with the first one coming Thursday. </em><br><br>We have covered the power industry challenges to scale and meet demand in numerous reports this year. Power comes up regularly in the &#8220;bottleneck&#8221; and there are deep constraints all the way down the supply chain. We recognize as much as we track constraints in the compute supply chain, the deployment of that compute is up against a much deeper set of build out challenges related to land, power, shells which is why we are also obsessed with tracking the GW buildout along side the AI compute build out. </p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;68acc72c-7b09-4ed7-b466-d9e065f7a9c5&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The AI Infrastructure Buildout: A Comprehensive Framework for the Datacenter and Power Cycle&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-02-09T17:22:29.587Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!KMw_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd8bf411-1dbe-4102-9a1d-c925a3bea54b_904x1100.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-ai-infrastructure-buildout-a&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:186754045,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:4,&quot;comment_count&quot;:5,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;2e8d6e46-d342-43af-a35a-3ff4d8e4820c&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The Behind-the-Meter AI Buildout&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-07-30T17:22:41.550Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!t0JX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d978f6d-f9f9-4aa8-9be0-34d5d432cfff_2451x1346.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-behind-the-meter-ai-buildout&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:209049901,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:11,&quot;comment_count&quot;:2,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p><br><a href="https://www.thediligencestack.com/p/the-behind-the-meter-ai-buildout">In our Bloom Energy report</a>, we looked at behind-the-meter power as a way to get data centers running sooner while customers wait on utility service. We wanted to take that question to Billy and get a better sense of what it actually takes to make these projects work. We&#8217;ve made the point in prior reports that customers may be willing to pay more for earlier access to power, and we still think that&#8217;s true. But the developer still needs an agreement that covers the cost of building and operating the plant.</p><p>Billy spent a good chunk of our conversation on a problem we had given less attention to. The power plant is a small share of the total investment at a compute site, but an outage can put a much larger investment at risk. So the question becomes how much of that risk the power developer can afford to take on. Adding spare generation or batteries costs money, and the customer&#8217;s contract has to run long enough for the developer to earn it back. That gives us another way to look at the BTM opportunity from the Bloom report: what reliability the customer needs, what it costs to provide, and whether the two sides can agree on who pays when something goes wrong. It also adds a piece we were missing in our TCO analysis and in our <a href="https://www.thediligencestack.com/p/gigawattonomics">Gigawattonomics model</a>, as we track AI capex ROI all the way down to the power shell provider.</p><p>The conversation also helped us understand another challenge with running data centers on natural gas, which is getting enough gas to the site. The US has plenty of gas, but a data center may still need a pipeline extension or more compression before it can use that supply. The companies building that infrastructure need customer commitments to justify the investment, so it becomes one more project that has to be funded and built on a schedule that lines up with when the data center needs power. It&#8217;s the same pattern we keep seeing, with the constraint moving further down the stack.</p><p>Below, we get into how these projects come together, why the contracts are hard to structure, and where Billy sees the next constraints showing up.</p><p>Our companion report develops the investment implications through project examples, gas-demand scenarios, and the economics of dedicated generation and who is best positioned. <a href="https://www.thediligencestack.com/p/introducing-cs-atlas-699">Subscribers, with Atlas access</a> can <a href="https://atlas.creativestrategies.com/agent?prompt=Find%20Creative%20Strategies%20research%20on%20natural%20gas%20and%20AI%20compute%2C%20including%20the%20Gas%20to%20Compute%20companion%20packet.%20Summarize%20our%20thesis%2C%20core%20assumptions%2C%20and%20unresolved%20questions.%20Identify%20the%20sources%20available%20and%20any%20missing%20material.">explore our full power landscape research, and BTM / natural-gas and compute research</a> alongside the interview. </p><p><strong>In the conversation:</strong></p><ul><li><p>Why generation, power delivery, and the customer&#8217;s opening date are difficult to align.</p></li><li><p>What happens when a power supplier cannot buy replacement electricity during an outage.</p></li><li><p>How reliability requirements and contract length affect the price of power.</p></li><li><p>Why pipeline companies need credible customer commitments before construction begins.</p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/expert-interview-from-gas-to-gigawatts">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[CPU:GPU Ratios and the Race to the Scale Up Domain]]></title><description><![CDATA[The Diligence Stack is the publishing platform for Creative Strategies, an independent research firm. We connect semiconductors, infrastructure, platforms, software, and adoption to explain how technical change reshapes markets and business models.]]></description><link>https://www.thediligencestack.com/p/cpugpu-ratios-and-the-race-to-the</link><guid isPermaLink="false">https://www.thediligencestack.com/p/cpugpu-ratios-and-the-race-to-the</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Mon, 21 Sep 2026 19:12:34 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/b4567f36-8570-4041-8233-e0737b888df7_1733x907.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Authors note: We are sharing this note, free for all readers.  For subscribers these week we have two exclusive interviews we think you will like :)</em><br><br>As the world catches on that agentic AI is going to need a lot more CPUs, both in the enterprise and for personal use cases, the conversation about the CPU-to-GPU ratio is hot again. We have covered this extensively, starting with <a href="https://www.thediligencestack.com/p/secret-agent-cpu">Secret Agent CPU</a> on March 24, when we looked at how agentic workloads could expand the server CPU market beyond general-purpose servers and head-node CPUs and released one of the earliest TAM expansion forecasts for datacenter CPUs.</p><p>In <a href="https://www.thediligencestack.com/p/secret-agent-cpu-revisited">Secret Agent CPU, Revisited</a>, published May 26, we raised that forecast. Our conversations across the industry were strengthening our conviction that dedicated CPU capacity would become an essential part of running agentic systems at scale. We remain bullish on CPUs because of the clarity in inference workload demand and the clear role the CPU plays becoming a larger infrastructure requirement.</p><p>But while we talk a lot about the CPU-to-GPU ratio, it is very hard to isolate that number and turn it into a demand forecast. The mix depends on the infrastructure operator and the decisions it makes about serving AI. Key point here, each hyperscalers ratio will be different. There will be no standard CPU/GPU ratio configuration. The main key here is to understand those decisions, we need to understand the scale-up domain and why this is priority number one for serving inference at scale and monetizing compute infrastructure.</p><h2>Why we add &#8220;domain&#8221; to scale-up</h2><p>A lot gets talked about scale-up, which involves connecting accelerators so they can work closely together in a single compute fabric. We add &#8220;domain&#8221; firstly because its a helpful mental model to understand networked infrastructure topology and because we want to &#8220;connect&#8221; how much networked compute and memory can cooperate efficiently on the same workload.</p><p>The goal is to make more compute and memory work tightly together as one domain. Today, one way to think about that is a rack whose accelerators cooperate to serve a model to many customers at the same time. Depending on the model and workload, that can mean thousands of simultaneous users, although there is no fixed number of users per rack. Longer conversations require more memory, while more demanding reasoning can occupy the processors for longer. Operators want to expand that domain where doing so lets them serve larger models or more users economically. Across the broader datacenter, they also connect multiple domains, without requiring every processor to participate in one tightly coupled system.</p><p>There are two ways this creates demand for more racks. An operator can run additional copies of the model and distribute customers across them. Or a model can require more resources than one rack provides efficiently, which means multiple racks must cooperate on its workload execution.</p><p>Extending the scale-up domain across racks gives the operator more tightly connected resources to work with. Models can also run across separate domains through scale-out networking, although the communication cost changes. Connecting racks alone does not establish that they form one scale-up domain.</p><p>This is where model size and model context enter the conversation. The model&#8217;s weights take up memory, and serving active users requires additional working memory. For many models, the KV cache holds information from the tokens already processed so the model can continue generating its response. Longer context and more simultaneous sessions increase that requirement.</p><p>A larger domain gives an operator more room to place the model and its active state. Depending on the workload, that can make a larger model practical to serve or improve throughput at the response time customers expect. The operator still has to balance those benefits: a larger model or longer context can consume capacity that otherwise serves additional users.</p><p>And shared memory needs a qualification. Memory remains distributed across processors, with a cost to accessing it remotely.More connected compute does not, by itself, make the same model smarter or more capable. It gives operators more capacity to deliver the capabilities of the models they choose.</p><h2>Interconnect determines how far the domain can grow</h2><p>Our view is that hyperscalers and neoclouds have a strong incentive to expand these domains where the additional scale improves serving economics. Some enterprises will face the same decisions as they deploy larger AI systems on-premises.</p><p>The limit is how many accelerators can exchange data fast enough to work efficiently together. When a model runs across multiple accelerators, each needs results from the others to continue its work. If those results arrive too slowly, adding accelerators can leave more expensive hardware waiting for data.</p><p>Copper has limits around reach and signal integrity as speeds increase. The underlying boundary depends on the architecture, including its physical layout and power budget. </p><p>Optical interconnects expand the possibilities for reach and bandwidth density, which is why we have spent so much time on this part of the market. But the optical system still has to be manufactured, qualified, and serviced. In <a href="https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the">Optics Won&#8217;t Scale as Fast as the Market Expects</a>, we explained why demand for optical connectivity can move faster than qualified supply.</p><p>The race is to build larger scale-up domains that can serve larger models and more users concurrently and economically. If the processors spend too much time waiting for data, operators are paying for compute they cannot fully use. How well each company solves that problem will help determine its margins from serving AI at scale.</p><h2>Where the CPU changes the equation</h2><p>The CPUs already present in GPU systems give us a baseline ratio. For example, <a href="https://www.nvidia.com/en-us/data-center/gb200-nvl72/">NVIDIA&#8217;s GB200 NVL72</a> contains 36 Grace CPUs and 72 GPU packages, or one CPU for every two GPU packages. Counting the dies inside those packages would produce a different number, so we need to keep the denominator consistent.</p><p>Where the ratio conversation becomes more interesting is when we add dedicated agentic CPU capacity which will manifest itself as dedicated racks of CPUs in the scale up domain of GPU compute racks.</p><p>This is why we separate head-node CPUs from dedicated agentic CPUs in our models. While each customer building their own compute racks, like AWS, Azure, and Google, can optimize the number agentic CPUs for their own unique needs the template we have today is of  <a href="https://www.nvidia.com/en-us/data-center/products/vera-rack/">NVIDIA&#8217;s Vera CPU Rack</a> which supports up to 256 CPUs and is positioned alongside its accelerator systems. <a href="https://www.arm.com/products/cloud-datacenter/arm-agi-cpu">Arm&#8217;s AGI CPU</a> also targets agentic infrastructure with AMD, Qualcomm, and Intel following suit. </p><p>We do not yet know how much of that capacity every operator will deploy or what their scale up domain mix of CPU/GPU/premium accelerators will be. It could be one CPU rack supporting several GPU racks, or more, with the allocation changing as the workload, or economics, changes.</p><p>Consider a useful, but hypothetical, example deployment of a scale up domain of ten GPU racks, each with 72 GPU packages and 36 host CPUs. That gives us 720 GPU packages and 360 CPUs. Adding a dedicated rack containing 256 CPUs takes the total to 616 CPUs, or about 0.86 CPUs per GPU package. Two dedicated CPU racks take it to 872 CPUs, or about 1.21 to one.</p><p>That is math using stated configuration assumptions, not a deployed-system claim or a forecast. We highlight this use case to show how varied potential configurations can be and why trying to estimate any CPU:GPU ratio is not the right analysis or measurement of the market. </p><h2>Demand still has to fit what can be manufactured</h2><p>Our CPU forecast (<a href="https://atlas.creativestrategies.com/dashboard">available in institutional tier of CS Atlas</a>) separates general-purpose servers, accelerator head nodes, and standalone agentic systems along with key vendor share assumptions. We then constrain shipments using our manufacturing assumptions since our forecasts are grounded also in what&#8217;s manufacturable. </p><p>Our most current base case implies the following growth from a 2026 baseline:</p><ul><li><p><strong>2027:</strong> CPU silicon-value growth of <strong>29%</strong>; CPU package shipment growth of <strong>20%</strong>.</p></li><li><p><strong>2028:</strong> CPU silicon-value growth of <strong>33%</strong>; CPU package shipment growth of <strong>22%</strong>.</p></li><li><p><strong>2029:</strong> CPU silicon-value growth of <strong>25%</strong>; CPU package shipment growth of <strong>11%</strong>.</p></li><li><p><strong>2030:</strong> CPU silicon-value growth of <strong>35%</strong>; CPU package shipment growth of <strong>29%</strong>.</p></li></ul><p>These are conditional, and continually updated, Creative Strategies estimates, grounded in our most current assumptions and industry checks. Silicon value includes an imputed value for captive CPUs, so it is broader than merchant CPU revenue. Pricing and product mix explain why dollar growth can exceed shipment growth given a core assumption we are making on ASP for agentic CPUs specifically.</p><p>The model constrains CPU output by compatible foundry-node capacity and allocation after competing demand, then applies yield, assembly, and substrate assumptions. Its 2029 slowdown and 2030 acceleration depend heavily on node transitions and the capacity those transitions make available. For customer/clients with access to our data models we break down the full assumptions in base/bull/stretch scenarios. </p><p>We remain aggressive in our forecasts but also grounded in manufacturing reality. Wafer mix assumptions matter and we cannot assume every wafer is available to CPUs while GPUs and custom accelerators are competing for capacity. Nor does the model establish the industry&#8217;s absolute manufacturing ceiling. We will continue refining these assumptions as new information becomes available on customer allocations and system-level deployment constraints.</p><p>Any ratio estimate has to be grounded. We would therefore be careful about declaring that a two-to-one CPU-to-GPU ratio, or more, is either inevitable or impossible. It first needs a defined workload and counting convention, then a test against the supply model aligned with tangible tracking of hyper scaler scale up domain mix. Demand above our forecast and demand above feasible supply are different conclusions.</p><h2>Each operator is making a hardware bet</h2><p>Hyperscalers make distinct decisions about the infrastructure they want to build, working with system suppliers and manufacturing partners. They choose the balance of merchant and custom silicon, then determine the memory and networking required to make those processors productive within a TCO profile.</p><p>It is important to note how one operator may prioritize flexibility across many customer models. Another may have enough predictable internal demand to justify a more specialized accelerator. They can also assign different stages of inference to different systems when the benefit outweighs the cost of moving state between them. Every implementation is unique and many times bespoke which is why generalities harm more than hurt the analysis. </p><p>Mixing merchant and custom infrastructure across a fleet is different from making those processors cooperate inside one tightly connected domain. That requires compatible hardware and software. These decisions commit capital to assumptions about workloads that are still evolving, and those assumptions help determine the margin profile of serving AI at scale.</p><p>Our conviction is that enterprise and personal agents will create much more work around the model layer in the scale up domain. We will have many simultaneous sessions calling on CPUs and then returning to accelerators, with memory retaining the state needed to continue. The amount of dedicated new CPU infrastructure depends on how much existing capacity absorbs and how efficiently the software schedules that work. Another reason, we are bullish on the growth profile of AWS, GCP, and Azure.</p><p>For who benefits here in silicon, we have high conviction on both AMD and Intel, with Intel standing to doubly benefit with <a href="https://www.thediligencestack.com/p/the-intel-foundry-opportunity-two">Intel Foundry well positioned</a> to also manufacture CPUs as additional capacity is brought online.  We maintain NVIDIA is also a primary beneficiary with their agentic CPU roadmap, and Arm and Qualcomm also coming online with solutions. This is not the server CPU TAM of old where share taking was the fundamental analytical baseline.  This is a significant TAM expansion and the analysis now who is are the unit volume and price share gainers in a market that is growing in dollar value ~30% YoY in our supply constrained forecast. </p><p>What would make us less bullish is evidence that CPU work per completed task falls enough to offset usage growth, or that existing infrastructure absorbs much more demand than we expect. For now, we believe the expansion of agentic workloads supports more CPU capacity, with operators making different decisions about how much belongs around each accelerator deployment.</p><p>That is how we think about the CPU-to-GPU relationship: through the complete inference system and how its scale-up domains shape what operators can manufacture and deploy economically. Keeping that view grounded is our ongoing research goal as hardware choices evolve and we learn more about how these systems perform in practice.</p><h2>Continue the research in Atlas</h2><p>Subscribers with CS Atlas access can use Atlas to connect our CPU reports with the research on networking and optical supply. Ask how dedicated agentic CPU racks change the processor mix, which assumptions constrain growth, and what evidence would change the forecast.</p><p><a href="https://atlas.creativestrategies.com/agent?prompt=Explain%20Creative%20Strategies%27%20CPU-to-GPU%20thesis%20using%20Secret%20Agent%20CPU%20and%20Secret%20Agent%20CPU%2C%20Revisited.%20Connect%20dedicated%20agentic%20CPU%20racks%20to%20scale-up%20domains%2C%20optical%20interconnects%2C%20and%20manufacturing%20constraints.%20Cite%20source%20dates%2C%20distinguish%20package%20ratios%20from%20rack%20ratios%2C%20and%20identify%20model%20versions%20and%20evidence%20gaps.">Explore this research in Atlas</a></p><p>The link opens an editable question after sign-in. Answers depend on the research and model versions available with your access.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.thediligencestack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">The Diligence Stack is the research publishing platform of Creative Strategies. Subscribe free for new research previews, or become a paid subscriber for full access to our technology and market analysis, company deep dives, proprietary forecasts, analyst judgements, and complete research archive.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[The Future of Compute Is Fungible]]></title><description><![CDATA[How greater choice in data center infrastructure changes the economics for operators and suppliers]]></description><link>https://www.thediligencestack.com/p/the-future-of-compute-is-fungible</link><guid isPermaLink="false">https://www.thediligencestack.com/p/the-future-of-compute-is-fungible</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 17 Sep 2026 18:47:13 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Cvak!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70d02241-aa3d-459d-a062-1757eb2e2af3_1800x1000.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><strong>Go deeper with this research in <a href="http://tlas.creativestrategies.com/">CS Atlas</a>:</strong> We encourage you to take this research further in Atlas, where you can explore the company assessments, work through the model assumptions and connect this report with our broader infrastructure research. If you haven&#8217;t used Atlas yet, start with a question that takes the research further: &#8220;As hyperscalers design more of their own silicon and racks, which suppliers gain business and which lose pricing power?&#8221; &#8220;How much of NVIDIA&#8217;s opportunity remains when customers choose another company&#8217;s accelerator?&#8221; or &#8220;How does serving larger AI models across more racks change the opportunity for optical and networking suppliers?&#8221;<br><br>Also now in Atlas see our takeaways from meetings at AI Infra summit.</em></p><ul><li><p><a href="https://atlas.creativestrategies.com/notes?note=cpo-summit-takeaways">CPO Summit Takeaways</a></p></li><li><p><a href="https://atlas.creativestrategies.com/notes?note=800-vdc-transition-separate-clocks">800 VDC Transition and Timelines</a></p></li><li><p><a href="https://atlas.creativestrategies.com/notes?note=aws-executive-conversation-serving-larger-ai-models">Learnings from AWS Meetings on Compute and Model Trends</a></p></li></ul><div><hr></div><p>We have spent time over the last month in conversations with stakeholders at different hyperscalers and have landed on a conviction about how infrastructure decisions are likely to play out during this AI buildout. We believe the future of compute is fungible. While we appreciate NVIDIA&#8217;s framing that the GPU is fungible, and that is true, it is clear to us that hyperscalers have a vested interest in building their data centers with <strong>workload fungibility</strong> in mind.</p><p>This viewpoint is an important baseline observation on the diversity of solutions they will use, spanning merchant compute, custom compute, copper, optical, liquid and air cooling, and power delivery from 800 VDC to older generations. We expect these technologies to coexist across their infrastructure, with software coordinating the work across that diversity as one compute fabric. Note, this is a particular advantage unique the hyperscalers and we believe will be a key part of their continued competitive advantage in designing AI infrastructure at scale and competing for enterprise workloads. Having this perspective raises a number of implications and questions that our report explores.</p><p>The value of this viewing infrastructure choices this way is in how it changes our assessment of the companies supplying this buildout. More choice gives customers another way to buy and build capacity, but the savings and supplier profits depend on which workloads move, what it costs to support them and who continues to supply the rest of the system. We work through six questions to understand where those economics are likely to improve and where the apparent benefit of greater choice breaks down.</p><p><strong>1. How does greater choice change the customer&#8217;s purchasing power?</strong></p><p>We expect hyperscalers to start by using a wider mix of systems for new workloads while keeping existing work on the hardware already running it. That includes buying from other suppliers and developing their own silicon and rack-scale designs, giving them more control over how the systems are built and which parts they buy. At first, these efforts may help them add capacity and better match hardware to their workloads. As the alternatives reach production at scale, customers gain more room to negotiate prices. We expect those benefits to develop before broad pricing pressure affects suppliers&#8217; growth and margins.</p><p><strong>2. Where does specialization offer better economics, and where does GPU flexibility remain more valuable?</strong></p><p>Workload fungibility gives operators more choice over where they run their work. We expect custom silicon to gain ground where steady demand justifies the cost of designing and supporting it, while GPUs remain valuable for a changing mix of workloads. The benefit comes from matching work to the systems that can run it most economically. That requires enough software support to make those choices practical. A cheaper chip offers limited savings when it cannot run enough of the customer&#8217;s work or takes too long to get into service.</p><p><strong>3. How much influence moves to the software that decides where the work runs?</strong></p><p>The software deciding where work runs also influences which hardware the operator needs to buy or they design custom compute. We expect hyperscalers to keep considerable control over those decisions because better utilization and more purchasing options directly benefit their own businesses. Suppliers still have an opportunity where their software reduces the work required to deploy and operate a system. The distinction is who collects the economic benefit. More important orchestration software does not necessarily mean a larger revenue opportunity for an independent software company.</p><p><strong>4. How does serving inference across larger compute domains change the network?</strong></p><p>As hyperscalers connect more systems to serve inference at scale, the network helps determine how much of that capacity they can use together. Workload fungibility depends on being able to send work to available compute without adding too much delay or cost. This raises questions about where copper remains sufficient, where optical connections become necessary, and how much flexibility operators can gain while keeping tightly connected systems running efficiently. We examine what those choices mean for networking and optical suppliers as operators build larger compute domains.</p><p>This builds on our ongoing optical and networking research and our <a href="https://atlas.creativestrategies.com/notes?note=aws-executive-conversation-serving-larger-ai-models">recent conversation with a senior AWS executive, covered in Atlas</a>. Larger, sparse models need fast connections between the accelerators holding their different parts. The race is on for the larger scale up domain where optical links are necessary extend those connections across more racks (bigger compute clusters), giving operators more room to spread power and cooling demands. The return depends on whether the larger system serves more work at the response times customers need, after accounting for the cost of connecting it.</p><p><strong>5. What is infrastructure flexibility worth over the life of a data center?</strong></p><p>Power and cooling decisions made today will affect what an operator can install several equipment generations from now. We see a stronger case for spending against a defined upgrade path than for preparing every part of a facility for the highest possible density. The extra investment has to earn its way back through lower modification costs, less downtime or getting paid for new capacity sooner. Our facility analysis shows why the return changes substantially when earlier installation does not produce earlier income, and why the lease matters as much as the engineering.</p><p><strong>6. Which companies retain the most value as operators gain more options?</strong></p><p>We keep coming back to the work a supplier retains as the customer gains more options. Another company may supply the accelerator while NVIDIA continues to sell valuable infrastructure around it. A custom-silicon partner may win a design but retain less of the profitable work when it reaches production. This is why we assess implementation, proprietary IP, networking and support separately. It also explains how greater customer choice can pressure pricing and still support profit growth for suppliers that remain difficult to replace.</p><h2>In the full report, we examine:</h2><ul><li><p><strong>When cheaper compute costs more.</strong> We test how a lower-cost system&#8217;s apparent advantage holds up once utilization, software compatibility and deployment delays enter the calculation&#8212;and where paying more for GPU flexibility or integration produces a better return.</p></li><li><p><strong>What supports our company preferences.</strong> Why Broadcom remains our largest modeled dollar opportunity in custom silicon, why MediaTek leads our incremental conviction ahead of Marvell, and what would change that order.</p></li><li><p><strong>How NVIDIA participates alongside custom compute.</strong> Which parts of the system can remain valuable to NVIDIA even when a customer chooses another accelerator.</p></li><li><p><strong>Which developments would change our view.</strong> The production orders, retained supplier work and completed facility upgrades we will assess over the coming quarters.</p><p></p></li></ul><p><em><strong>Take the analysis further in CS Atlas.</strong> Explore seven company assessments and three illustrative models, then connect the findings with our broader industry research. Ask which suppliers benefit as hyperscalers design more of their own infrastructure, compare company opportunities, and test what would change our views. We built Atlas so subscribers and clients can work through our research on their own terms and apply it to the decisions they face.</em></p><p><em>Not yet a paid subscriber? Join The Diligence Stack to access the full report and go deeper with our research in CS Atlas.<br><br>Want to engage more with our firm and our analysts, <a href="https://creativestrategies.com/contact-us/">reach out here</a>. </em></p>
      <p>
          <a href="https://www.thediligencestack.com/p/the-future-of-compute-is-fungible">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Credo’s Next Phase of Growth]]></title><description><![CDATA[Why broader design ownership can help Credo win more customer business, and what that growth needs to earn.]]></description><link>https://www.thediligencestack.com/p/credos-next-phase-of-growth</link><guid isPermaLink="false">https://www.thediligencestack.com/p/credos-next-phase-of-growth</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 15 Sep 2026 16:32:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!cz4l!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Want to go deeper on Credo and the full interconnect market? In <a href="https://atlas.creativestrategies.com/dashboard">CS Atlas</a>, you can work through our research on its technology, competitors and growth opportunity, then ask your own questions. What does DustPhotonics add? Where could linear optics or CPO change the business? What growth and cash margins would justify the valuation?</em></p><p><em>Our interconnect SWOT is also available in <a href="https://atlas.creativestrategies.com/agent">CS Atlas</a>, where subscribers can explore how we assess Credo alongside its competitors. In our July scorecard, Credo received our highest score for current-cycle strength, its role in addressing key connectivity bottlenecks, and its opportunity in scale-up systems. This report builds on that work, including why we think owning more of the copper and optical design gives Credo room to grow and what we still need to see as those products reach customers.</em></p><p><em>The companion research is available to subscribers with <a href="https://atlas.creativestrategies.com/dashboard">CS Atlas access</a>.<br><br>We will have full coverage of AI Infra Summit in Atlas as well this week so check CS Atlas later in the week for our event notes. </em></p><div><hr></div><h2>Why we are positive on Credo</h2><p>We are big believers that vertically integrated companies have more sustainable competitive advantages than their less integrated peers. This is a key reason we have been positive on Credo from the start, and while management consistently articulates this, we still think it is not given enough weight in the analysis of Credo&#8217;s competitive position. While Credo still has a lot of runway in its AEC and ALC businesses, we think the market is undervaluing what DustPhotonics adds as interconnect designs move toward NPO, CPO and scale-in.</p><p>DustPhotonics gives Credo control of the photonic chip alongside its own SerDes, optical DSP and firmware. We think owning the SerDes is an important part of this advantage because Credo can optimize how the electrical signal is sent and received as it works through the optical design. When a customer needs a connection to use less power, its engineers have more choices about where to make that improvement and how to balance it against reach and reliability. They can work across more parts of the electrical and optical parts together, including how a change in one affects the other. We think that flexibility becomes more valuable as customers move to new architectures and look to integrate heterogenous compute diversification, giving Credo more ways to meet their requirements and compete for the next design.</p><p>We also think Credo&#8217;s position as a connectivity-focused company with both copper and optical products deserves more weight than is given. Several competitors are stronger on one side of that market, while broader platform suppliers approach connectivity as part of a larger system. Credo can work with customers on where copper still makes sense and where optics is needed, including deployments that use both. That gives it more ways to stay involved as the customer&#8217;s architecture changes, without needing every connection to move to optics for the business to grow.</p><p>The same flexibility applies when the customer needs a more reliable connection or encounters a problem during qualification. Credo has more of the design available to investigate and adjust, including how it works with the customer&#8217;s switches, network interface cards and software. That also gives it more options when working through a production issue with manufacturing partners. If the solution requires changing both the electrical and optical design, the work can be coordinated inside the company rather than across separate suppliers and development schedules.</p><p>Helping a customer get to market faster is one benefit we expect from that control and one regularly highlighted my management. The customer may also get a product better suited to its power and thermal requirements, or have less work to do resolving problems in qualification and operation. What the May DustPhotonics acquisition gives Credo is more ability to make those tradeoffs across the full connection, and we think that will matter as customer requirements change from one design to the next and vary across many bespoke rack scale designs, as is the industry trend. That is the broader competitive advantage we see in its vertical integration. <a href="https://investors.credosemi.com/news-events/news/news-details/2026/Credo-Completes-Acquisition-of-DustPhotonics/default.aspx">Credo acquisition announcement</a></p><h2>Winning more of the customer&#8217;s business</h2><p>Credo&#8217;s current electrical/connectivity relationships give it a way to bring this broader set of capabilities to customers whose systems are already familiar. This is another element that favors an integrated approach in that it creates the environment for more customer co-design and less likely to be designed out. By covering many parts of the complete solution Credo can extend from the cable to optical components and complete transceivers, depending on what the customer needs help with. </p><p>There are good alternatives in both cases. Broadcom and Marvell have substantial electrical and optical capabilities, and established module makers have experience getting products through manufacturing and into customer deployments. Some buyers will prefer separate suppliers because that makes parts easier to change. Others may benefit from having more of the design and support with one company, particularly when power, reliability and the deployment schedule have to be worked through together. While we recognize the option of flexibility, our extensive work analyzing the supply chain consistently lands on the observation that customers prefer a simpler supply chain when possible and &#8220;one neck to choke,&#8221; meaning a single source with more of a total solution is preferred more often than not. </p><p><strong>Exhibit 1. Credo can do more of the work inside the connection</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!cz4l!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!cz4l!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 424w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 848w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 1272w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!cz4l!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Credo can supply jointly designed components, a finished connection, or qualified optics within a platform; customers and platform owners retain network and interface decisions.&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Credo can supply jointly designed components, a finished connection, or qualified optics within a platform; customers and platform owners retain network and interface decisions." title="Credo can supply jointly designed components, a finished connection, or qualified optics within a platform; customers and platform owners retain network and interface decisions." srcset="https://substackcdn.com/image/fetch/$s_!cz4l!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 424w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 848w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 1272w, https://substackcdn.com/image/fetch/$s_!cz4l!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d54809a-b291-4c35-ad8f-34afd6b88b58_2400x1350.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Source: Creative Strategies analysis of Credo&#8217;s public product portfolio and optical architectures. The map describes product responsibility, not measured competitive performance. Platform participation remains subject to qualification.</em> </p><p>Our expectation is that having more ways to meet the customer&#8217;s requirements makes it a stronger competitor for the connections that remain open to outside suppliers. Time to market is one reason a customer might choose it; the ability to keep improving the product with that customer is why we think the advantage can last.</p><h2>How much growth follows?</h2><p>Our proprietary accelerator and networking models help us better estimate this dynamic. More accelerators, and in particular higher density of accelerators, create more demand for connections, but the number of units is only part of the equation. As systems spread within the rack and across racks, the distance between parts of the system and the bandwidth they need also change. Copper may still make sense for the short links, or dedicated ones once optics intra rack is reliable enough. And its already established optics serves the longer distances. We expect opportunities for both, rather than one date when the industry moves everything to optics. More in our report on optical timing scenarios below. </p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;e45703e8-a0dc-4909-b1d0-9918a29a0443&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Optics Won&#8217;t Scale as Fast as the Market Expects&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-08-18T16:27:37.944Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!P6hE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:211118436,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:9,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:true,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>We envision a scenario where Credo could grow faster than accelerator deployments as the totality of their solutions get higher attach in rack scale builds. Our models let us test how much those assumptions matter, while keeping bandwidth growth from being counted twice. We also have to distinguish selling a component from selling a complete module. The module brings more revenue, but Credo has to pay for more hardware, inventory and support, so a bigger optical business does not automatically mean a higher company margin.</p><p>We are less certain about the pace of that ramp than we are about Credo&#8217;s position going into it. Qualifications can take longer than expected, manufacturing output can be uneven and customer schedules can move. Over the next year, we want to see repeat orders turn into gross profit and cash. Our view is that Credo is well positioned to win more business, with a path to growth that could justify its valuation. How quickly it gets there, and how much it earns along the way, are the parts we outline in our house view of Credo.</p><h2>Inside the full report</h2><ul><li><p><strong>What DustPhotonics adds.</strong> How joint electrical and optical design could improve power, reliability, qualification and delivery&#8212;and where manufacturing dependencies remain.</p></li><li><p><strong>Where Credo can win.</strong> Why customers might choose Credo over Broadcom, Marvell or established module suppliers, depending on what they&#8217;re buying.</p></li><li><p><strong>How optical changes affect the business.</strong> What Credo could gain or lose as customers adopt linear optics, NPO and CPO.</p></li><li><p><strong>The case for outgrowing deployments.</strong> Our accelerator and networking models test how content, share and delivery assumptions affect calendar-2028 optical revenue and gross profit.</p></li><li><p><strong>What would justify the valuation.</strong> Growth and cash-margin scenarios through FY32 show what could support the September 11 valuation&#8212;and what falls short.</p></li><li><p><strong>What changes our conviction.</strong> The orders, design wins, margins and cash conversion that distinguish a lumpy ramp from a weaker thesis.</p></li><li><p><strong>Go deeper in <a href="https://atlas.creativestrategies.com/dashboard">CS Atlas</a>.</strong> The companion, <em>Credo and AI Interconnects: Technology, Competition and Growth</em>, includes technical detail, competitive comparisons, full optical assumptions and 20 investor questions. Readers with Atlas access can explore those assumptions and ask their own follow-ups.</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/credos-next-phase-of-growth">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Agentic AI’s Next Frontier: Cyber Defense]]></title><description><![CDATA[More capable models can help enterprises investigate threats and respond. The next challenge is deciding how much authority to give them.]]></description><link>https://www.thediligencestack.com/p/agentic-ais-next-frontier-cyber-defense</link><guid isPermaLink="false">https://www.thediligencestack.com/p/agentic-ais-next-frontier-cyber-defense</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 10 Sep 2026 19:24:53 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!JfYk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><a href="https://atlas.creativestrategies.com/agent?prompt=Using+Creative+Strategies+and+Diligence+Stack+research+in+Atlas%2C+take+me+deeper+on+Cybersecurity%27s+Next+Bottleneck%3A+Defense.+Explain+how+agentic+AI+can+help+investigate+threats%2C+contain+attacks%2C+and+complete+approved+remediation.+Distinguish+using+AI+for+defense+from+securing+AI+deployments.+Show+how+frontier+models%2C+security+platforms%2C+enterprise+permissions%2C+and+recovery+fit+together%2C+where+revenue+could+accrue%2C+and+what+evidence+would+change+the+view.+Separate+public+facts%2C+illustrative+examples%2C+analyst+judgment%2C+and+unproven+scenarios.+Do+not+make+stock+calls.">Atlas companion available</a>: Subscribers can explore the cyber-defense use cases, compare companies, and test the supporting research in CS Atlas.<br><br></em><strong>CS View:</strong><em> </em>Our conviction is high that agentic AI will become an important part of enterprise cyber defense. The opportunity is to help security teams investigate threats and carry out more of the response safely. Conviction in a separate revenue pool for restricted frontier models remains Medium because we do not yet have direct evidence of sustained paid production use.</p><h3>Using agentic AI to defend the enterprise</h3><p>The first leg of AI adoption in the enterprise centered on basic LLMs that employees could ask questions or use to draft content. Those early pilots did not raise anywhere near the security concerns enterprises face today as agents run wild inside their four walls. In less than a year, AI went from those early pilots to software that can interpret a goal, decide what to do next, and keep working around the clock. Enterprises have already recognized the potential, but agent use has moved ahead of governed production. They are now working through how much authority to give systems that can change files, operate software, and access company data. That means setting clear limits, requiring approval for sensitive work, and having a way to recover when something goes wrong. <a href="https://www.thediligencestack.com/p/cybersecurity-and-the-enterprise">Our first cybersecurity report</a> examined the controls enterprises need as AI gains access to their systems. This report looks at the next phase: using agentic AI to defend those systems. Agents can help investigate threats, find vulnerabilities, and prepare fixes. The next challenge is how much of that response the enterprise can safely let them carry out.</p><p>One example from the practitioner interviews helps illustrate the defensive use case: a security agent detects suspicious activity and disables an employee&#8217;s account. That could stop an attacker, but a mistaken decision could also interrupt legitimate work. The company needs to know why the agent acted, what it was allowed to do, and how to restore access safely. Those requirements determine how much of the response it can automate.</p><p>We measure progress in remediation through verified closure: confirming that a security problem has been resolved and the affected system still works. Disabling an account may contain an attack, but the team still needs to check whether the attacker retains another way in. The opportunity is to help security teams complete more defensive work safely. This report examines how that work divides among frontier AI developers, security platforms, and enterprise teams, and where it could create new revenue.</p><p><strong>Exhibit 1. AI Makes Discovery Faster; Enterprise Change Control Becomes the Limiting Step</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JfYk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JfYk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 424w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 848w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 1272w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!JfYk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png" width="1456" height="849" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:849,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:152824,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/214989086?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!JfYk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 424w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 848w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 1272w, https://substackcdn.com/image/fetch/$s_!JfYk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74a9c389-a053-44e8-b1d8-c2f61a0b77d6_1800x1050.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>Frontier labs are becoming part of the defense stack</h3><p>We believe an under appreciated aspect of frontier AI models is how frontier model labs are becoming suppliers of cyber-defense capability. OpenAI&#8217;s Daybreak program gives approved defenders access to models with fewer restrictions on authorized security work, with separate approval for its purpose-trained cybersecurity models. Anthropic&#8217;s Project Glasswing gives selected partners access to an unreleased frontier model for defensive work. Both programs make advanced cyber capabilities available through controlled access rather than unrestricted public use.</p><p>Cybersecurity creates a distribution problem because the same model can help a defender validate an exploit or help an attacker develop one. Public services therefore block some advanced requests, including legitimate defensive work. A trusted enterprise program can allow more capability because access is tied to a verified user and a defined defensive purpose, with the provider monitoring each session. <a href="https://openai.com/index/expanding-daybreak-as-the-cyber-defense-window-narrows/">OpenAI&#8217;s Daybreak program</a> is the clearest current example, while <a href="https://www.anthropic.com/glasswing">Anthropic&#8217;s Project Glasswing</a> uses the same basic approach with controlled access to an unreleased model.</p><p>Frontier labs are likely to keep investing, making the case for the frontier strong, because gains in coding and reasoning already apply to cyber work. A model has the capabilities to stay with a long technical investigation or work across a large code base may create more defensive value than a public assistant that has to block advanced cyber tasks. That supports a restricted tier for vetted enterprises and governments, often through security-vendor partnerships. We are ready to treat trust-gated cyber access as an emerging product pattern. Private model weights and on-premises deployment remain unproven. A sovereign model is also a reasonable scenario for customers that require tighter isolation around sensitive telemetry, although provider and customer disclosures still have to show which delivery forms become real products.</p><p><strong>Continue this question in Atlas:</strong> <a href="https://atlas.creativestrategies.com/agent?prompt=Using%20Creative%20Strategies%20and%20Diligence%20Stack%20research%20in%20Atlas%2C%20stress-test%20the%20monetization%20thesis%20in%20Cybersecurity%27s%20Next%20Bottleneck.%20Evaluate%20what%20happens%20if%20cyber-specific%20capability%20commoditizes%2C%20controlled-access%20programs%20stay%20funded%20pilots%2C%20platform%20vendors%20bundle%20the%20capability%2C%20customers%20remain%20in%20advisory%20mode%2C%20or%20a%20major%20automated-response%20failure%20raises%20approval%20thresholds.%20Identify%20the%20evidence%20that%20would%20move%20frontier-model%20monetization%20conviction%20above%20or%20below%20Medium.">What evidence would move restricted frontier-model monetization from Medium to High conviction?</a></p><h3>Model intelligence still needs enterprise authority</h3><p>A defensive agent needs both model reasoning and the customer&#8217;s operating context. The model can help investigate a threat and prepare a response; identity and security platforms enforce what it is allowed to do. The enterprise owns the approval and recovery decisions. Partnerships are the practical near-term path because model developers and control platforms each supply part of the work needed to defend a live system.</p><p>The first financial proof we are watching for should appear in higher security-platform consumption or broader paid identity and recovery coverage as customers use AI for more defensive work. The real test is whether better reasoning helps teams resolve more exposure safely. Products that stop at recommendations leave the customer with the work of carrying out the response and the risk if it fails. </p><h2>Inside the Full Report</h2><ul><li><p>How agentic AI can help investigate threats, contain attacks, and complete fixes.</p></li><li><p>The delivery paths and value-capture scenarios beyond today&#8217;s controlled-access programs.</p></li><li><p>Why the model layer and the security control layer remain complementary.</p></li><li><p>A threat-to-control map for the authority and tool paths agentic systems create.</p></li><li><p>A safe-remediation framework built around skill-level authority and recovery.</p></li><li><p>An auditable completeness scorecard for the leading positions.</p></li><li><p>A 2030 market model that separates gross spend from incremental revenue.</p></li><li><p>The pricing units and buyer evidence that would confirm or break the thesis.</p></li><li><p>Integrated companion research in <a href="https://atlas.creativestrategies.com/dashboard">CS Atlas</a> for subscribers to engage more with the research. </p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/agentic-ais-next-frontier-cyber-defense">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Custom Silicon 3.0: Growth and Competition Across Compute and Networking]]></title><description><![CDATA[Why the market is shifting from ASIC design wins to program responsibility across compute and networking]]></description><link>https://www.thediligencestack.com/p/custom-silicon-30-growth-and-competition</link><guid isPermaLink="false">https://www.thediligencestack.com/p/custom-silicon-30-growth-and-competition</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 08 Sep 2026 17:39:28 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!yFaC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Check out CS Atlas and exclusive research product built on Creative Strategies research and available to subscribers. </p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;544d9a12-f3da-4143-8a58-22f67370cc83&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Introducing CS Atlas&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-08-31T18:56:37.374Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!eYu7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/introducing-cs-atlas&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:213410473,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:6,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p></p><h3>More suppliers can participate in the same program</h3><p>The custom ASIC market has become more diverse and competitive as customers mix and match suppliers across their programs. Program wins once gave us a clearer basis for assigning beneficiaries. Customers now have a wider menu of compute, I/O, networking, and front-side and back-side services, and can divide that work among vendors. Supplier revenue and margins depend on the IP, products and design services retained as customers develop more of their own tooling.</p><p>Our April reports, <a href="https://www.thediligencestack.com/p/googles-tpu-strategy-offers-a-clearer">Google&#8217;s TPU Strategy Offers a Clearer View of the Next AI Bottleneck</a> and <a href="https://www.thediligencestack.com/p/custom-asic-is-no-longer-one-market">Custom ASIC Is No Longer One Market</a>, connected workload specialization in a growing market with different supplier roles and margin profiles. Our September model more clearly separates compute from networking and allows for more sourcing combinations. As Google and Amazon continue to deepen their own tooling, they gain more control over which responsibilities they retain internally and which they assign to suppliers. We expect the wider availability of supplier IP to extend this mix-and-match approach across custom-silicon customers, including those with less in-house IP or tooling.</p><p>Our conviction in GPU flexibility remains intact because models are still changing, and inference workloads have very different memory and latency requirements. For enterprises managing that diversity, we continue to see GPUs as the strongest general-purpose choice on total cost of ownership (TCO): the ability to redeploy capacity as demand changes protects utilization. Specialized ASICs can retain an advantage where customers control a sufficiently large, predictable workload.</p><h3>Broadcom leads in dollars, while share becomes a layer-by-layer question</h3><p>Broadcom remains the largest modeled dollar beneficiary and the best-proven integrated supplier with a SerDes moat. The revenue and profit it retains depend on the mix of proprietary IP, products and design services customers continue to buy.</p><p>MediaTek is our highest-conviction incremental beneficiary. We see its TPU business expanding within a growing market, while its NVIDIA relationship gives it a route to customers developing custom accelerators for NVLink-connected infrastructure. Reaching that broader customer base still requires production volume and MediaTek retaining its implementation role through subsequent generations and widening customer base.</p><p>The broader vendor map includes Marvell, Qualcomm, Intel, AMD, GUC and Alchip. Their different combinations of owned IP, implementation experience and production responsibility make a single ranking of technical capabilities inadequate for judging the business opportunity.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yFaC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yFaC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 424w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 848w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 1272w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yFaC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png" width="1456" height="1183" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1183,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:146039,&quot;alt&quot;:&quot;Program sourcing overview: One custom program can use several suppliers&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/214213233?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Program sourcing overview: One custom program can use several suppliers" title="Program sourcing overview: One custom program can use several suppliers" srcset="https://substackcdn.com/image/fetch/$s_!yFaC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 424w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 848w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 1272w, https://substackcdn.com/image/fetch/$s_!yFaC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f4186ba-4ecb-4838-9b7a-99bc27993cd0_1600x1300.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>How to read the visual: the customer assigns responsibilities across the program. Each box can go to a different supplier; one vendor may also fill several roles. This is a sourcing example, not a disclosed customer design or an allocation of market value.</em></p><h3>A larger opportunity still requires program-level diligence</h3><p>Our 2028 base case puts the value of custom chips and the networking used with them above $350 billion, with a stretch case above $400 billion. Those figures include the estimated value of chip development done inside companies such as Google and Amazon, so they are larger than the revenue outside suppliers would report. We model supplier revenue separately. We also exclude networking used with off-the-shelf GPU systems. The full report explains how different growth and networking assumptions affect these estimates.</p><p>Suppliers can earn more gross profit from a growing market even if they receive a smaller share of each customer&#8217;s spending. Profit could exceed our estimates if customers buy more of their higher-margin products. Revenue growth from buying components on a customer&#8217;s behalf adds less profit because much of that money goes to other suppliers.</p><p>As customers choose suppliers for their next designs, we will look at who supplies the compute, interfaces, packaging and networking. Accelerator sales can meet expectations while supplier earnings differ considerably, depending on which parts of the system each company provides.</p><h2>Inside the Full Report</h2><ul><li><p>The five wallet layers that show where front-side, compute, back-side, I/O, and network value can accrue.</p></li><li><p>A vendor capability map covering Broadcom, Marvell, MediaTek, Qualcomm, Intel, AMD, GUC, and Alchip.</p></li><li><p>The base, high-attach, and stretch cases, with the assumptions that bridge custom logic and networking.</p></li><li><p>Broadcom&#8217;s modeled logic allocation and the sensitivity of its total-program share to networking participation.</p></li><li><p>The proof milestones and customer sourcing behavior that would change our view.</p></li><li><p>What has changed since April, why MediaTek leads our incremental conviction, and how program mix affects valuation.</p></li><li><p>Full companion deep research pack in <a href="https://www.thediligencestack.com/p/introducing-cs-atlas">CS Atlas</a> for subscribers to dive deeper with this report. </p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/custom-silicon-30-growth-and-competition">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[2027: Peak Year of Constraint]]></title><description><![CDATA[Recent hardware results point to a wider gap between AI infrastructure demand and deployable supply in 2027, followed by a larger increase in usable capacity during 2028.]]></description><link>https://www.thediligencestack.com/p/2027-peak-year-of-constraint</link><guid isPermaLink="false">https://www.thediligencestack.com/p/2027-peak-year-of-constraint</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 03 Sep 2026 17:50:48 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Fsfv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<blockquote><p><strong>Operating View</strong>: AI demand continues to grow through 2027, but the industry cannot convert all of that demand into shipments and deployed compute because critical manufacturing capacity is still being installed, qualified, and ramped. The capacity investments initiated in 2026 begin contributing during 2027, but many do not provide a full-year or mature-yield benefit until 2028. This creates the potential for a visible growth caps in 2027 followed by greater unit-growth capacity in 2028&#8211;30.</p></blockquote><p>The most recent round of earnings has only reinforced a fundamental point about the AI infrastructure supply chain. <strong>The industry only grows as fast as the most constrained layer.</strong> We have been tracking as many of the critical supply chain constraints that have been continually moving down deeper and deeper into the supply chain.  We have maintained that demand sits around 115-120% above annual capacity. The semiconductor supply chain, nor the power/utility supply chain moves very quickly, and only recently in late 2025 and into 2026 has the wider LTA agreements from top vendors with scale, and balance sheet, provided capacity buildout clarity for key supply chain providers who are now building out.  </p><p>It is our view by early 2028, much of the capacity funded in 2026 and installed through 2027 should begin to provide some relief. This is a point both for foundry and component capacity and we believe data-center projects should also be further along, giving the industry more room to turn higher component output into working systems and sustain faster unit growth through 2030. Demand should continue to run ahead of supply as the buyer base broadens and each new system generation requires more infrastructure around the accelerator. Our view is that the gap persists in 2028 and starts to bring better supply to demand imbalance (not solve) as more of the stack comes online together potentially leading to a re-acceleration into the end of the decade. </p><h3>What the latest hardware confirm in this view</h3><p><a href="https://atlas.creativestrategies.com/agent?prompt=Using%20Creative%20Strategies%20earnings%20coverage%20and%20company%20intelligence%20for%20Dell%2C%20HPE%2C%20NVIDIA%2C%20Broadcom%2C%20AMD%2C%20and%20Intel%2C%20compare%20the%20latest%20AI%20infrastructure%20demand%20signals%20with%20the%20conversion%20gates%20between%20orders%2C%20shipments%2C%20and%20deployed%20compute.%20Which%20parts%20of%20the%20stack%20appear%20most%20constrained%20heading%20into%202027%2C%20and%20what%20evidence%20would%20show%20that%20capacity%20relief%20is%20arriving%3F">Explore the earnings read-through across Dell, HPE, NVIDIA, Broadcom, AMD and Intel in Atlas</a></p><p>Across the latest earnings calls, the same constraints are continually emphasized. Dell and HPE see orders running ahead of the complete systems they can deliver. NVIDIA, Broadcom and AMD show demand spreading from accelerators into the network and rack around them. Intel is adding clean-room and substrate capacity to support the same build. The signal keeps going further down the stack, into MLCCs, analog power components and the electrical equipment needed to bring a data center online.</p><p>This is why we see 2027 as the peak year of constraint. More capacity will come online, although the additions will not arrive or qualify on the same schedule. A system can have the accelerator and still wait on a substrate, a capacitor, a power stage or an energized site. The investment underway today should begin to provide broader relief in 2028, when more of these layers have had time to reach volume together. Supply should remain tight, with fewer pieces holding the whole system back.</p><p>Take this one level deeper in Atlas: <a href="https://atlas.creativestrategies.com/agent?prompt=Using%20our%20earnings%20notes%20and%20capacity%20research%2C%20show%20me%20where%20AI%20infrastructure%20remains%20constrained%20through%202027%20across%20systems%2C%20accelerators%2C%20memory%2C%20advanced%20packaging%2C%20substrates%2C%20networking%2C%20MLCCs%2C%20analog%20and%20power%20components%2C%20and%20data-center%20power.%20Explain%20which%20constraints%20are%20most%20likely%20to%20ease%20in%202028%2C%20which%20may%20remain%20tight%2C%20and%20what%20company%20disclosures%20would%20confirm%20that%20broader%20capacity%20relief%20is%20arriving.">Where are the 2027 bottlenecks, and what begins to ease in 2028?</a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Fsfv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Fsfv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 424w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 848w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 1272w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Fsfv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png" width="1456" height="1984" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1984,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:252140,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/214020971?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Fsfv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 424w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 848w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 1272w, https://substackcdn.com/image/fetch/$s_!Fsfv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefe31f38-f36d-43c9-992c-51bea46bb354_1600x2180.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>For Subscribers:</h2><ul><li><p>Why 2027 can be the point when the gap between AI infrastructure demand and deployable supply is most visible.</p></li><li><p>How constraints move across leading-edge wafers, HBM, advanced packaging, networking, rack integration, and data-center power.</p></li><li><p>Why several capacity additions could begin providing much more relief in 2028 without fully closing the supply gap.</p></li><li><p>What the latest results from Broadcom, Intel, TSMC, Micron, SK hynix, Dell, HPE, NVIDIA, and AMD tell us about the timing.</p></li><li><p>The operating signals that would strengthen or weaken our view, including qualification progress, backlog conversion, customer readiness, and utilization.</p></li><li><p>How subscribers can use the deeper Atlas companion research to test the thesis by company or capacity layer.<br></p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/2027-peak-year-of-constraint">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The GPU Tsunami: Testing, Testing…]]></title><description><![CDATA[How GPUs, HBM, SiC, silicon photonics, and advanced packaging are creating new test demands across the semiconductor stack]]></description><link>https://www.thediligencestack.com/p/the-gpu-tsunami-testing-testing</link><guid isPermaLink="false">https://www.thediligencestack.com/p/the-gpu-tsunami-testing-testing</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Wed, 02 Sep 2026 13:41:14 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!tk2B!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;44bd5d68-b2ad-4d08-8d84-eb9cea3a9c0c&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Introducing CS Atlas&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-08-31T18:56:37.374Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!eYu7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/introducing-cs-atlas&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:213410473,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:6,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p><br><em>The GPU Tsunami framing recap: The race to accelerated computing, driven by AI workloads and the GPU, is pulling forward the entire semiconductor ecosystem as the industry races to meet demand, develop significantly more advanced chips, and solve new engineering challenges which emerge. </em><br><br>For most of the semiconductor industry&#8217;s history, test followed a familiar flow around a mostly monolithic chip. The angstrom era is changing that as chiplets, HBM, and other disaggregated designs turn the finished device into a system assembled from several pieces. Every additional die and connection creates another place a defect can appear, while more value is committed before final test. This is forcing manufacturers to screen earlier and add checks after assembly, often under harder power and thermal conditions.</p><p>A year ago, all major semiconductor companies told us testing would play a larger role as design complexity increased. We sat on this report because we were unsure how far into the manufacturing flow to take readers. Recent earnings make the change visible across the test market and we think tracking the category shows some early design signals worth playing attention. We are tracking the main test suppliers because each gives us a signal from a different part of the market. Aehr shows where wafer-level burn-in is moving into production. Teradyne and Advantest show how functional-test time and equipment demand are changing across advanced compute and memory. Cohu shows where hotter, more complex packages require new handling, thermal control, and inspection. Together, they reveal where rising design complexity is turning into additional factory work and test capacity.</p><h2>The GPU Tsunami is reaching semiconductor test</h2><p>Semiconductor manufacturers use test machines, commonly called testers, to apply power and signals to a chip and confirm that it works. Each machine has a fixed number of hours available. Larger accelerators can remain on the machine longer because they draw more power and require deeper test patterns, reducing the number of chips each tester can process. Advanced packaging adds cost around every die, while optical I/O introduces checks that can only happen after more of the device has been assembled.</p><p>We therefore focus, and have framed an economic model, on <strong>test content per sellable AI system</strong>: the total factory work required to prove that the components and the completed system will operate as intended. Chip volume remains important, although it is only one source of demand. Test capacity also grows when a device occupies the machine longer, requires checks at additional manufacturing stages, or consumes enough power that fewer devices can be tested at once.</p><blockquote><p><strong>Required test capacity = unit volume &#215; test insertions &#215; test seconds per insertion &#247; effective parallelism</strong></p></blockquote><p>Each part of the model has a direct meaning. More devices, additional checks, and longer tests increase the equipment requirement. Testing more devices at the same time reduces it.</p><p>In the full report, we use this model to estimate where the added test value can accrue. Functional-test suppliers benefit when processors require more machine time. Handling and optical-test companies participate when advanced packages create new checks. Wafer burn-in depends on how many wafers receive sustained stress and how long the process takes. We then map that capacity to equipment content and supplier position to estimate the commercial opportunity.</p><h2>Wafer burn-in finds weak die before they become expensive failures</h2><p>An individual chip, called a die, can pass a short electrical test and still carry a weakness that appears only after sustained heat or power. An AI accelerator die, as an example, can pass a short electrical test while still carrying a weakness that appears only after sustained power and heat. If the failure is discovered after the processor has been packaged with HBM, an interposer, and other components, the manufacturer can lose the value of the entire assembly. Wafer burn-in applies that stress before the expensive package is built.</p><p>Finding the weakness at this stage lets the manufacturer remove the die before packaging. A failure discovered later can destroy the package, the good die inside it, and the work already used to assemble everything. Earlier reliability screening protects more value as the package becomes more expensive.</p><p>To show how the risk compounds, assume a package requires eight to twelve die and that each selected die has a 98% to 99.5% probability of being good after screening. If failures are independent, the probability that every required die is good ranges from approximately 78% to 96% before assembly losses. These are illustrative assumptions, not measured industry yields. The point is the multiplication: as packages combine more required die, even a small improvement in die-level confidence can protect substantially more downstream value.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tk2B!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tk2B!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 424w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 848w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 1272w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tk2B!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png" width="1456" height="841" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:841,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Exhibit 1. Wafer-level burn-in moves reliability screening ahead of downstream value accumulation.&quot;,&quot;title&quot;:&quot;Exhibit 1. Wafer-level burn-in moves reliability screening ahead of downstream value accumulation.&quot;,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Exhibit 1. Wafer-level burn-in moves reliability screening ahead of downstream value accumulation." title="Exhibit 1. Wafer-level burn-in moves reliability screening ahead of downstream value accumulation." srcset="https://substackcdn.com/image/fetch/$s_!tk2B!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 424w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 848w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 1272w, https://substackcdn.com/image/fetch/$s_!tk2B!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1da2dad-7e92-4427-8153-84cd8b5f47aa_1800x1040.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><strong>Exhibit 1. Wafer-level burn-in moves reliability screening ahead of downstream value accumulation.</strong> <em>Source: Creative Strategies analysis.</em></figcaption></figure></div><h2>Test orders show where advanced silicon is entering production</h2><p>Recent earnings put numbers around this functional change for testing. Our blended measure of broad automated-test revenue grew roughly 35% to 45% in the latest full-year periods. More recent disclosures show compute-related test revenue and orders rising roughly 100% to 150% year over year. A separate test-cell utilization series moved from the mid-70% range to about 80%.</p><p>Wafer burn-in adds a specialized production indicator. Effective backlog at one supplier is roughly twice its recent annual revenue, supporting a forward revenue range of about 2.5 to 3 times that base. These figures measure different jobs and periods, so we treat them as independent markers of customers committing more factory time and equipment to advanced silicon.</p><p>Test equipment can reveal where a new chip architecture sits in the manufacturing cycle. An engineering system shows that a chipmaker has reached a new test problem. Qualification shows that the equipment can find a failure or performance limit the customer cares about. A production installation means the test has cleared the cost and throughput hurdle required to become part of manufacturing. Repeat orders show that the program is scaling or that the same test is spreading to more devices.</p><p>We highlight Aehr here because our conviction is it gives us a tangible view of that progression because its system configuration and order pattern reveal how customers are using wafer-level burn-in. Silicon carbide established the production case, while recent repeat capacity for AI processors and silicon photonics shows the process moving into additional high-value manufacturing flows. We apply the same framework across the broader test market to interpret functional-test, handling, optical-test, and reliability-equipment demand.</p><h2>Inside the full report</h2><ul><li><p>An original capacity model showing how more test steps, longer test times, and parallelism translate into equipment demand across the test market.</p></li><li><p>A manufacturing-flow map showing where test enters accelerators, HBM, advanced packaging, and optical I/O.</p></li><li><p>A wafer-burn-in sensitivity model that converts screening coverage and stress time into required production capacity.</p></li><li><p>An application map separating current production evidence from the next proof point across SiC, silicon photonics, GaN, silicon power, advanced packaging, and memory.</p></li><li><p>A value-capture map showing which suppliers participate in each test job, how the spending reaches them, and what evidence to track.</p></li><li><p>A monitoring ladder that follows new test processes from engineering and qualification through factory transfer, repeat capacity, and adoption across independent programs.<br><br><a href="https://www.thediligencestack.com/p/introducing-cs-atlas">Yesterday we introduced CS Atlas</a>, a new research platform from our firm <a href="https://creativestrategies.com/">Creative Strategies</a>, now available to all current subscribers. Use it alongside this report to go deeper into the work behind our view&#8212;from the signals across Aehr, Teradyne, Advantest and Cohu to the links between semiconductor test, advanced packaging, HBM, optical I/O and power semiconductors. <a href="https://atlas.creativestrategies.com/">Atlas</a> can help you compare suppliers, work through our capacity model and identify when a new test process is moving from engineering into production.</p><p></p><p>Some suggestion prompts for <a href="https://atlas.creativestrategies.com/">CS Atlas</a> on this subject:</p><ul><li><p>&#8220;Compare the demand signals provided by Aehr, Teradyne, Advantest, Cohu and FormFactor.&#8221;</p></li><li><p>&#8220;How do chiplets, HBM and advanced packaging increase test content per sellable AI system?&#8221;</p></li><li><p>&#8220;What milestones show that a test process has moved from engineering to qualification and production?&#8221;</p></li><li><p>&#8220;Where does wafer-level burn-in have the strongest technical and economic fit across SiC, GaN, silicon photonics, advanced packaging and memory?&#8221;</p></li><li><p>&#8220;How does optical I/O change the number and type of tests required during manufacturing?&#8221;</p></li><li><p>&#8220;Which assumptions have the greatest effect on required test capacity: units, test insertions, test time, parallelism or screening coverage?&#8221;</p></li></ul></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/the-gpu-tsunami-testing-testing">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Introducing CS Atlas]]></title><description><![CDATA[Creative Strategies research built to inform technology decisions]]></description><link>https://www.thediligencestack.com/p/introducing-cs-atlas</link><guid isPermaLink="false">https://www.thediligencestack.com/p/introducing-cs-atlas</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Mon, 31 Aug 2026 18:56:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!eYu7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>When we began publishing more of our research publicly and <a href="https://www.thediligencestack.com/p/introducing-the-dilligence-stack">introduced the Diligence Stack</a> in January, we were testing whether a wider group of technology executives and investors would value direct access to our work. The response gave us a reason to build a more complete research product around it.</p><h2>Research built to inform the decisions in front of you</h2><p>Today we are introducing the next step in that work. <a href="https://atlas.creativestrategies.com/">We are opening CS Atlas</a> to current subscribers as a soft launch included with every active subscription.</p><p>Atlas is a research environment built around the full body of work Creative Strategies produces, including research that extends deeper and wider than what we publish on Substack. Subscribers can ask Atlas a question and receive an answer grounded only in our research and analysis. Each response shows the Creative Strategies work behind the answer and provides direct access to the supporting reports, data, or models included with the subscription.</p><p>Atlas is designed for the work that follows reading. A subscriber can pressure-test a market assumption or examine how our view of a company has changed through several earnings cycles. The same research path can follow a technical change through the companies and markets it affects. This shortens the distance between a current question and an evidence-based judgment while preserving the research trail. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!eYu7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!eYu7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 424w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 848w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 1272w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!eYu7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png" width="1456" height="1431" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1431,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:552288,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/213410473?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!eYu7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 424w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 848w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 1272w, https://substackcdn.com/image/fetch/$s_!eYu7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc70ee718-a188-4b9c-ad4d-9cae4332fa27_2116x2080.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why Creative Strategies</h2><p>A research agent inherits the quality of the research behind it. That is where CS Atlas begins.</p><p>Creative Strategies has worked inside the technology industry since 1969. That history gives us a long record of how platform shifts develop and which patterns tend to repeat. It provides the foundation for how we map markets and evaluate the companies positioned within them. Our analysts combine that historical perspective and deep industry experience with direct exposure to the decisions shaping the industry today. Having worked through every major technology cycle since our founding, Creative Strategies is now relied on by many of the world&#8217;s leading technology companies for independent research and market insight.</p><p>Our analysts are in the rooms where companies explain product roadmaps and defend the assumptions behind them. We attend launches and analyst briefings, then spend time with management in smaller sessions. The work continues after the event as we track those claims through subsequent earnings cycles and test them against reported results and our broader technical and competitive analysis. Over time, this creates a record of how priorities shift and whether management&#8217;s confidence is supported by results. It also shows where a vendor has sustained an advantage. Atlas makes the publishable portion of that work searchable and source-linked, with the latest research and commentary carried into every answer.</p><p>That company-level work becomes more valuable when placed inside our broader view of the industry. Creative Strategies covers the technology stack from silicon through adoption. We can follow a change in semiconductor architecture through the systems that use it, into the software economics it reshapes, and out to how customers adopt it. Atlas connects those layers so subscribers can test what management says against the underlying technology and determine whether the economics support adoption. The coverage map below shows the research areas that feed that analysis.</p><p><strong>How subscribers can use the research in CS Atlas</strong></p><ul><li><p><strong>Earnings notes:</strong> Our earnings work focuses on what each quarter tells us about the core companies we cover. We compare reported results with our models, explain where our conviction changed or held, and identify the evidence we will watch through the next earnings cycle. We provide research rather than stock ratings or stock picks.</p></li><li><p><strong>Timely news analysis:</strong> When an announcement changes a company&#8217;s strategy or market opportunity, we place it inside our longer-running research and explain which assumptions should change.</p></li><li><p><strong>Key event takeaways:</strong> Our analysts attend product launches and briefings with company leadership. The coverage connects each announcement to the company&#8217;s technology roadmap and competitive position, then identifies the adoption evidence that should follow.</p></li><li><p><strong>Commentary from management meetings:</strong> When company leadership adds context we can publish, we explain how it changes our reading of the company and add that evidence to the Atlas research record. </p></li><li><p><strong>The Creative Strategies research archive:</strong> Atlas connects current questions to our accumulated company and market work. Subscribers can trace how our analysis developed over time and, where maintained models are included with their access, inspect the assumptions behind the answer.</p></li></ul><p>Every Atlas answer is grounded exclusively in Creative Strategies research and shows the supporting sources. Subscribers can see how the conclusion was formed and open the underlying work to continue the analysis from the evidence.</p><p>Atlas becomes more valuable as our research record grows. New reports add current evidence, while the accumulated archive makes it possible to compare today&#8217;s claims with what companies said and did in prior cycles. We will continue expanding those connections and the ways subscribers can work with them. </p><h2>How to start</h2><p>All subscribers with a currently active subscription can <a href="https://atlas.creativestrategies.com/">log in to CS Atlas here</a> using the email tied to their subscription. Start with a current question and follow the source links into the supporting research. The soft launch also gives subscribers access to our expanded fall event coverage as our analysts move through the industry calendar.</p><p>All current subscribers will remain grandfathered into the Landmark research tier at their existing price for as long as their subscription stays active. After the soft launch, Landmark will be priced at $500 per month or $5,000 per year. Technology vendors and institutional clients can also access Meridian, which includes expanded data and model dashboards, or Horizon, which includes our currently maintained core models and new models as they are released. Contact us to discuss those tiers or multi-seat institutional access. </p><p>We designed Atlas to make Creative Strategies research easier to use when a decision depends on understanding what changed and how the effects move across the technology stack. The supporting evidence remains attached to the judgment so subscribers can inspect the reasoning and continue the work. </p><p><a href="https://atlas.creativestrategies.com/">Access CS Atlas</a></p><p>We appreciate your interest in our research. </p><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.thediligencestack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.thediligencestack.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[AI’s Inference Era of Ferment]]></title><description><![CDATA[The Diligence Stack delivers analyst-grade intelligence on the full-stack, connecting semiconductors, infrastructure, platforms, software, and adoption to show how technical change reshapes markets and business models.]]></description><link>https://www.thediligencestack.com/p/ais-inference-era-of-ferment</link><guid isPermaLink="false">https://www.thediligencestack.com/p/ais-inference-era-of-ferment</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 27 Aug 2026 18:56:47 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/0fb83b32-1763-4b32-9140-79852434d3f9_1200x630.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Our hottest take from Hot Chips 2026 is that we may be in one of the semiconductor industry&#8217;s most inventive periods in decades, if not ever. Every presenter treated inference at scale as the common engineering problem: the system has to produce more useful tokens at a speed and cost customers will accept. The disagreement began with what keeps the system from doing that. One vendor sees memory bandwidth or capacity as the limit. Another focuses on how far data has to move, while others want to change the processor or use software to place work more carefully. Solving one constraint moves cost or complexity somewhere else, which is why the companies arrived at such different designs. That range of technical bets is why we believe inference has entered an era of ferment.</p><h2>Why This Looks Like an Era of Ferment</h2><p>In their seminal 1990 paper, <em><a href="https://www.edegan.com/pdfs/Anderson%20Tushman%20%281990%29%20-%20Technological%20Discontinuities%20and%20Dominant%20Designs.pdf">Technological Discontinuities and Dominant Designs: A Cyclical Model of Technological Change</a></em>, management scholars Philip Anderson and Michael Tushman formalized the idea of an &#8220;era of ferment.&#8221; They used the term for the period after a major technical break, when an industry tests competing approaches before one becomes the common architecture. <strong>Their research found that the design that wins often, though not necessarily, trails the technical frontier because adoption also depends on cost, manufacturing scale, software support and ease of use.</strong> (<a href="https://www.edegan.com/pdfs/Anderson%20Tushman%20%281990%29%20-%20Technological%20Discontinuities%20and%20Dominant%20Designs.pdf">Anderson and Tushman, 1990</a>)</p><p>Hot Chips gave us the clearest evidence yet for applying that framework to inference. NVIDIA has already set the merchant standard for training. Inference is producing a much wider range of technical bets, allowing for some competitive pressure, because vendors disagree about where data should live and which processor should handle each part of a request. Those choices change how much work software must carry. More specialized hardware can improve speed or cost, although the gain has to justify the added work. We highlight a few examples below before examining each bet in the full report.</p><h2>Memory Is Becoming Part of Compute Design</h2><p>Memory gave us some of the clearest examples of these different views. Micron and SK hynix are extending standard HBM through taller stacks and better bonding. Samsung is turning the HBM base die into a control point, a move we believe will become table stakes for next-generation HBM, and eventually wants to place DRAM over logic with zHBM. d-Matrix bonds custom DRAM under its accelerator. OXMIQ&#8217;s HBF uses flash as a cheaper home for model state that stays cold, while XCENA and Samsung use CXL memory to hold older KV pages and reduce them before sending a result back to the GPU. HBM supports a broad range of workloads at higher package cost. HBF and CXL ask software to identify state that can sit farther away, while d-Matrix accepts a smaller local memory pool to keep the useful data close.</p><h2>Ethernet Still Provides the Common Network Base</h2><p>The networking talks showed more agreement at one layer. Ethernet is becoming the common protocol for scale-out networks. Copper remains practical over the shortest links, while optics&#8212;<a href="https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the">and the variety of approaches showing up</a>&#8212; takes over as distance and speed increase. The scale-up fabric connecting accelerators into one tightly coupled system remains less settled. Broadcom provides merchant NICs and gives customers more choice over cables and optics. NVIDIA controls the DPU, switch and software, and is bringing optics into the switch. Microsoft changes how work moves over Ethernet through software. Google uses optical circuit switching to shape the network around the workload. These systems share a protocol while putting the physical links and traffic control in different places.</p><h2>Accelerators Carry the Widest Disagreement</h2><p>Accelerators showed the widest range of views. We saw it in the public presentations and in meetings with six private AI accelerator companies, where each team had a firm view of why its architecture maps better to inference. The public presentations gave us several examples of how those views lead to very different hardware.</p><p>Google has landed on an ASIC roadmap that separates TPU designs for training and inference, while Meta is building one MTIA platform for recommendation and generative AI. Microsoft uses software to place data explicitly across Maia. OpenAI keeps KV state local and changes the active compute mix inside Jalape&#241;o as a request moves through its phases. NVIDIA is bringing GPU throughput and Groq&#8217;s low-latency LPU into one platform. SambaNova maps the model into a persistent dataflow system, while Cerebras makes the wafer the compute unit. Each architecture also carries a forecast about how models will behave years from now. A design built around sparse access, local KV state or deterministic execution keeps its advantage only while that workload assumption holds.</p><h2>NVIDIA Is Closest to the Merchant Standard</h2><p>Our conviction is that the dominant design will form at the system level because useful inference depends on software coordinating compute and memory to produce the required output at an acceptable speed and cost. As specialized processors are added, that coordination becomes part of the architecture itself. The system has to make different processors and memory designs work as one pool of capacity, which pushes vendors toward deeper co-design around the workload.</p><p><a href="https://www.nvidia.com/en-us/networking/">NVIDIA</a> is the clearest current example of that thesis. It has the most complete in-house control of the merchant AI system, from accelerators and CPUs through networking and fleet software. CUDA ties those parts together. Bringing Groq&#8217;s deterministic LPU alongside the GPU shows how NVIDIA can add a specialized inference engine without asking customers to operate a second system.</p><p>AMD&#8217;s <a href="https://www.amd.com/en/products/rackscale-solutions/helios.html">Helios</a> follows the same direction through an open reference design that partners turn into products. <a href="https://docs.cloud.google.com/ai-hypercomputer/docs/overview">Google</a> and <a href="https://aws.amazon.com/ai/machine-learning/trainium/">Amazon</a> already integrate custom chips with their cloud infrastructure around workloads they control. Hyperscalers have enough internal demand to support those systems, while NVIDIA is building for customers that need to buy the full stack. That gives NVIDIA the clearest path to becoming the broadly used standard outside the largest clouds.</p><h2>How We Will Know the Market Is Settling</h2><p>This period could last longer than earlier hardware shifts because AI models can change several times during one chip-development cycle, while inference includes workloads with very different speed and memory needs. A design that fits today&#8217;s models may lose its advantage before the next chip reaches volume. Specialized hardware only improves the economics when its performance gain exceeds the added software work and operating cost. If we use the era of ferment framework we would expect this part of the cycle to end when competition among rival designs produces a dominant design, after which the industry shifts toward incremental improvement around that common architecture. We detail in the full report why some nuance and variations will still exist but it will not be nearly as diverse as we see in the market today. </p><p>What intrigues us about this moment is what that long testing period could produce. And a follow on question to who ultimately benefits the most in longevity of uncertainty in models and inference architecture standards. Several 800-pound gorillas already control much of the market, yet the range of architectures gives the industry a way to test very different answers against real workloads. Some will fall short once their software and operating costs are included. Others could create a larger opening for a smaller company or become part of an incumbent&#8217;s broader roadmap. In the rest of this report, we examine the technical bets from vendors large and small that stood out at Hot Chips 2026, along with the workload assumptions that have to hold for each one to work.</p><h3>Paid subscribers get the full technical breakdown</h3><ul><li><p>How HBM scaling, Samsung zHBM, d-Matrix 3D DRAM, HBF and CXL processing near memory each relocate the memory bottleneck, including the workload behavior required for their economics to hold</p></li><li><p>The architecture choices that remain open above Ethernet, including the handoff from copper to optics and the division of fabric control between hardware and software</p></li><li><p>The model and software forecasts embedded in Google TPU8, Meta MTIA, Microsoft Maia, OpenAI Jalape&#241;o, NVIDIA/Groq, SambaNova and Cerebras, along with the assumptions that would strengthen or weaken each technical bet</p></li><li><p>Why NVIDIA is currently closest to the merchant dominant design and how hyperscalers or specialized accelerators could still sustain alternative systems</p></li><li><p>Three original Creative Strategies exhibits mapping each architecture&#8217;s technical bet, required workload behavior, main constraint and the proof points needed to separate benchmark gains from durable inference economics</p></li></ul><p></p><h2></h2>
      <p>
          <a href="https://www.thediligencestack.com/p/ais-inference-era-of-ferment">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[State of Enterprise AI: What Has Changed Since the E/AI Index]]></title><description><![CDATA[The second-half CIO/CTO work follows enterprise AI from approved budgets into production and shows what is holding back wider deployment.]]></description><link>https://www.thediligencestack.com/p/state-of-enterprise-ai-what-has-changed</link><guid isPermaLink="false">https://www.thediligencestack.com/p/state-of-enterprise-ai-what-has-changed</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 25 Aug 2026 16:52:38 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!iAlf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Our firm has studied every major technology adoption cycle over the past several decades. A foundational part of that research has been understanding the customer who gives the earliest and most informative signals of a technology&#8217;s value, the pain points it solves, and the opportunities that begin to form. As much as we research AI through infrastructure trends, technological innovation across hardware, and the models themselves, we keep coming back to the customer required for this entire AI buildout to be successful and sustainable: the enterprise.</p><p>For those of us who have seen many different technology adoption cycles, the patterns that make the AI buildout still look like an immature market are familiar. Some parts of the market begin to show consistency, while the technology, standards, processes, or protocols remain far from settled. This is particularly true in early enterprise adoption. Even among the businesses moving most aggressively, more questions than answers remain. This report updates our E/AI Index CIO/CTO survey through our most recent channel checks across the areas that report highlighted as open questions, along with our most up-to-date observations from recent enterprise AI fieldwork conversations with decision makers on AI deployment.</p><h3>The May E/AI Index showed where budgets were forming. This update follows them into production</h3><p>That customer work formed the basis of our May <a href="https://www.thediligencestack.com/p/the-eai-index-budget-architecture">E/AI Index CIO/CTO report</a>. Our survey across a cohort of CIO/CTOs showed that AI had become a staple of enterprise IT budgeting. The survey revealed the clearest ROI was showing up in what we articulated as bounded workflows. These are repeated tasks with a clear result and an existing baseline, which lets the company compare cost and quality before and after AI. Agent deployment was also running well ahead of broad production and still is today. Budget formation is also a key metric we are tracking, as we want to continue to see AI become budget additive vs. take away from other areas scoped dollars.</p><p><strong>The main change since the May E/AI Index is the move into what we would call governed production. </strong>This is the point where an AI workflow leaves the relative safety of a pilot and starts operating inside the business under defined rules. Companies are now learning whether the value they saw in a controlled test holds when the workflow reaches more employees and touches more company systems. That wider use is exposing the upgrades required across the technology stack and internal processes before AI can move into more of the enterprise.</p><p>Governed production also gives management a much clearer view of the cost and risk attached to each workflow. Usage begins to shape which model is worth paying for, while company data has to reach the agent in a form it can use without losing the access rules around that information. The authority given to the agent then determines how much of the workflow it can complete on its own. Our fieldwork suggests this is where most enterprises sit today: the workflow is live, while companies are still building the cost controls and governance required to expand it safely.</p><h3>Governed production is happening workflow by workflow</h3><p>The same company can be at very different stages of adoption depending on the work being done. Coding may already be running at scale because the work is measurable and review is built into the process. A finance agent may remain under tight human control because an error can reach a system of record or affect an important business decision. This is why we look at enterprise adoption at the workflow level. Both the risk and the economics change with the work, and those conditions determine how much authority the company is willing to give the agent.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!iAlf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iAlf!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 424w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 848w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 1272w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!iAlf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png" width="1456" height="841" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:841,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:169931,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/212305786?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!iAlf!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 424w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 848w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 1272w, https://substackcdn.com/image/fetch/$s_!iAlf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3e4a23d-3e06-4456-914a-10e74c39c70a_1800x1040.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Exhibit 1. Enterprise AI has reached governed production, while scaled operating change remains early. Note: Qualitative Creative Strategies adoption-cycle synthesis. Stages describe operating maturity; the exhibit does not estimate a pooled survey distribution. Source: Creative Strategies analysis of enterprise CIO conversations and field checks through August 2026.</em></p><p>Our checks show that the companies furthest along are beginning to put a clear operating structure around each production workflow. A named owner sets the permission rules and determines how problems are escalated, which is what moves the workflow into governed production. The next proof point is whether the economics continue to hold as more employees use the workflow and the system completes a larger share of the work. Few companies have reached the point where AI-created capacity changes how jobs are designed or which software and outside services they continue to pay for. Those decisions would be stronger evidence that AI is beginning to change how the company operates and spends.</p><h3>Companies are now managing the cost of production use</h3><p>Our second-half checks also show that production is forcing CIOs to measure what it costs to complete a workflow. IT decision makers are counting model calls and asking where a premium frontier model creates enough economic benefit to justify the token cost. Our favorite quote is, &#8220;You don&#8217;t need to pay frontier model costs to summarize a Teams meeting.&#8221; Other areas may have clear value, such as coding and customer service, which have moved faster because the work already has a measurable baseline. Workflows without one will face more scrutiny, increasing demand for systems that route each request to the right model.</p><p>The economics also depend on whether the agent can reach the right company information while work is happening. Most enterprise data was organized for storage or later reporting. A production agent needs current context inside the workflow and has to preserve the access rules attached to it. Our checks keep coming back to this as one of the clearest ways production is exposing how much work remains across enterprise data systems. We detail that coming storage challenge in the report below.</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;dee818a4-ccac-454f-bc37-c6969b0bcb5c&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The Agentic AI Storage Shock&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-05-21T15:27:52.131Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!dEqI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66aeade-08be-401e-a4f4-e4b8da29998d_1800x1050.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-agentic-ai-storage-shock&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:198594825,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:22,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:true,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>Data sovereignty is also shaping model choice. Most workloads still run through closed frontier models in the cloud because they produce the best results on difficult work. Open-weight models are entering through cost-sensitive workflows, although interest still runs ahead of production use. Enterprises want to keep company context and workflow records under their control so they can change models without rebuilding the process. A credible open option gives them more choice when closed-model costs rise. We think that cloud-led pattern also creates a premium inference tier (good for Cerebras and NVIDIA Groq), particularly in workflows where lower latency increases completed work enough to justify paying for faster tokens on top of frontier-model pricing.</p><p>CIOs and CISOs are tightening control over who can create an agent and how much authority it receives. Companies still rely on human review across most production workflows because the controls around agent actions remain incomplete. Wider deployment now depends on whether companies can hold quality while improving the cost per completed task. Human review also has to grow more slowly than the amount of work the system completes.</p><h3>Inside the Full Update</h3><ul><li><p>Why governed production now best describes enterprise AI adoption and what changed once approved budgets reached live workflows</p></li><li><p>Where companies sit in the five-stage adoption cycle and what still separates production from scale</p></li><li><p>How CIOs are measuring the full cost of completing a workflow instead of relying on seats or token growth</p></li><li><p>Why control of company context gives enterprises more flexibility across closed and open-weight models</p></li><li><p>How permission rules and auditability determine the authority companies are willing to give an agent</p></li><li><p>Why cloud-led deployment can create a premium inference tier even as some workloads move back on premises</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/state-of-enterprise-ai-what-has-changed">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[State of Models, August 2026: What the Major Models Do Well and What They Cost]]></title><description><![CDATA[Our assessment based on daily use and CS Bench testing.]]></description><link>https://www.thediligencestack.com/p/state-of-models-august-2026-what</link><guid isPermaLink="false">https://www.thediligencestack.com/p/state-of-models-august-2026-what</guid><dc:creator><![CDATA[Max Weinbach]]></dc:creator><pubDate>Fri, 21 Aug 2026 17:29:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!C4KT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Editor&#8217;s note: This report is based on our daily use of the models and the testing behind CS Bench. We identify which findings come from the benchmark and which reflect our judgment. The rankings are current as of August 2026.</em></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!C4KT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!C4KT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 424w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 848w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 1272w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!C4KT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png" width="1456" height="824" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:824,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;exhibit-01-model-taxonomy.png&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="exhibit-01-model-taxonomy.png" title="exhibit-01-model-taxonomy.png" srcset="https://substackcdn.com/image/fetch/$s_!C4KT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 424w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 848w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 1272w, https://substackcdn.com/image/fetch/$s_!C4KT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fffc380f8-4748-4948-8f4a-291654dd059a_2480x1404.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Exhibit 1 groups the models into five classes based on the work they can complete reliably inside an agent system.</em></p><p>The Diligence Stack has covered the AI market broadly. This is our first full assessment of the models themselves. Something we will keep updating at different points in time. From talking with large enterprises, we believe we are going through the same exercise as it relates to both models that are acceptable for a wide range of knowledge work use cases and costs associated and tokens used.  We share our learnings from this exercise and the key takeaways relevant to compute infra and model economics. </p><p>We built <a href="https://csbench.com/benchmarks/diligence-stack-agent#score">CS Bench</a> to compare models inside our knowledge base agent that is the basis of our research for the Diligence Stack. The published benchmark measures the quality and estimated cost of first-draft of a financial analysis which is the anchor use case we test. We also use the models every day for research, software work, and the production of finished files. This report uses all tasks tested as its base for analyzing each model.</p><p>From a model evaluation standpoint, buyers pay model providers by the token and judge the result by the completed work. A low token price does not help if the output has to be checked for an hour or rebuilt. We include that review time when we compare model cost.</p><p>Financial modeling shows the problems more often than other workflows. The most common failure is a workbook that looks finished before its logic has been checked. It may have several tabs and a working scenario switch. The formatting looks credible on a first review. A deeper check then finds revenue pulled from the wrong fiscal period or driver rows hard-coded as values made to look like formulas. Finding those errors can take an hour or more.</p><p>We therefore score the work and the presentation separately. Correct work with poor formatting creates cleanup. Work with obvious errors is usually rejected quickly. The costly case is a polished file with errors buried inside it because the presentation makes the work look ready to use.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!MuLB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!MuLB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 424w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 848w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!MuLB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png" width="1456" height="889" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:889,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;exhibit-02-quality-grid.png&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="exhibit-02-quality-grid.png" title="exhibit-02-quality-grid.png" srcset="https://substackcdn.com/image/fetch/$s_!MuLB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 424w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 848w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!MuLB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96799942-be7a-45f6-b4d1-883beb2603f9_2293x1400.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Exhibit 2 shows the difference. CS Bench measures the first draft before an expert takes over. We are now adding the time needed to review that work, the errors that repeat, and the time needed to find them. Those checks give us a better estimate of the cost of usable work.</em></p><p>Parameter count says little about whether a model will finish the job. We focus on whether it understands an incomplete task, uses tools until the work is done, and recovers when its first approach fails. The software around the model also affects the result. Retrieval, file handling, and execution can make the same model much more or less reliable. Buyers are paying for that full system.</p><p>Public API rates describe only one way buyers pay. Small teams often use fixed-price subscriptions. Enterprises negotiate lower rates in exchange for spending commitments that they may not fully use. The real cost includes the model, retries, and human review. A low token price can still lead to a high cost for completed work.</p><p>For investors, the amount of review is one way to see which models still earn a premium as token prices fall. Smaller models can handle large volumes of clearly defined work. Larger models remain better suited to work that requires more judgment. Software companies can also earn a share of the value when their products make the models more reliable. The market will support several classes of models because the work and the cost of failure vary widely.</p><h2>Inside the Full Report</h2><ul><li><p>How we group the models and our assessment of each class.</p></li><li><p>Our scorecard for work quality, presentation, tool use, instruction retention, judgment, and cost.</p></li><li><p>Workload-level recommendations for research, software engineering, financial modeling, and everyday assistant use.</p></li><li><p>How subscriptions, enterprise contracts, usage, and review change the cost of completed work.</p></li><li><p>Why switching models during a long conversation can raise the total cost.</p></li><li><p>The evidence that would change our rankings and what CS Bench will test next.</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/state-of-models-august-2026-what">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Optics Won’t Scale as Fast as the Market Expects]]></title><description><![CDATA[Why qualified output will set the attach curve for AI compute]]></description><link>https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the</link><guid isPermaLink="false">https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 18 Aug 2026 16:27:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!P6hE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>This report draws on Creative Strategies&#8217; proprietary models, company intelligence, forecasts, and research corpus. Atlas stores the supporting evidence and tracks changes to our view over time.</em></p><div><hr></div><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;a1b8d23b-ef80-429b-8464-8ac96e7337dd&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Copper to Fiber: The Connectivity Inflection in AI Infrastructure &quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-03-03T16:09:01.705Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!1Cp1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F95465f35-6f00-4ad9-872d-fe7d5a5650c4_1372x940.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/copper-to-fiber-the-connectivity&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:189659693,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:12,&quot;comment_count&quot;:1,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p><em>In March we published our full primer on the transition from copper to fiber.  We were clear then, that this transition takes time and NPO would be a primary driver before CPO with LPO/pluggables still the most mature segment and not going away any time soon. Today&#8217;s report goes deeper on the manufacturing challenges that will continue to more accurately inform the timeline of adoption of higher optical content per rack specific to NPO and CPO. </em></p><p>We have spent the last few weeks catching up with friendlies across the optical supply chain. The move toward NPO, CPO, and optical I/O still feels like the Wild West. Architectures remain unsettled, and each vendor still requires highly specialized co-design work. That lack of standardization is the clearest sign of an immature manufacturing ecosystem and makes timing and likely winners much harder to predict.</p><p>One constant thread has persisted through every conversation. Manufacturing will set the pace of optical attach through at least 2028, and potentially longer. Network architecture and compute roadmaps already point to more optics per unit of compute. The industry will try to adopt these architectures faster than suppliers can produce qualified systems, so qualified output anchors our timing and exposes forecasts that convert demand directly into shipments.</p><p>Absent a major manufacturing breakthrough, the constraint should move through the supply chain in a clear sequence. New InP capacity raises the upstream ceiling first. As good laser die increases, precision packaging becomes the next manufacturing challenge. Most AI racks already contain optical links, so optical presence tells us little about increased adoption. We track how much connectivity per deployed rack moves beyond pluggable modules into NPO or CPO. Pluggables remain the more mature, lower-risk path and may persist longer than many want to admit. <strong>NPO and CPO can lower power per bit and raise bandwidth density, though their system-cost advantage, and reliability, still has to be proven at scale.</strong></p><p>Our model first estimates the incremental NPO and CPO links supported by 2028 network demand. Manufacturing constraints allow about 60% of those links to ship in our base case. This means, for every 100 incremental NPO/CPO links the architecture could support, roughly 60 are realized in 2028. The balance remains on pluggables or moves into later years. We see the larger conversion step in 2029, after new laser capacity has had time to qualify and package output becomes repeatable.</p><h2>Capacity arrives before qualified output</h2><p>Our work across public disclosures and supply-chain conversations kept turning up the same gap between installed capacity and usable supply. Capacity announcements usually measure wafer starts or installed equipment. Customers, however, buy qualified optical products. Performance depends on maintaining a low-loss light path across materials that expand differently as temperature changes and the package ages. The substrate has to meet the laser maker&#8217;s specification before the device fab can produce good die at repeatable yield. Those die still have to survive packaging and system qualification. Each stage runs on its own timeline, so finished output can remain constrained as physical capacity rises.</p><p>The move to 6-inch InP wafers is one attempt to raise the upstream supply ceiling. Larger wafers can produce more die per run once yields settle. Crystal uniformity, process transfer, and customer qualification take time, so we treat 6-inch capacity as the start of the supply ramp. Finished supply comes later.</p><p>Coherent has started 6-inch production. Lumentum&#8217;s Greensboro facility is scheduled to begin ramping in mid-2028, leaving limited time for qualified shipments that year. We treat 2029 as the first year these additions can support broader attach and will update that assumption as shipment evidence improves.</p><h2>Packaging becomes the next challenge</h2><p>More substrate and good laser die can move the manufacturing challenge downstream into packaging without producing the same increase in finished units. Lasers must be aligned to a lens or waveguide with very little loss. Some optical assembly flows still rely on <strong>manual or operator-assisted steps</strong>, particularly where package designs remain custom. Higher-volume lines can automate active alignment, though automation does not remove the cycle time. Precision equipment still has to measure optical power, move the component into position, and fix it in place for every package. More good die can therefore expose a packaging bottleneck instead of translating directly into finished units.</p><p>Manufacturers test again after assembly because bonding and thermal stress can shift the optical path. If the completed package fails, the working components inside it may become unsellable or require costly rework. NPO and CPO concentrate more component value in each assembly, making finished-package yield the better measure of usable optical supply.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!P6hE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!P6hE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 424w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 848w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!P6hE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png" width="1456" height="910" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:910,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:204029,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/211118436?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!P6hE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 424w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 848w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 1272w, https://substackcdn.com/image/fetch/$s_!P6hE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa737f7b-ea26-474e-8ccb-e49e0cecc1c4_1600x1000.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Optical attach also moves at different speeds across the network hierarchy. Scale-across already requires optics, while scale-out uses pluggables as the volume base today. The larger incremental content opportunity sits in scale-up as optics moves closer to the accelerator. Our base case moves <strong>inter-rack</strong> links first because bandwidth is concentrated into fewer optical connections at the rack boundary. Broad <strong>intra-rack</strong> adoption comes later because it spreads optics across many more endpoints, multiplying the package output that must reach repeatable yield and making failures harder to service inside the rack.</p><p>Public disclosures point to early <strong>inter-rack</strong> CPO activity in 2027 and new laser capacity beginning to ramp in mid-2028. We use those milestones as timing anchors. Our model concentrates incremental NPO/CPO attach in lead <strong>inter-rack</strong> scale-up systems through 2028. Broader <strong>intra-rack</strong> attach comes later, after package output becomes repeatable and the manufacturing ecosystem matures.</p><h2>Inside the full report</h2><ul><li><p>A low, base, and high scenario for how quickly NPO and CPO can grow as a share of modeled AI compute-fabric links.</p></li><li><p>A year-by-year map of the primary manufacturing constraint limiting qualified output.</p></li><li><p>A pluggable-persistence sensitivity showing how the 2030 mix changes even if manufacturing improves.</p></li><li><p>Why a laser fab starting in mid-2028 has limited impact until 2029.</p></li><li><p>A public market map showing who controls each step of the optical transition, including the operating proof required at each layer.</p></li><li><p>The manufacturing and rack-level proof that would cause us to raise or lower the attach curve.</p></li><li><p>Company read-throughs for AXT, Broadcom, Coherent, Lumentum, and AAOI, tied to the manufacturing step each controls.</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/optics-wont-scale-as-fast-as-the">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[GPU Tsunami and FPGAs: AI Compute Programmable Fabric]]></title><description><![CDATA[Why the control plane around AI compute may be a larger market than merchant FPGA units suggest]]></description><link>https://www.thediligencestack.com/p/gpu-tsunami-and-fpgas-ai-compute</link><guid isPermaLink="false">https://www.thediligencestack.com/p/gpu-tsunami-and-fpgas-ai-compute</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 13 Aug 2026 20:38:12 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!L4XU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><strong>Powered by CS Atlas</strong><br>This research draws on our proprietary industry models, company intelligence, benchmarks, forecasts, and research corpus within <a href="https://atlas.creativestrategies.com/">CS Atlas</a>.</em></p><div><hr></div><p>One of our favorite things to do at vendor events or broader trade shows is get up close and personal with compute trays and inspect the semiconductor content and adjacencies that show up across different boards. We know this labels us as geeks. We prefer technologists at heart, and we are ok with either label. There is much to learn in this process. Tracking whose names show up, how much content is present, and which functions are being added can signal trends we are watching for. This exercise led us to our report on <a href="https://www.thediligencestack.com/p/gpu-tsunami-beneficiaries-power-semis">power semis</a>, and now to a vastly misunderstood and perhaps under appreciated bit of silicon called FPGAs.</p><p>We have followed Lattice Semiconductor for some time, spoken with management regularly, and attended numerous customer and developer events. The company had been outlining a datacenter opportunity, and the story was plausible yet unproven. Then we started seeing Lattice on AI accelerator boards, networking boards, and AI CPU boards. You get the point. Lattice has talked about FPGA ratios growing to multiples on compute boards, and observationally we can see it happening. The interesting part is why, and what increasing programmable content tells us about AI infrastructure design.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hR8a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hR8a!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 424w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 848w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 1272w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hR8a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png" width="398" height="404" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/527204e9-3e97-4b9a-b900-8531814492ba_398x404.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:404,&quot;width&quot;:398,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:463412,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/210943020?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!hR8a!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 424w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 848w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 1272w, https://substackcdn.com/image/fetch/$s_!hR8a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F527204e9-3e97-4b9a-b900-8531814492ba_398x404.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>The rack has become one brain</h3><p>We think this is well known and obvious, but modern day AI compute requires rack-scale architecture. The full AI compute rack system connects through a common fabric and functions as one brain.</p><p>As rack density increases, control work rises around the main processors and lets them focus on their core job. More variables have to be managed, monitored, or secured, which increases semiconductor attach per rack. The GPU tsunami is also pulling more FPGAs into the AI rack system.</p><p>All compute boards have a BMC (baseboard management controller) which is a dedicated processor that monitors and manages a server independently of the main CPU and operating system. While crucial, its I/O is fixed. A more complex board creates signals and interfaces the BMC may not cover cleanly. A small FPGA can sit beside it as a companion and handle a wider range of work. The BMC relationship with an FPGA is why we so often see an ASPEED processor (BMC) in close proximity to a Lattice FPGA.</p><p>We have spent time in years past trying to explain why FPGAs are so valuable. Engineers understand the value proposition. The broader market has a harder time seeing it because an FPGA looks like a blank slate to a degree. We think it is helpful to frame FPGAs as silicon that enables flexible specialization. Its programmable fabric becomes specific in its job once the customer designs it into a board. That flexibility has real value as AI infrastructure becomes more customized.</p><p>Understanding the rack as a compute system requires viewing it as planes in which silicon has specific roles. Accelerators and CPUs form the compute plane. Networking provides the fabric that lets the rack operate as one system. Power and cooling keep it within operating limits. The control plane sits across all of it, sequencing power, configuring boards and interfaces, monitoring system state, enforcing security policy, and isolating failures.</p><p>As AI infrastructure becomes more purpose-built, that control work becomes specific to each system. Programmable fabric makes those design variations practical while the architecture is still changing. The deeper this co-design goes, the stronger the need for flexible specialization.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!L4XU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!L4XU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 424w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 848w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 1272w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!L4XU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Exhibit 1: The Four Planes of the AI Factory&quot;,&quot;title&quot;:&quot;Exhibit 1: The Four Planes of the AI Factory&quot;,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Exhibit 1: The Four Planes of the AI Factory" title="Exhibit 1: The Four Planes of the AI Factory" srcset="https://substackcdn.com/image/fetch/$s_!L4XU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 424w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 848w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 1272w, https://substackcdn.com/image/fetch/$s_!L4XU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe5ba4cc-a314-432b-a220-609ebe7c8b0d_1600x900.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Exhibit 1: The Four Planes of the AI Factory</figcaption></figure></div><p><em>Source: Creative Strategies analysis of public rack documentation, OCP specifications, company technical materials, and primary research.</em></p><h3>Counting packages misses the point</h3><p>That creates a value-capture problem. FPGA units and ASPs measure how much standalone silicon was sold, while our thesis follows programmable control content across the rack. Today, both are rising as more boards and control work increase FPGA attach. Some functions could eventually move inside combined devices, which would leave a chip count missing programmable content and the firmware that makes it reliable. We have not seen evidence that integration is reducing attach, so we treat it as a downside risk rather than the base case.</p><p>We created Programmable Infrastructure Content, or PIC, to measure programmable control wherever it sits. The model counts each function once and includes firmware only where a supplier can charge for it. PIC per rack, megawatt, or gigawatt lets us compare deployments of different sizes without losing the system-level view.</p><p>Our view today is that AI infrastructure is creating more places for programmable logic across the board and rack. Liquid cooling, 800 VDC, and more optical content should add new control work. Faster product cycles and greater customization favor a device that can solve a specific control problem without forcing a larger system redesign. The board-level evidence is still developing, which is why the full report builds the case from the architecture up and tests how far FPGA content can rise.</p><h3>Inside the Full Report</h3><ul><li><p>The PIC model from individual control domains through rack, megawatt, and gigawatt values</p></li><li><p>A disaggregation sensitivity that tests new board boundaries against BMC, SMC, and eFPGA consolidation</p></li><li><p>Lattice&#8217;s verified server attach history and the mechanism behind the increase</p></li><li><p>A use-case map showing how flexible logic becomes specialized control on each board</p></li><li><p>A TCO bridge from faster design cycles and lower board-support burden to rack manageability</p></li><li><p>A four-layer software map separating design tools from board firmware and rack orchestration</p></li><li><p>A role-based market map covering established FPGA leaders, specialist challengers, Chinese suppliers, and fixed-function substitutes</p></li><li><p>A downside and monitoring framework with thresholds that can confirm or break the thesis</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/gpu-tsunami-and-fpgas-ai-compute">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Changelog Q2.26]]></title><description><![CDATA[What changed in our technology theses, models, and conviction over the last six months]]></description><link>https://www.thediligencestack.com/p/the-changelog-q226</link><guid isPermaLink="false">https://www.thediligencestack.com/p/the-changelog-q226</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 11 Aug 2026 16:37:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!HIUU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>One of our favorite questions from investors and enterprise clients is, &#8220;What, if anything, in your view has changed recently?&#8221; We think this question requires a lot of intellectual honesty and is a great lens to continue to challenge all our assumptions. Like prior cycles we have studied, a lot has changed and continues to change quickly in this industry. Something we believed strongly earlier in the year may no longer carry the same conviction. Other views held, and in some cases our conviction increased.</p><p>We are introducing a new feature called The Changelog. For the time being, we will update it quarterly because this industry changes enough over three months to justify a formal review. It will cover our core theses and the companies we track. It will also cover the micro and macro trends shaping our work. We will explain what changed and why, then identify new theses or areas where our conviction increased.</p><p>This regular review will help keep us honest and make industry changes easier to follow. Our research covers the full technology stack, so The Changelog will also give readers a consistent set of mental models they can use across our work.</p><h3>What this first review found</h3><p>This first edition covers six months of published research across our broad technology industry coverage. Our conviction in the broader AI thesis remains high and increased in several areas as we studied enterprise customers, their early deployments, and what they learned. We also maintain that demand for compute, and the supply chain around it, will exceed supply for the foreseeable future. At the same time, new evidence changed several views under the broader trend and produced eight new theses.</p><p>The broad AI demand thesis held across the six months. The evidence changed several views underneath it. Inference raised our conviction in agentic CPU demand, bringing along revived winners as a part of it, and the tension building across memory and networking. Our enterprise work increased our confidence that current adopters are seeing enough ROI to keep spending. Security also emerged as a new thesis as companies focused more on protecting their data and controlling what agents can access.</p><p>The thesis map below gives a high-level view of how each thesis moved during the period. Raised conviction means the evidence strengthened an existing thesis, while hold means our view remains intact at roughly the same level of conviction. Changed means the evidence altered the thesis or how we measure it. New means the thesis first emerged during this period, so we start with lower confidence and test it again in future editions.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HIUU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HIUU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 424w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 848w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 1272w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HIUU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png" width="1456" height="1229" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1229,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Exhibit 1. Where Our Views Changed&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Exhibit 1. Where Our Views Changed" title="Exhibit 1. Where Our Views Changed" srcset="https://substackcdn.com/image/fetch/$s_!HIUU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 424w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 848w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 1272w, https://substackcdn.com/image/fetch/$s_!HIUU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fded25e0a-7d08-4990-b4c8-0139a7798634_1600x1350.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Inside the full report</h2><ul><li><p>The full raised conviction, hold, changed, and new thesis ledger.</p></li><li><p>Why inference turned the merchant-versus-custom accelerator market into a TCO competition and raised our CPU forecast.</p></li><li><p>Eight new theses, with the first report, current confidence, and evidence still needed.</p></li><li><p>How chiplets deepened the advanced-packaging constraint and made Intel&#8217;s opportunity clearer.</p></li><li><p>What enterprise ROI, token budgets, and security requirements now tell us about adoption.</p></li><li><p>Why bitcoin miners may become better capacity partners for hyperscalers than pure AI neoclouds.</p></li><li><p>A next-quarter monitoring table showing what would strengthen or weaken each view.</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/the-changelog-q226">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Breaking the Memory Wall With CXL]]></title><description><![CDATA[Why disaggregated memory is moving closer to commercial deployment and who benefits]]></description><link>https://www.thediligencestack.com/p/breaking-the-memory-wall-with-cxl</link><guid isPermaLink="false">https://www.thediligencestack.com/p/breaking-the-memory-wall-with-cxl</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 06 Aug 2026 15:22:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!-SOo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><strong>Powered by CS Atlas</strong><br>This research draws on our proprietary industry models, company intelligence, benchmarks, forecasts, and research corpus within <a href="https://atlas.creativestrategies.com/">CS Atlas</a>.</em></p><div><hr></div><p>We spent the last few days at FMS (Future of Memory and Storage) and had meetings with all the key players in the memory, storage, and now also interconnect/networking, ecosystem. A clear takeaway was better line of sight to the CXL standard to start to solidify. If you are not familiar with CXL it is a standard interface that gives the industry a common way to attach and share memory over a PCIe-based physical link. Up to this point the deployment model around that interface is still being developed, which is why the ecosystem can support several architectures, from a memory box inside a rack to pooled or optical memory systems.</p><p>From our conversations we believe deployments are more likely to start next year and build into 2028, but the ecosystem is maturing enough for CXL to move from a standard into something that can be deployed with enough customers to meaningfully start to deploy in their AI compute infrastructure. The first and most logical customer base is the hyperscalers, which can put memory and inference workloads into custom compute clusters and use the surrounding ecosystem to qualify the architecture.</p><p>It is our conviction that solving the memory wall will take many different shapes by many different players but the same problem statement remains. We need more memory, and designers are up against how much memory can go on CPU/XPU/GPU package or near the package. Having ways to expand the available memory pool while keeping latency low enough for selected near-memory workloads is the promise of CXL.</p><h3>Memory is becoming a fleet problem</h3><p>The old server model ties memory capacity to one processor and its local channels. AI workloads make that boundary more expensive because context, KV cache, and orchestration state can grow faster than the memory attached to one compute device. A fleet can have plenty of memory in total while individual CPUs or accelerators still run short.</p><p>The practical distinction is important: &#8220;hot&#8221; describes the role memory plays in the workload, while local, off-die, off-board, and rack-level describe where that memory sits. HBM can remain the hot tier in an attached appliance when the fabric preserves the bandwidth and latency the workload requires. DDR can be split by role in the same way. Local DDR can serve the CPU&#8217;s most active data, while DDR4 or DDR5 behind a CXL controller can provide a larger attached tier and eventually a shared pool. That remote memory will not have the same latency as on-package HBM, but it can still be the highest-performance tier available outside the package.</p><p>CXL gives the system those placement choices through a coherent interface. The first commercial use is likely to be a card, module, or box that adds memory to one host. Later designs can attach several hosts to a pool, with software deciding which data belongs close to compute and which data can move into the attached memory. The value comes from expanding the working set and using capacity more fully without buying a full server for every increment of memory.</p><p>The graphic below frames the opportunity by workload rather than by device. HBM remains closest to compute for the hottest accesses, while local DDR/SOCAMM and CXL-attached memory support larger working sets, overflow KV cache, retrieval buffers, and shared state. CXL is not a fixed warm tier; its role depends on the memory type, topology, and workload.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-SOo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-SOo!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 424w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 848w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 1272w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!-SOo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png" width="1456" height="838" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:838,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2269783,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/209964300?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-SOo!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 424w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 848w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 1272w, https://substackcdn.com/image/fetch/$s_!-SOo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9dcee093-c4a3-4971-a8c1-f785f551137f_1664x958.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>Exhibit 1. Inference moves the memory problem from model weights to active state. CXL expands the set of places where that state can live.</strong></p><h3>Deployment flexibility</h3><p>It is noteworthy how early we are in the rack scale compute era. By our estimates, using our accelerator installed base model, we believe rack scale accelerators in the range of 9-11% of the total AI accelerator installed base. The shift to rack scale solutions are the necessary catalyst that will enable CXL, and other solutions even if custom, to be designed by the customer. Knowing the data center customer is scaling their rack scale infrastructure helps as a catalyst for CXL whether that deployment is north south or east to west in its location. Enough of the ecosystem was present, through announcements and demonstrations at FMS, to make the deployment path more visible. Memory suppliers, interconnect companies, switch vendors, custom silicon providers, and networking ASIC companies were all discussing a path toward viability with much different language than earlier in the year. As of now, we expect the larger deployments are more likely to arrive in 2027 and build into 2028, yet the ecosystem is now moving from evaluation toward qualification, driven by a key set of customers.</p><p>We believe hyperscalers are the first catalysts for several reasons. They control rack specifications, work with ODMs, and can make system-level TCO decisions that are difficult in standardized OEM deployments. <strong>They also have access to a large legacy memory resource that is not always useful in its original server configuration, but could become valuable again in a CXL-based system.</strong> We explain the size of that resource and the qualification path in the full report. That flexibility gives hyperscalers room to qualify a CXL memory box, attach memory beside a CPU or custom ASIC, or build a dedicated memory system. The economic benefit is that they can add controller and system content around capacity they already own.</p><p><strong>Our key take here is:</strong> We have increased confidence that the CXL standard will emerge as a preferred additional approach to infrastructure build out. Its economic and TCO benefits, detailed in the full report, along with its flexibility in implementation give it many advantages over other solutions. While we understand the tradeoffs, we believe the biggest customers in the world are positioned to drive the adoption of CXL and have distinct advantages over others in the market. The competitive advantage available to those customers through CXL could become evident.</p><h2>Inside the Full Report</h2><ul><li><p>Why hyperscalers are likely to become the first large CXL customers, and how their ODM model helps them qualify custom systems faster.</p></li><li><p>How much existing memory could become reusable, what that changes for deployment timing, and the potential TCO benefit.</p></li><li><p>Where CXL fits alongside HBM, local DDR and MRDIMM, HBF, proprietary memory attach, and networked-memory approaches.</p></li><li><p>Our CXL market model through 2030, including the path from single-host expansion to rack-level pooling.</p></li><li><p>The beneficiary map across controllers, memory suppliers, interconnect, systems, and software, plus the production signals needed to validate each opportunity.</p></li></ul><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/breaking-the-memory-wall-with-cxl">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Behind-the-Meter AI Buildout]]></title><description><![CDATA[Why Bloom Energy&#8217;s Q2 shows that onsite power may be starting to scale]]></description><link>https://www.thediligencestack.com/p/the-behind-the-meter-ai-buildout</link><guid isPermaLink="false">https://www.thediligencestack.com/p/the-behind-the-meter-ai-buildout</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Thu, 30 Jul 2026 17:22:41 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!t0JX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d978f6d-f9f9-4aa8-9be0-34d5d432cfff_2451x1346.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h3>BTM extends the capacity-partner model</h3><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;a3f090b5-94f2-476a-a633-09fa3bb05f50&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The Hyperscaler Capacity Partner Hierarchy&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-07-28T16:05:03.994Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!NZlD!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-hyperscaler-capacity-partner&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:208397514,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:4,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>In our prior report, <a href="https://www.thediligencestack.com/p/the-hyperscaler-capacity-partner">The Hyperscaler Capacity Partner Hierarchy</a>, we talked about the importance of partners for hyperscalers, particularly those with a specific type of business model that allowed them to keep a preferred margin profile when they could not secure infrastructure fast enough to convert their backlog. We think, as the market adopts behind-the-meter power and standards emerge, this can accelerate time to power and perhaps shift the speed at which hyperscalers can get land, shells, and other physical infrastructure in place (all things easier to secure and build), then work with a partner like Bloom, and others, to bring capacity online while they still work to get broader grid connectivity.</p><p>Grid connectivity is the hardest part of this equation. The hyperscalers that needed to monetize their compute were doing deals with those who had secured power via the grid, often on less favorable terms that impacted their margins, because they were desperate for power. As BTM scales and becomes more viable, it gives them another choice since it can operate without going through all the hoops needed to secure a grid connection. We are not saying they will stop pursuing grid connections. By adopting BTM, they can scale the easier part of the project, if anything in this process is actually easy: getting a shell built and all the surrounding infrastructure in place. That gives them first-party ownership instead of forcing them to go through partners simply because those partners have grid contracts done and ready to go. The maturation of BTM means the option now exists to add the grid later. That is why BTM can cost more and still be the better choice.</p><h3>Inference changes the equation for BTM</h3><p>From conversations a year ago, when BTM seemed more like a theoretical with potential but needed to be proved out, a few things have changed. First, the AI infrastructure mix moving from training toward more inference is a big driver. In training, the workloads are bursty and thus prone to massive power spikes versus more nominal and consistent power draw. Inference is less bursty and more manageable as a workload, meaning that having a range of redundancies in place to handle power spikes, which was a challenge for pure BTM, is less of an issue with inference. But even with training workloads now, the latest GPUs and rack-scale systems are putting more power control into their systems to help regulate power spikes and make them smoother. One data center operator we spoke with told us anything around 25% or lower for this kind of power spike was low enough that BTM can suffice, and that the latest rack-scale systems can keep those spikes at 25% or lower.</p><p>Public data supports the view from our conversations with those in the power industry. <a href="https://www.microsoft.com/en-us/research/wp-content/uploads/2024/03/GPU_Power_ASPLOS_24.pdf">Microsoft production data</a> measured a maximum two-second change of 37.5% of provisioned power for training, compared with 9% for interactive inference. <a href="https://docs.nvidia.com/multi-node-nvlink-systems/multi-node-tuning-guide/power-thermals.html">NVIDIA&#8217;s GB200 documentation</a> describes programmable power smoothing, while its newer <a href="https://developer.nvidia.com/blog/inside-nvidia-rubin-platform-six-new-chips-one-ai-supercomputer/">Vera Rubin rack architecture</a> adds more local energy buffering. We would not treat 25% as a universal engineering cutoff. It is one operator&#8217;s practical marker, and the broader point is that better rack-level power management gives the onsite generation system a smoother load to follow. Smoother workloads are one enabler of the BTM shift. Grid delays and the economics of bringing compute online earlier remain the larger forces.</p><h3>Customers have moved from &#8220;can we use BTM?&#8221; to &#8220;how will we use it?&#8221;</h3><p>We are not saying BTM becomes the standard or only source of power, only that BTM was not in a place where it was as viable as it appears now. That waas clear from Bloom&#8217;s call where they disclosed every major customer is now engaged to use BTM as a way to get to revenue faster. Customers have moved from BTM looks good on paper to all systems go to ramp BTM. We are in a cycle where the supply chain needs to scale and start to ramp to meet demand so customers can use BTM either to bridge the time to grid service or offset some grid needs and work toward more favorable power economics by using a hybrid architecture. BTM seems to be inflecting, for all the reasons we include, and now the main players need to start ramping their supply chains to meet demand.</p><p>From talking to operators in the field, we had consistently heard about the challenge that is electrical integration for the full site. While the equipment that goes into a BTM solution is one piece of the puzzle, the customer still needs to secure labor and testing, then bring together switchgear, transformers, UPS capacity, microgrid controls and a host of other things. The best-positioned companies are those that have already secured the fuel, have utility relationships and have sites ready to go.</p><p>Power is only part of the equation when analyzing who captures most of the value. This is why the ability to control the complete delivery schedule and stand behind the contract matters, because any delay has a direct impact on the customer&#8217;s time to revenue. The guarantee must cover an operating outcome. That shifts the risk of turning a power plan into operating compute away from the hyperscaler and onto the power or capacity partner.</p><h3>Bloom is the clearest public proof point for now</h3><p>Bloom went from essentially entering this market nine months ago, per the call, with one customer, to management saying its technology is now validated and approved by all major U.S. hyperscalers and more than a dozen other AI infrastructure customers. Those relationships span live deployments, booked and shipped systems under construction, and definitive agreements. Customer engagement has clearly inflected. The next proof is whether those approvals become repeat deployments and accepted, revenue-producing critical IT MW.</p><p>The reported results now sit behind that claim. Revenue reached $1.065 billion in Q2, up 165.5% from a year earlier, while GAAP gross margin increased to 33.4%. The next proof is repeat orders and accepted, revenue-producing critical IT MW.</p><p>A handful of large projects can make the market appear broader than it is. Developers may reserve several generation options for the same campus, while different suppliers count the same prospective demand. Repeat deployments provide stronger evidence. They show that the first installation worked well enough for the customer to use the architecture again. Accepted, revenue-producing critical IT MW then confirms that the project cleared every gate: fuel, permits, generation, electrical integration, commissioning, and usable compute. That would establish BTM as a repeatable procurement model rather than a collection of emergency power projects.</p><h2>Inside the Full Report</h2><ul><li><p>How BTM gives hyperscalers a faster path to owned compute</p></li><li><p>The six gates between a power plan and usable capacity</p></li><li><p>Where Bloom leads and how engines and turbines compete</p></li><li><p>What Bloom&#8217;s Q2 confirms and what still needs proof</p></li><li><p>Who captures value across the BTM delivery stack</p></li><li><p>How BTM can scale and what would weaken the thesis</p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/the-behind-the-meter-ai-buildout">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Hyperscaler Capacity Partner Hierarchy]]></title><description><![CDATA[Why the preferred external AI infrastructure partner may own the physical bottleneck while leaving compute control to the hyperscaler]]></description><link>https://www.thediligencestack.com/p/the-hyperscaler-capacity-partner</link><guid isPermaLink="false">https://www.thediligencestack.com/p/the-hyperscaler-capacity-partner</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Tue, 28 Jul 2026 16:05:03 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!NZlD!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>This report is the third installment in our work on hyperscalers, neoclouds, and the economics of external AI capacity.</em></p><p>We have spent a lot of time tracking power and utilities because we continue to believe power will set the pace of the AI infrastructure buildout. Our recent conversations with industry sources keep coming back to the same problem. We have known about the power bottleneck for some time. What we are hearing now is that it has not gotten any better and, if anything, is getting worse. Data center demand continues to move faster than local utilities can support it. Grid studies can take six to twelve months, and those timelines are getting longer. A new substation can add another two to three years. A company can sometimes move faster if it pays for the substation work itself, but that makes the project more expensive. Even then, the equipment and skilled labor needed to finish the work are getting harder to secure on schedule. Permitting and local resistance can push the timeline out again. Based on what we are hearing, we think the power constraint is likely to stay with the industry through at least 2030 and probably longer.</p><p>As we have heard directly from hyperscalers, this timing problem has been shaping how they think about capacity for some time. Demand is coming in faster than utilities and the normal data center build cycle can support. That leaves them using outside partners that already have firm power or can bring a site online sooner.</p><p>Calling a company an power/shell/ landlord, neocloud or data center developer only tells us so much. What we care about is whether the site can actually get power and be delivered on time. Where we may differ from many consensus is our belief that the best fit is often a partner that can bring the power and the building online, then stop there. The hyperscaler still controls the compute and the customer, which keeps more of the economics inside its own business.</p><h3>Amazon and Microsoft will put the capacity gap back in focus</h3><p>This report will publish during the same week <a href="https://news.microsoft.com/source/2026/07/08/microsoft-announces-quarterly-earnings-release-date-68/">Microsoft reports fiscal Q4 results on July 29</a> and <a href="https://ir.aboutamazon.com/events/event-details/default.aspx">Amazon reports Q2 results on July 30</a>. We expect both companies to raise the capital-spending bar and show another increase in contracted cloud demand. The labels differ between backlog and remaining performance obligations, but the economic signal is the same: Google (reported), AWS, and Azure are booking demand faster than internal infrastructure can be delivered.</p><p>The chart below puts the imbalance on one scale. Across the companies shown (full universe including meta and neoclouds), backlog and RPO have grown faster than cost-adjusted capex. That pulled the ratio from 44% in 2024 to about 37% in 2026. We would not treat this as a measure of physical capacity coverage because capex is an annual flow and backlog is a point-in-time balance. Still, the direction is clear. Contracted demand has grown faster than the capital response, which is why we do not expect capex to slow anytime soon. Key point to remember - revenue always lags capex. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NZlD!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NZlD!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 424w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 848w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 1272w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NZlD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png" width="1456" height="846" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:846,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:338926,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/208397514?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!NZlD!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 424w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 848w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 1272w, https://substackcdn.com/image/fetch/$s_!NZlD!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23764c0d-c349-4a1d-a0fe-77a5795f03f1_3200x1860.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That leaves the economics of the partner as the main question. Hyperscalers will keep using outside capacity while they build more of their own. On Alphabet&#8217;s latest earnings call, management called that capacity a bridge and said it would create modest near-term margin pressure. Google is willing to pay the premium because the revenue is available now. Waiting for its own data centers would mean leaving some of that demand unserved. As Google brings more controlled capacity online, part of the premium should go away. The type of partner, and how much of the stack that partner owns, will determine how expensive the bridge becomes. <a href="https://www.investing.com/news/transcripts/earnings-call-transcript-alphabet-beats-q2-2026-estimates-shares-fall-on-capex-surge-93CH-4807140">Alphabet Q2 2026 call transcript</a></p><p>Our prior reports looked at the AI cloud from the supplier side. We mapped where hyperscalers and neoclouds compete, then separated neoclouds by the layers they own.</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;46b263ab-9c71-4332-b60e-8130ccbaa2cf&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Neoclouds and the Three Business Models&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-04-14T16:06:43.791Z&quot;,&quot;cover_image&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/258acade-5321-4ae9-9d74-625034f7df23_2752x1536.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/neoclouds-and-the-three-business&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:193829282,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:10,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:true,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;57e55d75-d495-421b-8df5-9897b368d260&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The AI Cloud Stack: Where Hyperscalers and Neoclouds Actually Compete&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-06-04T16:42:03.230Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!JB7R!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2d1a2e4-fdff-44ec-ac8c-0ffe3ffa69f2_2400x1246.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-ai-cloud-stack-where-hyperscalers&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:200619959,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:4,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:true,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>This report looks at the same issue from the buyer&#8217;s side. We think AWS and Azure face the same choice Google described. They can, and will, buy outside capacity now and accept some pressure on unit economics, then move more of the workload into controlled infrastructure as their own supply arrives. The question is who is best suited to the hyperscalers are a foundational capacity partner.</p><p>That is why we are spending more time on the partner type. A company that secures firm power and delivers the physical layer can remain an attractive partner after the scarcity premium fades. The hyperscaler still controls the server system and the customer. From here, we want to know which providers can deliver the same kind of project more than once.</p><h3>External capacity is not one product</h3><p>A complete compute service and a leased data center shell can both deliver capacity, but the buyer is paying for very different things. A managed compute provider supplies the building and the server system, then operates it. The price has to cover the cost of the hardware and the risk that the provider cannot keep it fully used. It also has to cover the chance that the equipment loses value faster than expected. All of that adds another supplier margin to the cost.</p><p>A third-party-owned shell stops at the physical layer. The landlord develops the site and delivers a building that can support the required density. The hyperscaler can still own the accelerators and decide how the network is designed. It also keeps the workload inside its own control plane, which is what the hyperscalers generally prefer. More of the cloud margin stays with the buyer, while someone else owns the slow, long-lived physical asset.</p><p>This is the capacity hierarchy we are trying to describe. When there is enough time, hyperscalers prefer to own and operate strategic capacity themselves. A leased shell can get them there sooner without giving up control of the compute. Managed third-party compute still makes sense when the value of serving demand now is greater than the premium being paid.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CmqN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CmqN!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 424w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 848w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 1272w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CmqN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png" width="1456" height="890" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:890,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:126968,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/208397514?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!CmqN!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 424w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 848w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 1272w, https://substackcdn.com/image/fetch/$s_!CmqN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1f65520a-b013-4533-9c21-492a6bb24542_1800x1100.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Exhibit 1. The Hyperscaler Capacity Hierarchy. Relative profiles are Creative Strategies analytical judgments, not reported provider margins. Source: Creative Strategies analysis of Alphabet public disclosures and public infrastructure agreements.</em></p><h3>The best landlord owns more than land</h3><p>Power delivery is the known hook making these partners attractive. The latest disclosures help answer the next question: what turns that power into a valuable contract? Applied Digital delivered another 75 MW on schedule, while Core Scientific had 437 MW billing by mid-July against 1.1 GW leased. More important for our thesis, Applied Digital said direct hyperscaler leases should lower its financing cost over the full term. Core Scientific&#8217;s mix of direct AMD leases and neocloud leases with AMD protections shows how the risk can change by project. The value sits in converting power into accepted capacity under a contract the market can finance with a specific margin profile. <a href="https://ir.applieddigital.com/news-events/ir-calendar/detail/20260727-q4-2026-earnings-call">Applied Digital Q4 2026 earnings call</a> <a href="https://investors.corescientific.com/news-events/press-releases/detail/139/core-scientific-announces-second-quarter-2026-results">Core Scientific Q2 2026 results</a> <a href="https://investors.corescientific.com/news-events/press-releases/detail/138/core-scientific-and-amd-announce-infrastructure-partnership">Core Scientific and AMD partnership</a></p><p>Hut 8 may add another version. The company has leased 704 MW at Beacon Point to an unnamed investment-grade tenant. The Financial Times reported that NVIDIA is the tenant and may sublease the capacity to neocloud partners, although neither company has confirmed it. If accurate, NVIDIA would be securing physical capacity itself rather than waiting for partners to find it. <a href="https://www.hut8.com/news-insights/press-releases/hut-8-fully-commercializes-1-gw-beacon-point-ai-data-center-campus-with-second-352-mw-it-lease">Hut 8 Beacon Point announcement</a> <a href="https://www.brecorder.com/news/40432141/nvidia-behind-50-billion-lease-on-texas-data-center-ft-reports">Reuters summary of the FT reporting</a></p><p>Chip vendors may be starting to secure physical capacity themselves. AMD is doing it directly with Core Scientific, while NVIDIA is reported to be leasing Hut 8 capacity that it may place with neocloud partners. The obvious reason is speed, but we think there may be a competitive angle as well. Hyperscalers are putting more custom ASICs into the infrastructure they control. Securing outside sites could help NVIDIA keep scarce power tied to NVIDIA systems before those sites are absorbed into hyperscaler builds. That is our interpretation, not something NVIDIA or Hut 8 has said, but it would expand the buyer pool for the physical layer.</p><p><strong>For now, our perhaps out of consensus view, is we still think the best long-term position may sit with the company that controls the physical asset and stops before the compute layer.</strong> Hyperscalers will use neoclouds when speed is worth the premium. Chip vendors may now compete for the same sites. All of them still need the landlord to deliver.</p><h1>Inside the Full Report For Clients and Subscribers</h1><ul><li><p>An original model for comparing the cost of delay with the premium paid for managed compute.</p></li><li><p>A buyer-side margin and capital sensitivity across owned, leased-shell, and managed-compute structures.</p></li><li><p>Google and Meta case studies showing how the same buyer uses different structures for different time horizons.</p></li><li><p>A contract-quality ladder separating direct hyperscaler leases from backstopped neocloud tenancy and uncontracted pipeline.</p></li><li><p>A selected capacity map showing where supply sits, followed by public-company market, beneficiary, and partner-fit maps that separate economic role from announced MW.</p></li><li><p>A deployable-MW proof ladder and monitoring framework for testing whether announced capacity can become revenue-producing infrastructure.</p></li></ul>
      <p>
          <a href="https://www.thediligencestack.com/p/the-hyperscaler-capacity-partner">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[In 2023-2024 We Weren't Bullish Enough]]></title><description><![CDATA[What the 2023&#8211;2024 models saw, what they missed, and why today's market requires a different unit of analysis]]></description><link>https://www.thediligencestack.com/p/in-2023-2024-we-werent-bullish-enough</link><guid isPermaLink="false">https://www.thediligencestack.com/p/in-2023-2024-we-werent-bullish-enough</guid><dc:creator><![CDATA[Ben Bajarin]]></dc:creator><pubDate>Fri, 24 Jul 2026 19:45:07 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Vw-u!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We thought it would be useful to look back at a wide range of research from 2023 and 2024, just as it became clear that AI was about to change everything, and ask where those early forecasts ended up being right, wrong, or simply too conservative.</p><p>This retrospective draws on a wide range of research from third party sources as well our own. Much of that work saw AI coming. The largest misses came from underestimating how quickly the pieces around the accelerator would have to scale together. Something we now refer to as the GPU Tsunami.</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;8973b796-144b-4b9b-bf98-687dde52fbe6&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;GPU Tsunami Beneficiaries: Power Semis and Analog &quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-06-23T15:28:07.785Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!ilTa!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F629f2b30-8b30-4446-a350-859ece5ec790_1192x772.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/gpu-tsunami-beneficiaries-power-semis&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:203105848,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:8,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;b073b74d-8a4d-48ba-9bec-c1ecd2bf1c72&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;The GPU Tsunami: TSMC, Intel, and Samsung Foundry&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-07-07T17:47:21.315Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!i9dp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c7bc45f-6ca0-4b06-a869-4a664d0b6c1b_1552x988.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/the-gpu-tsunami-tsmc-intel-and-samsung&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:205663139,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:11,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><h3>How much the market moved</h3><ul><li><p><strong>Four years early:</strong> A 2022 forecast put the semiconductor market at <strong>$1 trillion in 2030</strong> (<a href="https://www.mckinsey.com/industries/semiconductors/our-insights/the-semiconductor-decade-a-trillion-dollar-industry">historical framework</a>). Our current model reaches <strong>$1.79 trillion in 2026</strong> and <strong>$3.49 trillion in 2030</strong>. Adding adjacent AI infrastructure brings the combined 2030 silicon-systems pool to <strong>$3.95 trillion</strong>.</p></li><li><p><strong>5.8 times:</strong> Our 2027 accelerator model is now <strong>$720 billion</strong>, compared with an old <strong>$125 billion</strong> AI-compute endpoint.</p></li><li><p><strong>60%:</strong> One quarter of NVIDIA Data Center revenue reached about 60% of the old full-year 2027 AI-compute endpoint.</p></li><li><p><strong>2.7 to 3.2 times:</strong> The 2025 CoWoS capacity estimate was revised from 25,000 to 30,000 wafers per month to more than 80,000.</p></li><li><p><strong>79%:</strong> The 2027 AI-switching endpoint was revised higher in less than a year.</p></li><li><p><strong>3.0 to 3.6 times:</strong> Current frontier rack power surpassed an old 2030 expectation four years early.</p></li><li><p><strong>2.4 times:</strong> Our seven-company 2027 capex model is already 2.4 times an old global data-center endpoint.</p></li></ul><p>We think its important to look back, as a post mortem, to understand where the analysis went wrong and what the collective industry (us analysts) underestimated, so we can recognize those patterns when they appear again. Some earlier calls were right, while others moved too quickly on adoption timing. We also missed how much the unit of analysis was changing as the market developed. We were particularly too conservative on the ASP expansion across the semiconductor supply chain. We fully modeled semiconductor output based on our foundry capacity model, but we did not fully appreciate the pricing leverage created by the AI infrastructure cycle. Our midpoint scenario implies the industry&#8217;s blended semiconductor ASP rises from approximately $0.75 today to more than $2.10 by 2028, nearly tripling in just three years. <strong>Between 2025 and 2028, we estimate semiconductor unit shipments increase only 25&#8211;30%, while the average semiconductor ASP increases nearly 185%, driving approximately 260% industry revenue growth</strong>. This represents a structural shift in semiconductor industry economics as value per device compounds substantially faster than industry unit shipments. We map every constraint in the below report leading to this ASP increase, in the era we now call the era of margin expansion.</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;8db72aad-d216-41e0-ac06-7c9e107691ad&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;sm&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Where AI Constraints Become Pricing Leverage&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:21971657,&quot;name&quot;:&quot;Ben Bajarin&quot;,&quot;bio&quot;:&quot;CEO&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc186a30-2fc0-4b79-ad09-869042c38eac_772x772.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:100}],&quot;post_date&quot;:&quot;2026-07-02T16:56:59.453Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!55nn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa41bd399-702b-4905-bf3d-94df7098e42f_1586x900.png&quot;,&quot;cover_image_alt&quot;:null,&quot;canonical_url&quot;:&quot;https://www.thediligencestack.com/p/where-ai-constraints-become-pricing&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:204530527,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:5,&quot;comment_count&quot;:0,&quot;publication_id&quot;:4189414,&quot;publication_name&quot;:&quot;The Diligence Stack - By Creative Strategies&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!at7f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8eb90428-a00e-4b29-a979-0d47d3bf0802_612x612.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><h3>What the archive saw, and where its boundary failed</h3><p>We reviewed a broad set of historical forecasts to understand how expectations changed over time. Licensed historical work is described as third-party forecasts or archive estimates, while current comparisons use public outcomes and Creative Strategies models.</p><p>The scorecard separates outcomes, run rates, and model revisions. A newer forecast shows expectations moving; only an outcome proves the old forecast wrong.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Vw-u!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Vw-u!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 424w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 848w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 1272w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Vw-u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png" width="1456" height="898" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:898,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:198548,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/207821056?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Vw-u!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 424w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 848w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 1272w, https://substackcdn.com/image/fetch/$s_!Vw-u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39168a20-ee13-4574-a2b6-d83bf6568f44_2400x1480.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Each row uses a different type of evidence, but the pattern is consistent. The largest forecast revisions appeared once the market moved beyond the accelerator and began modeling the complete AI system. Compute only becomes usable capacity when the full rack can be commissioned. The early forecasts treated the infrastructure around the accelerator as a supporting input. It turned out to be part of the market itself.</p><h2>Compute demand escaped the original boundary</h2><p>In March 2023, a third-party forecast assumed that 40 to 60 large-model builds over the following 12 to 24 months would create approximately $10 billion to $15 billion of incremental GPU TAM. A June 2023 custom-silicon model put AI computing semiconductors at roughly $43 billion in 2023, growing to $125 billion in 2027, with custom ASICs reaching as much as 30% of cloud AI semiconductor spending.</p><p>Those estimates were aggressive at the time, but their boundary was still too conservative. The model counted likely builds and the accelerators required, then extended the curve as custom silicon gained share. It did not capture the wider inference market that would form around installed compute. Ultimately, what most got wrong was underestimating the compute intensity of the workload that is agentic AI. We think many still under appreciate this today as well.</p><p>NVIDIA reported $75.2 billion of Data Center revenue in Q1 FY2027. Data Center includes systems and networking, so it is not like-for-like with semiconductor TAM. Even so, that quarter reached 60% of the old 2027 AI-compute endpoint. In one quarter, NVIDIA generated revenue equal to 60% of what the earlier model expected from the entire AI-compute market for all of 2027. Looking forward, our current model puts merchant GPU and XPU logic plus custom AI accelerators at $770 billion in 2027 and $1.36 trillion in 2030.</p><p>The models underestimated how much demand each new accelerator would create. Training built the installed base, while better performance expanded the market for inference. That pulled custom silicon and rack-scale systems into what had started as a GPU market. As supply grew, the TAM grew with it.</p><h2>Packaging was the clearest under call</h2><p>In August 2023, a third-party advanced-packaging forecast put industry CoWoS capacity at roughly 15,000 wafers per month, rising to 20,000 to 25,000 in the second half of 2024 and 25,000 to 30,000 in 2025. The forecast saw little likelihood that CoWoS would remain a meaningful bottleneck beyond 2024.</p><p>By January 2025, a later archive model expected TSMC CoWoS capacity to exceed 80,000 wafers per month by the fourth quarter of 2025. <strong>That was 2.7 to 3.2 times the 2023 estimate for the same year. </strong>In July 2026, TSMC still described packaging as tight enough to limit customer growth. <a href="https://investor.tsmc.com/english/quarterly-results/2026/q2">TSMC Q2 2026 materials</a>.</p><p>In retrospect, what was missed was the timing, pull-in, of chiplet designs as AI accelerators were the first evidence of the broad shift from monolithic to systems based chip design.</p><p>Packaging became part of the capacity boundary, which is the central idea in our report <a href="https://www.thediligencestack.com/p/the-gpu-tsunami-tsmc-intel-and-samsung">The GPU Tsunami: TSMC, Intel, and Samsung Foundry</a>. A leading-edge wafer becomes useful AI capacity only after advanced packaging brings it together with HBM and the rest of the rack.</p><h2>Memory became a much larger market than the models allowed (and structural)</h2><p>Memory was not missing from the early forecasts. It was treated as a cyclical recovery. In late 2023, the public market forecast called for roughly $130 billion of memory revenue in 2024. Actual sales reached $165 billion, 27% above that estimate.</p><p>The longer-range forecasts were even more conservative. One public model published in 2024 put combined DRAM and NAND revenue at approximately $206 billion in 2025 and just $214 billion in both 2026 and 2027. The assumption was that the recovery would level off once pricing normalized.</p><p>Our current model looks very different. We estimate combined DRAM and NAND revenue of $230&#8211;240 billion in 2025, $550&#8211;570 billion in 2026, and $800&#8211;850 billion in 2027. Against the old forecast, the 2026 market is now modeled at 2.6 times the prior estimate. By 2027, the difference reaches approximately four times.</p><p>This is a forecast revision, not yet a realized outcome, yet trending in that direction. But it shows what the earlier models missed. AI did not create demand only for HBM. It increased the amount of server DRAM and enterprise NAND required around each accelerator. At the same time, HBM consumed capacity that would otherwise have served conventional memory. The result was a much broader shortage and a much larger market than the original forecasts allowed.</p><h2>The bottleneck kept moving</h2><p>The early work saw the constraint moving beyond the accelerator, but underestimated how quickly the network and site would control the deployment schedule.</p><p>A June 2023 forecast put 2027 AI-switching revenue at $8.5 billion. Eleven months later, that endpoint had risen 79% to $15.2 billion. Our broader networking-silicon model now reaches $105 billion in 2027. The categories differ, but reported revenue confirms the direction: Broadcom&#8217;s $10.8 billion of quarterly AI semiconductor revenue reached 77% of its old full-year FY2025 forecast. <a href="https://investors.broadcom.com/news-releases/news-release-details/broadcom-inc-announces-second-quarter-fiscal-year-2026-financial">Broadcom Q2 FY2026 results</a>.</p><p>Power moved faster still. A July 2024 note expected average rack density to reach 40 kilowatts by 2030. GB200 and GB300 systems reached 120 to 142 kilowatts four years early, or 3.0 to 3.6 times the old endpoint. These are frontier systems rather than fleet averages, but they set the next building standard. <a href="https://docs.nvidia.com/mission-control/docs/systems-administration-guide/2.1.0/prs/faq.html">GB200 specification</a> and <a href="https://docs.nvidia.com/enterprise-reference-architectures/nvl72-ai-factory/latest/components.html">GB300 reference architecture</a>.</p><p>Capex followed. A May 2024 model put global data-center capex at $500 billion in 2027. Our seven-company cost-adjusted base now reaches $1.18 trillion, or 2.4 times that endpoint.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NXbU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NXbU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 424w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 848w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NXbU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png" width="1456" height="849" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:849,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:114275,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.thediligencestack.com/i/207821056?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!NXbU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 424w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 848w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 1272w, https://substackcdn.com/image/fetch/$s_!NXbU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ef7e108-4035-41b9-a34c-f61a8b3856de_2400x1400.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The bottleneck moved from the chip into the network and then the site. Each fix exposed the next constraint. That is why <a href="https://www.thediligencestack.com/p/counting-real-ai-capacity">Counting Real AI Capacity</a> and <a href="https://www.thediligencestack.com/p/gigawattonomics">Gigawattonomics</a> focus on commissioned systems and economic output per watt. Until the full system is commissioned, announced capacity remains intent.</p><h2>The top line hid the infrastructure reallocation</h2><p>A January 2024 semiconductor model forecast sales of $645 billion in 2024 and $718 billion in 2025. WSTS reported $630.5 billion and $795.6 billion, respectively. The model was 2.3% high for 2024 and 10.8% low for 2025. <a href="https://www.wsts.org/76/103/Global-Semiconductor-Market-grows-26-in-2025-to-796B">WSTS 2025 result</a>. It caught the recovery but missed the next acceleration in memory pricing and AI-infrastructure mix.</p><p>Public cloud was also broadly on track. A June 2024 model forecast spending rising from roughly $675 billion in 2024 to $1.38 trillion in 2028. The surprise occurred inside the total as AI infrastructure grew faster and carried more capital intensity than conventional workloads.</p><p>A top-line forecast can land within normal error while the internal demand map changes enough to redirect capital, capacity, and profit. The semiconductor and cloud totals did not reveal how much of the next dollar would be pulled toward accelerators and the infrastructure required to deploy them.</p><h2>Enterprise AI had two opposite forecast errors</h2><p>Infrastructure estimates were generally too small. Enterprise adoption produced two errors in opposite directions. Spending and usage intensity ran above the early markers, while scaled-production timing was sometimes too aggressive.</p><p>Two 2023 third-party forecasts framed an $820 billion enterprise-software TAM and approximately $150 billion of GenAI software spending within three years.</p><p>Our current working range puts enterprise GenAI spending across software, services, and inference compute at $175 billion to $200 billion in 2026, rising to more than $600 billion by 2030. The boundary is broader than software alone, so the comparison is directional. Even with that caveat, the 2026 midpoint is about 25% above the old three-year marker, and the decade-end range is more than four times as large.</p><p>The survey archive explains the other error. A 2024 IT survey found 52% of respondents live with at least one AI use case, but only 10% in production at scale. Later CIO surveys measured production at 30% in 2024 and 39% in 2025, while an earlier CTO survey expected nearly universal use by year-end 2024.</p><p>The error was treating a company with one live use case as equivalent to a company that had reorganized a production workflow. An enterprise can pay for AI and increase token consumption while only a small number of workflows reach scaled production. In our report, <a href="https://www.thediligencestack.com/p/from-ai-usage-to-ai-earnings-power">From AI Usage to AI Earnings Power</a> picks up there. The test is whether repeated use changes a measurable operating baseline enough to earn a durable budget.</p><h2>Where the current Diligence Stack work goes next</h2><p>The current research starts from this revised unit of analysis. <a href="https://www.thediligencestack.com/p/counting-real-ai-capacity">Counting Real AI Capacity</a> establishes what has actually been commissioned. <a href="https://www.thediligencestack.com/p/gigawattonomics">Gigawattonomics</a> then asks whether that capacity can earn an acceptable return from the power it consumes.</p><p>Below the site, <a href="https://www.thediligencestack.com/p/the-gpu-tsunami-tsmc-intel-and-samsung">The GPU Tsunami</a> applies the same capacity discipline to foundries. <a href="https://www.thediligencestack.com/p/where-ai-constraints-become-pricing">Where AI Constraints Become Pricing Leverage</a> asks which shortages can support durable economics rather than temporary scarcity pricing. The memory and enterprise reports carry the method into capacity allocation and workflow monetization.</p><h2>Bottom line</h2><p>As a firm that has been doing market models, forecasting, sizing, and more for over 40 years, we understand being conservative, and how forecasts are almost always wrong.  A forecast is only as good as the underlying assumptions we stay in a state of constant learning, observing, and looking for the right past and present patterns in order to continually strengthen our assumptions on every part of the industry we research. <br><br>We shared a lot of our internal forecasts and models in the look back, knowing full well they may be wrong and also pose the scenario, within the historical view, that what if even today we are not bullish enough. </p><h3>For subscribers</h3><p>Below the paywall, we share our notes from attending AMD Advancing AI and having time with management to discuss products and strategy and Intel earnings with feedback from our calls with IR. The Intel note explains why the earnings recovery may arrive before an external foundry win, with custom ASICs emerging as another business to watch. The AMD note looks at Helios and whether its open rack-scale design can turn strong component technology into a coherent system.</p><p></p>
      <p>
          <a href="https://www.thediligencestack.com/p/in-2023-2024-we-werent-bullish-enough">
              Read more
          </a>
      </p>
   ]]></content:encoded></item></channel></rss>