Amin Vahdat, VP of Machine Studying, Programs and Cloud AI at Google, holds up TPU Model 4 at Google headquarters in Mountain View, California, on July 23, 2024.
Marc Ganley
Google ‘s AI infrastructure boss instructed staff that the corporate has to double its compute capability each six months with the intention to meet demand for synthetic intelligence companies.
At an all-hands assembly on Nov. 6, Amin Vahdat, a vice chairman at Google Cloud, gave a presentation, considered by CNBC, titled “AI Infrastructure,” which included a slide on “AI compute demand.” The slide stated, “Now we should double each 6 months…. the following 1000x in 4-5 years.”
“The competitors in AI infrastructure is probably the most essential and in addition the costliest a part of the AI race,” Vahdat stated on the assembly, the place Alphabet CEO Sundar Pichai and CFO Anat Ashkenazi additionally took questions from staff.
The presentation was delivered per week after Alphabet reported better-than-expected third-quarter outcomes and raised its capital expenditures forecast for the second time this 12 months, to a spread of $91 billion to $93 billion, adopted by a “important enhance” in 2026. Hyperscaler friends Microsoft, Amazon and Meta additionally boosted their capex steering, and the 4 corporations now anticipate to collectively spend greater than $380 billion this 12 months.
Google’s “job is after all to construct this infrastructure but it surely’s to not outspend the competitors, essentially,” Vahdat stated. “We’re going to spend so much,” he stated, including that the actual purpose is to offer infrastructure that’s far “extra dependable, extra performant and extra scalable than what’s obtainable anyplace else.”
Along with infrastructure build-outs, Vahdat stated Google bolsters capability with extra environment friendly fashions and thru its customized silicon. Final week, Google introduced the general public launch of its seventh technology Tensor Processing Unit known as Ironwood, which the corporate says is sort of 30 occasions extra energy environment friendly than its first Cloud TPU from 2018.
Vahdat stated the corporate has a giant benefit with DeepMind, which has analysis on what AI fashions can seem like in future years.
Google must “be capable of ship 1,000 occasions extra functionality, compute, storage networking for basically the identical value and more and more, the identical energy, the identical vitality degree,” Vahdat stated. “It will not be straightforward however via collaboration and co-design, we’ll get there.”
Sundar Pichai, chief government officer of Alphabet Inc., in the course of the Bloomberg Tech convention in San Francisco, California, US, on Wednesday, June 4, 2025.
David Paul Morris | Bloomberg | Getty Photographs
Pichai instructed staff on the assembly that 2026 will likely be “intense,” citing AI competitors and the stress to satisfy cloud and compute demand.
He additionally answered a query a couple of potential AI bubble, a subject that is gained resonance throughout Silicon Valley and Wall Road of late as traders have grown skeptical about whether or not the trillions of {dollars} in anticipated spend within the coming years is justified.
The worker query that he learn aloud requested, “Amid important Al investments and market speak of a possible Al bubble burst, how are we serious about guaranteeing long-term sustainability and profitability if the Al market would not mature as anticipated?”
Pichai acknowledged the considerations.
“It is an important query. It has been positively within the zeitgeist, persons are speaking about it,” Pichai stated.
He then reiterated some extent he is made prior to now concerning the dangers of not investing aggressively sufficient, and highlighted Google’s cloud enterprise, which simply recorded 34% annual income progress to greater than $15 billion within the quarter. Its backlog reached $155 billion.
“I believe it is at all times tough throughout these moments as a result of the chance of underinvesting is fairly excessive,” Pichai stated. “I truly suppose for a way extraordinary the cloud numbers have been, these numbers would have been significantly better if we had extra compute.”
He stated the corporate follows a disciplined method, pointing to the energy of the underlying companies and firm’s steadiness sheet.
“We’re higher positioned to face up to, you recognize, misses, than different corporations,” Pichai stated.
Market jitters
Looking forward to subsequent 12 months, Pichai instructed staff, “there will likely be little doubt ups and downs.”
“It is a very aggressive second so, you may’t relaxation in your laurels,” he stated. “We’ve got a whole lot of laborious work forward however once more, I believe we’re effectively positioned via this second.”
Google declined to remark.
The bubble dialog picked up steam forward of Nvidia‘s quarterly earnings report on Wednesday. Shares of massive AI winners like CoreWeave and Oracle have gotten hammered, persevering with a monthlong slide. In an interview with the BBC earlier this week, Pichai stated that there are “components of irrationality” out there and that if a bubble have been to burst, “no firm goes to be immune, together with us.”
Nvidia CEO Jensen Huang started his commentary on the chipmaker’s earnings name on Wednesday by rejecting the premise of an AI bubble, saying that, “We see one thing very totally different.” Nvidia, which counts Google as a significant buyer, reported 62% income progress, topping estimates, and issued stronger-than-expected steering for the fourth quarter.
Nonetheless, the markets sank on Thursday, with Nvidia shares sliding 3.2%, pushing the Nasdaq down 2.2%. Alphabet’s inventory fell 1.2%.
Earlier this week, Google launched its latest AI mannequin, Gemini 3, which the corporate says will present higher solutions to extra complicated questions in contrast with prior fashions. Google is in a race with AI corporations, most notably OpenAI, to get its superior AI instruments within the arms of as many individuals as doable.
Nonetheless, Pichai stated capability provide is the bottleneck. He gave the instance of video technology device Veo, which the corporate upgraded final month.
“When Veo launched, how thrilling it was,” Pichai stated. “If we might’ve given it to extra folks within the Gemini app, I believe we’d have gotten extra customers however we simply could not as a result of we’re at a compute constraint.”
One other highly-rated worker query learn on the assembly stated, “Capex is accelerating at a fee considerably quicker than our working earnings progress,” and requested what the corporate’s technique is for “wholesome free money stream” over the following 18 to 24 months.
Ashkenazi, who joined Google as finance chief final 12 months, stated the corporate has numerous prospects, together with the potential to convey extra prospects from bodily knowledge facilities into the cloud.
Broadly, she stated, “The chance in entrance of us is important and we won’t miss that momentum.”
WATCH: Google releases Gemini 3


