Submind YouTube summaries
Thumbnail for Horace Zona, DigitalBridge | theCUBE + NYSE Wired: AI Factories - Data Centers of the Future

Horace Zona, DigitalBridge | theCUBE + NYSE Wired: AI Factories - Data Centers of the Future

Watch on YouTube

Video summary

Horace Zona, Managing Director at DigitalBridge, joins the discussion to provide a historical perspective on the current surge in artificial intelligence infrastructure, arguing that we are witnessing a genuine demand curve rather than a speculative bubble. Drawing parallels from previous technological waves like the internet and telecom eras, Zona emphasizes that AI represents a fundamentally new form of compute that cannot simply leverage existing legacy infrastructure. He explains that while traditional cloud computing prioritizes low latency for real-time collaboration, AI workloads often involve complex tasks where higher latency is acceptable, creating distinct opportunities for specialized data centers and high-performance computing solutions. This shift necessitates a complete rethinking of the digital infrastructure landscape, moving beyond just connecting users to actively injecting intelligence into the network itself. The conversation highlights the critical role of capital markets in fueling this physical expansion, particularly through non-investment grade financing for high-performance compute chips and data centers. Zona details DigitalBridge's strategy of using domain expertise to navigate complex financial structures, such as the controversial circular financing models involving NVIDIA, which he views as market-making rather than nefarious. He notes a significant imbalance in the cost structure between building physical data centers and purchasing the necessary chips, requiring creative financial solutions that traditional banks have been slow to adopt. By partnering with private credit funds and focusing on companies with strong off-take agreements, like those backed by Microsoft or NVIDIA, DigitalBridge aims to bridge the gap between available capital and the massive scale of gigawatt-level "AI factories" required to meet future demand. Looking toward the future, Zona identifies several key trends that will define the next phase of AI infrastructure development, including the rise of edge computing and the integration of advanced energy solutions like geothermal power. He discusses the potential for transforming existing telecom towers into intelligent nodes capable of running inference workloads, thereby decentralizing compute power closer to end-users. The discussion also touches on the importance of regional topology, where businesses will seek out locations with dormant power capacity and robust connectivity to deploy these new facilities efficiently. Ultimately, Zona concludes that the convergence of energy availability, financial innovation, and domain-specific expertise is essential for entrepreneurs to overcome current constraints and realize the full potential of the AI revolution.
Read the full video transcript
Palo Alto studio connecting Silicon Valley and Wall Street. I'm John Furrier host of the Cube here with Dave my co-host. Hello, I'm John Furrier host of the Cube here in our Palo Alto I mean sorry New York City NYSE studio. We have a Palo Alto studio connecting Silicon Valley to Wall Street and I think it really is about the deep tech inner interfacing with Wall Street. That's the NYC wired program and open community. It's our AI factory series. We got Horse Zona here managing director digital bridge here seen many ways of innovation. Horse great to see you here in the Cube and NYC wired program. We're talking before we came on camera about historical perspective. Can't wait to get into it. >> I am too. Thanks so much for having me today. I'm excited to sit down and chat. >> So you're involved in a lot of the key infrastructure deals but also you have a historical perspective. You've seen the internet wave. You've seen the telecom wave. You've seen the SAS cloud wave. Now you got the AI wave. You know there's been a lot of talk around AI taking over the world and killing people through the anthropic nonsense. This bubble talk. Are we in a bubble not in a bubble? All that aside we are in the most massive demand curve I've ever seen in my career where you have all these forces in the confluence of these forces. As someone who's been seeing the waves, what is your take on this because a lot of us are seeing this as it right what Am I crazy? What are you seeing? >> Uh well we're seeing tremendous opportunity to make fundamental fundamentally driven very thoughtful investments across the entire capital structure. So as a firm we're unlike most GPs in that our entire focus is investing whether it be public equity, private equity, private credit, all we do is invest invest in digital infrastructure. So, it's that level of focus where our portfolio companies really give us insights about where the opportunity is. Um and so, to draw historical perspective, you know, I started in '93 uh as a banker uh within the media and communication space, really focusing on digital infrastructure. So, that would be, you know, broadband, wireless, fiber. Um and at times, you've seen very significant pockets of growth, but not without a um >> Yeah. >> a really detailed business model. And um that ultimately can end up in a bad place. Um and I'd say then to really roll that forward to today, we see a very healthy ecosystem with genuine demand drivers, and the supply is there to fulfill it. Um and so, not to necessarily just ape what Jensen says, but, you know, AI is a completely new form of compute. It cannot necessarily leverage your off of prior infrastructures. And so, as a value proposition, you know, we see a real opportunity there for end users and the developers uh to bring to marketplace that intelligence that people are willing to pay for. And that's obviously what um you know, this is all about. >> When you say new forms of compute, I I totally agree with you because I wrote a post a couple weeks ago said it's math that needs to be fed more math. And if you look at the matrix multiplication, if you look at the the density of the Nvidia architecture, it's mathematics that's driving all that activity. Now, the systems around it are getting tweaked. You got KB cache, you got roll of memory, um and they're getting bigger and there's demand for it. But there's also it's not over. You got the edge, but there's also an infrastructure on the cloud side. We have the internet's built. It's steady state. There's no debate there. The The hyperscalers, AWS, they're they pumped the last generation. You got Uber who built first generation app from columnar store to people, places, and things. So, a lot of stuff's kind of been done. So, it's like there's a shoulders of giants kind of mentality that's a lot different from the hey, let's kill the local loop telecom deal, bring in broadband, lay down new fiber. Web replaces this. So, there's a there's a displacement in the other generations. It doesn't feel like a displacement uh infrastructure. Um and because I mean, some will some stuff will go away and change and refactor. But what is your take on that? Because if you look at things like the internet really in the '90s, that was telecom. You had PBXs became digital, eyeballs on the you know >> Being being a valuation Mary Meeker had a slide, the online population was like a chart she tracked at Morgan Stanley back in the day. It's like, hey, more people are coming on the information superhighway, the web. That was just a curve, that wasn't just ramp. So, you have now people connected with SaaS and phones. How does that change your view on digital infrastructure? Because in a way, a lot of it's already out there. Sure. Well, we look at the infrastructure from end to end, right? Anything that is moving a bit is really part of what we think of moving or storing a bit is what we think of as digital infrastructure. So, that's towers, that's residential broadband, that's enterprise broad enterprise fiber and and broadband, satellite, subsea cable, of course data centers, and then high performance compute. I I don't like to use the neo cloud phrase. >> AI AI clouds, they call them now. That's what the core we call themselves. >> And so, what's interesting is that, you know, this is largely driven by the product and the need that that you're trying to fill for the customer. So, cloud computing is very simple, right? You're if I'm working on a PowerPoint in New York and you're in Palo Alto and we want to work on it together, we we need really very low latency for that for us to coexist. So we're not messing up with each other and and frustrating each other. Um AI is very different, right? I am now querying whether it's caught or chat or whomever with a task. And that task can be easy or complicated. So that latency is not necessarily as important today for AI compute. So that if I give it a very difficult task, if I've downloaded 10 documents, I want to I want it to perform several different analysis, I want a different presentation schemes, that may take 30 seconds. It could take a minute. Um And so I'm not I'm >> And we haven't even gotten into what >> real agentic compute is all about. So I'm I'm unleashing two or three bots to 24/7 discover under you know, analyze, find different opportunities. So I'd say that these are complementary networks, but they're different. And so you're really not getting into that innovators dilemma where one system is dislocating another. Not in not in our perspective. >> latency is a great point because if you're driving a car that's autonomous or you're not driving, you have a tons of or you have physical robot running a manufacturing doing heavy lifting, there's a safety issue. They need real time. So you want to have a policy. Again, that's I think where you're getting at that compute's different. >> Right. Exactly. So physical AI, right? The the robotics, that is a revolution that is is starting very, very early. In fact, we haven't made an investment there yet, but we're looking forward to that space and keeping a really close eye. >> Yeah, I'm really fascinated by your networking background, because I why I'm going there is because, you know, you know, Scott McNealy had an expression, network is the computer back in the Sun Microsystems days. You You're smiling, you remember. I actually interviewed him in 2013. He's And I said, "What do you think about cloud?" He goes, "It's He said, I just should have called it the cloud, right?" Cuz I was like, it is the computer. But, if you look at Nvidia, the whole premise of their entire architecture's networking based. Mellanox was the beginning of it. No one wanted to buy that company. There was only like three buyers. Nvidia picked it up. InfiniBand worked that made the whole system happen. But, now the KB cache is so critical, and it's growing. You got disaggregated serving. Hello, inference. So, you're starting to see that new compute architecture emerge. How do you look at that? Because the next question would be, okay, if AI factories is a big fat node, big Texas data center, gigawatt, big metro node, there's going to be edge factories. A telecom tower has a building. They got power, and they got networking. And also, they got RF on the on the other end. So, you're starting to see, okay, with you inject intelligence, that's a That could be an investment. These I'd love to get your reaction on that, because, you know, I've been saying, like, look at if you inject intelligence, that might even change how licensed spectrum might operate. And that's just a haymaker, but it like that's kind of the thinking that people are starting to come to come to uh grips with. What's your thoughts on it? Cuz that's like That's an arc. It's not maybe next year. It might come. That'll power things. >> Inference is really the big tent in the pole. Right, that's where there is tremendous economic opportunity. That's where at an enterprise level, um we can see a tremendous uh uptake in the the the compute um for those businesses. It's largely going to be productivity and efficiency enhancing. Um if you're not doing it, your competitors are doing it. They're going to eat you alive. Um and so we will see the implementation of that uh coming very fast here over the next several years. And so what we're really investing in are the data centers um and the high-performance compute businesses, the chip uh the chip factories that will make that happen. The pick the picks and the shovels. Um and what's interesting is that post-COVID when we saw such an uptake in cloud computing um where a 20 MW or a 50 MW data center was a very significant investment uh only 3 years ago. Now, 2 years ago we see hundreds of MW data centers. And of course now we see gigawatt data factories. Now that is not all cloud computing, but what we've seen is that uh demand get driven and the supply has to come to where the power is. So now we're getting into this whole NIMBY thing. Um where it is a a significant concern as an industry. We're very focused on doing the right thing for our communities um where we live. And so what we want to see though is um the compute happen and bring it back. So whether it's through a tower, through a fiber to where the end user needs it. >> On Digital Bridge, what's your um parameters or I guess the line where you don't invest because you brought energy up. Um energy's the bounding function. Does that take you off the reservation so to speak or is that in line with what you're thinking because you know, we're seeing geothermal use cases coming out out in the west. Um I would see a terawatt could come out of the super hot rocks out there. Um that's like the journey to the center of the earth for energy. We don't know yet we don't know, but what And there's also energy futures. Is that off scope? Is that line? >> in fact our co-founder Mark Yanzi has been speaking about this now for quite some time to the extent that even with SoftBank making an offer to acquire Digital Bridge, we went out and we've had made a subsequent agreement to buy Arc Arc Light Capital and energy infrastructure investment business. So yes, we do see and value that area and we look forward to partnering with those people in the near future. So yes, energy is at the core of many of our discussions and and there's an opportunity >> Of course, what's what's the mindset? I'm learning a lot from you on this session and so I'd like to take a few liberties if you don't mind. When Jensen came into New York a couple weeks ago with KKR Goldman, all the players, Brookfield I think was in there, few others. >> Goldman. >> Goldman was in there. So okay, what I saw was Jensen basically trying to get the monkey off his back on this whole circular financing thing which he was taking a lot of heat. Bloomberg had a story, they made up a story or they tried to hang a story out there. I don't think Nvidia is nefarious in the circular finance. I think they're just making the market, that's my opinion. But I think what I heard him say is that look, I want to bring pros in. We need financial capital, financial players, partners to finance the physical plants. I'll use that word loosely. And then so okay, I get that. That's a good thing. And then I say okay, that's the physical plant. So how do you see the financial world coming behind it because a lot of these old school data centers have old school contracts, 10-20 year leases, the contracts are coming in around three to four years, back end years are not loaded at all. They may be on two years visibility. So there's a lot of risk. >> They're yeah, they're they're they're all in >> How are finance people looking at this because the numbers aren't rounding errors. They're significantly B's and maybe a T in the future. >> That's true. So, here's maybe a um a more simplified way to think about it. Uh let's let's uh talk about the infrastructure itself. So, data centers historically have had a useful life in the 10 to 15-year time frame. And so, banks and institutional investors and private credit have all invested, whether you have a an investment grade off-take or non-investment grade off-take, and brought capital to table to actually finance that growth, to go from that 20 uh megawatt data center to that 1 and 2 gigawatt data center complex. So, the uh so, finance has been very constructive there. Um at Digital Bridge, our credit fund uh worked with Magnetar to stand up CoreWeave's first two GPU financing vehicles, which at the time, CoreWeave was not a very significant company. >> the numbers were big, too. >> And right. >> A lot of people were throwing shade on that deal. >> Well, it was $2.3 billion in the first deal, $7.3 in the second. We had a a fan- they had a fant- They had negotiated a fantastic contract with Microsoft. And so, what we brought to the table was some creativity and some belief that this um infrastructure, these chips, had significant value because of the off-take, right? Microsoft had a 5-year um compute deal with CoreWeave, and we helped finance that. And so, >> That was bankable in your mind. >> Completely. Absolutely bankable. Now, the banks wouldn't have done it, and institutional investors weren't ready to do it, but pri- private credit was ready to do it. Um so, I would say Now, now take a step back from those infrastructure deals. 5-year compute deals for chips, 15-year leases with pri- uh with data centers. You know, there's a duration imbalance here, right? So, um what we have found is that there are opportunities to finance both stacks at the same time. So, finance the chips and the data center all at once or finance them independently. And so, really every situation is is somewhat, you know, different. And but we can work with those fundamental >> was creativity and not being hung up on kind of like >> not needing a rating, right? Using our own fundamental uh insight and knowledge of the space and uh trying to find a right resolution for the company, CoreWeave, which is um at the time uh looking to uh for sources of capital and hadn't found many. Um and then working for our LPs as well. >> So, this is not an obvious thing. So, you have to have domain experiences. This is where Do you see this big part of the market because I think this could be more of the trend. But domain risk management's going to come from domain expertise, not just numbers. So, basically you made a bet. You made a bet on CoreWeave. Basically is what you did. >> And and a and a great contract with Microsoft. >> Yeah. >> Um and Nvidia as well, right? We we part of our fundamental analysis was the belief that that ecosystem that group of companies >> Yeah. >> wanted uh to uh Opening Eye to succeed, right? Cuz that's where ultimately the compute was going. >> was a pretty obvious bet, too. They were on a trajectory. Compute we'll be at the CoreWeave conference in 2 weeks, too. We'll get more data from them. >> Of course. But back to your point when Jensen came in and and announced his $500 billion MOU, I'm not sure at the end of the day what problem they're trying to solve. Um we do believe chips are financeable. Um now, does the institutional market feel that way? Does the bank market feel that way? There's evidence that they're they're coming to grips with that, but not on the scale order of how data centers have been financed. And let's remember that if you have if it takes $100 to build a data center, it probably costs $250 for the chips that go into the data center. So, there's a scale order there that needs to get financed. >> why you break it out. >> Correct. So, I think that, you know, what Jensen and NVIDIA are trying to accomplish is to provide um a valuation floor of some sort where more financing sources can look at a 5-year average life or a 6-year average life and find comfort in that. Like we have as well. >> Yeah. And of course, they have the backstop options. They have all kinds of co- trajectory trend data. >> Lots of tools in the bag. >> Yeah, and it's I think that's a market making. What what Do you think that that meeting was really more about confidence too and or am I just conspiracy theory thinking it was just shaking off that noise around backstopping and circular financing? Cuz they got the cash. Why wouldn't you make the market? If I'm motivated to build a physical plant that people can use my chips in. And by the way, there have been durability numbers too on them. >> I From what I can see and for transactions that we have evaluated, I don't think that there is a fundamental circularity to these financings. I believe that NVIDIA is building a business and executing a plan where they're getting compute out into the marketplace. But, I can tell you uh that they are hands-off after a certain point. And they want the marketplace to evolve and thrive without necessarily their micromanaging. And I I I feel confident saying that. So, it's it's a >> It's a nice invisible hand strategy for them. All right. So, what's the focus for you guys now? Because, you know, you got a lot of um activity. I mean, I think we're at the be early innings of this build-out. The edge is going to be massive. I think it's it might look a lot like the early days of the uh internet uh out when you saw UUNETs of the world and Exodus is coming out. Metro pops were popular. I mean, I I was talking to Envidia like if you're going to have an AI factory in Texas, why not have one in New York? Like why can't I just put a metro factory in New York and >> Power. >> Well, I mean a lot of >> Access to power. >> of dormant power in a lot of these buildings. I mean, there's an argument for regional topology. >> We've seen, you know, some >> I've seen a couple of different business models as of late that are really trying to just do that. So, take advantage of opportunities where you have physical infrastructure with available power and connectivity and putting those together to present a a a valuable you know, business plan for inference compute. And I I think that that there there are a lot of merits to that, but I would also say that this is not an easy business. >> No, it's not. Where's the data? I mean, where's the market data? >> Right. So, bringing these three things together at a time and place with the confidence of your off-taker to sign that 5-year contract or that 15-year contract. That's that's why we have a number of portfolio companies that have been quite successful. >> Have you seen the deals where the off-take contracts were significantly large and the company has yet to stand up and turn on clusters? And is that a symptom of a flawed execution or a lack of market? Because, you know, you could I could have a billion dollars in orders. Put it in escrow, but I got to actually go develop deploy. The risk of deploying. >> I You know, I think that there's a lot of speculation in the marketplace about the announcements of deals and now let's see how they get executed. Um, I'm sure as in any other hyper growth phase, we will see some projects that don't move along on the on the on the advertised timeline because of a number of challenges that you know are honestly you know, too many to to list. Um, but I don't think that that's a fundamental flaw in the business proposition. >> Yeah. >> Right? That gets back to the expertise, the focus of those those operations and their ability to deliver. >> final question. What are you excited about now on from a business plan standpoint that you're looking at the kind of category? Is it the data centers? Is the chips? What kind of transactions are you excited to do deals on and will invest in lean into? >> So, we we remain excited about the entire ecosystem. We see predominance of activity in non-investment grade data center development. The high performance compute businesses are largely all non-investment grade. And then your inference cloud companies are of course all of nascent. They're two, three years old. They're non-investment grade as well. That's an awesome place for us to invest. >> grade mean to the average person? >> Yeah, so that that means you know, you don't have a rating from Moody's or S&P that says, you know, you're triple B and above. So, it doesn't >> It requires due diligence. >> It's size and age of operations. It doesn't necessarily mean a company is any less worthy. And that's why we we find them to be terrific places to >> That's where opportunity is lying. >> Cuz you can arbitrate the non-rating value extraction. >> Well, we we like to think of it as as helping these markets develop and just go hearken back to the the initial core weave GPU financings just three years later, you know, many thought that they were more near investment grade than or Yeah, squarely investment grade than non-investment grade. >> Having having Nvidia involved kind of makes it a quasi investment grade. That's a triple A in my mind. So, of course, great to have you on. I'll go on forever learning a lot because I think the the bounding function is not just energy, it's finance. And I think what you're doing and the kind of creativity, bringing the domain expertise, and looking at this thing holistically is where I think a lot of the growth will come from. So, >> Well, it's a real pleasure to sit down with you. >> Yeah, I appreciate I'm John Furrier, host of the Cube. Yeah, AI infrastructure is going to continue to boom. It's only going to get bigger and and bigger and global the edge and the energy and the financial functions are going to be very important to make sure things can hedge the risk, understand risk, but also the upside potential. And AI infrastructure is certainly not a bubble. The demand's there. The systems are in place. It's a matter of the entrepreneurs and the capital finding those constraints and making it happen. We're doing our part here in the Cube. Thanks for watching. >> Clear.