01:41:29 路 Matthew Prince
[01:41:29] S13: And and and now, you know, that's become that's become a pretty pretty important part of our our our business. And so today, you can run inference at the edge of Cloudflare. Yep. And because of the fact that we're, you know, in over 300 cities worldwide, you know, we're within within milliseconds of the vast majority of the world's population, we become a very natural place for inference to happen. I my my working assumption has always been that about 50% of the inference that happens will be on device, whether that's your your phone or your or your laptop or or whatever. But then there needs to be some standard protocol where your phone or your laptop or whatever that local thing is can hand those either long running tasks or larger tasks off next to the network, and so that would be to us. And then if if for some reason you need something that's more than that, then it could handle it back to, you know, some centralized data center with, you know, with with more more capacity than than we may have. And I think that that that's what that's what we're increasingly seeing. I think my my assumption was a little bit probably off. I think actually, I think less is gonna happen on device today because I think more and more of the tasks are going to be these long running Yeah. Task where it's not gonna be just, you know, what what's, you know, what's the, you know, what's the temperature in in New York today. Yeah. Instead, it's gonna be something like, help help me plan a a vacation, go you know, take into account all of these different things, shop for, you know, different hotels in different places, plan all the plan all the, the the travel between between the different locations. Here are the criteria I have. And that might be something that takes, you know, maybe, you know, certainly not not gonna be seconds. It may might be, you know, minutes or hours or days in some cases to run-in that case.
01:43:11 路 Jordi Hays, John Coogan, Matthew Prince, Trent Simonian
[01:43:11] S0: I feel like you're gonna have long running agents just for Park City snow forecasting and reporting, tracking like individual I already do. Individual runs, you know. Maybe a network of maybe a network of drones that are identifying what's tracked out [01:43:26] S1: Satellite photos, planet lapsed. [01:43:28] S0: Optimizing your routes on the mountain. [01:43:30] S1: A lot of stuff. [01:43:30] S13: Exactly that's that's that's exactly right. Hopefully hopefully it snows this year unlike last year's. [01:43:35] S0: Yeah. So [01:43:36] S1: what are the decisions when you're doing inference on the edge? Because it's sort of a hard pitch to say, I'm going to shave off three hundred milliseconds, six hundred milliseconds, when you're talking about a twenty minute workflow or even a ten second workflow, you're getting me a 3% boost. Is that gonna make the difference? But are you optimistic that there will be sort of like a in between state where there will be inference that happens and needs to happen within the request loop under a second and then the the latency matters? [01:44:12] S13: Yeah. Well, I think I think there are there are sort of three different [01:44:15] S12: Yeah.
01:44:15 路 Trent Simonian, Matthew Prince, John Coogan, Farza Majeed
[01:44:15] S12: Yeah. [01:44:16] S13: Buckets why why people are choosing to run inference tasks on on Cloudflare. I think I think the first bucket is exactly what you said. It's just it's latency. And so especially for those things that have human and computer interaction where where, you know, any delay feels like it's it's it it hurts you that people are are trying to make sure that they can get the best best performance possible. [01:44:36] S1: For voice models, I mean, it feels like that has to yeah. Voice models have gotta be local. Yeah. I love that. [01:44:42] S6: Yeah. And so and
01:44:42 路 Farza Majeed, Matthew Prince
[01:44:42] S6: Yeah. And so and [01:44:42] S13: so that's and so, you know, again, there there's a case for that. I think the second case is that a lot of times for either privacy or regulatory reasons, people wanna keep things as close to where they physically are Sure. As possible. And so, you you know, I think that a lot of especially in Europe and otherwise, of places think that, you know, they made a mistake with the Internet kind of one point o and two point o of having everything go back to Ashburn, Virginia, everything go back to The United States. And so I think that there's there's a real kind of sovereign desire to keep things local, and that's important. And I think the third thing is we we actually can be oftentimes much more cost effective because of the fact that, you know, we we are this we are a network and and because of how we're interconnected with networks around the world, bandwidth for us is effectively free. And so it's very easy for us to get things onto our network. And because of where we deploy, systems, we often are in places where we don't have to pay for the space or the power, which allows us to then pass those savings on to customers. So it can be significantly more cost effective to use inference with us than it can be in some other other places. That's somewhat counterintuitive, but but but it's sort of the nature of what we've what we've built and kind of the secret to what's allowed Cloudflare to to to to deliver as much as we have over time.
01:45:59 路 John Coogan
[01:45:59] S1: There there's a ton of ton of debate over data centers, how they get built, how big they should be, what we need, the pushback, regulation, etcetera. Is any of this affecting your business? Are you thinking about how you position your footprint in the real world? How are you processing the evolving discussion around data center construction?
01:46:25 路 Matthew Prince
[01:46:25] S13: Yeah. I mean, so so first of all, I mean, we're we're gonna need more data centers. I think a lot of a lot of the discussion is is somewhat silliness. I mean, the the water consumption I mean, these are closed loop systems. I mean, a a golf course uses more water than than probably all the data centers in The United States over over the course of over a year. Yeah. So, you know, I I think that I think, you know, there there's there's there's a lot of kinda silly concerns that are there. And but but there are but there are real concerns as well. We've gotta make sure that there are efficient ways to get power to these things, that it's not taking power from from other other systems that the grid can support support that. And so I think those are all all all good considerations. For Cloudflare ourselves, you know, it it we're we're we're a little bit different where in in the case of, you know, if you're a a AWS or a Google or, you know, a SpaceX, you're building one big facility or a handful of very big facilities and putting a ton of machines in that that one facility. Cloudflare is different. Have a ton of machines, but we spread them massively all around the world. And oftentimes, we we wanna go into the places where networks come together. And so those those can be, you know, some of the oldest data centers in the world. And in any of those facilities, we may not have we may we may have only hundreds of machines. But over collectively around the world, we've got, you know, what is effectively much larger than any individual data center which is which is out there. So I think we're less less impacted from, you know, the new builds of data centers. I think we're much more impacted by how do we find our way into the existing data centers, and then how do we make sure that the equipment that we're deploying is as power efficient as possible because we're often given sort of, here's the envelope that you have to fit your fit your your equipment in, and we're often guests of, you know, whoever the local ISP is or or or whoever, you know, partner is that we're working within in the, you know, the the thousands of buildings that we're in all around the world.