00:11:55 · Molly O'Shea, Parag Agrawal
[00:11:55] S1: I can't discount that this was really just invented. So, how did you... You mentioned this at the start of the interview, but like, you have been obsessed with this for a while. So, what does that mean and how? [00:12:08] S2: So I think I got obsessed with it now almost three and a half years ago. I was the... I don't know if people remember, there was like this moment of this baby AGI and auto GPT speaking of oftentimes developers in the open source world being ahead of everything else. People were building with like, I don't know what is the model of the day, GP three point or whatever, like old models that weren't like relative to today. They were like really bad models, Relative to today. And people were trying all these things, and I was trying all of these things to try and make things work. And they didn't work. But if you believed you spent any time with the labs back then, you internalized how models will scale and how models will improve. Like in some sense today, it feels like everything changes every month. In some sense, I [00:13:03] S1: don't know if it's every month, it might be every week.
00:13:03 · Molly O'Shea, Parag Agrawal
[00:13:03] S1: don't know if it's every month, it might be every week. [00:13:05] S2: But if you look at it in a different way, almost nothing that is happening is diverging from what you could have predicted in a straight line three years ago. Models will keep getting bigger and better. They will run for longer. Holding capability constant, models will get way way way smaller and cheaper. And people will be able to productize around them to disrupt every category of work that can be done on a computer. These were very simple things that we believed and said three years ago. And we have only seen evidence week on week and month on month supporting these very few simple things. Yeah. And almost everything follows. So now you can say, yeah, I didn't have, I didn't predict that like the big category would be coding agents first. Right. I didn't predict the CLI form factor. Right? Those were all bits of information and news to me along the way. But the macro thesis of agents are going to get more capable. You're going to do a bunch of inference and for all the inference you do, you're going to have to do web search along it. I've now been on the record everywhere saying like, like the one invariant I believe is we will use a lot of GPUs for model inference for agents, whether they be at work or consumer agents. And for every 10 GPUs, the world spends on model inference will spend one to two on web search. That's the business I'm in. [00:14:47] S1: So are you aggregating GPUs? You've raised $230,000,000 reported and announced. I don't know. But are you aggregating GPUs?
00:14:47 · Molly O'Shea, Parag Agrawal
[00:14:47] S1: So are you aggregating GPUs? You've raised $230,000,000 reported and announced. I don't know. But are you aggregating GPUs? [00:14:57] S2: Yeah, we are not. I wouldn't use the word aggregating. We are buying, renting GPUs to build the scale of search traffic that we are seeing and expecting. And as I said, we grow alongside inference. So inference is growing. So we have to do a proportionate amount. I don't know if it's like already a, I don't think it's a core competency of ours. Like we have been in multiple mad GPU scrambles in the last three months to be like, oh, shit, we need GPUs. We don't have GPUs. Can someone figure it out? Like, you're making a bunch of calls. [00:15:39] S1: Who are you calling? [00:15:40] S2: Sorry? [00:15:40] S1: Who are you calling? Everyone. Everyone. [00:15:45] S2: Like every hyperscaler, every neo cloud. [00:15:49] S1: What's like the typical response back? Because this comes up in pretty much every conversation now. It's like, how do you get, I guess the allocation of GPUs?
00:15:49 · Molly O'Shea, Parag Agrawal
[00:15:49] S1: What's like the typical response back? Because this comes up in pretty much every conversation now. It's like, how do you get, I guess the allocation of GPUs? [00:15:58] S2: No, I think it's like, I think the, at least for us, I think it's true for many people. It's like, okay, which GPU is it? Physically, is it? Sometimes we need GPUs within five milliseconds of where a large web index is sitting. Other GPUs which sometimes more flexible, right? There are multiple GPU workloads. It's not just like, okay, do you have GPUs for me? It's like, do you have the right GPU in the right scale in the right physical locations for me available at the right time? And that is what makes the problem much harder. I think so far we have managed to solve every problem we have encountered. We've not had to turn away a customer because I didn't have a GPU. [00:16:49] S1: Right. [00:16:49] S2: But we've had a bunch of GPU acquisition fire drills. [00:16:56] S1: I mean, that's a really interesting line to go down. It's like, what is the sourcing process like for GPUs? Like, what are the main questions that you're asking? What do you need?
00:16:56 · Molly O'Shea, Parag Agrawal
[00:16:56] S1: I mean, that's a really interesting line to go down. It's like, what is the sourcing process like for GPUs? Like, what are the main questions that you're asking? What do you need? [00:17:05] S2: Yeah. So I think you mostly... So I think different workloads are different. For the bulk of our workload, it's like how many GPUs, which types are you open to? When do you need them? And where must they be? So it's like, there's too much more to it. I think for certain large training clusters, there's a little bit more to it. And then for us, you willing to commit enough duration to that physical thing? Yeah, but that's not complicated. The reality is that the, I wouldn't say the market is entirely efficient right now. Like a lot of it is on iMessage. Really? Yeah. So yeah, but it works. The market works. [00:17:49] S1: Well, that's crazy. So you're doing deals on iMessage for GPUs? [00:17:53] S2: Not exactly. You're figuring out availability on iMessage. And then, like, the the finance person then calls the finance person and the paperwork gets done. Oh my god.
00:18:03 · Molly O'Shea
[00:18:03] S1: This episode is brought to you by Brex, my favorite. You become what you spend on and I refuse to spend my time on work that shouldn't exist. Expense reports, receipt chasing, and manual closes. The companies building what's next from Vercel, OpenAI, Anthropic, Granola, and Deepgram all made the same call. They all run on Brex. Brex is the intelligent finance platform that combines cards, expenses, and banking into a single stack with agentic finance built in. AI agents that handle expenses automatically, enforce policy before spend happens, and close your books in minutes. That's why Sorcery runs on Brex, I can spend time on building and not busy work. It's time to get Brex AF. Learn more at brex.com/sorcery. That's brex.com/sourcery. Bye. From Handshake to Signature Faster, Harvey, the AI platform built for legal work, is trusted by 80% of the Amlaw 100 and over 20% of the Fortune five hundred. Learn more today at harvey.ai. That's harvey.ai. AI needs more than chips. It needs power, land, and infrastructure. Zone develops next generation data center campuses, partnering with AI companies, site developers, and technology leaders to bring compute online faster and at scale. Zone is building the foundation of the AI frontier. Visit zonefrontier.com to learn more. That's zonefrontier.com to learn more. I want to go back to the topic of scale because we were chatting about historical scale and what that used to look like and what you would expect. So you were at Twitter for eleven years, you were CTO, then you became CEO.