00:04:33 · Pat Grady, Ronak Malde
[00:04:33] S2: Yeah. So how do you connect the dots to the real world and how much of that is product or productizable and how much of that is just handholding and helping people through the process? [00:04:44] S0: Yeah, so up until now, it's been really hard to just go from this fact of like data to intelligence. Up until now, that's only been in the labs and you need a massive research team. When, so in the last couple of years, we started to have vertical companies going into this space as well and building a massive research team. So I was previously at Windsurf where we embarked on this journey and trained a model, so we won. So did Cursor as well with Cursor Composer, but the problem was you needed hundreds of millions of dollars of R and D in compute. You needed a really massive research team to invest in, and then you also needed a lot of time. So it took us six to nine months to actually get to that point where we could train a frontier model, and that is with a kind of handholding sort of consulting model. That's still sort of the world that we live in. I think any good product exists when you have every single company in the world trying to do the same thing over and over and over again, and if you can package that into a really beautiful interface that just says, Here are the knobs and levers that you care about to translate what good looks like, and then everything else is packaged away, I think that's a beautiful interface to do that.
00:04:44 · Ronak Malde, Lauren Reeder
[00:04:44] S0: Yeah, so up until now, it's been really hard to just go from this fact of like data to intelligence. Up until now, that's only been in the labs and you need a massive research team. When, so in the last couple of years, we started to have vertical companies going into this space as well and building a massive research team. So I was previously at Windsurf where we embarked on this journey and trained a model, so we won. So did Cursor as well with Cursor Composer, but the problem was you needed hundreds of millions of dollars of R and D in compute. You needed a really massive research team to invest in, and then you also needed a lot of time. So it took us six to nine months to actually get to that point where we could train a frontier model, and that is with a kind of handholding sort of consulting model. That's still sort of the world that we live in. I think any good product exists when you have every single company in the world trying to do the same thing over and over and over again, and if you can package that into a really beautiful interface that just says, Here are the knobs and levers that you care about to translate what good looks like, and then everything else is packaged away, I think that's a beautiful interface to do that. [00:05:56] S1: What did you and your co founders see when you were at Windsurf and when they were working on models as well to help you realize, hey, this is repeatable, that there is a project build. When did you have that moment and that realization?
00:06:07 · Ronak Malde
[00:06:07] S0: Yeah, so part of it was, you know, we were training these models on production, like basically it's saying, What are all these edits, the retries that are happening in the product? And learning from that at Windsurf. And then combined with that, so my co founders, Michael was at DeepMind as well. He was working on Gemini Robotics, and they're starting to see the same thing where you could actually deploy these robots in the real world, build continual learning infrastructure to basically allow these robots to update every single day. And then Arjun was at Apple working on the Vision Pro, and the same thing was, he was basically saying, how can we take artist feedback and use that for multimodal foundation models? So in one way or another, all of us were basically figuring out this grand alignment problem of how do you actually take this feedback from the real world and improve the models? The problem is we were all at these big research labs, right? And so I started to realize, okay, continual learning is going to be the next learning paradigm. Is there a way that I can actually do this within the labs? And the thing I very quickly realized is at DeepMind, we, our entire focus was training one massive model and then distributing that one model to everyone in the And that's been a winning business model, obviously, across the board. But if you want to basically take one model, customize that for a single person, and then distribute that one model, like just for that customer, Like, for example, what our platform does with Harvey, that is an immense amount of infrastructure for a massive lab to build just for one customer.
00:07:36 · Pat Grady, Ronak Malde
[00:07:36] S2: Yeah, talk about what you guys have done with Harvey, maybe as an example. [00:07:39] S0: So, basically, they were up until now riding on top of the Frontier closed source models, models, right? Right? And they've been able to build incredible interfaces and products on top of that, that help tons of law firms in the world. But what they realized is they have an immense amount of knowledge of data, of all of this nuance built up that they are actually able to see what the law firms actually care about, and the built up experience of just thirty years of working in this domain, and with using frontier models, they're unable to actually take that data and use that to their advantage. And so what they realized is, hey, okay, they're able to construct, for example, a legal agent benchmark and what they released, and using all of the expert information that they have, and then if they get the power to basically use that data to train a model, then they get to shape their own destiny. So with Trajectory, what they were able to do is train a model that is six times cheaper, and it goes from around 4% accuracy for an open source model to around 18%. And this is, there's still so much room to grow, obviously, what they're able to do, but now suddenly they get the power of a research lab. And on top of that, the nice part is these models end up being six times cheaper than the Frontier, and so you're able to expend so many more tokens to achieve these tasks.
00:07:39 · Ronak Malde, Lauren Reeder
[00:07:39] S0: So, basically, they were up until now riding on top of the Frontier closed source models, models, right? Right? And they've been able to build incredible interfaces and products on top of that, that help tons of law firms in the world. But what they realized is they have an immense amount of knowledge of data, of all of this nuance built up that they are actually able to see what the law firms actually care about, and the built up experience of just thirty years of working in this domain, and with using frontier models, they're unable to actually take that data and use that to their advantage. And so what they realized is, hey, okay, they're able to construct, for example, a legal agent benchmark and what they released, and using all of the expert information that they have, and then if they get the power to basically use that data to train a model, then they get to shape their own destiny. So with Trajectory, what they were able to do is train a model that is six times cheaper, and it goes from around 4% accuracy for an open source model to around 18%. And this is, there's still so much room to grow, obviously, what they're able to do, but now suddenly they get the power of a research lab. And on top of that, the nice part is these models end up being six times cheaper than the Frontier, and so you're able to expend so many more tokens to achieve these tasks. [00:08:55] S1: So you picked the name Trajectory, as it's related to this Continual Learning concept. How did you pick the name and tell us how it fits into what you guys are doing?
00:08:55 · Lauren Reeder, Ronak Malde
[00:08:55] S1: So you picked the name Trajectory, as it's related to this Continual Learning concept. How did you pick the name and tell us how it fits into what you guys are doing? [00:09:02] S0: Yeah, so it's funny because the world right now is very focused on tokens, and I think a lot of people view tokens as a unit of work, but if you think about the way that we interact with other humans, I'm not counting the amount of words that you're actually talking about, right? And with coworkers, we, a lot of the time, are thinking about a task or a trajectory, and that's the unit of work that I really want to get to it. In RL, it basically is synonymous with a rollout or what you would actually do in a training stack, and with continual learning, you have an RL training stack that's like a rollout engine and a trainer. A rollout engine is just like in a simulation, basically like doing a bunch of rollouts and doing these trajectories. In the real world for continual learning, your rollout engine becomes just the inference and the tokens in the real world, and now suddenly your trajectories are the tasks of economic value that are happening. And so I want this basically paradigm to propagate, where the unit of work that we think about is a trajectory. Beyond that, I think for also people that don't understand RL, it is also super nice that we are basically letting companies just own that path and really grow on their own. I think it has this nice double entendre.