00:01:14 · Ronak Malde
[00:01:14] S0: That's a great question. So when I think about continual learning, I actually think the human brain is a really good model for where we should aspire to get to. Like, in some sense, we are true continual learners. We learn online, we are constantly updating, iterating, and I think the world we're in right now with agents and AI is kind of, like you said, pseudo continual learning. When I was growing up, my family used to do a bunch of road trips, right? And I don't know how you guys did things, but we would go to AAA back in the day, and like, they would give us a bunch of these maps, they would like highlight everything, and then we'd go on a road trip, and like, if there's any point where we wanted to change our route, we'd have to either call AAA or like go to a physical location, and I feel like that's the world we're in right now, where we have these amazing agents, they're very intelligent, we have these mapping algorithms, but you can only consult offline a couple of places, and anytime you wanna update your course, have to just do an entire mass batch update. What the first goal, and what we're building at Trajectory, is first the ability to just democratize that access, to even just training these models and customizing them for what people want. I think of that as kind of like MapQuest, where suddenly it's still offline, but we at least got the ability for everyone to not need to go to AAA, but get the ability to map these algorithms. But the final stage of continual learning is something more like Google Maps, where every single time you're driving, every route that you make, it is updating. It's learning aggregate what the fastest route is and where the traffic is. That's the world I wanna get to.
00:02:47 · Pat Grady
[00:02:47] S2: That's a really good analogy. So, we had... Recently, we had Rich Sutton and David Silver on the show, and both of them kinda made the comment that continual learning isn't really possible with today's architectures. I'm curious in your point of view, what's doable, what's not doable, what's the state of play, do we need major architectural leaps to kind of bring this to fruition, where are we today?
00:03:11 · Ronak Malde
[00:03:11] S0: Yeah, so it's funny because when you think about a transformer in LLMs, I feel like a lot of people have seen maybe Karpathy's TinyGPT video or something where you basically have this stack of attention blocks and transformers that are built on top of each other. And a lot of LLM scaling has just been stacking these transformers on top of each other. But when you look at like any paper, like DeepSeek v4.1 flash that just came out recently, their architecture is actually kind of lobotomized or changed a lot of that base architecture, where you have things like fast and slow memory within the weights. You have skip connections that are going between layer two and layer 50. And so I think these architectural changes are actually already happening within the base models, and it will be a key component, I do agree, for continual learning. Where I want to sit is basically leverage all of that technology and research that's happening at the architectural level, but then actually connect the dots to the real world, because at the end of the day, the real value of any AI progress, but certainly continual learning, is how are people actually using models in the real world? And I think companies have this idea of basically what good looks like in their mind, and the hardest part of this entire loop is then translating that to actual improvements for the model. I think that's where that missing layer is.
00:04:33 · Pat Grady, Ronak Malde
[00:04:33] S2: Yeah. So how do you connect the dots to the real world and how much of that is product or productizable and how much of that is just handholding and helping people through the process? [00:04:44] S0: Yeah, so up until now, it's been really hard to just go from this fact of like data to intelligence. Up until now, that's only been in the labs and you need a massive research team. When, so in the last couple of years, we started to have vertical companies going into this space as well and building a massive research team. So I was previously at Windsurf where we embarked on this journey and trained a model, so we won. So did Cursor as well with Cursor Composer, but the problem was you needed hundreds of millions of dollars of R and D in compute. You needed a really massive research team to invest in, and then you also needed a lot of time. So it took us six to nine months to actually get to that point where we could train a frontier model, and that is with a kind of handholding sort of consulting model. That's still sort of the world that we live in. I think any good product exists when you have every single company in the world trying to do the same thing over and over and over again, and if you can package that into a really beautiful interface that just says, Here are the knobs and levers that you care about to translate what good looks like, and then everything else is packaged away, I think that's a beautiful interface to do that.
00:04:44 · Ronak Malde, Lauren Reeder
[00:04:44] S0: Yeah, so up until now, it's been really hard to just go from this fact of like data to intelligence. Up until now, that's only been in the labs and you need a massive research team. When, so in the last couple of years, we started to have vertical companies going into this space as well and building a massive research team. So I was previously at Windsurf where we embarked on this journey and trained a model, so we won. So did Cursor as well with Cursor Composer, but the problem was you needed hundreds of millions of dollars of R and D in compute. You needed a really massive research team to invest in, and then you also needed a lot of time. So it took us six to nine months to actually get to that point where we could train a frontier model, and that is with a kind of handholding sort of consulting model. That's still sort of the world that we live in. I think any good product exists when you have every single company in the world trying to do the same thing over and over and over again, and if you can package that into a really beautiful interface that just says, Here are the knobs and levers that you care about to translate what good looks like, and then everything else is packaged away, I think that's a beautiful interface to do that. [00:05:56] S1: What did you and your co founders see when you were at Windsurf and when they were working on models as well to help you realize, hey, this is repeatable, that there is a project build. When did you have that moment and that realization?
00:06:07 · Ronak Malde
[00:06:07] S0: Yeah, so part of it was, you know, we were training these models on production, like basically it's saying, What are all these edits, the retries that are happening in the product? And learning from that at Windsurf. And then combined with that, so my co founders, Michael was at DeepMind as well. He was working on Gemini Robotics, and they're starting to see the same thing where you could actually deploy these robots in the real world, build continual learning infrastructure to basically allow these robots to update every single day. And then Arjun was at Apple working on the Vision Pro, and the same thing was, he was basically saying, how can we take artist feedback and use that for multimodal foundation models? So in one way or another, all of us were basically figuring out this grand alignment problem of how do you actually take this feedback from the real world and improve the models? The problem is we were all at these big research labs, right? And so I started to realize, okay, continual learning is going to be the next learning paradigm. Is there a way that I can actually do this within the labs? And the thing I very quickly realized is at DeepMind, we, our entire focus was training one massive model and then distributing that one model to everyone in the And that's been a winning business model, obviously, across the board. But if you want to basically take one model, customize that for a single person, and then distribute that one model, like just for that customer, Like, for example, what our platform does with Harvey, that is an immense amount of infrastructure for a massive lab to build just for one customer.