00:58:57 · Karol Hausman, Mario Gabriele
[00:58:57] S0: Because I think one powerful insight from the language model work is that for a long time, people thought that, you know, we still have a few ideas that are missing or we need a different architecture or we need different this or that. But it turned out that it was good enough. It was just a matter of scaling, and we just didn't have enough foresight to predict how scaling is gonna resolve some of the issues that seem like big issues of of today at small scale. So I think there is a nontrivial chance that the recipe is already there. That the recipe that we have today would work and would just solve everything. And we just need to scale scale it in the right way and execute on it really, really well. Well, I'm not certain about this at all, but I think there is... That's one question that is that is an important question that we're thinking about quite a bit. So what we're trying to do is is verify it. So start scaling the the existing recipe and see how it how it performs, how it scales, and then the same time continue to do research that, at the very least, could improve the the slope of that scale. [01:00:01] S1: NVIDIA and, you know, is probably the best example of a company that is putting a ton of money into improving its sort of simulation engines and getting that to higher and higher fidelity. How optimistic are you about that improving at a sufficiently high rate that it really, I don't know, closes the gap in some meaningful way or allows you to to get the kind of data at scale that could improve things meaningfully? So as I mentioned before, I'm
01:00:01 · Mario Gabriele, Mario Gabriele
[01:00:01] S1: NVIDIA and, you know, is probably the best example of a company that is putting a ton of money into improving its sort of simulation engines and getting that to higher and higher fidelity. How optimistic are you about that improving at a sufficiently high rate that it really, I don't know, closes the gap in some meaningful way or allows you to to get the kind of data at scale that could improve things meaningfully? So as I mentioned before, I'm [01:00:29] S2: I'm quite open minded about these things. I'm not
01:00:29 · Mario Gabriele, Karol Hausman
[01:00:29] S2: I'm quite open minded about these things. I'm not [01:00:31] S0: very pragmatic about the path that's gonna it's gonna take to get there. I think simulation over the past, you know, a decade plus has been improving like crazy. Simulation that we see today is much more realistic than what we've seen in the past and it's becoming more and more scalable. I believe that the first place where we're gonna see the impact of it is not going to be as much data collection as it's going to be evaluation. And one thing we see here at at at Physical Intelligence is that as these models become more powerful, it takes more and more time to evaluate them. So now not only you need to evaluate them for longer, you need to take more samples to distinguish between the model being, you know, at 99% success rate versus 95% rate, the success rate, and it was between, you know, 50 versus 70%. You just need more samples to be statistically significant, but the repertoire becomes broader and broader. So now you need to evaluate them on more tasks across more robots in more environments. And that trend, I think, will continue. As the models get get stronger, you will need to evaluate them for much longer and much more sophisticated ways. So I think if simulation starts to work in the way that we all hope it will, I think that's where it will... We'll see the the first impact of it, where we can start evaluating these models in simulation across diverse set of scenarios. And if they're realistic enough, that should correlate with with real world evaluations.
01:01:58 · Mario Gabriele
[01:01:58] S1: You know, we talked about some of the real inflection points for you over the course of your career. I'm sure that physical intelligence biggest inflection points are are to come. But over the past couple of years so far, what have been the... Maybe the biggest surprises or the the moments that have impressed you the most?
01:02:17 · Karol Hausman
[01:02:17] S0: I think the the main thing is just how fast all of this has been moving and how much it's picking up speed as we go. So before we started the company, we thought that it was gonna take us something like five years maybe to to start deploying robot. And we deployed our first robots, I think, eighteen months into the company. So it either means that I'm very bad at at making those predictions or it's been just moving much, much faster. There's been multiple of these moments. I think our first release, Pi Zero, was definitely one of those moments where I thought it would take a very long time before we have robots folding laundry, especially diverse pieces of laundry fully autonomously. This was one of these holy grail of robotics that I thought were gonna... It's gonna take many, many years before we get to. And we got there within the first seven months of the company. I think the next model was another one of these moments where I thought it was gonna take very, very long to get robots to perform in an environment that they've never seen before. And with our Pi 0.5 release, we got we got robots to new homes that they've never seen before. And home is kinda like the most diverse environment you can imagine. So it's the hardest version of that challenge. And that started working as well. Then with with PyStar six, we started seeing that these robots can perform tasks at very high clip, at very high success rates. And now we have videos of robots doing extremely dexterous tasks like making coffee on the proper espresso machines, machine for like thirteen hours without any cuts, just like thirteen hours straight. The robot is doing coffee over and over again and cleaning after itself. So I think all of this is just moving very, very fast, and every single release so far has been quite surprising to me. I thought it was gonna take longer or that the problem is much more difficult than I than I expected.
01:04:06 · Mario Gabriele
[01:04:06] S1: But I think that's maybe one thing about working with these models. I think probably people working on LLMs would have similar answers that they thought it was gonna take much longer to get to a certain level of capability. You know, when you're running a robot for thirteen hours straight making espresso, what does a good failure rate look like in that in that case, or what are you excited by when you when you see that happening, if anything? And then, you know, something I was talking about with with a friend who's in this industry is that a lot of the times, the failure for these kinds of robots is maybe less obvious and more like it almost doesn't realize it's stuck in some way and and doesn't find a way out of of being stuck in that loop. Is that is that sort of something that you you see a a fair amount in this case?