Going Direct Conversations
00:01:03 · Michael Cho, Jordan Wolfe, Chris Paxton
[00:01:03] S1: Yeah. Great. How are you? It's morning here in Hangzhou in China. Hopefully, I don't get kicked out by the firewall, but otherwise, yeah, it's great to be here. [00:01:13] S2: Great. So, yeah, Mike's currently in China. Chris is in Pittsburgh, and I'm in San Francisco, so we're a little spread out. So, hey, listen, guys, it was... I was excited to reach out to you all because for most folks that don't know, you guys started a podcast not too long ago called RoboPapers where you're doing weekly interviews with folks that are putting out a variety of technical papers related to research around robotics and kind of moving the field forward. And for everyone that's listening or watching, obviously you all know that If we're ever going to decentralize the real economy, the heart of that new system is decentralized production, of which the heart of that is robotics and automation. So I'm excited to, as you guys like to say, geek out with you a little bit today. And so thanks again. So I want to start here. So where did the two of you guys meet? [00:02:07] S0: That's a good question. That's a better answer. Yeah, that's right. I think Sarah must be.
00:02:07 · Chris Paxton, Michael Cho
[00:02:07] S0: That's a good question. That's a better answer. Yeah, that's right. I think Sarah must be. [00:02:17] S1: So yeah, I'm the odd one because I'm actually not a researcher. Chris is a really good researcher. I'm not even a researcher. But I've been really fascinated by this kind of like AI research for like a decade now. Literally, my hobby is for the last 12 years, let's say, or maybe even longer, I don't know, something like 10 years, sorry, something like 10 years, is to read papers before I sleep. I've been doing that for something like 10 years. What happened was, I think back in 2016, I was in the Bay Area and I crashed this course at Stanford called CS231N. which then was taught by this one PhD student called Andrej Karpathy. So I was there in the front row. I have no idea what's going on, but then I thought that he was just a phenomenal teacher. And since then I've been reading like computer vision, mostly CV papers. in the initial years and of course like in more recent years like robotics paper but that's that's how and then of course bump into Chris and one of those robotic conference and I think Chris is just one of those rare researchers who us I don't know how Chris find the time but he finds the time to share right and which I think is very rare and I thought Yeah, it's been a real privilege for me to do this with him. Anyway, I should stop yapping. Yeah, it's been a lot of fun. [00:03:34] S0: I'm pretty sure I was thinking about it where we met. We met at ICRA in Yokohama, right? So last year in Japan. [00:03:39] S1: Is that right, in person?
00:03:39 · Michael Cho, Chris Paxton, Jordan Wolfe, Jordan Wolfe
[00:03:39] S1: Is that right, in person? [00:03:41] S0: Yeah, I think that's right. I think so, yeah. Yeah, so a year and a half, right? That was... And ironically, also, I learned deep learning from Andrew Karpathy's lectures, too. So I think that's true of basically everyone of my generation in AI. So it's, anyway. [00:03:57] S2: Cool. And so, Chris, I'll start with you. So kind of your journey in the robotics space, you were at NVIDIA and Meta for a little while and now at Agility. Is that right, Agility? [00:04:09] S3: Yeah. So just kind of walk through kind of your kind of experience in the embodied AI [00:04:15] S2: space, getting kind of up to date. So I actually got my start in my PhD at Johns Hopkins University in Maryland.
00:04:15 · Jordan Wolfe, Chris Paxton
[00:04:15] S2: space, getting kind of up to date. So I actually got my start in my PhD at Johns Hopkins University in Maryland. [00:04:26] S0: Initially, we were doing surgical industrial robotics. We did a bunch of work on how to teach robots to do different tasks and try to make them easier to use and all this. And this was all before deep learning really worked. So it's all stuff that it's ironic looking back at it now, because a lot of it doesn't like It ended up being quite different, I think, than the things that actually we use these days. But then after that, I went to... Actually, during that, I missed one, which is that I did a co-op at Zoox, so I went to Zoox for like a year and a half. So Zoox is a self-driving car company. So that was... But then I did post-doc. And was there for a while, moved to Pittsburgh. And then I moved to Pittsburgh, then I moved to Meta. And since then, I've been at startups after Meta, which is, yeah, so I've done, I've worked in a lot of different parts of robotics over the years, actually. I mean, yeah, many different robotics fields and industries. [00:05:24] S2: I don't know. Is there kind of an underlying theme with kind of your research or what you work on that you enjoy doing across the different robotic systems? Or is it kind of pretty wide ranging?
00:05:24 · Jordan Wolfe, Chris Paxton
[00:05:24] S2: I don't know. Is there kind of an underlying theme with kind of your research or what you work on that you enjoy doing across the different robotic systems? Or is it kind of pretty wide ranging? [00:05:35] S0: I think it's been wide-ranging, but my research area, the area that I've always been excited about is long horizon reasoning and planning for robots. How do we get robots to do multi-step tasks? How do we get them to reason and be able to interact with the world? One of the things I was most excited about last year was working on the work on Meta and the work that I did last year was around home robots and reasoning about how can they reason about and represent their environments to be able to make long horizon decisions. What that means in practice is me being able to tell my robot, hey, can you go find me my drink and have it go and search the house and look for it and pick it up and bring it to you, stuff like that. Because obviously this is actually still fairly challenging for robotics, that kind of stuff. And I think home robotics is something that I've always been very excited about, passionate about, which is not quick. [00:06:29] S2: And Mike, so Mike, over to you. So obviously, outside of RoboPapers, what's the day job or what do you do every day?
00:06:29 · Jordan Wolfe, Michael Cho
[00:06:29] S2: And Mike, so Mike, over to you. So obviously, outside of RoboPapers, what's the day job or what do you do every day? [00:06:40] S1: Yeah. So, yeah, I'm the co-founder of this project called BitRobot, where we're trying to use crypto incentives to incentivize, well, gather resources to push forward like embodied AI research. I don't know whether I lost you at the moment I say crypto, it just made me like 10 times less serious. But I genuinely believe you. [00:07:02] S2: Not at all, but go ahead.