Invest with AI
00:03:59 · Robert Yang
He just looked at me and said, Um, you are building upon trash, right? So so I was building upon uh this author, David Sussillo, who I later actually did an internship with. He's a great scientist. Um so I was built, uh he's actually a book author and wrote a wrote a book as well. But uh I was building upon his work, and uh and this professor didn't want to call my work trash. He called David Sussillo's work trash and was like, I'm making it a little bit nicer, but it's still trash. Uh he didn't say it's still trash, he's just saying you're building upon trash and making it a little bit nicer, right? Um, but within two years, uh, I think essentially the approach that I was doing and David Sussillo was doing became mainstream very, very quickly. Uh, everyone was using these artificial neural networks, like deep neural networks, to model the brain. Uh, and I actually kind of had a had a like uh existential crisis at the point. I I was having a crisis at MIT because so we realize that the neural networks that um these AI people are putting out, right? The language models, etc., etc., are actually much better models of the brain than uh than the neuroscientists have been building. You know? So so it turns out these people are just out there trying to solve intelligence, and as a result, we're building actually better descriptions of how our human brain works than anyone else did.
00:05:32 · Brett Caughran, Robert Yang
[00:05:32] S1: So that was a real just backing up, is this what inspired you to like it was it sounds like a childhood interest in in artificial intelligence that drove you into computational neuroscience? Is that yeah, yes? [00:05:46] S0: Yes, sorry, I skipped that. So essentially my thinking process was pretty naive. Um I was like, I want to but I want to do AI, right? AI is I think the right form of AI would be a neural network. [00:06:00] S1: And the only working initial inspiration, like what what was it? Did you read was it reading sci-fi? Like what reading, like what you remember, what what sort of got you interested at such a such a young? I can't I can't recall what was on my mind in 2007, but it's it certainly was an AI.
00:06:16 · Robert Yang
[00:06:16] S0: Yeah, yeah. Uh I guess so I was thinking about the I had always wanted to do something important. It's like profound. Um, and I felt like there are not that many profound things out there left to do, right? Like Newton and Einstein already did a lot on physics, we already under we know there's gene, right? So but AI just felt like an obvious, like if we can do this, then this is gonna be extremely important, right? Maybe the most important thing in the in like after Newton, right? This is my my opinion. Um, is I think after I think it's like Newton, Darwin, and AI, right? Um so yeah, I thought I just thought that's what I want to do. Um and I'm naive in the sense that I wasn't really thinking about, oh, like, is the timing gonna be ready, right? Maybe it's not gonna be ready for another 30 years, right? Then uh and and then I also didn't think, am I the right person to do this, right? So uh I didn't really think about these things. Uh in fact, I went to um I went to physics department. Uh I actually considered going to biology, but I went to biology and I was like, what do you study? They're like, we're studying like plants, right? And animals, and that's boring. So so I went into physics because I thought, okay, physics is how you understand the world through mathematics, right? And um essentially you want to understand the intelligence through mathematics. Uh so I went to physics and we we were introducing ourselves, and everyone is like, oh, like I really love physics, blah blah blah. And I was like, I love AI, and if you're interested in AI, please come tell me. Um people were very confused because most people have not even heard of AI, right? It's not, it's like um for people who have heard of it, it's like a sci-fi thing. It's the people didn't think it's a real thing. That was 2008.
00:08:17 · Brett Caughran, Robert Yang
[00:08:17] S1: This was what this was what year? [00:08:19] S0: 2008. [00:08:21] S1: 2008, okay. [00:08:22] S0: Yeah, yeah. Yeah, so that's some so that's how I got into computational neuroscience. Um, so something that a lot of people don't realize is is um really some of the uh AI uh pioneers, uh like for example, Dario at um Anthropic, right, the co-founder CEO, uh he actually did uh computational neuroscience in his PhD. Uh I actually know some of his co-authors. Um and uh and the DeepMind co-founder and CEO, um uh Demis Hassabis also did uh neuroscience. He just did straight up neuroscience in his PhD and then did computational neuroscience in his postdoc. Uh, and DeepMind was kind of spun out of um his postdoc. Uh it's um my I guess what I did is you can call it a mistake, at least from my career standpoint. It's like I spent a little too long uh doing it, right? Um kind of probably the right thing would be at 2017, maybe just pivot to go all the way to like building intelligence, right? Because that that was always my goal, right? Um, but I was I think a bit more like risk averse back then. I was like, I already did PhD, I think I can get a faculty job. [00:09:36] S1: And um uh so yeah, so it's uh but but what does it what does a faculty MIT PhD do in in computational neuroscience do? Like what were what were your responsibilities in that in that seat?
00:09:52 · Robert Yang
[00:09:52] S0: Yeah, so um uh yeah, absolutely. So so uh a faculty is like is essentially these like professors, right? I mean, there's rank, there's like assistant professor, associate professor, right? But we can just call them all professors. And so these these professors they do essentially two things. One is they uh teach uh they they teach undergrads, right? Uh teach undergrads and teach grad students. And for a lot of like people uh right who after the graduate college, this is their main understanding of what these professors do, right? But at a lots of research institutes like MIT and like Stanford, Harvard, um, you can say the main responsibility of the professors are actually to conduct research, right? Typically you you run a research lab that has um somewhere between like five to maybe like 30, 40 people, and uh you kind of just guide them to do research, right? Um so so this is what I was doing. Uh I was at MIT for uh a few years um before I essentially um resigned. And uh I had a pretty good lab, but we actually had uh we had I I didn't have any student who's like I wasn't there long enough to have a student graduate PhD, but I had postdocs. These are people who already have PhDs. I had postdocs who did really well. I had one postdoc who went to CMU to be uh assistant professor in the machine learning department, another one went to Brown uh in the applied mass, and I think I mentored like five, six students who ended up going to like MIT, Berkeley, all these good schools. Uh so I was really, I think, proud of our team. Uh I am proud of our team we had at MIT. Um, but during almost the whole time at MIT, I was like suffering from this existential crisis. Uh to be fair, our our apartment, um I would say I was in part of two apartments. One is uh brain cognitive science, another is uh EECS, electroengineering and computer science. Uh and I would say uh these two apartments, uh departments are are really like the best, right? Maybe like uh the MIT department is definitely among like the top three, four departments in the world in computer science. And the brain cognitive science department I was in, I would argue it's like the number one department in the world to do it.
00:12:15 · Robert Yang
Um but what I realize is it's really not about like okay, is this school it's not about like the school, it's not about MIT, it's not about the department, it's about this entire like tsunami that's coming to everybody, which is AI, just like the AI buildup in industry, right? And they're just like and we're seeing this this year in mathematics, right? Like this AI tsunami just like is is come completely transforming how everyone do their work and making a lot of the old way of doing things just irrelevant, and and you have to adapt, right? So I was feeling that um back at MIT, and I felt to do what I've always wanted to do, which is to build, to build humans, to build um, to build AI, I have to uh go to industry. Uh in fact, I I I didn't want to just join a big lab. Um, so I wanted to do it in a startup. Um and the reason really is is I mean you didn't ask it, but I'll I'll explain it. The reason why I wanted to do a startup is is I think the way that the big labs think about AI is still a bit different from my vision of um of of a human, right? So the big lab is very much focused on um very much focused on intelligence, like capability, right? Um, which which makes a lot of sense. I mean, this is how you how you um how you have a real business model, right? Um so capability that is aligned with human, right? So that's how I would describe it. Uh but there are things in human that's uh that we don't really understand the capability yet. Uh like why why this is useful, right? So I'll give you an example, like why why should human feel happy when they when they get a reward, right? Like you you eat some chocolate, you're not only reinforcement learning, which is a major way that people train neural networks, right? You you give you give a neural network chocolate, and you give through reinforcement learning, you would teach them to to more likely to get chocolate in the future, right? Whatever action that led them to get that chocolate, they're more likely to get that chocolate. But humans, we not only do that, we're also happy to eat that chocolate, right? The current neural networks, we don't think that they're happy, right? When something good happens to them, right? Maybe they will say they're happy, but uh it's I think most people don't really believe that they experience the happiness, right? Um, so so now you can say, well, why is that useful, right?