Lenny's Podcast: Product | Career | Growth
00:35:56 · Lenny Rachitsky, Simon Willison
[00:35:56] S1: Like your brain is exhausted? [00:35:57] S0: My brain is exhausted. I've got more time to go and do things and I do things and it's great, but the exhaustion from that sort of intensity of work has been a really big surprise for me. That's been something which I've been observing, especially since November as all of this stuff started ramping up. And yeah, I think that the concern there comes down... It's always expectations from other people. If you work for a company that's expecting you to get five times more done, that's going to be exhausting. And maybe we'll see. And I think the good companies with good management are paying attention to this and that they don't want to burn out their best employees for the short-term gain, but lose people over it. But yeah, it's a big tension. I think those of us on the sort of leading edge of the AI boom are feeling it first. I imagine it's going to come for everyone else as well. [00:36:50] S1: The other element of this though that we haven't mentioned is, and you've mentioned a couple times, it's actually really fun. The drive here is not-
00:36:50 · Lenny Rachitsky, Simon Willison
[00:36:50] S1: The other element of this though that we haven't mentioned is, and you've mentioned a couple times, it's actually really fun. The drive here is not- [00:36:55] S0: I'm enjoying myself so much. Absolutely. It's so fun. A lot of my friends have been talking about how they have this backlog of side projects. For the last 10, 15 years, they've got projects they never quite finished and ideas they thought would be cool. And some of them are like, "Well, I've done them all now. Last couple of months I just went through and every evening I'm like, 'Let's take that project and finish it and that one and that one and that one and that one.'" And they almost feel a sort of sense of loss at the end where they're like, "Well, okay, my backlog's gone. Now what am I going to build?" [00:37:24] S1: Yeah, it comes back to that factory. I was talking to the founder of Linear the other day and this idea of the factory, and we were just like, a factory doesn't sound like a place that'll create amazing products. It feels like what are the chances that it'll create something beautiful and innovative? So either that's the wrong word or it's just this will lead to bad stuff probably.
00:37:42 · Simon Willison
[00:37:42] S0: I feel like the word artisanal does... Artisanal handcrafted software I think is going to be valued more. Something I've noticed in my own work is sometimes I'll have an idea for a piece of software, Python library or whatever, and I can knock it out in an hour and get to a point where it's got documentation and tests and all of those things and it looks like the kind of software that previously I've spent several weeks on, and I can stick it up on GitHub and everything, and yet I don't believe in it. And the reason I don't believe in it is that I've got to rush through all of those things. I think the quality is probably good, but I haven't spent enough time with it to feel confident in that quality. Most importantly, I haven't used it yet. It turns out when I'm using somebody else's software, the thing I care most about is I want them to have used it for months. I want other people to have put that software into practice. So I've got some very cool software that I've built that I've never used. It was quicker to build it than to actually try and use it. And so the way I've been dealing with that is I always put alpha on it. If you see my software and it says it's an alpha, that probably means I haven't actually used it yet for most of my project, which is a bit of a cheat code, alpha [inaudible 00:38:53]. But isn't that interesting? It used to be if you looked at software and it had high quality tests and documentation and everything, it meant it was good, and now that signal is gone.
00:39:02 · Lenny Rachitsky, Simon Willison
[00:39:02] S1: It's almost like we need a proof of work for this versus the blockchain. [00:39:05] S0: A proof of usage. [00:39:07] S1: Proof of use. [00:39:07] S0: Yes, exactly. [00:39:08] S1: Oh, man. On this note of handcrafted code, I don't know if you know this, this is so interesting, data labeling companies are buying old GitHub repos of handwritten code to train their models on, and they're paying a lot of money for artisanal human written code. [00:39:24] S0: Oh, that's fascinating. That's the pre-World War II, the metal that you can dig up from old shipwrecks, which is before the first nuclear explosions, and so it's not got the radiation baked into the metal. It's that whole thing. [00:39:42] S1: Wow. That's a great metaphor. [00:39:44] S0: That's fascinating. [00:39:44] S1: Yeah. So they're looking for code pre-2022, I think, whenever ChatGPT emerged. [00:39:49] S0: Wow. [00:39:51] S1: So if you've got some, you can make a fortune. [00:39:54] S0: Problem is, I open source all my stuff, so it's already out there. It's been used to train the models already. [00:39:54] S1: It's been slurped up already. [00:40:00] S0: Yep. [00:40:01] S1: Oh, man. Okay. Let me ask you this question. I'm just curious about this prediction. I know you're not a prediction person, although you do make predictions and you seem to be right often. When do you think 50% of engineers in the world will be... AI will be writing 100% of their code? How close to that do you think we are?
00:40:17 · Simon Willison
[00:40:17] S0: So I'm going to refactor that to 95% of their code. I don't think we'll get to it. But yeah, it's very difficult to say worldwide, partly because there are cultural differences. I spend way too much time on hack and use, and something I've noticed about hack and use is a conversation that starts at midnight Pacific time and goes until 8:00 AM, very different tone because it's the Europeans. And the Europeans are a lot more AI skeptic than the Americans are generally. So I think different countries are going to have different cultures around this. At the same time, I think it's become undeniable this year that this stuff produces good code. It used to be that you could say, "I don't use this stuff because the code is bad." And that was a justifiable position. That's not justifiable anymore. The code is now good. It's good code, for my definition of good code at least. So we're saying 50% of engineers, let's say 15 engineers, majority of their code, it could happen by the end of this year. It could, because the technology is good enough now. And I feel like the challenge now is getting people to learn how to use this stuff, which is difficult because using this stuff, everyone's like, "Oh, it must be easy. It's just a chatbot." It's not easy. That's one of the great misconceptions in AI is that using these tools effectively is easy. It takes a lot of practice and it takes a lot of trying things that didn't work and trying things that did work. But yeah, I expect by the end of this year, it will not be uncommon to have an engineer say that almost all of that code is written by AI.
00:41:56 · Lenny Rachitsky, Simon Willison
[00:41:56] S1: That was the same rough idea I had. And how crazy is that, how quickly- [00:42:00] S0: It's wild. [00:42:00] S1: ... this job has changed and what is possible. And I think people, this is a good example of people underestimate how quickly things can change. I think Dario was predicting this a year or two ago, just, "Oh, 100% of code's going to be written by AI," and we were just like- [00:42:14] S0: We all laughed at him. Yeah. [00:42:15] S1: Right. Exactly. Like, "What are you talking about? It's so bad. It's so bad at writing code." And this might come for other jobs that people don't see coming, which is scary and interesting and exciting. [00:42:27] S0: Honestly, I'm not an AI doomer in the slightest. The economics of it do make me nervous. Are we really going to wipe out a tenth of white collar knowledge work jobs in the next few years? I really hope not, because I don't know how the economy adapts to that. So yeah, that's complicated. [00:42:46] S1: Yeah. Actually, I'm doing a report that's coming out, it'll come out ahead of this episode, looking at the job market in tech. And surprisingly, just at tech companies, we're at the highest number of open engineering roles, open PM roles. [00:43:00] S0: Interesting. [00:43:02] S1: Except for during the crazy peak during COVID. So it's kind of coming back to that. Basically, it's the highest number of open roles in three and a half-ish years for engineers and PMs at tech companies globally. [00:43:16] S0: That's very interesting. It's funny, isn't it? Because you get all of these headline grabbing-