Lenny's Podcast: Product | Career | Growth
00:44:42 · Lenny Rachitsky, Cat Wu
[00:44:42] S1: What's interesting about this Slack is the tool that nobody's... It's just like nobody's trying to create their own. Slack just continues to win, and this is just like the way you describe it as the OS of so many companies. It's so interesting. People talk about Salesforce as just SaaS. We don't need SaaS software anymore. We're going to build our own. It's like Slack is a durable tool that nobody wants to try to compete with and build a better version. [00:45:04] S0: I think it's pretty important communications infrastructure, and I think they do the core task of helping everyone get real-time updates incredibly well. [00:45:13] S1: Yeah, people hate on Slack, but it's really great at what it's trying to do, and the most cutting-edge teams are hooked on it. It's so interesting. [00:45:21] S0: Yeah, and I also love how easy they've made to customize it. And so we love making Slack bots and this kind of hackability means that we're able to integrate with Slack the way that we want to. So really appreciate Slack's work on that.
00:45:38 · Lenny Rachitsky
[00:45:38] S1: Time to buy some CRM stock. I am so excited to tell you about this season's supporting sponsor Vanta. Vanta helps over 15,000 companies like Cursor, Ramp, Duolingo, Snowflake, and Atlassian earn and prove trust with their customers. Teams are building and shipping products faster than ever thanks to AI, but as a result, the amount of risk being introduced into your product and your business is higher than it's ever been. Every security leader that I talk to is feeling the increasing weight of protecting their organization, their business, and not to mention their customer data. Because things are moving so fast, they are constantly reacting, having to guess at priorities, and having to make do with outdated solutions. Vanta automates compliance and risk management with over 35 security and privacy frameworks, including SOC 2, ISO 27001, and HIPAA. This helps companies get compliant fast and stay compliant. More than ever before, trust has the power to make or break your business. Learn more at vanta.com/lenny. And as a listener of this podcast, you get $1,000 off Vanta. That's vanta.com/lenny. Okay. So you talked about all these different teams and how they use Claude Code and Cowork to operate. Which teams do you find other than engineering... Imagine engineering is the biggest token spender, but if not, that'd be really interesting. What's the second place function right now for tokens?
00:47:04 · Cat Wu, Lenny Rachitsky
[00:47:04] S0: Oh, Applied AI is amazing at pushing the boundaries of what Claude Code and Cowork can do. A lot of our Applied AI team spends time with our customers helping them adopt our API, and so sometimes our Applied AI team will, for example, make prototypes on behalf of these customers, which Claude Code makes so much faster than it used to do. They also have the dual goal of needing to manage a lot of customer comms, a lot of customer inbound and historical context, call notes, and so they're both extremely heavy on Cowork and on Claude Code. [00:47:42] S1: And just to understand Applied AI, is that forward to play engineering sort of role? How would most people describe what the Applied AI team is doing? [00:47:52] S0: Yeah, it's helping our customers adopt the latest API and model features across their company, both for powering their company's products and also for internal acceleration. [00:48:05] S1: Got it. So it's like customer success, go to marketing, kind of for deploy engineering sort of thing. [00:48:11] S0: Exactly. It's like a very technical go to-market person. [00:48:13] S1: Got it. Okay, awesome. So you're saying that might be the second org that uses the most tokens?
00:48:13 · Lenny Rachitsky, Cat Wu
[00:48:13] S1: Got it. Okay, awesome. So you're saying that might be the second org that uses the most tokens? [00:48:19] S0: Yeah. And then we also see them pushing the boundaries of what Cowork can do. So for example, if... So a lot of these folks cover multiple customers and in any given day can have five to 10 customer engagements on a high day, and so what they often use Cowork to do is the night before, they'll ask it to summarize, okay, what are all my customer meetings that are coming up the next day? What are all the things that this customer has asked me for? What's top of mind for them? What are the action items from the past meetings? And Cowork will just put together this dossier, this brief of what they should be aware of going into the next meeting. And Cowork can also research answers. So if a customer asks, "Okay, when is feature X going to launch?" Cowork can help the Applied AI person research through Slack to get the latest ETA, add that to the notes so that during the customer call, the Applied AI person has the absolute latest. And these are just workflows that people are building for themselves and sharing with other people on their team. [00:49:25] S1: So cool. Something that kind of this question, this trend, I don't know, question topic comes up a lot recently, which is tokens spend exceeding people's salary where people just use AI and it costs more than how much they're making. Are there any numbers floating around Anthropic of just how much tokens spend, say, engineers spend, I don't know, a month, a day or PMs, anything like that?
00:49:25 · Lenny Rachitsky, Cat Wu
[00:49:25] S1: So cool. Something that kind of this question, this trend, I don't know, question topic comes up a lot recently, which is tokens spend exceeding people's salary where people just use AI and it costs more than how much they're making. Are there any numbers floating around Anthropic of just how much tokens spend, say, engineers spend, I don't know, a month, a day or PMs, anything like that? [00:49:50] S0: It is clear to us that as the models get better, people delegate far more tasks to it and they spend a lot more hours in tools like Claude Code and Cowork, and so we do see the token cost per engineer or per any knowledge worker increase every time that there's a model jump or a substantial product improvement. I think it's still much lower than what the average engineer salary is, but we see the percentage increasing over time. [00:50:22] S1: It's such an interesting... We talked about how you have access to the most cutting-edge models and other advantage of working Anthropic, I believe you guys have basically unlimited tokens. You can use as much as you want. Is that right? [00:50:33] S0: We can use a lot of tokens. Some people do run into limits, so- [00:50:37] S1: Okay, there's a limit. Okay. Boris, shut it down. Okay. It's so interesting how many advantages come from having the most advanced model. It's such an interesting flywheel that starts to kick in.
00:50:37 · Lenny Rachitsky, Cat Wu
[00:50:37] S1: Okay, there's a limit. Okay. Boris, shut it down. Okay. It's so interesting how many advantages come from having the most advanced model. It's such an interesting flywheel that starts to kick in. [00:50:49] S0: I think we also believe a lot in empowering our internal teams to build as fast as possible, and we also trust that everyone understands how much capacity that serving these models truly costs, and we trust our team to use the tokens responsibly. So it's very frowned upon to waste tokens, but we do trust individuals to make that judgment call. [00:51:14] S1: Awesome. Coming back to the PM role, we talked a little bit about this, but I think this will be really interesting for people to hear. Just what I want to understand is what do you think are the emerging skills that PMs need to develop/you most look for, AI companies most look for when they're hiring PMs these days?