Lenny's Podcast: Product | Career | Growth
00:43:06 · Lenny Rachitsky, Cat Wu
[00:43:06] S1: I got to hear more. What are some examples? What are things you've built, other people built that are really popular and useful? [00:43:12] S0: One of the sales folks on Claude Code, he realized he was making these repetitive decks over and over and over again, and so he actually has this web app that he built with the examples of the core Claude Code decks that we know work well, so like a 101, 201 and mastering Claude Code, and then he has a way to input specific customer context that pulls from Salesforce, that pulls from Gong, that pulls from other notes so that we can customize the decks for specific customers. And so we'll pull out things like, okay, this customer is using Bedrock or Claude for enterprise or console, which affects what features are available to them. It'll pull out things like, okay, this customer is concerned about the code review stage of the SLC, and so we'll add a slide about our code review features there. It'll pull out things like, okay, this customer needs to be HIPAA-compliant or needs X, Y, Z security controls, and so we'll make sure to add a slide or two in their deck about that. And then for example, if this is a customer that's on Vertex or Bedrock and doesn't want to use Claude for enterprise, then we'll just take out some of the slides that are Claude for enterprise-only features. And so normally this is manual work that could take 20, 30 minutes, and so people will either spend that time doing it or they'll just decide not to do it and use the general deck. With this, it takes a few seconds and you get a tailored deck.
00:44:42 · Lenny Rachitsky, Cat Wu
[00:44:42] S1: What's interesting about this Slack is the tool that nobody's... It's just like nobody's trying to create their own. Slack just continues to win, and this is just like the way you describe it as the OS of so many companies. It's so interesting. People talk about Salesforce as just SaaS. We don't need SaaS software anymore. We're going to build our own. It's like Slack is a durable tool that nobody wants to try to compete with and build a better version. [00:45:04] S0: I think it's pretty important communications infrastructure, and I think they do the core task of helping everyone get real-time updates incredibly well. [00:45:13] S1: Yeah, people hate on Slack, but it's really great at what it's trying to do, and the most cutting-edge teams are hooked on it. It's so interesting. [00:45:21] S0: Yeah, and I also love how easy they've made to customize it. And so we love making Slack bots and this kind of hackability means that we're able to integrate with Slack the way that we want to. So really appreciate Slack's work on that.
00:45:38 · Lenny Rachitsky
[00:45:38] S1: Time to buy some CRM stock. I am so excited to tell you about this season's supporting sponsor Vanta. Vanta helps over 15,000 companies like Cursor, Ramp, Duolingo, Snowflake, and Atlassian earn and prove trust with their customers. Teams are building and shipping products faster than ever thanks to AI, but as a result, the amount of risk being introduced into your product and your business is higher than it's ever been. Every security leader that I talk to is feeling the increasing weight of protecting their organization, their business, and not to mention their customer data. Because things are moving so fast, they are constantly reacting, having to guess at priorities, and having to make do with outdated solutions. Vanta automates compliance and risk management with over 35 security and privacy frameworks, including SOC 2, ISO 27001, and HIPAA. This helps companies get compliant fast and stay compliant. More than ever before, trust has the power to make or break your business. Learn more at vanta.com/lenny. And as a listener of this podcast, you get $1,000 off Vanta. That's vanta.com/lenny. Okay. So you talked about all these different teams and how they use Claude Code and Cowork to operate. Which teams do you find other than engineering... Imagine engineering is the biggest token spender, but if not, that'd be really interesting. What's the second place function right now for tokens?
00:47:04 · Cat Wu, Lenny Rachitsky
[00:47:04] S0: Oh, Applied AI is amazing at pushing the boundaries of what Claude Code and Cowork can do. A lot of our Applied AI team spends time with our customers helping them adopt our API, and so sometimes our Applied AI team will, for example, make prototypes on behalf of these customers, which Claude Code makes so much faster than it used to do. They also have the dual goal of needing to manage a lot of customer comms, a lot of customer inbound and historical context, call notes, and so they're both extremely heavy on Cowork and on Claude Code. [00:47:42] S1: And just to understand Applied AI, is that forward to play engineering sort of role? How would most people describe what the Applied AI team is doing? [00:47:52] S0: Yeah, it's helping our customers adopt the latest API and model features across their company, both for powering their company's products and also for internal acceleration. [00:48:05] S1: Got it. So it's like customer success, go to marketing, kind of for deploy engineering sort of thing. [00:48:11] S0: Exactly. It's like a very technical go to-market person. [00:48:13] S1: Got it. Okay, awesome. So you're saying that might be the second org that uses the most tokens?
00:48:13 · Lenny Rachitsky, Cat Wu
[00:48:13] S1: Got it. Okay, awesome. So you're saying that might be the second org that uses the most tokens? [00:48:19] S0: Yeah. And then we also see them pushing the boundaries of what Cowork can do. So for example, if... So a lot of these folks cover multiple customers and in any given day can have five to 10 customer engagements on a high day, and so what they often use Cowork to do is the night before, they'll ask it to summarize, okay, what are all my customer meetings that are coming up the next day? What are all the things that this customer has asked me for? What's top of mind for them? What are the action items from the past meetings? And Cowork will just put together this dossier, this brief of what they should be aware of going into the next meeting. And Cowork can also research answers. So if a customer asks, "Okay, when is feature X going to launch?" Cowork can help the Applied AI person research through Slack to get the latest ETA, add that to the notes so that during the customer call, the Applied AI person has the absolute latest. And these are just workflows that people are building for themselves and sharing with other people on their team. [00:49:25] S1: So cool. Something that kind of this question, this trend, I don't know, question topic comes up a lot recently, which is tokens spend exceeding people's salary where people just use AI and it costs more than how much they're making. Are there any numbers floating around Anthropic of just how much tokens spend, say, engineers spend, I don't know, a month, a day or PMs, anything like that?
00:49:25 · Lenny Rachitsky, Cat Wu
[00:49:25] S1: So cool. Something that kind of this question, this trend, I don't know, question topic comes up a lot recently, which is tokens spend exceeding people's salary where people just use AI and it costs more than how much they're making. Are there any numbers floating around Anthropic of just how much tokens spend, say, engineers spend, I don't know, a month, a day or PMs, anything like that? [00:49:50] S0: It is clear to us that as the models get better, people delegate far more tasks to it and they spend a lot more hours in tools like Claude Code and Cowork, and so we do see the token cost per engineer or per any knowledge worker increase every time that there's a model jump or a substantial product improvement. I think it's still much lower than what the average engineer salary is, but we see the percentage increasing over time. [00:50:22] S1: It's such an interesting... We talked about how you have access to the most cutting-edge models and other advantage of working Anthropic, I believe you guys have basically unlimited tokens. You can use as much as you want. Is that right? [00:50:33] S0: We can use a lot of tokens. Some people do run into limits, so- [00:50:37] S1: Okay, there's a limit. Okay. Boris, shut it down. Okay. It's so interesting how many advantages come from having the most advanced model. It's such an interesting flywheel that starts to kick in.