Lenny's Podcast: Product | Career | Growth
00:21:48 · Lenny Rachitsky
[00:21:48] S1: Is there an example, one of those hills you were climbing that was kind of a technical breakthrough or technical challenge you overcame that really helped it just work?
00:21:56 · Roman Ugarte
[00:21:56] S0: Yeah. One example was from rolling out Grok Bot, one group inside of the company that was actually incredibly bot pilled, so to speak, was our go-to-market team was sales. And there are a bunch of tools that sales uses that do not have well-supported MCPs or APIs. And I think that's a lot of what made bot so before and after powerful for this group was these were things that they just could not give another AI tool reliably. We would get stuck at some part in the process. And then Bot kind of felt like they had an assistant or kind of felt like they onboarded someone to their personal team, they gave it a laptop and it could just run. And so there were a bunch of small things and probably a list of 10 or 20 of them of places where for whatever reason, the mouse would just not have fine enough control to click on exactly that part of the Salesforce dashboard or something like that, that we would have to take back to the core team working on really the infrastructure to say, "Here's a very concrete case of where the agent not having this visibility into the browser or this visibility into the pixels on the screen is making it impossible for this task to be done." And that was just a lot more tangible than seeing a number on a dashboard slowly creep up. It was kind of like new chunks of work getting unlocked and you would immediately feel the feedback where you would ship an improvement that was kind of behind the scenes, kind of infrastructure-y. And then the next day you would just get this outpour of love and appreciation from the sales team that now this workflow that was failing the last seven days finally works. And it's just a constant exercise of finding those next tasks to unlock and then solving them.
00:23:45 · Lenny Rachitsky
[00:23:45] S1: So computer use basically improvements seems like a big unlock. I heard also I had Adam Ward on the podcast who's head of recruiting, head of hiring, basically head of talent. I heard that his team was one of the top users of Grok Bot.
00:24:01 · Roman Ugarte
[00:24:01] S0: Yes. The recruiting team gave us a lot of great feedback. Anytime the product, especially in the early days, if there was a little bug, we'd get a ping from some folks on the recruiting team. Yeah, I think the main use cases for recruiting that were particularly interesting was first, it was incredibly valuable as a sourcing tool. And I think one thing Adam talked about on the podcast with you, and it's a big part of our hiring philosophy internally, is looking for a job, being on the market is not a precondition for us trying to hire you. And in a lot of ways, the best way to hire is really just look at the biggest problems at the company that need someone to own it or take it to the next level, find out of the total universe of people in the world who would be best and then ruthlessly go after them and try to convince them to join. And this is a lot of the philosophy from the very beginning of the company. And so if that's your mindset, really the best recruiting work stream or workflows to automate are not here are a bunch of resumes, read through them, help sort them. The most useful thing is here's an entire universe of potential people, help match that to this very concrete business problem or this very concrete role that we're recruiting for and help me get in touch with them, help me get coffee with them. Let's just throw everything at it. And so there have been some cases of really kind of unexpected ways of finding top talent that is beyond even just looking on LinkedIn and trying to find interesting people. But who are the co-authors of this paper and the PDF doesn't exist on Google Scholar. It just exists on this conference website. I want you every morning to go to the conference website, download the PDFs. If there are any new ones, you should find every new name that we've not yet tracked. You should add that name to a spreadsheet, you should do research, you should look at everybody at SpaceXAI, see if there's anyone directly connected. If so, you should send them a Slack message asking for an introduction. It's those types of always on sourcing use cases that I think in the past were incredibly manual and now it's the type of thing AI is superhuman at and our team can focus on closing great candidates and getting conversations with great candidates and not pulling these huge lists.
00:26:28 · Lenny Rachitsky, Roman Ugarte
[00:26:28] S1: Wow, that is such a cool example. First of all, someone's about to take the transcript of what you just said, put it into a bot and create their version of this, which is great. On the other hand, I think you guys could sell a template of this bot for a billion dollars. I think could basically use Adam's team strategy for finding the best people and just turn it into a bot, holy moly, democratizing hiring. I want to come back to a few things. Okay. So one is you made this point about unshipping, such a important point I think that people can overlook because AI is not good at telling you what to take out. It's very good at, okay, here's more ideas, here's more stuff. And something that's come up a number of times in the podcast is that's a big space for humans to continue to be very important and valuable is knowing what not to ship and what to cut and what not to do. And so it's so interesting to hear that that's been a big part of the internal evolution from prototype to launches deciding, okay, we need to cut a bunch of stuff. Anything more there? [00:27:34] S0: Yeah. So one thing we talk about internally is for anything that we're working on for Grok Bot, what is the launch post? What is the thing that we would actually tell users? And if it's not- [00:27:47] S1: A launch tweet, I imagine.
00:27:48 · Roman Ugarte
[00:27:48] S0: Launch tweet. And if it's not compelling, maybe we shouldn't be working on it if it's not something that users will directly feel in the product. And to take that even one step further, I think there's this old school software tendency to say things like Grok Bot now has, and when you think of completing that sentence, it would be like a new button to press or it'd be a new dropdown or it'd be a new integration that you can press plus and add. And instead to reframe it as Grok Bot can now, which is I think a much more human way of describing these capabilities. And I think it's forced us to think more in the frame of what are tools and what are capabilities that we can give Grok Bot, not what are new things we can add to the product? Adding things to the product is not the goal, that's not the thing that's going to push this product forward and make it more useful to more people. Making your bots reliably do really impactful work for you behind the scenes in a way that just works and giving them the capabilities to do that, that's what users actually care about. And so I think in the context of unshipping, there have been a lot of Grok Bot now has things that we've realized are actually just capabilities that don't need pixels. Let's kill as many pixels as we can. Those can just be things that your bot manipulates behind the scenes for you and you don't need to directly control. And I think one example of this is the way that many of our competitors, you set up automations or routines is you go into a sidebar, you press plus, you select what the trigger event is, you then select what action it should take after that, and you might describe it in natural language and it's just really clunky. And it means that people don't set up many automations for many things. We certainly have seen this in the coding realm. And so I think what Grok Bot did in response to that was actually you should just define automations in natural language and you should tell your bot, "Remind me that at 8:00 AM every day, please." And then it should just do it and you should never ever have to see that interface of creating an automation. And so that's kind of the decision that we've made and now that's how 99% of automations on the platform built. And I think there are a bunch of other places where we can do things like that.