Lenny's Podcast: Product | Career | Growth
00:01:15 · Lenny Rachitsky, Roman Ugarte
[00:01:15] S1: What is it that you think you did that is so different that made Grok Bot so successful? [00:01:20] S0: It was two early decisions that at the time definitely did not feel obvious, but in hindsight I think are critical to what makes Grok Bot work. Thank you. It is great to be here. [00:02:18] S1: I am so excited to have you here. I am so hooked on Grok Bot. I have it over here in my window. I have like 15 bots that I use every day, all the time. I went to a meetup the other day, a Grok Bot meetup. There were hundreds of people there, standing room only, people sharing all the ways they're using Grok Bot. It's very clear to me that you guys have built something very special. It's very hard to break through the noise in the AI world. Grok Bot is the hottest AI product in the world right now. That is a very high bar. There's a lot of competition for that slot. I personally noticed I've moved a lot of my use cases from Cowork and Codex into Grok Bot just very quickly, which again, feels like a really big deal and a very special moment. And so I'm excited to talk about so many things. I want to understand how you guys did this, where this came from, where this is going, what you've learned about the journey so far. First of all, just nice job. Nice work. This is very hard what you've done. [00:03:21] S0: Thank you. I mean, I remember onboarding you by hand about a month ago and I think you were skeptical at first, but we're very glad that you've been using it and it's been great to see so many people really take advantage of Grok Bot.
00:03:21 · Roman Ugarte, Lenny Rachitsky
[00:03:21] S0: Thank you. I mean, I remember onboarding you by hand about a month ago and I think you were skeptical at first, but we're very glad that you've been using it and it's been great to see so many people really take advantage of Grok Bot. [00:03:36] S1: I am going to talk about that onboarding. That was a very interesting element of how this worked. I actually remember in that onboarding, you asked me to do like a, let's try something and I was like, okay, try to come up with a tweet to promote my latest podcast episode. So I'm just like, come up with a tweet to promote my last episode. That's it. And it was actually very good. It figured out what the hell the last episode was, how to promote it. So I actually remember in the moment being like, wow, this is really good. So let's actually start with the origin story. Where did this start? What was the original idea and when did the work on this begin?
00:04:12 · Roman Ugarte
[00:04:12] S0: Yeah, it started really as a blank page completely from scratch, build from zero exercise where I think we'd been feeling for a long time that we wanted to build something that wasn't just a great product for developers and engineers, which is really where we started. And I think we've gained a lot of intuition about how to build great agents and useful products that way. But what would that product look like for knowledge work? And we decided to create this very small team internally. It was really just a handful of people to go off into a cave for about a month with the sole objective of build an amazing knowledge work product that brings agents to the rest of the company. And I think from the first line of code to when we released this prototype internally, it was only about a month. It was a very quick scrappy prototype that was pulled together. And I think in hindsight, this would not have been possible if it had been, I think, a much bigger group. I think it took a small focus group that was completely isolated from the rest of the company. And I mean that literally, it was like a separate part of the office where this team sat, private Slack channels. And the goal, and I think in hindsight it was a lot of what allowed us to move so quickly on this, was we needed to make a lot of micro decisions every day, some things that maybe we'll talk about a bit later that were not obvious, were not really things that we'd done on other product surfaces before. And I think if it had been a very big group of people and we were thinking about this six to 12 month long vision, we just wouldn't have really gotten to the place that we ended up landing at. And so that was about a month from first line of code to here's a functional, useful product that the core team is excited about. And so then there was a moment of rolling this out across the company, rolling this out across all of SpaceXAI. And so there was an all hands where we kind of shared the progress that had been made so far, there's this brand new product, we would love for you to use it. And I think what was most encouraging ... Because at that point we were excited about it. I think we were using it constantly, but it's easy to use the thing that you built and you kind of understand the mechanics and what it's good for. And so this was a real pressure test with reality.
00:07:24 · Roman Ugarte
Are people actually going to switch from other internal tools, other external tools to use Grok Bot as their primary agent surface? And in that first week after that all hands, I mean, I can't even tell you just the outpour of love for Grok Bot from people that maybe you wouldn't expect or from groups of the company that maybe you wouldn't expect, people who were daily driving ChatGPT or a chat interface, switching all of their day-to-day agentic tasks over to Grok Bot as their primary surface for doing work. And so the internal reception was really extraordinary. Can tell some funny stories from that week or two period. And then once we saw, I think the internal reception, we immediately switched into let's get this ready for the world. There's a lot of work to do to scale this out to millions of users. And then that led to the GA launch that we had a few weeks ago. It was not obvious at all. I think you're completely right that that was one of those original decisions that at the time we had a lot of discussions about, and I'm very glad with where we landed. And I think to your point, it being a brand new product that you control every pixel of the experience and you have this consistent vision about where knowledge work is going and it's all contained in this new thing, I think has contributed a lot to the success. But there were a lot of discussions about Cursor, for example, and some of our coding products, people use it for non-coding tasks all the time. And these coding agents are really excellent at some of these things, but you run into small paper cuts. Sometimes the product itself is kind of intimidating to non-technical users. There's a brand association with these things. And so I think we evaluated that path and I think we saw what maybe some of our competitors had been doing of this is all just one surface, you add new tabs for each new form factor and it feels a little cluttered. And I think for users, they can feel that, that this was not a single consistent vision of the way that work should work. And instead it's three different visions that all kind of share a screen and you can hop between, but it is kind of a shipping your org chart style thing that I think users are reacting negatively to. And so we decided let's just start completely from scratch. Let's see where we can get from there.
00:10:36 · Roman Ugarte, Lenny Rachitsky
There might be some really amazing opportunities to bring people from other surfaces into this more bot native experience, but it's really important for people to just have an amazingly simple and amazingly powerful experience. [00:10:55] S1: That is a really valuable lesson for people to take away here, just that that might be the solution instead of adding in complicated and existing AI product. So interestingly, Codex went the other direction and it's like a different path than a different product, but it's interestingly, they're like, now we're going to make it one thing. So there's many ways to make it work and it also feels like the path you take there will kind of lead you, but maybe we'll look back and be like, that was not maybe the best idea. Something you mentioned that you did that is also really unique is this onboarding of early users. I heard you and your team onboarded two to 300 people manually, including me. Talk about why you thought that was necessary and what you learned from that experience and just how long that period was of this kind of manual onboarding.
00:11:41 · Roman Ugarte, Lenny Rachitsky
[00:11:41] S0: I mean, you just learned so much and the first few onboardings were pretty painful. I'm glad you got a good one, Lenny, but there were some that were kind of rough and we learned a lot. And I think it was important for the core team to be in the room for those and to just sit on a call for 20 minutes when the computer isn't spinning up or when someone's in onboarding and they're just incredibly confused so that immediately after you're like, that can never happen again. We need to solve this tomorrow because tomorrow I'm onboarding this person and it needs to go better. And so there was about a two-week period where we were in that mode and onboarded a couple hundred people. And not only did we learn a lot about the product, I think we didn't really know ... I think sometimes with these products there's some group think of ways to use them. And I think internally, because people inside of SpaceXAI were just constantly sharing tips and tricks for how to use Grok Bot, some patterns were starting to emerge that we thought would be useful to the world, but we weren't really sure and we definitely didn't want to bias the world. [00:12:46] S1: Is there an example of that?