00:13:25 · Ruchi Sanghvi, Amjad Masad
[00:13:25] S3: You just tell us one thing. [00:13:30] S0: Think we're headed into a post prompting world. I think prompting... The way technology move is things get layered, right? But I think we've reached the apex of sort of what prompting is and what it could do. And the next phase is about, I think, two different things. One is new interfaces for interacting with AI. And the second is fully autonomous agents that can push instead of pull, that can actually operate in the background, understand you or your organization about how they work, and do proactive work that is useful. And we're building in both these directions. [00:14:11] S3: I'm a little confused about the interface because it will still be web based. [00:14:18] S0: I think that the multimodal capabilities of models are very compelling. You know in the movie Her, like how when he's installing the operating system, he's sitting in front of his computer, he's talking to his computer. I think we're almost there in a moment where you can sit in front of the screen and maybe even turn on your webcam and maybe there's touch component there. And it's very natural, sort of like you're dueling, that we just launched our Canvas interface. You are like moving your hands, you're talking. It was like, do this here, do that here. It kind of sort of looks like Iron Man. Did you see that meme, Iron Man vibe coding? And so I think we're headed to that world. Maybe part of it is gonna be VR or AR, but we're headed to that world where communicating with machines is just gonna feels more natural, more like how I talk to you.
00:14:18 · Amjad Masad, Haya Odeh
[00:14:18] S0: I think that the multimodal capabilities of models are very compelling. You know in the movie Her, like how when he's installing the operating system, he's sitting in front of his computer, he's talking to his computer. I think we're almost there in a moment where you can sit in front of the screen and maybe even turn on your webcam and maybe there's touch component there. And it's very natural, sort of like you're dueling, that we just launched our Canvas interface. You are like moving your hands, you're talking. It was like, do this here, do that here. It kind of sort of looks like Iron Man. Did you see that meme, Iron Man vibe coding? And so I think we're headed to that world. Maybe part of it is gonna be VR or AR, but we're headed to that world where communicating with machines is just gonna feels more natural, more like how I talk to you. [00:15:12] S1: Minority report. [00:15:13] S0: Or minority report. But I don't like to give that example because it's like so dystopian. But yes, but that interface is really cool.
00:15:13 · Amjad Masad, Aditya Agarwal
[00:15:13] S0: Or minority report. But I don't like to give that example because it's like so dystopian. But yes, but that interface is really cool. [00:15:20] S2: Yeah, it's interesting. Both of the kind of use cases that you laid out, I was just actually literally vibe coding well, I was building SPC's app kind of upstairs right before this, and I was just trying to be like move this thing over here, shorten this, kind of like rearrange the layout, make it more compact. And then the other thing I was running was trying to just, again, automate the set of things that it's supposed to do every morning for me. But I was thinking in my head, I have done the same thing the last Like, two why is it not predicting what it's supposed to do? So I think both of those, which is inferred use based on kind of my usage patterns, and then also the UI stuff can be so much quicker than what it is right now. The prompting back and forth is so slow. [00:16:01] S0: Well, you should just check out Agent 4. I have. The Canvas there's some fundamental way in which the big labs are operating that is limited. I think in trying to build that AGI, they're not really building systems that are super user friendly. Claude Code work is amazing Claude is amazing, but everything is based on this prompt, something happens, and maybe you can schedule it so that it happens every day. But it is not a fully integrated system that understands. And this is the opportunity for everyone here, is building amazing user experiences, because I don't
00:16:01 · Amjad Masad, Ruchi Sanghvi, Haya Odeh
[00:16:01] S0: Well, you should just check out Agent 4. I have. The Canvas there's some fundamental way in which the big labs are operating that is limited. I think in trying to build that AGI, they're not really building systems that are super user friendly. Claude Code work is amazing Claude is amazing, but everything is based on this prompt, something happens, and maybe you can schedule it so that it happens every day. But it is not a fully integrated system that understands. And this is the opportunity for everyone here, is building amazing user experiences, because I don't [00:16:36] S3: think I agree. I think the hardest thing, or my biggest user issue and my biggest user complaint is how do I load all the context that I wanna share to be able to build something as powerful as I want it to be? Which is like going back to what you were saying, like why hasn't it learned from my usage patterns? Why Yeah. Isn't it retaining [00:16:58] S1: So that's where we're thinking about like the pull and push information and what So would that look right now it's a lot of the user is telling the agents like, do this, do that. You don't understand me. Like, no, no, no. Like I meant that. Did you forget about XYZ? We spoke about it multiple times. I mean, and at this point, maybe you need to understand my taste and I build multiple projects, and I need it the same way. So if you're working with a real engineer or a real designer, at this point, they need should understand each other at some point, at some level. This is what we're trying to
00:16:58 · Haya Odeh, Amjad Masad, Ruchi Sanghvi
[00:16:58] S1: So that's where we're thinking about like the pull and push information and what So would that look right now it's a lot of the user is telling the agents like, do this, do that. You don't understand me. Like, no, no, no. Like I meant that. Did you forget about XYZ? We spoke about it multiple times. I mean, and at this point, maybe you need to understand my taste and I build multiple projects, and I need it the same way. So if you're working with a real engineer or a real designer, at this point, they need should understand each other at some point, at some level. This is what we're trying to [00:17:38] S0: get. One of the coolest things in Agent four is that the entire project context is in one place. Instead of usually, previously, you would build a website one place, a web app, mobile app in another place, Xcode or whatever. So literally on the canvas, you see your mobile app, you see your web app, you see your back end, you see everything. And now you want to generate a slide deck to pitch an investor, just like generate a slide deck. Because it has the entire project context in one place, you can do that. And again, those kinds of interfaces, they're not prominent because these big companies are just focused on the model being as powerful as possible. And so that leaves a lot of white space for entrepreneurs to invest. [00:18:22] S3: So what is the most powerful thing you have built using Agent 4?
00:18:22 · Ruchi Sanghvi, Amjad Masad, Aditya Agarwal
[00:18:22] S3: So what is the most powerful thing you have built using Agent 4? [00:18:27] S0: Our users at this point are just way better than me at building things. I'll tell you one thing that really blown my mind recently. I did a shoulder surgery and had a physical therapist and she always had the, she kind of specializes in fascia therapy. Not many people know how to do it. Has this trigger point component. She tracks your progress every time you see her, like lift up your hand, what is your range of motion? Things like that. She always talked about this idea of like, I wanna be able to track that. I wanna be able take a three d scan of your body and allow you at home to kind of do these exercises, give you feedback on them, track your movement, all of that. I would tell her to check out Replit every now and then. And then I was like, most of the time it didn't work out. But like in the past few months, they actually built an amazing app where as part of the onboarding, you take a few pictures of yourself, it creates a three d Which she built herself. [00:19:23] S2: Wow. That's amazing.