00:04:19 · John Collison, Scott Kirby
[00:04:19] S1: in finance, the frequency of Six Sigma events is... [00:04:22] S0: That's where I first started. You know, like, know, VAR, valuation at risk is the dumbest model in history. It's stupid. Like, you know, things that shouldn't happen in the history of the universe happen once every five years because it's a dumb, dumb, fundamentally flawed mathematical model that assumes everything is normally distributed. It's not. And it's just the perfect... I had a debate when I was getting my master's degree back in the 90s. This was about black souls. You know, this is such a dumb model for valuing options. Like, because it assumes a normal distribution. The world's not normally distributed. The tails are much fatter in everything that matters. And anyway, that applies to everything, but especially in a crisis. [00:05:04] S1: Black Scholes has a lot of assume a spherical cow like assumptions baked into it. Okay, love hearing you talk about the over fixation on surveys, But like the travel industry, the airline industry loves surveys. United probably surveys people up the wazoo. And definitely at Stripe, find we need to deprogram people a bit because in tech, people love running things via metrics and you can outsource your thinking to the dashboards and And so we're trying to encourage people to... I mean, your opinions should survive contact with reality, but the metrics are not going to tell you what to do. That sounds like...
00:05:04 · John Collison, Scott Kirby
[00:05:04] S1: Black Scholes has a lot of assume a spherical cow like assumptions baked into it. Okay, love hearing you talk about the over fixation on surveys, But like the travel industry, the airline industry loves surveys. United probably surveys people up the wazoo. And definitely at Stripe, find we need to deprogram people a bit because in tech, people love running things via metrics and you can outsource your thinking to the dashboards and And so we're trying to encourage people to... I mean, your opinions should survive contact with reality, but the metrics are not going to tell you what to do. That sounds like... [00:05:38] S0: So we use survey. I like surveys for how did people feel about stuff we've already done. I ignore surveys for what we could do in the future. [00:05:46] S1: AppleFamously does not do a lot of focus group testing on the products. They just like build the products [00:05:50] S0: That's they want to the way I, you know, stuff that we're doing right now. Like today, we rolled out a Starlink tracker. We didn't ask anyone about that. Like, I sit on an airplane and talk to customers and I know they're gonna think that's cool. Yes. And they do think it's cool. [00:06:02] S1: Well, you're getting to the second thing which is people try to over measure tiny steps and it's just like, do the Starlink tracker. If it's not useful, whatever. Doesn't matter.
00:06:02 · John Collison, Scott Kirby, Ben Thompson
[00:06:02] S1: Well, you're getting to the second thing which is people try to over measure tiny steps and it's just like, do the Starlink tracker. If it's not useful, whatever. Doesn't matter. [00:06:10] S0: Yeah, and that's like, and especially in a world of AI, you can do so much so fast. Like, it's really powerful. I have a different view of what we'll probably talk about, but I at least have a different view of where the value is going be created in AI. But you can just try so much so fast. And some of it doesn't work and people don't care. Somebody do, like it takes me to take more time to do a survey or a focus group, and just do it, see if they like it, and if they don't, stop, and if they do, do it, more of it. [00:06:35] S2: How important is your ability to do these sorts of experimentation? We talked, you know, eight months ago, redoing your whole tech stack so you could sort of put all these things on top of it.
00:06:46 · Scott Kirby
[00:06:46] S0: Is that So, we, like, I've always been a big believer in technology. Have a computer science degree. You're one of us. Yeah, yeah. But eight months ago when I talked to you, I not yet had my AI epiphany, but I've always wanted to get on modern platforms. And so during COVID, nothing we did, like in the middle of COVID, said, When everyone else is cutting back at airlines, cutting everything, we're gonna double down on technology investment. We started a several $100,000,000 project to get, not just on the cloud, but get everything off of mainframes to build databases, you know, that are modern that we can, you know, access the data. Just to really modernize our tech stack. And there was no ROI, there was no payback, which is why companies don't do it. Like it's really hard to do the ROI on something like that. But what it does is it enables you to move fast and do things. Like we're doing stuff that other airlines frankly can't do because they don't have the right tech stack. And we can do them easy and do them fast. So we started that, you know, in 2020 in an anticipatory and it's really paying off today. So my AI epiphany that I think has happened within the last eight months is I don't think AI, like summarizing documents and all that kind of crap, think is like ridiculous. Like my calendar, summarize my day. Like I can read my calendar. Like I don't need to summarize my day. But the power of programming. So, I hired a tutor and took three one hour sessions. And if you want me to, I can tell you the stuff I did.
00:08:13 · Ben Thompson, Scott Kirby
[00:08:13] S2: No, we want to see the vibe coded out. [00:08:15] S0: Final So, out right I went and, so I'll just tell you what the first thing I did was. I've always been into gambling for better or worse. It helps you make big bets on aircraft, for example. But after three one hour sessions completely by myself, got up on a Saturday morning, went down to the home gym, worked out, took my laptop down there. It took about two and a half hours of run time, but I did a full workout. You know, takes time to run. [00:08:42] S2: I did exactly what settled in my gym. I actually have like an iPad with the keyboard there. Yeah. And in between sets I'm just typing pops and it's like running. [00:08:51] S0: Yeah, It's perfect. So that's what I did. I, on my own, in two and a half hours, created a webpage that had dropdown menus for what sport do you want, what dates do you want, what kind of bets do you want. So, four or five dropdowns. And then it would go off. Four sportsbooks, Kolschi being one of them, not actually a sportsbook, but four sportsbook. It would pull up all the odds and you could just decide what you wanted to bet and put the dollar amount in. And then it would go to whichever sports book had the best odds and make the bet on my behalf. You're aggregating the sports fest. That's on everyone. I'm walking very soon, yeah. Man, I could do that with three hours of tutoring on my own could write a program to do that was an epiphany for me. And like I got, I think I called him on that Saturday, you know, our team, and like, We're all in on this.
00:08:51 · Scott Kirby, Ben Thompson
[00:08:51] S0: Yeah, It's perfect. So that's what I did. I, on my own, in two and a half hours, created a webpage that had dropdown menus for what sport do you want, what dates do you want, what kind of bets do you want. So, four or five dropdowns. And then it would go off. Four sportsbooks, Kolschi being one of them, not actually a sportsbook, but four sportsbook. It would pull up all the odds and you could just decide what you wanted to bet and put the dollar amount in. And then it would go to whichever sports book had the best odds and make the bet on my behalf. You're aggregating the sports fest. That's on everyone. I'm walking very soon, yeah. Man, I could do that with three hours of tutoring on my own could write a program to do that was an epiphany for me. And like I got, I think I called him on that Saturday, you know, our team, and like, We're all in on this. [00:09:40] S2: At that point though, he did tell me when I asked him about it that I had huge switchover coming the following week, and it went off without a hitch. [00:09:46] S0: And I remember that. [00:09:47] S2: I was actually flying the next day.