AI Tinkerers - "One-Shot"
00:53:50 · Luke Harries, Joe Heitzeberg
[00:53:50] S0: Yeah. [00:53:50] S1: Come to your meetup, the Tinkerers meetup in London, which you didn't say. Luke is now the organizer for AI Tinkerers London. [00:53:55] S0: Yeah. I'm not honored. I've got big sheets in fill. Louis did a fantastic job. [00:53:59] S1: And so we've had the founder of Sesame coming to that meetup for a while. We have the founder of... The other founder of Sesame lives in my end of the world in Bellevue, Washington Yes. And comes to the Seattle meetup. But that system kinda blew my mind. It... Emotionality, I think, was the the the best I'd experienced. Before they cut it down to, like, I think you get two minutes. At... When they first launched, it was an hour, And I had hour long Wow. Conversations with this thing, multiple, driving, working out, where I'm getting entertained. I'm genuinely laughing. [00:54:31] S0: Yeah. [00:54:32] S1: Like, the content's just, you know, where they're using Gemma, you know, Google's open source model. [00:54:37] S0: Right? But [00:54:39] S1: because the voice emotional response is so adapting to me and engaging Yeah. It's it's it's gonna lead to, like, the few things. One is this uptick in the usage, I believe Yeah. That once you experience that, there's no going back. And therefore, for this case of, like, chess education or anything, it's gonna be that much deeper and better. And then two is, like, this hard to predict, but, like, in the same way that social media became addictive and took over and maybe is not the best thing, AI companions are are real. This is happening.
00:54:39 · Joe Heitzeberg, Luke Harries
[00:54:39] S1: because the voice emotional response is so adapting to me and engaging Yeah. It's it's it's gonna lead to, like, the few things. One is this uptick in the usage, I believe Yeah. That once you experience that, there's no going back. And therefore, for this case of, like, chess education or anything, it's gonna be that much deeper and better. And then two is, like, this hard to predict, but, like, in the same way that social media became addictive and took over and maybe is not the best thing, AI companions are are real. This is happening. [00:55:10] S0: What's what's interesting is I would argue at the moment, AI is the only modality that can actually make you feel something. Yeah. So it can, like, really make you laugh. Yeah. It can make you cry. It can make you scared. The... If... I'm not sure if you've heard of any of our ASMR voices, but they happily give you a feel on your neck. But let's... I don't have that yet for AI poetry, AI short stories, AI images. Images. I think that will come. But Yeah. That... That's very cool. And, yeah, it's just going to get better, better, and better. And there's a... Yes. Yeah. [00:55:43] S1: Fascinating. Fun. I'm sure you've played with the music products, the sound generators. [00:55:48] S0: Yes. [00:55:48] S1: I don't know if that's an area that you guys have... I'm sure you've thought about it. Yeah. Endless entertainment on those, of course, which is I think most of the consumption must be just personal fun and friends. But I've tried to use those systems to actually just create dialogue. Have you done this?
00:55:48 · Joe Heitzeberg, Luke Harries
[00:55:48] S1: I don't know if that's an area that you guys have... I'm sure you've thought about it. Yeah. Endless entertainment on those, of course, which is I think most of the consumption must be just personal fun and friends. But I've tried to use those systems to actually just create dialogue. Have you done this? [00:56:04] S0: No. I haven't done that. What what have you done? [00:56:06] S1: So instead of prompting for music, prompt... And be very specific in your prompt, like, stand up comedy routine [00:56:12] S0: Yeah. [00:56:13] S1: Small club, microphone, crowd noise, you know, and have it try to generate comedy.
00:56:13 · Joe Heitzeberg, Luke Harries
[00:56:13] S1: Small club, microphone, crowd noise, you know, and have it try to generate comedy. [00:56:19] S0: Wow. That's very cool. That's very fun. The... Yeah. The interesting thing is if you think about audio Yeah. As a modality, like, do end up... So we currently have like a sound effects model. We have a text to speech model. We have... But I could definitely imagine a world of like more and more becoming, you know, the one... I mean, to digress slightly. If you think about audiobooks and what's an audiobook, it's normally one person reading out an entire book with no special effects, no sound effects, and only one character. Like, you're listening to Harry Potter with Stephen Fry playing both teenage Hermione and teenage Harry Potter. And and the future which I could really imagine is, particularly of audiobooks, is like... And we're trying to build this with our studio product. You feed in a PDF and it goes, okay. These are all the different people. Okay. This is where we should have, like, suspense music in this particular sound effect. Yeah. I think that's really exciting for just audio overall. [00:57:15] S1: Yeah. It is. You think about... Sometimes you see museums have done that with their audio thing. [00:57:19] S0: And there are audio dramas, but they're so rare and the production The cost production's crazy, [00:57:25] S1: and then it's not that good, [00:57:26] S0: actually. Yeah. Yeah. [00:57:27] S1: Yeah. So he's he's kinda tragic because they... You know, they spent a lot and it's not that good. Yeah. Yeah. It's not Hollywood.
00:57:27 · Joe Heitzeberg, Luke Harries
[00:57:27] S1: Yeah. So he's he's kinda tragic because they... You know, they spent a lot and it's not that good. Yeah. Yeah. It's not Hollywood. [00:57:32] S0: There's there's an interesting thesis we have, which is the creator will become the consumer. [00:57:37] S1: Yeah. [00:57:37] S0: So currently, lots of people spend hours and hours, like, manually creating these audiobooks. Mhmm. And and I think that will work for, like, the real big blockbusters with the fantastic... With, like, when you get a voice like Stephen Fry. But I think more and more, it will move to, like, the end user having content dynamically generated on the fly, like, exactly... They're like, I love this voice and this voice in my language. You know, it says Serbian, and then it's just, like, generated live for you. [00:58:07] S1: Mhmm. Yeah. That'll be a... That'll be fun. It's it's great to see that. And so so automated so you could have it. Your cake could eat it too. So we've seen, you know, the rise of these... Any unexpected use cases where you're like, yeah, people using ElevenLabs in this way we never anticipated.
00:58:07 · Joe Heitzeberg, Luke Harries
[00:58:07] S1: Mhmm. Yeah. That'll be a... That'll be fun. It's it's great to see that. And so so automated so you could have it. Your cake could eat it too. So we've seen, you know, the rise of these... Any unexpected use cases where you're like, yeah, people using ElevenLabs in this way we never anticipated. [00:58:23] S0: I'm just continually amazed by how big companies are being built on conversational AI. Because if you think about the number of jobs which are, like answering the phone. And so one example, hotel receptionist in Guatemala. Mhmm. Apparently, you can build a massive business building AI just for hotel receptionists in Guatemala. Yeah. Because currently, they're spending hundreds of dollars per month on a hotel receptionist per hotel. Yeah. And so the the biggest surprise is pretty much every single niche, whether it's like dental clinic receptionist, whether it's customer support, whether it's sales, like, every niche of every country of every industry [00:59:09] S1: Right. [00:59:10] S0: If you... I think if you just go really deep in it, you could build a massive business because the amount which is currently spent. And then you use like that as your wedge into all the other tools and workflows and becoming a system of record. [00:59:21] S1: That's amazing. I have to say, like, I think for my tinkering in Gen AI and things being so amazing, and so much experimentation happened, this is very early on. I think ElevenLabs was also the first where the whisper rumor numbers of the revenue growth [00:59:37] S0: Yes.