00:28:39 · John Collison, Mati Staniszewski
[00:28:39] S0: Okay. [00:28:40] S1: Going for the text layer. And and as we work with, like, a lot of the businesses and enterprises, they they will need that visibility into what happens. They will want to execute certain tasks. On top of that, they want a good visibility into each of the steps and and great accuracy of all the models. But beyond that, they can abstract away what's the LM layer, what's the intelligence layer. The integrations are easier in that system. So that's, like, where we are betting a lot of the the research work of how you can make that great, and we think we can make that great. And speech to speech, as you think about maybe more of, a companion version of the applications, of that's where that will flourish because maybe the hallucinations aren't as important, but the latency is a little bit more, and maybe hallucinations are even a feature. And maybe in the future future, just to finish that part, you will have, like, some version of combination of the models that for, like, low complexity, easy models, you will have speech to speech. And for, like, higher layer complexity, you will have the cascaded. [00:29:32] S0: Okay. So I was gonna ask about this. Like, you know the way there is research on how the invention of writing changed humans' brains and just, like, changed the the neural pathways in ways beyond kind of the the actual written language. Do you observe that speech to speech models think differently than cascaded models? Like, sounds like they're dumber.
00:29:32 · John Collison, Mati Staniszewski
[00:29:32] S0: Okay. So I was gonna ask about this. Like, you know the way there is research on how the invention of writing changed humans' brains and just, like, changed the the neural pathways in ways beyond kind of the the actual written language. Do you observe that speech to speech models think differently than cascaded models? Like, sounds like they're dumber. [00:30:00] S1: They are definitely dumber. You need smaller models. You cannot... You... [00:30:03] S0: But that's interesting, right, that, like, forcing models to reason about text. I mean, I know they just have much more in there as well, but they're smarter. [00:30:11] S1: Yeah. But it's like, you know, like, if you are going speech to speech, usually, you you will use smaller models, so it's still quick. Set [00:30:17] S0: I see. So it's also just a model size thing. [00:30:19] S1: Yeah. So that would [00:30:20] S0: But are there interesting differences beyond, like, correlates like size?
00:30:20 · John Collison, Mati Staniszewski
[00:30:20] S0: But are there interesting differences beyond, like, correlates like size? [00:30:23] S1: What I can say is, like, slightly different to your question. The people interacting through voice and the performance we see for, like, how they interact with the business changes just by nature of interacting with A good example, you can contact ElevenLabs and register for your interest. You go for the form, and at the end of that, we have supplemented that, that instead of going through the form process, you can speak with our agent and leave more details. In webinar, two things. One, people were actually much more keen to leave the forums through speaking with the agent, so we would go through the forum a lot easier. But second, they would be a lot more open ended in terms of what the use cases are. So they would start giving us information about the wider set of use cases, the complexity of the use case. So, like, the writing out was tedious and tricky. [00:31:12] S0: This is like an open ended adventure.
00:31:12 · John Collison, Mati Staniszewski
[00:31:12] S0: This is like an open ended adventure. [00:31:13] S1: Open ended. You could ask follow-up questions. You could clarify. But people were just more at ease and could trust the system while doing that, that it's working, and that kind of helped us a lot. And then free, which maybe is more of a technological barrier, it also works across all languages. So now we have leads from like all parts of the world coming in and leaving their details. So we did that use case, and now we have a few different companies building their SDR versions of that too Yes. To help... Who'll help them capture the leads coming coming in from from banks all the way to... Actually, one of the automotive companies that, like, leaves that where people are just more keen to speak through voice. So...
00:31:50 · John Collison
[00:31:50] S0: Yeah. I wanna ask about this kind of a second order effect. You have... You know, you talked in the past about how growing up in Poland, I guess, the dubbing of TV shows, they were cheap, and so they would only have one voice actor for a TV show. So no matter all the parts, male and female, they're like, love you. I love you too. You know, there's, like, one voice actor doing all of them. And now, you know, thanks to better voice models, you'll be able to just have, like, really good voices AI generated for all the dubbing. Because, again, it's not like it's taking jobs from great dubbing that was happening previously. Was, like, awful dubbing, you know, happening in Poland previously. So that's, like, one example of the the second order effects. What are the other second order effects you're seeing of ubiquitous goods, text to speech, speech to text? It seems like across a broad array of languages because whatever about in English, just this didn't exist in Polish or Irish or, you know, pick your language.
00:32:44 · Mati Staniszewski
[00:32:44] S1: One, breaking down the language barrier, we... You know, the... Kind of the inspiration came from from the movie side, but it also applies in any in any communication setup. Like, could in the future, could I travel to another country and speak Polish or speak English, and that language isn't being understood in the local native language? Like from Hitchhiker's Guide to Galaxy, this version of the babble Exactly. Then you can actually understand the world. Voice, of course, will be an interaction layer, but similarly, all of us will have our own kind of extension and voice agents that can help on our behalf, and there's very clear and great examples of that of people that lost their voice and can get it for the first time back. We see that everywhere, whether that's people that lost it due to ALS or throat cancer that can get it back. Just recently, there was an example of a patient that had Neuralink. We worked with them to bring the voice that that person could speak with their own voice back with the with the family around. We worked with with with with the lady that lost her voice before before she got married, and and then finally, technology became possible. We we were able to recreate that voice, and for the first time, she could replicate the the marriage ceremony and speak the vows together, which was, like, such a heartfelt moment. Probably, like, the most important from all the work that that we do.